Full-screen display method and device for mobile terminal
By detecting user operations on the mobile terminal, switching screen directions and updating window sizes, full-screen display is realized, and the problem of being unable to play videos in full screen on the entire screen in the prior art is solved, and the user's immersive experience is improved.
Patent Information
- Application Number
- CN202210327603.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-25
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2039-06-25
AI Technical Summary
In the prior art, in multi-window scenarios, when the mobile terminal plays video in full screen, it is impossible to display the video in full screen on the entire screen, resulting in a poor immersive viewing experience for users.
By detecting the user's touch operation, switching the screen direction and updating the window size, the entire screen is used to display the target object in full screen, realizing device-level full screen display, avoiding visual interference from multiple windows.
It improves the user's immersive viewing experience, can display video or other content in full screen on the entire screen, provide a larger display area, and enhances the user's browsing experience.
Smart Images

Figure CN114816209B_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 201910554567.6, and the original application date is June 25, 2019. The entire contents of the original application are incorporated into this application by reference. Technical Field
[0002] The embodiments of the present application relate to the field of electronic technology, and more particularly to a full-screen display method and device for a mobile terminal. Background Art
[0003] At present, multi-window display technology is widely used in mobile terminals such as mobile phones and tablet computers. In a multi-window scenario, multiple windows can be displayed on a mobile terminal. When a video in a currently displayed window needs to be played in full screen, the mobile terminal can play the video in full screen in the window.
[0004] For example, in a multi-window scenario, Figure 1A As shown, the multiple windows displayed on the tablet computer include a window 01 of a microblog application and a window 02 of a settings application. After the tablet computer detects that the user clicks the full-screen play button 03 in the window 01, as shown in FIG. Figure 1B As shown, the video is played in full screen in window 01.
[0005] The full-screen playback mode adopted in the prior art provides poor user experience. Summary of the invention
[0006] The embodiments of the present application provide a full-screen display method and device for a mobile terminal, which can display a video playback interface in full screen on the entire screen of the mobile terminal, thereby improving the user's immersive viewing experience.
[0007] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:
[0008] On the one hand, an embodiment of the present application provides a full-screen display method for a mobile terminal, the mobile terminal including a display screen, the method comprising: the mobile terminal displays a first interface, the first interface includes a first window and a second window, the first window and the second window are used to display a user interface of an application, and the first window includes a target object. The mobile terminal detects a first touch operation, the first touch operation is used to instruct the mobile terminal to display the target object in full screen. In response to the first touch operation, the mobile terminal switches the vertical screen orientation to the horizontal screen orientation. Then, the mobile terminal displays a second interface, the second interface includes a third window, the third window is used to display the target object in full screen, and the third window is larger than the first window.
[0009] In this solution, after the mobile terminal detects that the user indicates a full-screen display operation in the first window, the multiple windows are no longer displayed, and only a third window can be displayed on the entire screen of the mobile terminal. The third window is larger than the first window, and the third window is used to display the target object in full screen. In other words, the entire screen is used to display the target object in full screen through the third window, and the entire screen of the mobile terminal is used to display the target object in full screen. In this way, the mobile terminal can use a larger third window to replace the first window to display the target object in a larger range, and stop displaying the second window. As a result, the user can see the larger target object without seeing the content in the second window, and will not be visually disturbed by the content of the second window, thereby improving the user's browsing experience.
[0010] In a possible design, the size of the third window is consistent with the size of the display screen.
[0011] In this way, the target object in the third window can fill the entire screen of the mobile terminal, and the size of the target object matches the size of the entire screen. In addition, unlike the prior art, the target object can only be displayed in full screen in a certain window in a local area of the screen. Thus, a better immersive browsing experience can be given to the user.
[0012] In another possible design, before the mobile terminal switches the vertical screen orientation to the horizontal screen orientation, the method further includes: the mobile terminal obtains a display orientation, the display orientation includes a horizontal screen orientation or a vertical screen orientation. The mobile terminal switches the vertical screen orientation to the horizontal screen orientation, including: if the display orientation obtained by the mobile terminal is the vertical screen orientation, and the difference between the width and height of the display screen is greater than a preset value, the mobile terminal switches the display orientation from the vertical screen orientation to the horizontal screen orientation.
[0013] That is, if the width and height of the display screen are greatly different, and the display orientation acquired by the mobile terminal is a portrait orientation, the mobile terminal switches to a landscape orientation to better display the target object in full screen through the landscape orientation.
[0014] In another possible design, if the display orientation acquired by the mobile terminal is a portrait orientation, and the difference between the width and the height of the display screen is less than or equal to a preset value, the mobile terminal performs full-screen display.
[0015] In this solution, if the difference between the width and height of the display screen is small, the full-screen display effects in the horizontal and vertical directions are not much different, so the mobile terminal does not need to switch the vertical direction to the horizontal direction.
[0016] In another possible design, after the mobile terminal obtains the display direction, the method further includes: if the display direction obtained by the mobile terminal is a horizontal screen direction, the mobile terminal displays the second interface.
[0017] That is to say, if the display direction acquired by the mobile terminal is the landscape direction, the mobile terminal does not need to switch the display direction, but can directly perform full-screen display.
[0018] In another possible design, after the mobile terminal switches the portrait orientation to the landscape orientation, the method further includes: the mobile terminal saves orientation switching information, the orientation switching information is used to indicate that the display orientation is switched from the portrait orientation to the landscape orientation. After the mobile terminal displays the second interface, the method further includes: the mobile terminal detects an instruction to exit the full-screen display. The mobile terminal switches the display orientation back to the portrait orientation according to the orientation switching information. The mobile terminal displays a third interface, the third interface including a first window and a second window; the size of the first window and the second window on the third interface is consistent with the size on the first interface.
[0019] That is, after exiting the full-screen display, the mobile terminal can restore the multi-window display state before the full-screen display.
[0020] In another possible design, the mobile terminal includes an activity manager and a window manager. The mobile terminal displays a second interface, the second interface includes a third window, the third window is used to display the target object in full screen, and the third window is larger than the first window, including: the activity manager updates the first state information of the first window, the first state information includes the window size of the first window; the updated window size of the first window is larger than the size of the first window on the first interface. The activity manager updates the updated first state information to the configuration file of the application corresponding to the first window. The window manager draws the third window according to the first state information in the updated configuration file. The display screen shows the third window, and the third window is used to display the target object in full screen.
[0021] In this way, the mobile terminal can update the information of the first window through the configuration file, so that the size of the updated first window is larger than the size of the first window displayed on the first interface. Furthermore, the mobile terminal draws the third window according to the information of the updated first window, so that the third window is larger than the size of the first window displayed on the first interface.
[0022] In another possible design, the first interface displays the first window and the second window in a split-screen mode. Before the window manager draws the third window, the method further includes: the activity manager switches the split-screen mode to the full-screen mode. The window manager draws the third window according to the first state information in the updated configuration file, including: the window manager draws the third window according to the first state information in the updated configuration file and the full-screen mode.
[0023] That is to say, if the mobile terminal displays the first window in the split-screen mode on the first interface, the mobile terminal needs to switch the split-screen mode to the full-screen mode before the full-screen display can be performed.
[0024] In another possible design, the window mode corresponding to the first window on the first interface is the split-screen mode, the first status information also includes the window mode, and the window mode corresponding to the updated first window is the full-screen mode.
[0025] That is to say, if the first window is in split-screen mode, the mobile terminal needs to switch the split-screen mode to full-screen mode before full-screen display can be performed.
[0026] In another possible design, the mobile terminal includes an activity manager and a window manager. After the mobile terminal detects the first touch operation, the method further includes: the activity manager saves the second state information of the first window and the second state information of the second window, the second state information including the window size and the window mode. The mobile terminal displays a third interface, the third interface including the first window and the second window, the size of the first window and the second window on the third interface is consistent with the size on the first interface, including: the activity manager updates the saved second state information of the first window to the configuration file of the application corresponding to the first window. The window manager draws the first window on the third interface according to the second state information of the first window in the configuration file. The display screen displays the first window on the third interface, and the size of the first window on the third interface is consistent with the size on the first interface. The activity manager updates the saved second state information of the second window to the configuration file of the application corresponding to the second window. The window manager draws the second window on the third interface according to the second state information of the second window in the configuration file. The display screen displays the second window on the third interface, and the size of the second window on the third interface is consistent with the size on the first interface.
[0027] That is, the mobile terminal can save the state information of the multiple windows before the full-screen display, so that after exiting the full-screen display, the multi-window display state before the full-screen display can be restored according to the saved information.
[0028] In another possible design, the target object includes a video, a picture, a game interface, or a reader interface.
[0029] That is to say, the mobile device can play videos in full screen, display pictures in full screen, display game running interface in full screen, display reader interface in full screen, etc.
[0030] In another possible design, the target object is a video. Before the mobile terminal displays the second interface, the method further includes: the mobile terminal determines that one or more of the following conditions are met: the audio and video decoder is in a working state; the application corresponding to the first window where the video is located obtains the audio focus; or the first window includes a subwindow of the SurfaceView type.
[0031] In this solution, the mobile terminal can more accurately determine the need to play the video in full screen according to these conditions.
[0032] In another possible design, the first window on the first interface includes a first control, and the first touch operation is a touch operation on the first control.
[0033] In this way, when the mobile terminal detects a touch operation (such as a click operation) of the user on the first control, device-level full-screen display can be achieved on the entire display screen.
[0034] In another possible design, the first window on the first interface further includes a second control, and the method further includes: the mobile terminal detecting a touch operation on the second control. In response to the touch operation on the second control, the mobile terminal displays the target object in full screen in the first window.
[0035] In this way, when the mobile terminal detects a user's touch operation (such as a click operation) on the first control, full screen display can be performed in the first window. Thus, for user touch operations on different controls, the mobile terminal can have different full screen display modes, including a device-level full screen display mode and an in-window full screen display mode.
[0036] In another possible design, the device-level full-screen display mode and the in-window full-screen display mode can be switched mutually.
[0037] In another possible design, after the mobile terminal displays the target object in full screen in the first window, the method further includes: the mobile terminal detecting a third touch operation; and in response to the third touch operation, the mobile terminal displays the second interface.
[0038] That is, the device-level full-screen display mode can be switched to the in-window full-screen display mode.
[0039] In another possible design, after the mobile terminal displays the second interface, the method further includes: the mobile terminal detects a fourth touch operation, the fourth touch operation is used to indicate switching to a full-screen display mode. In response to the fourth touch operation, the mobile terminal displays a fourth interface, the fourth interface includes a first window and a second window, the size of the first window and the second window on the fourth interface is consistent with the size on the first interface; the mobile terminal displays the target object in full screen in the first window.
[0040] That is, the full screen display mode in the window can be switched to the device and full screen display mode.
[0041] On the other hand, an embodiment of the present application provides another full-screen display method of a mobile terminal, the mobile terminal including a display screen, the method comprising:
[0042] The mobile terminal displays a first interface, the first interface includes a first window, the first window is smaller than the display screen, the first window is used to display the user interface of the application, and the first window includes a target object. The mobile terminal detects a first touch operation, the first touch operation is used to instruct the mobile terminal to display the target object in full screen. In response to the first touch operation, the mobile terminal switches the vertical screen orientation to the horizontal screen orientation. The mobile terminal displays a second interface, the second interface includes a second window, the second window is used to display the target object in full screen, and the second window is larger than the first window.
[0043] In this solution, after the mobile terminal detects that the user indicates a full-screen display operation in the first window, the multiple windows are no longer displayed, and a second window can be displayed on the entire screen of the mobile terminal. The second window is larger than the first window, and the third window is used to display the target object in full screen. In other words, the entire screen is used to display the target object in full screen through the second window, and the entire screen of the mobile terminal is used to display the target object in full screen. In this way, the mobile terminal can use a larger second window to replace the first window to display the target object in a larger range. As a result, the user can see a larger target object, thereby improving the user's browsing experience.
[0044] In one possible design, after the mobile terminal switches the vertical screen orientation to the horizontal screen orientation, the method further includes: the mobile terminal saves the orientation switching information. After the mobile terminal displays the second interface, the method further includes:
[0045] The mobile terminal detects an instruction to exit the full screen. If the mobile terminal determines, based on the direction switching information, that the display direction is switched from the portrait direction to the landscape direction, the mobile terminal switches the display direction back to the portrait direction. The mobile terminal displays a third interface, the third interface including the first window. The size of the first window on the third interface is consistent with the size on the first interface.
[0046] After exiting the full-screen display, the mobile terminal may restore the multi-window display state before the full-screen display.
[0047] In another possible design, before the mobile terminal detects the first touch operation, the method further includes: the mobile terminal detects a second touch operation, the second touch operation is used to instruct the mobile terminal to display the target object in full screen. In response to the second touch operation, the mobile terminal displays the target object in full screen in the first window.
[0048] In this way, in response to different touch operations of the user, the mobile terminal can have different full-screen display modes, including a device-level full-screen display mode and an in-window full-screen display mode.
[0049] On the other hand, an embodiment of the present application provides a mobile terminal, comprising: one or more processors; a memory; a touch screen for detecting a touch operation, and a display interface. The memory stores a code, and when the code is executed by one or more processors, the mobile terminal performs the following steps: displaying a first interface, the first interface comprising a first window and a second window, the first window and the second window being used to display a user interface of an application, and the first window comprising a target object. Detecting a first touch operation, the first touch operation being used to indicate full-screen display of the target object. In response to the first touch operation, switching the vertical screen orientation to the horizontal screen orientation. Displaying a second interface, the second interface comprising a third window, the third window being used to display the target object in full screen, and the third window being larger than the first window.
[0050] In this solution, after the mobile terminal detects that the user indicates a full-screen display operation in the first window, the multiple windows are no longer displayed, and only a third window can be displayed on the entire screen of the mobile terminal. The third window is larger than the first window, and the third window is used to display the target object in full screen. In other words, the entire screen is used to display the target object in full screen through the third window, and the entire screen of the mobile terminal is used to display the target object in full screen. In this way, the mobile terminal can use a larger third window to replace the first window to display the target object in a larger range, and stop displaying the second window. As a result, the user can see the larger target object without seeing the content in the second window, and will not be visually disturbed by the content of the second window, thereby improving the user's browsing experience.
[0051] In one possible design, when the code is executed by one or more processors, the mobile terminal is also caused to perform the following steps: before switching the portrait screen orientation to the landscape screen orientation, obtaining a display orientation, the display orientation including a landscape screen orientation or a portrait screen orientation. Switching the portrait screen orientation to the landscape screen orientation includes: if the obtained display orientation is the portrait screen orientation, and the difference between the width and height of the display screen is greater than a preset value, switching the display orientation from the portrait screen orientation to the landscape screen orientation.
[0052] In another possible design, when the code is executed by one or more processors, the mobile terminal is further caused to perform the following steps: after obtaining the display direction, if the obtained display direction is a horizontal screen direction, the second interface is displayed. Alternatively, if the obtained display direction is a vertical screen direction and the difference between the width and height of the display screen is less than or equal to a preset value, the second interface is displayed.
[0053] In another possible design, when the code is executed by one or more processors, the mobile terminal is also caused to perform the following steps: after switching the vertical screen orientation to the horizontal screen orientation, saving the orientation switching information, the orientation switching information is used to indicate that the display orientation is switched from the vertical screen orientation to the horizontal screen orientation. After displaying the second interface, detecting an instruction to exit the full screen display. According to the orientation switching information, switching the display orientation back to the vertical screen orientation. Displaying a third interface, the third interface includes a first window and a second window; the size of the first window and the second window on the third interface is consistent with the size on the first interface.
[0054] In another possible design, the code is used to implement an activity manager and a window manager. Displaying a second interface, the second interface includes a third window, the third window is used to display the target object in full screen, and the third window is larger than the first window, including: the activity manager updates the first state information of the first window, the first state information includes the window size of the first window; the updated window size of the first window is larger than the size of the first window on the first interface. The activity manager updates the updated first state information to the configuration file of the application corresponding to the first window. The window manager draws the third window according to the first state information in the updated configuration file. The touch screen shows the third window, and the third window is used to display the target object in full screen.
[0055] In another possible design, the first interface displays the first window and the second window in the split-screen mode. When the code is executed by one or more processors, the mobile terminal is also caused to perform the following steps: the activity manager switches the split-screen mode to the full-screen mode. The window manager draws the third window according to the first state information in the updated configuration file, including: the window manager draws the third window according to the first state information in the updated configuration file and the full-screen mode.
[0056] In another possible design, the code is used to implement an activity manager and a window manager. When the code is executed by one or more processors, the mobile terminal also performs the following steps: after detecting the first touch operation, the activity manager saves the second state information of the first window and the second state information of the second window, the second state information including the window size and the window mode. Displaying a third interface, the third interface including the first window and the second window, the size of the first window and the second window on the third interface is consistent with the size on the first interface, including: the activity manager updates the saved second state information of the first window to the configuration file of the application corresponding to the first window. The window manager draws the first window on the third interface according to the second state information of the first window in the configuration file. The touch screen displays the first window on the third interface, and the size of the first window on the third interface is consistent with the size on the first interface. The activity manager updates the saved second state information of the second window to the configuration file of the application corresponding to the second window. The window manager draws the second window on the third interface according to the second state information of the second window in the configuration file. The touch screen displays the second window on the third interface, and the size of the second window on the third interface is consistent with the size on the first interface.
[0057] In another possible design, the target object includes a video, a picture, a game interface, or a reader interface.
[0058] In another possible design, the target object is a video, and when the code is executed by one or more processors, the mobile terminal is further caused to perform the following steps: before displaying the second interface, determining that one or more of the following conditions are satisfied:
[0059] The audio and video decoder is in working state; the application corresponding to the first window where the video is located obtains the audio focus; or, the first window includes a subwindow of the SurfaceView type.
[0060] In another possible design, the first window on the first interface includes a first control, and the first touch operation is a touch operation on the first control.
[0061] In another possible design, the first window on the first interface also includes a second control, and when the code is executed by one or more processors, the mobile terminal is further caused to perform the following steps: detecting a touch operation on the second control. In response to the touch operation on the second control, displaying the target object in full screen in the first window.
[0062] On the other hand, an embodiment of the present application provides a full-screen display device, which is included in a mobile terminal, and the device has the function of implementing the above aspects and the behavior of the mobile terminal in any of the methods in the possible designs. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above functions. For example, a display module or unit, a detection module or unit, a switching module or unit, an acquisition module or unit, etc.
[0063] On the other hand, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on a mobile terminal, the mobile terminal executes the full-screen display method in any possible design of the above aspects.
[0064] On the other hand, an embodiment of the present application provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the full-screen display method in any possible design of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0065] Figure 1A A multi-window display interface diagram provided by the prior art;
[0066] Figure 1B A full-screen display interface diagram provided by the prior art;
[0067] Figure 2 A schematic diagram of the structure of a mobile terminal provided in an embodiment of the present application;
[0068] Figure 3A A multi-window display interface diagram provided in an embodiment of the present application;
[0069] Figure 3B Another multi-window display interface diagram provided in an embodiment of the present application;
[0070] Figure 4A A full-screen display interface diagram provided in an embodiment of the present application;
[0071] Figure 4B Another full-screen display interface diagram provided in an embodiment of the present application;
[0072] Figure 4C Another full-screen display interface diagram provided in an embodiment of the present application;
[0073] Figure 5A Another multi-window display interface diagram provided in an embodiment of the present application;
[0074] Figure 5B Another full-screen display interface diagram provided in an embodiment of the present application;
[0075] Figure 5C Another multi-window display interface diagram provided in an embodiment of the present application;
[0076] Figure 5D Another full-screen display interface diagram provided in an embodiment of the present application;
[0077] Fig. 6A Another multi-window display interface diagram provided in an embodiment of the present application;
[0078] Figure 6B Another full-screen display interface diagram provided in an embodiment of the present application;
[0079] Figure 6C Another full-screen display interface diagram provided in an embodiment of the present application;
[0080] Fig.6D Another multi-window display interface diagram provided in an embodiment of the present application;
[0081] Fig. 7A Another multi-window display interface diagram provided in an embodiment of the present application;
[0082] Figure 7B A schematic diagram of a screen folding state provided in an embodiment of the present application;
[0083] Figure 7C Another full-screen display interface diagram provided in an embodiment of the present application;
[0084] Fig. 8A Another multi-window display interface diagram provided in an embodiment of the present application;
[0085] Figure 8B Another multi-window display interface diagram provided in an embodiment of the present application;
[0086] Fig. 9A Another multi-window display interface diagram provided in an embodiment of the present application;
[0087] Fig. 9B Another full-screen display interface diagram provided in an embodiment of the present application;
[0088] Fig. 10A A schematic diagram of a prompt information provided in an embodiment of the present application;
[0089] Fig. 10B A schematic diagram of another prompt information provided in an embodiment of the present application;
[0090] Fig.11 A schematic diagram of a setting interface provided in an embodiment of the present application;
[0091] Fig. 12AAnother multi-window display interface diagram provided in an embodiment of the present application;
[0092] Fig. 12B Another multi-window display interface diagram provided in an embodiment of the present application;
[0093] Fig. 12C Another multi-window display interface diagram provided in an embodiment of the present application;
[0094] Fig.13 A schematic diagram of another prompt information provided in an embodiment of the present application;
[0095] Fig.14 A schematic diagram of a set of full-screen playback controls provided in an embodiment of the present application;
[0096] Fig.15A Another multi-window display interface diagram provided in an embodiment of the present application;
[0097] Fig. 15B Another full-screen display interface diagram provided in an embodiment of the present application;
[0098] Fig.16A Another multi-window display interface diagram provided in an embodiment of the present application;
[0099] Fig. 16B Another full-screen display interface diagram provided in an embodiment of the present application;
[0100] Fig.17A A schematic diagram of a software architecture provided for an embodiment of the present application;
[0101] Fig. 17B A flow chart of a display method provided in an embodiment of the present application;
[0102] Fig.18 A flowchart of another display method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0103] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0104] In the prior art, in a multi-window scenario, when a mobile terminal detects that a user instructs a video in a certain window to be played in full screen, the mobile terminal still displays multiple windows and displays the video playback interface in full screen in the window where the video is located, thereby achieving full screen playback of the video. Figure 1A After the video in window 01 of the Weibo application shown in the figure, Figure 1B As shown, the microblog application window 01 and the setting application window 02 are still displayed; and the video playback interface is displayed in full screen in the microblog application window 01. The full screen display of the video playback interface in the microblog application window 01 means that the size of the video screen matches the size of the microblog application window 01. Figure 1B As shown, the video screen in the video playback window fills up the window 01 of the microblog application horizontally, and leaves a blank margin between the upper and lower edges of the window 01 of the microblog application vertically (i.e., Figure 1B The entire microblog application window 01 is used to display the video playback interface, and the video playback interface fills the microblog application window 01.
[0105] The full-screen playback method adopted in the prior art can only display the video playback interface in full screen within the window of the Weibo application, that is, the video playback interface can only be displayed in full screen in a local area of the mobile terminal, and the size of the video screen matches the size of the application window, which can be called full-screen display within the window; but the video playback interface cannot be displayed in full screen on the entire screen of the mobile terminal, resulting in a poor immersive experience for users.
[0106] The embodiment of the present application provides a full-screen display method, which can be applied to a mobile terminal with a screen. In a multi-window scenario, the mobile terminal can display multiple windows on the screen, and the size of each window is smaller than the size of the screen. For example, the multiple windows include a first window and a second window. After the mobile terminal detects that the user indicates the operation of full-screen display in the first window, the multiple windows are no longer displayed, and only a third window can be displayed on the entire screen of the mobile terminal, and the third window is larger than the first window. The third window is used to display the target object in full screen. In other words, the entire screen is used to display the target object in full screen through the third window, and the entire screen of the mobile terminal is used to display the target object in full screen, so it can be called device-level full-screen display. In this way, the mobile terminal can replace the first window with a larger third window to display the target object in a larger range, and stop displaying the second window. Thereby, the user can see a larger target object, and will not see the content in the second window, and will not be visually disturbed by the content of the second window, thereby improving the user's browsing experience.
[0107] In some embodiments, the size of the third window is consistent with or substantially consistent with the size of the screen. In this way, the target object in the third window can fill the entire screen of the mobile terminal, and the size of the target object matches the size of the entire screen. Moreover, unlike the prior art, the target object can only be displayed in full screen in a certain window in a local area of the screen. Thus, a better immersive browsing experience can be given to the user.
[0108] For example, the target object may be a video. In a multi-window scenario, after the mobile terminal detects the operation of the user indicating full-screen video playback (or indicating full-screen display of the video playback interface), it no longer displays multiple windows, but can display the video playback interface in full screen on the entire screen of the mobile terminal, and the video playback window covers the entire screen, and the entire screen is used to display the video playback interface, and the size of the video screen matches the size of the screen. Moreover, unlike the prior art, the video playback interface can only be displayed in full screen in a certain window in a local area of the screen. Thus, the user can be given a better immersive video viewing experience. For another example, the target object displayed in full screen on the entire screen of the mobile terminal can also be a picture, a game interface, or a reader interface. Among them, the mobile terminal can be a tablet computer, a mobile phone, a folding screen device, a netbook, a personal digital assistant (PDA), a wearable device, or an augmented reality (AR) / virtual reality (VR) device and other electronic devices, and the embodiment of the present application does not impose any restrictions on the specific type of the mobile terminal.
[0109] For example, Figure 21 shows a schematic diagram of the structure of the mobile terminal 100. The mobile terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0110] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0111] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0112] The controller may be the nerve center and command center of the mobile terminal 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0113] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0114] In some embodiments, the processor 110 can be used to execute instructions in the memory and call related modules to implement the functions of the mobile terminal 100 in the embodiments of the present application. For example, in a multi-window scenario, a full-screen display function is implemented on the entire display screen of the mobile terminal.
[0115] In some embodiments, in a multi-window scenario, when the mobile terminal determines to perform full-screen display on the entire display screen, the current multi-window status information can be saved in the internal memory 121 or the memory of the processor 110; so that after exiting the full-screen video playback, the display status of the multi-window can be restored according to the status information.
[0116] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0117] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the mobile terminal 100.
[0118] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0119] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to implement the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0120] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0121] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the mobile terminal 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the mobile terminal 100.
[0122] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0123] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile terminal 100, and can also be used to transmit data between the mobile terminal 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other mobile terminals, such as AR devices, etc.
[0124] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0125] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the mobile terminal 100. While the charging management module 140 is charging the battery 142, it may also power the mobile terminal through the power management module 141.
[0126] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0127] The wireless communication function of the mobile terminal 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0128] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0129] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the mobile terminal 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0130] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0131] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile terminal 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0132] In some embodiments, the antenna 1 of the mobile terminal 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile terminal 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS) and / or the satellite based augmentation system (SBAS).
[0133] The mobile terminal 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. In some embodiments, the GPU can draw windows. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0134] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile terminal 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0135] In some embodiments, in a multi-window scenario, multiple windows may be displayed on display screen 194. When mobile terminal 100 detects that the user indicates a full-screen display operation in a window, display screen 194 may display the target object in full screen in the entire display area.
[0136] The mobile terminal 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.
[0137] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.
[0138] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the mobile terminal 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0139] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the mobile terminal 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0140] Video codecs are used to compress or decompress digital videos. The mobile terminal 100 may support one or more video codecs. Thus, the mobile terminal 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0141] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the mobile terminal 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0142] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0143] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the mobile terminal 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the mobile terminal 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0144] The mobile terminal 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.
[0145] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0146] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The mobile terminal 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0147] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the mobile terminal 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.
[0148] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting his mouth close to the microphone 170C to input the sound signal into the microphone 170C. The mobile terminal 100 can be provided with at least one microphone 170C. In other embodiments, the mobile terminal 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the mobile terminal 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0149] In some embodiments, microphone 170C may be used to receive a voice signal from a user indicating full screen display.
[0150] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0151] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The mobile terminal 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the mobile terminal 100 detects the touch operation intensity according to the pressure sensor 180A. The mobile terminal 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0152] The gyroscope sensor 180B can be used to determine the motion posture of the mobile terminal 100. In some embodiments, the angular velocity of the mobile terminal 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the mobile terminal 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the mobile terminal 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0153] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the mobile terminal 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0154] The magnetic sensor 180D includes a Hall sensor. The mobile terminal 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the mobile terminal 100 is a flip phone, the mobile terminal 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.
[0155] The acceleration sensor 180E can detect the magnitude of the acceleration of the mobile terminal 100 in various directions (generally three axes). When the mobile terminal 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the mobile terminal and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0156] The distance sensor 180F is used to measure the distance. The mobile terminal 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the mobile terminal 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0157] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The mobile terminal 100 emits infrared light outward through the light emitting diode. The mobile terminal 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile terminal 100. When insufficient reflected light is detected, the mobile terminal 100 can determine that there is no object near the mobile terminal 100. The mobile terminal 100 can use the proximity light sensor 180G to detect that the user holds the mobile terminal 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0158] The ambient light sensor 180L is used to sense the ambient light brightness. The mobile terminal 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the mobile terminal 100 is in a pocket to prevent accidental touches.
[0159] The fingerprint sensor 180H is used to collect fingerprints. The mobile terminal 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0160] The temperature sensor 180J is used to detect temperature. In some embodiments, the mobile terminal 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the mobile terminal 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the mobile terminal 100 heats the battery 142 to avoid abnormal shutdown of the mobile terminal 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the mobile terminal 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0161] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the mobile terminal 100, which is different from the position of the display screen 194.
[0162] In some embodiments, the touch sensor 180K can be used to detect a user's touch operation on the full-screen display control on the display screen 194, so that the mobile terminal implements a device-level full-screen display on the entire display screen in response to the touch operation.
[0163] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0164] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The mobile terminal 100 may receive key input and generate key signal input related to user settings and function control of the mobile terminal 100.
[0165] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0166] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.
[0167] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the mobile terminal 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The mobile terminal 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The mobile terminal 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the mobile terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the mobile terminal 100 and cannot be separated from the mobile terminal 100.
[0168] Taking the scenario of full-screen video playback as an example, the hardware workflow of the mobile terminal in the embodiment of the present application is exemplified. The touch sensor 180K can detect the operation of the user touching the full-screen playback control. In response to the operation, the processor 110 can draw a window of the same size as the display screen 194. The display screen 194 displays the video playback screen in full screen in the window, thereby realizing device-level full-screen video playback.
[0169] The following will be combined with Figure 2 and Fig.17A The mobile terminal with the structure shown takes full-screen video playback in a multi-window scenario as an example to illustrate the full-screen display method provided in the embodiment of the present application.
[0170] The mobile terminal includes a screen. The screen may be the display screen 194 or a touch screen composed of the display screen 194 and a touch sensor 180K. The screen usually includes multiple windows, and a certain window includes a video.
[0171] The video may be a video in a video player, or a video in other applications such as Weibo, WeChat, or gallery; the video may be a video shot by a mobile terminal, a video downloaded by a mobile terminal, or a video obtained by other means, and the embodiments of the present application are not limited thereto.
[0172] The multi-window scenario can specifically include a variety of application scenarios, such as free multi-application multi-window scenarios, single-application multi-window scenarios, split-screen (such as the native split-screen solution of the Google system), multi-application multi-window scenarios, and picture-in-picture scenarios, etc.
[0173] For example, in a free multi-application multi-window scenario, one or more application windows can be displayed on the screen, and the size and position of each window are arbitrary. The size and position of the window can be modified by the user dragging the window. In addition, different windows can be displayed in a stacked manner. The multiple windows displayed on the screen can occupy the entire screen or not.
[0174] For example, Figure 3A As shown, in the free multi-application multi-window scenario, the multiple windows displayed on the screen may include a window 301 corresponding to the microblog application and a window 302 corresponding to the settings application.
[0175] It should be noted that, unlike the existing scenario where a single window fills the entire screen and the entire screen can only display this one window, in a multi-window scenario, it is also possible that only one window is included on the screen. Figure 3B As shown, the size of the window 301 displayed on the screen is obviously smaller than the size of the screen, and on the basis of the window 301 being displayed on the screen, other windows may also be displayed on the screen, for example, Figure 3A The window 302 shown, thus Figure 3B The situation shown also belongs to a multi-window scenario.
[0176] For example, Figure 5A or Figure 5C As shown, in the free multi-application multi-window scenario, the multiple windows displayed on the screen may include a window 501 corresponding to the microblog application and a window 502 corresponding to the settings application.
[0177] For another example, in a single-application multi-window scenario, multiple windows of the same application may be displayed on the screen, and the multiple windows generally do not overlap with each other.
[0178] For example, Fig. 6A or Fig.6D As shown, in a single-application multi-window scenario, the multiple windows displayed on the screen include window 601 and window 602 corresponding to the live broadcast application.
[0179] For example, Fig. 7A As shown, when the screen of the folding screen device is unfolded, in a single application multi-window scenario, the multiple windows displayed on the screen may include window 701 and window 702 corresponding to the live broadcast application.
[0180] For another example, in a split-screen multi-application multi-window scenario, the screen can display windows corresponding to different applications in split screens, and the different windows usually do not overlap, and the multiple windows displayed on the screen usually occupy the entire screen. For example, when the top-bottom split screen is used, the window of application 1 can be displayed on the top of the screen, and the window of application 2 can be displayed on the bottom of the screen. For another example, when the left-right split screen is used, the window of application 1 can be displayed on the left of the screen, and the window of application 2 can be displayed on the right of the screen.
[0181] For example, Figure 1A As shown, in a split-screen multi-application multi-window scenario, the multiple windows displayed on the screen may include window 01 corresponding to the microblog application and window 02 corresponding to the settings application.
[0182] For example, Fig. 8A As shown, in the split-screen multi-application multi-window scenario, the screen includes windows 801 and 802 displayed in a split screen on the left and right. The left window 801 corresponds to the Taobao application, and the right window 802 corresponds to the live broadcast application.
[0183] For example, Figure 8B As shown, in the split-screen multi-application multi-window scenario, the screen includes windows 803 and 804 displayed in upper and lower split screens, the upper window 803 corresponds to the live broadcast application, and the lower window 804 corresponds to the headline application.
[0184] For example, Fig. 9A As shown, in a split-screen multi-application multi-window scenario, the screen includes windows 901 and 902 displayed in a split-screen on the left and right. The left window 901 corresponds to the live broadcast application, and the right window 902 corresponds to the headline application.
[0185] In a multi-window scenario, after detecting the user's instruction to play a video in full screen, the mobile terminal can save the current multi-window status information; so that after exiting the full-screen video playback, the display status of the multi-window can be restored according to the multi-window status information. For example, the window status information may include the width and height information of the window, and may also include the window mode (Window Mode) corresponding to the window, and position information, etc. Among them, the window mode corresponds to the application, and each window in the same application is the window mode of the application; the window mode of a window is the window mode of the application corresponding to the window.
[0186] Among them, after the mobile terminal detects the user's instruction to play the video in full screen, the window where the video is located can be called the focus window (that is, the window that the user has recently operated), and the application corresponding to the focus window can be called the focus application.
[0187] For example, see Figure 3A , the operation of the user instructing to play the video in full screen may be an operation of the user clicking the full screen play control 303 in the window 301. In another exemplary embodiment, the operation of the user instructing to play the video in full screen may be an operation of the user double-clicking the video play area in the window 301. In another exemplary embodiment, the operation of the user instructing to play the video in full screen may be an operation of the user instructing to play the video in full screen by voice or gesture, etc.
[0188] In a multi-window scenario, after detecting the user's instruction to play the video in full screen, the mobile terminal can determine whether to switch the display direction. The display direction includes a horizontal screen direction and a vertical screen direction. The width of the display interface of the screen corresponding to the horizontal screen direction (i.e., the side with the smaller angle between the display interface and the screen in the horizontal direction) is greater than the height of the display interface (i.e., the side with the smaller angle between the display interface and the screen in the vertical direction), and the width of the display interface of the screen corresponding to the vertical screen direction is less than the height of the display interface.
[0189] When a user uses a mobile terminal, the side of the mobile terminal screen that is substantially parallel to the horizontal direction (or has a smaller angle) can be referred to as the width of the mobile terminal; the side of the mobile terminal screen that is substantially parallel to the vertical direction (or has a smaller angle) can be referred to as the height of the mobile terminal. The landscape state refers to a state in which the width of the mobile terminal is greater than its height. The portrait state refers to a state in which the height of the mobile terminal is greater than its width. When a user flips the mobile terminal to the landscape state, the mobile terminal can also display the interface in the landscape direction in conjunction with the landscape state; when a user flips the mobile terminal to the portrait state, the mobile terminal can also display the interface in the portrait direction in conjunction with the portrait state.
[0190] In some embodiments, the mobile terminal may determine whether to switch the display direction according to a preset policy. If it is determined according to the preset policy that the display direction does not need to be switched, the video playback interface is displayed in full screen on the entire screen of the mobile terminal to achieve device-level full-screen display of the video playback interface (or device-level full-screen video playback); if it is determined according to the preset policy that the display direction needs to be switched, the display direction is switched first, and then the video playback interface is displayed in full screen on the entire screen of the mobile terminal to achieve device-level full-screen display.
[0191] For example, in a preset strategy, if the difference between the width and height of the screen of the mobile terminal is less than or equal to the preset value, that is, the aspect ratio of the screen (i.e., the ratio between the width and height of the screen) is close to 1:1, the width and height of the screen are not much different, and the screen is close to a square, then the display effect of the mobile terminal in the horizontal screen state and the vertical screen state is not much different. Therefore, after the mobile terminal detects the user's operation of instructing full-screen video playback, no matter whether it is currently in the horizontal screen state or the vertical screen state, the display direction will not be switched.
[0192] For example, for some folding screen devices (such as folding screen mobile phones), when the screen is folded (such as Figure 7B ), the difference between the width and height of the screen is large; when the screen is expanded (as shown Fig. 7A The difference between the width and height of the screen is small, and the aspect ratio of the screen is close to 1:1. When the folding screen device detects the user's instruction to play the video in full screen in the unfolded state, the display direction will not be switched regardless of whether the current state is horizontal or vertical.
[0193] If the difference between the width and height of the screen of the mobile terminal is greater than a preset value, and the width and height of the screen differ greatly, the display effects of the mobile terminal in the horizontal and vertical states are quite different, and the device-level full-screen display effect of the mobile terminal in the horizontal state is better. Therefore, after the mobile terminal detects the user's instruction to play the video in full screen, if the current state is vertical and the current display direction is vertical, the mobile terminal can switch the display direction to horizontal, and then display the video playback interface in full screen on the entire screen. For easy viewing, the user can flip the mobile terminal to the horizontal state to correspond to the horizontal direction. If the current state is horizontal and the current display direction is horizontal, the display direction is not switched, and the mobile terminal can directly display the video playback interface in full screen on the entire screen.
[0194] In other embodiments, in a multi-window scenario, after the mobile terminal detects the user's operation of instructing the full-screen video playback, if the current state is portrait and the display direction is portrait, the user may be prompted to switch the display direction by displaying information, voice or other means. If the mobile terminal detects that the user instructs the mobile terminal to switch the display direction by clicking a control, voice, or gesture, the portrait screen direction is switched to the landscape screen direction. If the mobile terminal detects that the user instructs the mobile terminal not to switch the landscape / portrait screen direction, or if the user's operation of instructing the mobile terminal to switch the landscape / portrait screen direction is not detected within a preset time, the mobile terminal does not switch the landscape / portrait screen direction, and the current landscape screen direction or portrait screen direction remains unchanged. For easy viewing, the mobile terminal may also prompt the user to flip the mobile terminal to the landscape screen state to correspond to the landscape screen direction.
[0195] For example, in Figure 5AIn the multi-window scenario shown in FIG. 1 , after the mobile terminal detects that the user clicks on the full-screen play control 503 in the window 501, as shown in FIG. Fig. 10A As shown, a prompt box 1001 is displayed to prompt the user whether the current display direction is vertical and whether to switch to horizontal, so as to improve the full-screen playback experience. If the user clicks the control 1002, the display direction is switched from vertical to horizontal. In addition, after the mobile terminal detects that the user clicks the control 1002, Fig. 10B As shown, a prompt box 1003 may also be displayed to prompt the user to flip the mobile terminal to the horizontal screen state so as to display the horizontal screen direction in the horizontal screen state. Figure 5B As shown, the mobile terminal can play the video in full screen on the entire display screen in the horizontal screen state and the horizontal screen direction.
[0196] In other embodiments, the user can pre-set in the system or in the video application whether to switch the display direction if the current state is vertical screen and vertical screen orientation after the mobile terminal detects that the user instructs to play the video in full screen. The mobile terminal determines whether to switch the display direction according to the user's setting. For example, the setting interface can be referred to as Fig.11 The interface in window 1101 is shown.
[0197] When the video playback interface is displayed in full screen on the entire screen of the mobile terminal to achieve device-level full screen display, the entire screen of the mobile terminal is used to display the video playback interface. The size of the video playback interface is consistent with the size of the screen.
[0198] In some embodiments, when the video playback interface is displayed in full screen on the entire screen of the mobile terminal to achieve device-level full screen display, the entire screen of the mobile terminal is used to display a window for playing the video, the size of the window is consistent with the size of the screen, and the size of the video screen matches the size of the screen. The mobile terminal no longer displays other windows of the focus application and windows of other applications on the screen.
[0199] For example, in Figure 1A , Figure 3A or Figure 3B In the scenario shown, a schematic diagram of a mobile terminal playing a video on the entire screen can be seen in Figure 4A .like Figure 4A As shown, the entire screen displays only one full-screen play window 401. The full-screen play window is smaller than the size of the screen. Figure 1A , Figure 3A or Figure 3B The window of the Weibo application is shown in . Figure 1A , Figure 3A or Figure 3BCompared with the full-screen video playback in the window of the Weibo application shown, Figure 4A The area used to display the video playback screen on the interface shown is larger, and the content in other windows will not be displayed, so the user will not see the interference information in other windows. Figure 4A The full-screen playback effect shown can give users a better viewing experience.
[0200] For example, in Figure 1A , Figure 3A or Figure 3B In the scenario shown, a schematic diagram of a mobile terminal playing a video on the entire screen can be seen in Figure 4B or Figure 4C .like Figure 4B or Figure 4C As shown, the full-screen playback window is the same or substantially the same size as the screen. Figure 4B and Figure 4C The full-screen playback effect shown can give users a better immersive viewing experience.
[0201] In the following embodiments of the present application, the example in which the window for playing the video in full screen (ie, the window for displaying the target object in full screen) is the same size or substantially the same size as the screen is mainly used for explanation.
[0202] Among them, when playing the video in full screen, Figure 4B The interface shown and Figure 4C The interfaces shown can be switched between each other. For example, when the mobile terminal displays Figure 4B When the interface shown is detected, if the user clicks on the interface, it switches to display Figure 4C The interface shown; displayed on the mobile terminal Figure 4C When the interface shown is displayed, if a user clicks on the interface, it switches to Figure 4B The interface shown.
[0203] It should be noted that device-level full-screen display means that the video playback interface basically fills the entire screen of the mobile terminal, and some areas of the screen can be reserved for status indicators, notification messages, etc. Device-level full-screen display does not require that the video screen completely fills all areas of the screen. Figure 4B and Figure 4C As shown, the video picture can fill the entire width of the screen in the horizontal direction, but leave blank margins between the upper and lower edges of the screen in the vertical direction to adapt the aspect ratio of the video image.
[0204] The following provides examples for display directions and full-screen video playback in different application scenarios.
[0205] For example, in a free multi-application multi-window scenario, after detecting the user's instruction to play the video in full screen, the mobile terminal determines whether to switch the display direction, and then displays the video playback interface in full screen on the entire screen of the mobile terminal.
[0206] For example, Figure 3A or Figure 3B As shown in FIG. 1 , in the free multi-application multi-window scenario, the mobile terminal is in a horizontal screen state and the display direction is a horizontal screen direction. After the mobile terminal detects the user's operation of instructing to play the video in full screen, as shown in FIG. Figure 4B or Figure 4C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0207] For example, Figure 5A As shown in FIG. 1 , in the free multi-application multi-window scenario, the mobile terminal is in a portrait mode and the display direction is a portrait mode. After the mobile terminal detects the user's operation of instructing to play the video in full screen, it switches to a landscape mode, such as Figure 5B As shown, the video playback interface is displayed in full screen in horizontal mode.
[0208] For example, Figure 5C As shown in FIG. 1 , in the free multi-application multi-window scenario, the mobile terminal is in a vertical screen state and the display direction is a vertical screen direction. After the mobile terminal detects the user's operation of instructing to play the video in full screen, as shown in FIG. Figure 5D As shown, the video playback interface is displayed in full screen in the vertical screen state.
[0209] For another example, in a single-application multi-window scenario, after detecting the user's instruction to play the video in full screen, the mobile terminal determines whether to switch the display direction, and then displays the video playback interface in full screen on the entire screen of the mobile terminal.
[0210] For example, Fig. 6A As shown in FIG. 1 , in a single application multi-window scenario, the mobile terminal is in landscape mode and the display direction is landscape. After the mobile terminal detects the user's instruction to play the video in full screen, Figure 6B or Figure 6C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0211] For example, Fig.6D As shown in FIG. 1 , in a single application multi-window scenario, the mobile terminal is in a portrait mode and the display direction is a portrait mode. After the mobile terminal detects the user's instruction to play the video in full screen, it switches to a landscape mode. Figure 6B or Figure 6C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0212] For example, Fig. 7AAs shown in FIG. 1 , in a single application multi-window scenario, the mobile terminal is in a vertical screen state and the display direction is a vertical screen direction. After the mobile terminal detects the user's operation of instructing to play the video in full screen, as shown in FIG. Figure 7C As shown, the video playback interface is displayed in full screen in the vertical screen state.
[0213] For another example, in a split-screen multi-application multi-window scenario, after detecting the user's instruction to play the video in full screen, the mobile terminal can determine whether to switch the display direction, and then display the video playback interface in full screen on the entire screen of the mobile terminal.
[0214] For example, Figure 1A As shown in FIG. 1 , in a split-screen multi-application multi-window scenario, the mobile terminal is in landscape mode and the display direction is landscape. After the mobile terminal detects the user's instruction to play the video in full screen, Figure 4B or Figure 4C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0215] For example, Fig. 8A As shown in FIG. 1 , in a split-screen multi-application multi-window scenario, the mobile terminal is in landscape mode and the display direction is landscape. After the mobile terminal detects the user's instruction to play the video in full screen, Figure 6B or Figure 6C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0216] For example, Figure 8B As shown in FIG. 1 , in a split-screen multi-application multi-window scenario, the mobile terminal is in a portrait mode and the display direction is a portrait mode. After the mobile terminal detects the user's instruction to play the video in full screen, it switches to a landscape mode, such as Figure 6B or Figure 6C As shown, the video playback interface is displayed in full screen in horizontal mode.
[0217] For example, Fig. 9A As shown in FIG. 1 , in a split-screen multi-application multi-window scenario, the mobile terminal is in a vertical screen state and the display direction is a vertical screen direction. After the mobile terminal detects the user's instruction to play the video in full screen, as shown in FIG. Fig. 9B As shown, the video playback interface is displayed in full screen in the vertical screen state.
[0218] When the difference between the long side and the short side of the mobile terminal is much greater than 1:1, the difference between the width and height of the mobile terminal screen is usually greater than the preset value, and the mobile terminal can play in full screen in the horizontal screen state. Figure 4B or Figure 6B The scene shown. Exemplarily, the mobile terminal may be a tablet computer, a mobile phone or other mobile terminal with a large difference between the long side and the short side.
[0219] When the ratio of the long side to the short side of the mobile terminal is close to 1:1, the difference between the aspect ratio of the mobile terminal screen and 1:1 is usually less than or equal to the preset value 1, and the mobile terminal can display the video playback interface in full screen in the horizontal screen state, or in the vertical screen state. For example, this situation can correspond to Figure 5D , Figure 7C or Fig. 9B The scene shown. Exemplarily, the mobile terminal may be a device with a long side and a short side that are not much different, such as a folding screen device in an unfolded state. For example, the folding screen device is a folding screen mobile phone, and the aspect ratio of the screen in the folded state may be 16:9; in the unfolded state, the aspect ratio of the screen may be 8:9, which is close to 1:1.
[0220] It is understandable that in Figure 5B , Figure 5D , Figure 6B , Figure 6C , Figure 7C and Fig. 9B In the example, the window for playing the video in full screen (i.e., the window for displaying the target object in full screen) is described by taking the size of the window as being the same as or substantially the same as the size of the display screen. Figure 4A similar, Figure 5B , Figure 5D , Figure 6B , Figure 6C , Figure 7C and Fig. 9B The window for full-screen video playback shown in FIG. 1 may also be smaller than the screen size and larger than the display state of multiple windows before full-screen video playback, such as Figure 1A , Figure 3A , Figure 3B , Figure 5A , Figure 5C , Fig. 6A , Fig.6D , Fig. 8A , Figure 8B , Fig. 7A , Fig. 9A The window where the video is shown.
[0221] When the mobile terminal plays the video in full screen on the entire screen, after detecting the user's instruction to exit the full screen video playback, the full screen video playback state can be exited and the multi-window display state before the full screen video playback can be restored.
[0222] For example, the user may instruct to exit the full-screen video playback operation by clicking on Figure 4C The operation shown is to exit the full screen control 402, click the back control 403, or click the return button 404.
[0223] In some embodiments, after detecting that the user instructs to exit the full-screen video playback operation, the mobile terminal can restore the display state of the multiple windows before the full-screen video playback according to the previously saved state information of the multiple windows. For example, the window size, window mode, and window position of each window in the multiple windows are restored. It should be noted that restoring the display state of the multiple windows does not include restoring the display content of the multiple windows before the full-screen video playback. The display content in each window can change in real time. The display content in the multiple windows after exiting the full-screen video playback may be consistent or inconsistent with the display content in the multiple windows before the full-screen video playback.
[0224] For example, the correspondence between the schematic diagram for representing the display status of multiple windows before the video playback interface is displayed in full screen, the schematic diagram for representing the display status of the video playback window when the video playback interface is displayed in full screen, and the schematic diagram for representing the display status of multiple windows after exiting the full screen display of the video playback interface can be seen in Table 1.
[0225] Table 1
[0226]
[0227] For example, in Figure 1A In the scenario shown, after the mobile terminal detects the user's instruction to play the video in full screen, it can display Figure 4C The interface shown. Figure 4C In the scenario shown, after detecting the user's instruction to exit the full-screen video playback, the Figure 1A The window size, window mode, window position and display direction are shown. If the display direction is switched from portrait to landscape when the video is played in full screen, the display direction can be switched from landscape back to portrait after the full screen video is exited.
[0228] For example, in Fig. 12A In the scenario shown, the display orientation of the mobile terminal is vertical. After detecting the user's instruction to play the video in full screen, the mobile terminal can switch to horizontal orientation and display the following Figure 6B The interface shown. Figure 6B In the scenario shown, after detecting the user's instruction to exit the full-screen video playback operation, the following may be displayed: Fig. 12B The interface shown. Fig. 12B In the example, after the mobile terminal exits the full-screen display, it switches back to the vertical screen orientation, and displays the window corresponding to the Taobao application and the window corresponding to the live broadcast application in the vertical screen orientation in the horizontal screen state. Fig. 12A As shown, the mobile terminal can display the window corresponding to the Taobao application and the window corresponding to the indicator application in the vertical screen state in the vertical screen direction.
[0229] In other embodiments, after detecting the user's instruction to exit full-screen video playback, the mobile terminal can adaptively set the position and size of multiple windows according to the current horizontal or vertical screen state, so that the window display effect is compatible with the user's current flip state and holding method of the mobile terminal, thereby improving the user experience.
[0230] For example, in Fig. 12A In the scenario shown, the display orientation of the mobile terminal is vertical. After detecting the user's instruction to play the video in full screen, the mobile terminal can switch to horizontal orientation and display the following Figure 6B The interface shown. Figure 6B In the scenario shown, after detecting the user's instruction to exit the full-screen video playback operation, the following may be displayed: Fig. 12C The interface shown. Fig. 12C In the present embodiment, after the mobile terminal exits the full-screen display, it no longer switches back to the vertical screen orientation, but still displays the window corresponding to the Taobao application and the window corresponding to the live broadcast application in the horizontal screen orientation in the horizontal screen state.
[0231] In other embodiments, after detecting the user's instruction to play the video in full screen, the mobile terminal can prompt the user by displaying information or voice, etc., whether to display the video playback interface in full screen on the entire screen of the mobile terminal; or to display the video playback interface in full screen in the application window in a local area of the screen. The mobile terminal performs the corresponding full screen display operation according to the user's instruction.
[0232] For example, the mobile terminal Figure 1A In the scenario shown, after detecting the user's instruction to play the video in full screen, Fig.13 As shown, the mobile terminal can display a prompt box 1301 to prompt the user whether to play the video in full screen on the entire screen. Figure 4B or Figure 4C As shown, the mobile terminal plays the video in full screen on the entire screen. If the mobile terminal detects that the user clicks on the control 1303, Figure 1B As shown, the mobile terminal plays the video in full screen in the Weibo window.
[0233] In other embodiments, Fig.14 As shown, the video playback interface includes a full-screen playback control 1401 and a full-screen playback control 1402. After the mobile terminal detects that the user clicks the control 1402, the method provided by the embodiment of the present application is adopted. Figure 4B or Figure 4C As shown, the video playback interface is displayed in full screen on the entire screen, and the size of the video screen matches the size of the entire screen. After the mobile terminal detects that the user clicks the control 1401, Figure 1B As shown, the video playback interface is displayed in full screen in the application window where the video is located, and the size of the video screen matches the size of the window 01 of the Weibo application.
[0234] In other embodiments, after detecting a preset first voice or a first gesture, the mobile terminal uses the method provided by the embodiments of the present application to display the video playback interface in full screen on the entire screen of the mobile terminal, and the size of the video screen matches the size of the entire screen. After detecting a preset second voice or a second gesture, the mobile terminal displays the video playback interface in full screen in an application window in a local area of the screen, and the size of the video screen matches the size of the local application window.
[0235] In some other embodiments, the device-level full-screen display mode and the in-window full-screen mode can be switched between each other. Figure 4B In the device-level full-screen display mode shown in FIG. 1 , the interface displayed by the mobile terminal includes a full-screen mode switching control. After the mobile terminal detects that the user clicks on the full-screen mode switching control, it switches to the full-screen mode switching control as shown in FIG. Figure 1B For example, the mobile terminal detects that the user is in the full screen mode in the window Figure 4B After pinching the interface shown, switch to Figure 1B In the full screen mode in the window shown in FIG. Figure 1B In the full-screen display mode in the window shown, if the mobile terminal detects a user voice instruction to switch to the full-screen display mode, it switches to the full-screen display mode as shown in FIG. Figure 4B Device-level fullscreen mode shown.
[0236] The above is explained by taking the scenario of full-screen video playback, where the mobile terminal displays the video playback interface in full screen as an example. In other usage scenarios, the full-screen display method provided in the above embodiments of the present application can also be used to display the target object on the entire screen of the mobile terminal.
[0237] For example, in a multi-window scenario, a window includes a picture. In response to the user's instruction operation, the mobile terminal can display the picture in full screen to improve the user's immersive experience of browsing pictures. The picture can be a picture in the gallery, a picture in the browser, a picture in WeChat Moments, or other pictures.
[0238] For example, Fig.15A As shown, the multi-window scenario includes a window 1501 corresponding to the microblog application and a window 1502 corresponding to the browser application. After the mobile terminal detects that the user clicks on the picture in window 1502, as shown in FIG. Fig. 15B As shown, the picture is displayed full screen.
[0239] For another example, in a multi-window scenario, a certain window is a window of a reader application. In response to a user's instruction operation, the mobile terminal can display the reader interface in full screen on the entire screen to enhance the user's immersive experience in reading e-books.
[0240] For example, Fig.16A As shown, the multi-window scenario includes a window 1601 corresponding to the microblog application and a window 1602 corresponding to the reader application. After the mobile terminal detects that the user clicks on the control 1603, as shown in FIG. Fig. 16B As shown, the text content of the reader is displayed in full screen.
[0241] For another example, in a multi-window scenario, a certain window is a window of a game application. In response to a user's instruction operation, the mobile terminal can display the game interface in full screen on the entire screen so that the user can be better immersed in the game.
[0242] The software system of the mobile terminal may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the mobile terminal.
[0243] Fig.17A : is a software structure diagram of a mobile terminal of an embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.
[0244] like Fig.17A As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
[0245] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0246] like Fig.17A As shown, the application framework layer may include an activity manager, a window manager, a media system, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0247] The activity manager is responsible for managing the startup, status, life cycle and other activities of the application. Among them, activity is an application component that can provide a screen for users to interact with the mobile terminal through the screen to complete a task.
[0248] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, manage the window size, display, and animation, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0249] The media system is used to manage the media information of applications.
[0250] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0251] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0252] The phone manager is used to provide communication functions for the mobile terminal, such as the management of call status (including answering, hanging up, etc.).
[0253] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0254] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the mobile terminal vibrates, the indicator light flashes, etc.
[0255] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.
[0256] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0257] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0258] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0259] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0260] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0261] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0262] A 2D graphics engine is a drawing engine for 2D drawings.
[0263] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver. Among them, the display driver can be used to drive the display and control the driving current, etc.
[0264] The following is an example of the software workflow of the mobile terminal in the embodiment of the present application, combined with the scenario of full-screen video playback.
[0265] For example, in Figure 1A or Figure 3A In the illustrated multi-window scenario, the display screen of the mobile terminal includes a window corresponding to the microblog application and a window corresponding to the settings application. After the mobile terminal detects the user's instruction to play the video in full screen, the video playback interface is displayed in full screen on the entire display screen.
[0266] Specifically, the touch sensor can detect a touch operation. After the touch sensor detects a touch operation instructing the user to play the video in full screen, the application in the application layer corresponding to the window where the video is located notifies the application framework layer. After the application framework layer determines that the video is played in full screen, it draws a window consistent with the size of the display screen and provides the window drawing data to the display driver in the kernel layer. The display driver controls the display screen to display the corresponding window based on the window drawing data, and displays the video content in the window, thereby realizing device-level full-screen video playback.
[0267] Among them, the touch sensor receives the touch operation, and the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into raw input events (including touch coordinates, timestamp of the touch operation, and other information). The raw input events are stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. The touch operation is a touch single-click operation, and the control corresponding to the single-click operation is the full-screen playback control on the interface of the Weibo application. The window of the Weibo application is the focus window, and the Weibo application is the focus application.
[0268] like Fig. 17B As shown, the application (i.e., the focus application) can call the setRequestOrientation function and request that the display orientation be landscape orientation. The activity manager first determines whether the first preset condition is met. If the first preset condition is met, the activity manager further determines whether to switch the display orientation; if the first preset condition is not met, the activity manager does not process.
[0269] In some embodiments, the first preset condition may include determining whether the request for the landscape orientation is an application or the system. If the request for the landscape orientation is an application, the application is the focus application corresponding to the focus window, and the video is not currently in full screen playback (i.e., the video is not currently playing in full screen on the entire display screen).
[0270] In addition, it should be noted that when the user flips the mobile terminal so that the mobile terminal switches from the portrait mode to the landscape mode, the gyroscope and other sensors can detect the change in the posture of the mobile terminal and report it to the system. The system can call the setRequestOrientation function and request that the display orientation be landscape.
[0271] In other embodiments, since the audio and video decoder is in working state when playing the video, the first preset condition may also include that the microblog application is calling the audio and video decoder, and the activity manager determines that the audio and video decoder is in working state based on the media information of the microblog application obtained from the media system. In this way, the activity manager can more accurately determine that full-screen video playback needs to be triggered based on the first preset condition.
[0272] In addition, when the target object is a game interface, if the activity manager determines that the application requesting the display direction is the focus application corresponding to the focus window, the display direction requested by the focus application is horizontal, the video is not currently in full-screen playback, and the video decoder is in working condition, then it can be more accurately determined that full-screen video playback needs to be triggered.
[0273] There are multiple apps on the mobile terminal that can play audio. The operating system provides an API for sharing audio focus between apps. At the same time, only one app can obtain and hold the audio focus. When a certain app needs to output audio, it needs to request audio focus. The app can only play audio after being authorized with audio focus. In other words, only the application that obtains the audio focus can play audio. Therefore, in other embodiments, the first preset condition may also include that the Weibo application has obtained the audio focus, and the activity manager determines that the Weibo application has obtained the audio focus based on the media information of the Weibo application obtained from the media system, so that the activity manager can more accurately determine the need to trigger full-screen video playback based on the first preset condition.
[0274] In other embodiments, since most video playback windows are currently of SurfaceView type, the first preset condition may also include that the activity manager includes a sub-window of SurfaceView type based on the window where the full-screen playback control is obtained from the window manager, and the sub-window may be a video playback window, so that the activity manager can more accurately determine the need to trigger full-screen playback of the video based on the first preset condition.
[0275] like Fig. 17B As shown, after determining that the video can be played in full screen, the activity manager saves the current state information of the multi-windows, so that after exiting the full screen video playback, the display state of the multi-windows can be restored according to the state information of the multi-windows.
[0276] like Fig. 17B As shown, after determining that the video can be played in full screen on the entire display screen, the activity manager determines whether to switch the display direction. According to the above description, the activity manager can determine whether to switch the display direction based on a preset strategy, a user's pre-settings, or a user's current instructions, which will not be described in detail here. If the activity manager determines that the display direction needs to be switched, the vertical screen direction can be switched to the horizontal screen direction, and the direction switching information can be saved. The direction switching information is used to indicate that the display direction is switched from the vertical screen direction to the horizontal screen direction.
[0277] like Fig. 17BAs shown, the activity manager can set the width and height of the focus window (i.e., the window of the microblog application) to the width and height of the display screen, respectively, so that the size of the focus window is consistent with the size of the display screen. In some cases, the activity manager can also set the window mode (Window Mode) of the focus window to full screen mode (fullscreen), that is, set the window mode of the focus application corresponding to the focus window to full screen mode. Thus, the video playback interface in the window of the microblog application is displayed in full screen on the entire display screen.
[0278] For example, in a free multi-application multi-window scenario, the mobile terminal displays multiple windows in freeform mode. The window mode of the focus window is freeform mode, and there is no need to switch to full screen mode. The activity manager can set the width and height of the focus window to the width and height of the display screen, respectively.
[0279] For another example, in a single application multi-window scenario, multiple windows are displayed in full screen mode. The window mode of the focus window does not need to be switched to full screen mode. The activity manager can set the width and height of the focus window to the width and height of the display screen, respectively.
[0280] For another example, in a split-screen multi-application multi-window scenario, the mobile terminal displays multiple windows in split-screen mode. The window mode of the focus window is split-screen mode. The activity manager can switch the split-screen mode to the full-screen mode. After the split-screen mode is switched to the full-screen mode, the activity manager can also set the width and height of the focus window to the width and height of the display screen, respectively.
[0281] After the activity manager sets the width and height of the focus window (i.e., the window of the Weibo application) to the width and height of the display screen, or sets the split-screen mode to the full-screen mode, it can update the width and height information of the focus window and status information such as the window mode in the configuration file of the focus application, so that the window information can be called back to the focus application through the configuration file.
[0282] like Fig. 17B As shown, the window manager can call the onConfigurationChanged interface to obtain the updated width and height information of the focus window from the configuration file of the focus application, and draw a window consistent with the size of the display screen according to the updated width and height information of the focus window. The window manager provides the window drawing data to the display driver.
[0283] like Fig. 17BAs shown, the display driver draws data according to the window, and drives the display screen to display a window that is consistent with the size of the display screen. In addition, the display screen can also obtain video data from the video file, so as to display the video content in a window that is consistent with the size of the display screen, and realize device-level full-screen video playback.
[0284] After the mobile terminal detects the user's instruction to exit the full-screen video playback operation, it exits the device-level full-screen video playback and restores the display state of the multiple windows before the full-screen video playback.
[0285] Specifically, the touch sensor receives a touch operation, and the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event. The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. The touch operation is a touch single-click operation, and the control corresponding to the single-click operation is a return button set on the mobile terminal, a full-screen exit control or a back control set on the video playback interface, etc.
[0286] like Fig. 17B As shown, the application (i.e., the focus application) calls setRequestOrientation to request that the display orientation be a non-landscape orientation. If it is determined that the second preset condition is met, the full-screen video playback is exited. The second preset condition includes that the current video is in full-screen playback state, that is, the video playback interface is displayed on the entire display screen, and the previous historical state is determined to be a multi-window state based on the previously saved multi-window state information.
[0287] like Fig. 17B As shown, the activity manager sets the width and height values of each window and the window mode in the previously saved state information of the multiple windows to the current width and height values and the window mode of each window. In addition, the activity manager updates the width and height values of the window and the window mode in the configuration files of the applications corresponding to the multiple windows according to the state information of the multiple windows. After the activity manager determines that the display direction has been switched from the portrait orientation to the landscape orientation according to the previously saved direction switching information, it can also switch back to the portrait orientation.
[0288] like Fig. 17B As shown, the window manager can call the onConfigurationChanged interface to obtain the relevant information of the updated window from the configuration file, draw the windows corresponding to the microblog application and the setting application respectively according to the relevant information of the updated window, and provide the window drawing data to the display driver.
[0289] like Fig. 17BAs shown, the display driver drives the display screen to display multiple windows according to the window drawing data, and restores the display state of multiple windows before the full-screen video playback. The display screen can also obtain the content data of the application from the video file, and display the corresponding content in each window according to the content data of the application. Thus, the mobile terminal exits the device-level full-screen video playback.
[0290] also, Fig. 17B The relevant processes of the full-screen display method provided in the embodiments of the present application are mainly explained from the perspective of software. Fig.18 Another schematic diagram is provided, mainly from the perspective of a mobile terminal, to illustrate the relevant process of the full-screen display method provided in the above embodiments of the present application.
[0291] The embodiment of the present application further provides a mobile terminal, which may include: a display unit, a detection unit, a switching unit, an acquisition unit, etc. These units may execute the various steps in the above embodiment to implement a device-level full-screen display method.
[0292] The embodiment of the present application also provides a mobile terminal, including one or more processors; a memory; a display screen; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the mobile terminal executes the various steps in the above embodiment to implement the device-level full-screen display method.
[0293] Exemplarily, when the mobile terminal is Figure 2 When the device is shown, the processor in the mobile terminal can be Figure 2 The processor 110 in the mobile terminal may be Figure 2 The internal memory 121 in the mobile terminal may be Figure 2 Display screen 194 in.
[0294] An embodiment of the present application also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on a mobile terminal, the mobile terminal executes the above-mentioned related method steps to realize the device-level full-screen display in the above-mentioned embodiment.
[0295] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes the above-mentioned related steps to implement the device-level full-screen display method in the above-mentioned embodiment.
[0296] In addition, an embodiment of the present application further provides a device, which may be a chip, and the chip may include a processor and a memory, wherein instructions are stored in the memory. When the instructions are executed by the processor, the chip performs the above-mentioned related steps to implement the device-level full-screen display method in the above-mentioned embodiment.
[0297] In addition, an embodiment of the present application also provides a device, which may specifically be a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the device is running, the processor may execute the computer execution instructions stored in the memory so that the chip executes the device-level full-screen display method in the above-mentioned method embodiments.
[0298] Among them, the mobile terminal, chip, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0299] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0300] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0301] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0302] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0303] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0304] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A full-screen display method for a mobile terminal, the mobile terminal comprising a display screen, It is characterized in that include: The mobile terminal displays a first interface, the first interface includes a first window and a second window, the first window and the second window are used to display a user interface of an application, the first window and the second window are free multi-windows, or the first window and the second window are single-application multi-windows, or the first window and the second window are split-screen multi-windows, or the first window and the second window are windows in a picture-in-picture format, wherein the first window includes a target object, and the target object includes a video; The mobile terminal detects a first touch operation, where the first touch operation is used to instruct the mobile terminal to display the target object in full screen; The mobile terminal displays a second interface, the second interface includes a third window, the third window is used to display the target object, and the size of the target object displayed in the third window is inconsistent with the size of the target object displayed in the first window.
2. The method according to claim 1, It is characterized in that After the mobile terminal displays the second interface, the method further includes: The mobile terminal detects an instruction to exit full-screen display; In response to the instruction to exit full-screen display, the mobile terminal displays a third interface, wherein the third interface includes the first window and the second window; the window states of the first window and the second window on the third interface are consistent with the sizes on the first interface.
3. The method according to claim 2, It is characterized in that The window state includes at least one of the following: Window size, window mode, and window position.
4. The method according to any one of claims 1 to 3, It is characterized in that The method further comprises: In response to the first touch operation, the mobile terminal switches the display orientation from the portrait orientation to the landscape orientation, or the mobile terminal switches the display orientation from the landscape orientation to the portrait orientation.
5. The method according to claim 4, It is characterized in that After the mobile terminal detects an instruction to exit full-screen display, the method further includes: In response to the instruction to exit the full-screen display, the mobile terminal switches the display orientation from the horizontal screen orientation to the vertical screen orientation, or the mobile terminal switches the display orientation from the vertical screen orientation to the horizontal screen orientation.
6. The method according to claim 1, It is characterized in that The target object is a video, and before the mobile terminal displays the second interface, the audio and video decoder of the mobile terminal is in a working state; or the application corresponding to the first window where the video is located obtains the audio focus; Or the first window includes a subwindow of SurfaceView type.
7. The method according to claim 1 or 2, It is characterized in that The full-screen display is a device-level full-screen display.
8. The method according to claim 1 or 2, It is characterized in that The first window and the second window are used to display interfaces of the same application or different applications.
9. A mobile terminal, It is characterized in that include: one or more processors; Memory; A touch screen, used to detect touch operations and display an interface; Wherein, the memory stores codes, and when the codes are executed by the one or more processors, the mobile terminal executes the full-screen display method as described in any one of claims 1-8.
10. A computer storage medium, It is characterized in that The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the full-screen display method as described in any one of claims 1 to 8.
11. A computer program product, It is characterized in that When the computer program product is run on a computer, the computer is enabled to execute the full-screen display method according to any one of claims 1 to 8.
