Display device and multi-window display method

Abstract

The invention provides a display device and a multi-window display method, and the display device can pre-register a monitoring service for monitoring task stacks, create a first task stack of a first application when entering a first mode, and display the first task stack of the first application when the monitoring service monitors that the first task stack has been created. The visible area defined by the first window container can be triggered and modified, equivalently, the application is bypassed, the window attribute is directly and logically adjusted from the bottom layer, and the rendering of the corresponding window is realized. The display device does not need to configure system parameters in advance to start the switch of the first mode, and is not limited by the support condition of the application on the first mode.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a multi-window display method. Background Art

[0002] A display device refers to a terminal device capable of outputting a specific display image. These devices can include smart TVs, mobile terminals, smart advertising screens, projectors, and other terminal devices. Taking smart TVs as an example, they are based on Internet application technology, feature an open operating system and chip, and possess an open application platform. They enable two-way human-computer interaction and integrate multiple functions, including audio, video, entertainment, and data, to meet the diverse and personalized needs of users.

[0003] The display device can be configured with multi-window mode. In multi-window mode, the display device can display multiple windows at the same time, and each window displays an application to achieve the effect of displaying multiple applications at the same time. The display device needs to turn on the multi-window mode switch by configuring system parameters. In this way, the display device can support multi-window mode. In addition, only applications that have previously declared support for multi-window mode, that is, only applications that support multi-window mode themselves, can be used in multi-window mode.

[0004] As you can see, if the display device is not pre-configured with system parameters to enable multi-window mode, users will not be able to use multi-window mode. In addition, if the application itself does not support multi-window mode, the display device will not be able to use these applications in multi-window mode. Summary of the Invention

[0005] The present application provides a display device and a multi-window display method. The display device can still implement the multi-window mode when the multi-window mode switch is not turned on, and can use applications that do not support the multi-window mode in the multi-window mode.

[0006] In a first aspect, the present application provides a display device, comprising:

[0007] The display is configured to: display a first window and a first page in the first window, wherein the first window is in a full-screen state;

[0008] The controller is configured as:

[0009] In response to a user instruction to start a first application, a second window is displayed on an upper layer of the first window, and a second page of the first application is displayed in the second window, wherein the second window is in a full-screen state; in response to a user instruction to enter a multi-window mode, if the multi-window mode is the first mode, a first task stack corresponding to the first application is created, and the first task stack is monitored through a pre-registered monitoring service, wherein the first task stack includes an application page associated with the first application, and the application page includes the second page; when the monitoring service monitors that the first task stack has been created, window information for adjusting the second window is generated; according to the window information, a visible area defined by a first window container associated with the first task stack is adjusted from the entire visible area of the screen to a first visible area, the first window container includes an application window corresponding to each of the application pages, and the application window includes the second window, wherein the first window container is used to define the visible area of the application window on the screen; the display is controlled to display the second window according to the first visible area on an upper layer of the first window in a full-screen state.

[0010] The above technical solution has the following beneficial effects or advantages:

[0011] The display device can pre-register a listening service for monitoring task stacks. When entering the first mode, it can create a first task stack for the first application. When the listening service detects the creation of the first task stack, it can trigger the modification of the visible area defined by the first window container. This is equivalent to bypassing the application and directly adjusting window properties from the underlying logic to achieve rendering of the corresponding window. The display device does not need to pre-configure system parameters to enable the first mode, and is not limited by the application's own support for the first mode.

[0012] In some embodiments of the present application, the controller, in response to a user instruction to start a first application, displays a second window on top of the first window, and displays a second page of the first application in the second window, and is specifically configured to:

[0013] In response to the user's instruction to start the first application, the first task stack corresponding to the first application is created, and the first task stack corresponding to the first application is monitored through the monitoring service; when the monitoring service monitors that the first task stack has been created, the first window container associated with the first task stack is created; the visible area defined by the first window container is set to the entire visible area of the screen, and the window level defined by the first window container is set to the top layer; the second page to be displayed in the first task stack is determined; the display is controlled to display the second window at the top layer according to the entire visible area of the screen, and the second page is displayed in the second window.

[0014] The above technical solution has the following beneficial effects or advantages:

[0015] When the display device starts the first application, the second window can be displayed in full screen by setting the visible area defined by the first container window to the entire visible area on the screen, and the window level defined by the first container window can be set to the top layer so that the second window is displayed on top of the first window.

[0016] In some embodiments of the present application, when the monitoring service monitors that the first task stack has been created, the controller determines the window information for adjusting the second window, and is specifically configured to:

[0017] When the monitoring service monitors that the first task stack has been created, a task stack list is obtained, where the task stack list includes the package name of the application that has created the task stack and the task stack identifier, where the task stack identifier is used to uniquely identify the corresponding task stack, wherein the application list includes the package name of the first application and the task stack identifier of the first task stack; based on the package name of the first application, the task stack identifier corresponding to the first task stack is determined from the task stack list; and the window information is generated based on the task stack identifier corresponding to the first task stack and the default window properties.

[0018] The above technical solution has the following beneficial effects or advantages:

[0019] After monitoring that the first task stack has been recreated, the display device can generate corresponding window information for the first task stack in a targeted manner, and further can adjust the second window in a targeted manner.

[0020] In some embodiments of the present application, the controller adjusts the visible area defined by the first window container associated with the first task stack from the entire visible area of the screen to the first visible area, and is specifically configured to:

[0021] Obtain a pre-stored mapping relationship list, the mapping relationship list including a mapping relationship between a task stack and a surface controller, the mapping relationship being stored when the listening service listens to a created task stack, wherein the surface controller is used to manage container parameters of a window container associated with the corresponding task stack, the container parameters including a visible area defined by the window container; according to the mapping relationship list, obtain a first surface controller corresponding to the first task stack; according to the window information, adjust the visible area defined by the first window container from the entire visible area of the screen to the first visible area through the first surface controller.

[0022] The above technical solution has the following beneficial effects or advantages:

[0023] The display device manages the mapping relationship between the task stack and the surface controller corresponding to each launched application through a mapping relationship list. After determining the window information for adjusting the second window, the display device can determine the first surface controller for managing the first window container based on the mapping relationship list, thereby adjusting the visible area defined by the first window container through the first surface controller.

[0024] In some embodiments of the present application, the controller adjusts the visible area defined by the first window container associated with the first task stack from the entire visible area of the screen to the first visible area based on the window information, and is specifically configured to:

[0025] According to the size information in the window information, the visible area defined by the first window container is reduced from the entire visible area of the screen to the first visible area; and according to the position information in the window information, the position of the first visible area is defined as a first position on the screen.

[0026] The above technical solution has the following beneficial effects or advantages:

[0027] The display device can reduce the visible area defined by the first window container and modify the position of the visible area defined by the first window container on the screen to reduce the second window in the first window container and display the second window at the adjusted position.

[0028] In some embodiments of the present application, when the display displays a first window and displays a first page in the first window, the controller is further configured to:

[0029] In response to an instruction from a user to enter the multi-window mode, if the multi-window mode is the second mode, obtain the total number N of split-screen areas indicated by the user, and the N split-screen applications indicated by the user to be used in the second mode, wherein N is an integer greater than or equal to 2; create a task stack corresponding to the split-screen application, and call the multi-window interface to call the task management controller through the multi-window interface to create N root task containers, the task stack corresponding to the split-screen application includes application pages associated with the split-screen application, each of the root task containers corresponds to a split-screen area, and the root task container is used to define a visible area on the screen for the window contained in the root task container, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area; mount the application window associated with each application page in the task stack to the corresponding root task container; control the display to adjust the application window corresponding to the corresponding split-screen application according to the visible area defined by the root task container, and display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window.

[0030] The above technical solution has the following beneficial effects or advantages:

[0031] When the display device enters the second mode, it can directly call the task management controller for creating a root task container through the multi-window interface to create root task containers corresponding to multiple split-screen areas. Then, by mounting the application windows corresponding to the multiple split-screen applications under different root task containers, the application windows of the multiple split-screen applications can be displayed in split screens on the screen by limiting the visible area of the windows within the root task container. As can be seen, there is no need for the display device to pre-configure system parameters to enable the second mode switch, and it is not limited by the application's own support for the second mode.

[0032] In some embodiments of the present application, the controller creates a task stack corresponding to the split-screen application, and calls a multi-window interface to call a task management controller through the multi-window interface to create N root task containers, which is specifically configured as follows:

[0033] According to the total number N of split-screen areas, the area information of the visible area of each split-screen area on the screen is calculated; the multi-window interface is called to call the task management controller through the multi-window interface to create the corresponding root task container according to the area information; wherein, according to the size information in the area information, the size of the visible area defined by the corresponding root task container is set, and according to the position information in the area information, the position of the visible area defined by the corresponding root task container on the screen is set.

[0034] The above technical solution has the following beneficial effects or advantages:

[0035] The display device creates a root task container according to the area information of the corresponding split-screen area through the task management controller, which can effectively ensure that the application windows contained in the root task container are displayed in the corresponding split-screen area, thereby ensuring the split-screen effect between multiple split-screen applications.

[0036] In some embodiments of the present application, after the controller controls the display to display the second window in the first visible area on top of the first window in full screen mode, the controller is further configured to:

[0037] In response to an instruction from a user to enter a multi-window mode, if the multi-window mode is the third mode, obtain the total number M of split-screen areas indicated by the user, and the M split-screen applications indicated by the user to be used in the third mode, where M is an integer greater than or equal to 2; create a task stack corresponding to the split-screen application, and call the multi-window interface to call the task management controller through the multi-window interface to create M root task containers, the task stack corresponding to the split-screen application includes the application page associated with the split-screen application, each of the root task containers corresponds to a split-screen area, the root task container is used to define the window hierarchy of the window contained in the root task container, and in the A visible area on the screen, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area, and the window hierarchy is located at the lower layer of the second window; the application window associated with each application page in the task stack is mounted under the corresponding root task container; the display is controlled to adjust the application window corresponding to the corresponding split-screen application according to the visible area defined by the root task container, and display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window, wherein each adjusted application window is displayed at the lower layer of the second window.

[0038] The above technical solution has the following beneficial effects or advantages:

[0039] In the first mode, the display device can continue to perform split-screen operations in the lower layer of the second window to enter the third mode. This split-screen operation does not require the display device to pre-configure system parameters to turn on the split-screen mode switch, and will not be restricted by the application's own support for the split-screen mode.

[0040] In some embodiments of the present application, after the controller controls the display to display the second window in the first visible area on top of the first window in full screen mode, the controller is further configured to:

[0041] In response to a mode switching instruction input by the user, a multi-window interface is called to call a task management controller through the multi-window interface to create two root task containers, each of which corresponds to a split-screen area, and the root task container is used to define the visible area of the window contained in the root task container on the screen, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area; the first task stack corresponding to the first application and the second task stack to which the first page belongs are obtained, wherein the first task stack includes an application page associated with the first application, and the second task stack includes an application page associated with the application to which the first page belongs; the application window associated with the application page in the first task stack and the application window associated with the application page in the second task stack are respectively mounted under the corresponding root task container; the display is controlled to adjust the first window and the second window according to the visible area defined by the root task container, and the adjusted first window and second window are displayed in the corresponding split-screen area, and the first page is displayed in the adjusted first window, and the second page is displayed in the adjusted second window.

[0042] The above technical solution has the following beneficial effects or advantages:

[0043] The display device can flexibly switch between the first mode and the second mode without pre-configuring system parameters to enable the first mode and the second mode, and is not restricted by the application's own support for the first mode and the second mode.

[0044] In a second aspect, the present application provides a multi-window display method, applied to a display device as described in any one of the first aspects, wherein the display device displays a first window and displays a first page in the first window, wherein the first window is in a full-screen state;

[0045] The method comprises:

[0046] In response to a user instruction to start a first application, a second window is displayed on an upper layer of the first window, and a second page of the first application is displayed in the second window, wherein the second window is in a full-screen state; in response to a user instruction to enter a multi-window mode, if the multi-window mode is the first mode, a first task stack corresponding to the first application is created, and the first task stack is monitored through a pre-registered monitoring service, wherein the first task stack includes an application page associated with the first application, and the application page includes the second page; when the monitoring service monitors that the first task stack has been created, window information for adjusting the second window is generated; according to the window information, a visible area defined by a first window container associated with the first task stack is adjusted from the entire visible area of the screen to a first visible area, the first window container includes an application window corresponding to each of the application pages, and the application window includes the second window, wherein the first window container is used to define the visible area of the application window on the screen; the display is controlled to display the second window according to the first visible area on an upper layer of the first window in a full-screen state.

[0047] The above technical solution has the following beneficial effects or advantages:

[0048] The display device can pre-register a listening service for monitoring task stacks. When entering the first mode, it can create a first task stack for the first application. When the listening service detects the creation of the first task stack, it can trigger the modification of the visible area defined by the first window container. This is equivalent to bypassing the application and directly adjusting window properties from the underlying logic to achieve rendering of the corresponding window. The display device does not need to pre-configure system parameters to enable the first mode, and is not limited by the application's own support for the first mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0050] Figure 1 Schematic diagram of an operation scenario between the display device 200 and the control device 100 in an embodiment of the present application;

[0051] Figure 2 This is a hardware configuration block diagram of the display device 200 in an embodiment of the present application;

[0052] Figure 3 This is a diagram of the operating system configuration of the display device 200 in an embodiment of the present application;

[0053] Figure 4 A flowchart of the display device 200 provided in an embodiment of the present application displaying multiple applications in a first mode;

[0054] Figures 5A-5C A schematic diagram of interaction of the display device 200 displaying multiple applications in the first mode;

[0055] Figure 6 A flowchart of the display device 200 starting a first application provided in an embodiment of the present application;

[0056] Figure 7 A timing diagram of the display device 200 provided in an embodiment of the present application displaying multiple applications in a first mode;

[0057] Figure 8 A flowchart of the display device 200 determining window information for adjusting a second window provided in an embodiment of the present application;

[0058] Figure 9 A flowchart of adjusting a first window container of the display device 200 provided in an embodiment of the present application;

[0059] Figure 10 A flowchart of the display device 200 provided in an embodiment of the present application displaying multiple applications in the second mode;

[0060] Figure 11 A flowchart of creating a root task container for the display device 200 provided in an embodiment of the present application;

[0061] Figure 12 A timing diagram of the display device 200 provided in an embodiment of the present application displaying multiple applications in the second mode;

[0062] Figures 13A and 13B The display device 200 provided by the embodiment of the present application displays a schematic diagram of interaction of multiple applications in the second mode;

[0063] Figure 14 A flowchart of the display device 200 provided in an embodiment of the present application displaying multiple applications in a third mode;

[0064] Figure 15 A schematic diagram of an interface displaying multiple applications in a third mode provided by an embodiment of the present application;

[0065] Figure 16 This is a flowchart of switching the display device 200 to a multi-window mode according to an embodiment of the present application. DETAILED DESCRIPTION

[0066] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0067] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0068] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0069] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0070] In the embodiments of the present application, a display device generally refers to a device capable of displaying images and processing data. For example, a display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0071] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, the user can operate the display device 200 through touch operation, voice, mobile terminal 300 and control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0072] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0073] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0074] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0075] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0076] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. The communication device 220 can enable the display device 200 to communicate with the external device or server 400 through wireless or wired connections.

[0077] In some embodiments, the detector 230 is used to collect signals from the external environment or from interactions with the external environment.

[0078] In some embodiments, the device interface 240 is used to access an external device.

[0079] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory.

[0080] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0081] In some embodiments, the display 260 is configured to receive and display image signals outputted from the controller 250. The display 260 may include a display functional component for presenting images and a driving component for driving image display.

[0082] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface 280 may receive the user command through the GUI.

[0083] In some embodiments, the audio output device 270 may be a local speaker of the display device 200 or an external audio output device of the display device 200 .

[0084] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0085] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. An operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0086] The operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0087] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 3 As shown, in some embodiments, the system can be divided into four layers, from top to bottom, namely the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system runtime layer and the kernel layer.

[0088] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications.

[0089] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0090] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0091] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.

[0092] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0093] The display device 200 may be configured with a multi-window mode. In the multi-window mode, the display device 200 may display multiple windows simultaneously, and display one application in each window, so as to achieve the effect of displaying multiple applications simultaneously.

[0094] In some embodiments, the multi-window mode may include a first mode, which may also be referred to as a small window mode, a picture-in-picture (PIP) mode, or the like. In the first mode, the display device 200 may display different windows in the upper and lower layers, respectively, wherein the window located in the upper layer is in a non-full screen state (i.e., a small window state), and the window located in the lower layer is in a full screen state. The upper and lower layers correspond to window levels. In one example, the window level of the window located in the upper layer is higher than the window level of the window located in the lower layer, that is, the window with a higher window level is displayed over the window with a lower window level.

[0095] In some embodiments, the multi-window mode may include a second mode, which may also be referred to as a split-screen mode, a freeform mode, etc. In the second mode, the display device 200 may display two windows on the same layer, wherein the two windows correspond to the same window level and there is no overlap between the two windows.

[0096] Whether the display device 200 can support the multi-window mode is subject to multiple restrictions.

[0097] On the one hand, the display device 200 is subject to its own limitations. The display device 200 needs to configure the system parameters and turn on the native switch of the multi-window mode to support the multi-window mode. For example, the display device 200 can only support the first mode when the system feature of the first mode (such as PiP mode) is turned on; the display device 200 can only support the second mode (such as split-screen mode) when the multi-window config is configured to true; the display device 200 can only support the second mode (such as free window mode) when the developer option turns on the free window mode.

[0098] On the other hand, the display device 200 is subject to restrictions on applications. Only applications that have previously declared support for multi-window mode, that is, only applications themselves support multi-window mode, can the display device 200 use the application in multi-window mode. For example, the application supports multi-window mode only when the (resizeableActivity) corresponding to the application page (activity) associated with the application is set to true. In addition, the application must declare support for multi-window mode (such as support for PiP mode supports Picture-In-Picture mode) in the manifest file before the display device 200 can use the application in multi-window mode.

[0099] It can be seen that if the display device 200 does not pre-configure the system parameters to turn on the multi-window mode switch, the user will not be able to use the multi-window mode. Moreover, if the application itself does not support the multi-window mode, the display device 200 will not be able to use these applications in the multi-window mode.

[0100] In order to solve the above problems, an embodiment of the present application provides a display device 200, which can support multi-window mode without being restricted by its own native switch for turning on multi-window mode or whether the application itself supports multi-window mode.

[0101] In some embodiments, as Figure 3 The operating system shown in the figure has a control application (Control APP) configured in the application layer of the operating system. The display device 200 can implement an unlimited multi-window mode based on the control application. The control application can be a native application of the display device 200 and is started together with the display device 200 when it is turned on.

[0102] The operating system framework layer includes system services (SystemServer) and a system interface (SystemUI). System services include the Activity Manager (AM) and the Windows Manager (WM) services, while the system interface includes the Windows Manager Shell (wmshell). These services and the system interface provide interfaces for control applications, enabling them to implement unlimited multi-window modes.

[0103] In the embodiment of the present application, the display device 200 displays the first window before entering the multi-window mode, and displays the first page in the first window. The first window is in full screen state, that is, the display device 200 displays the first page in full screen.

[0104] In some embodiments, the first page may be the system main interface (Launcher) of the display device 200 , or may be an application page of a native application of the display device 200 , or may be an application page of a third-party application.

[0105] The process of displaying multiple applications in the multi-window mode by the display device 200 is described in detail with reference to the following embodiments.

[0106] Example 1

[0107] Figure 4 The display device 200 provided in the embodiment of the present application displays a flowchart of multiple applications in the first mode. Figure 4 The specific steps are as follows:

[0108] Step S401 : in response to a user instruction to start a first application, a second window is displayed on top of the first window, and a second page of the first application is displayed in the second window.

[0109] The first application is an application that the user wants to open. The first application may be a native application of the display device 200 or any third-party application.

[0110] The second window is used to display the page content of the second page, and the second page is an application page associated with the first application.

[0111] The display device 200 configures the window level of the second window to be higher than the window level of the first window. Thus, the display device 200 can display the second window on an upper layer of the first window so that the user can view the application page of the first application.

[0112] In some embodiments, the display device 200 is configured to display the single window in full screen mode by default when starting an application in normal mode (i.e., single window mode). Thus, the second window is in full screen mode, i.e., the first application is displayed in full screen mode.

[0113] The full-screen state indicates that the entire visible area of the screen can be used to display the window.

[0114] Figures 5A-5C FIG. 1 is a schematic diagram of interaction of the display device 200 displaying multiple applications in the first mode.

[0115] like Figure 5A As shown, the display device 200 displays the first page in the first window 51, and the first window 51 is in full screen state. The display device 200 responds to the user's instruction to start the first application, such as Figure 5BAs shown, a second window 52 is displayed on top of the first window 51, and the second page of the first application is displayed in the second window 52, wherein the second window 52 is also in full screen mode. At this time, the second window 52 is displayed over the first window 51, so the user can only see the second page and cannot see the first page.

[0116] Figure 6 The flowchart of the display device 200 starting the first application provided in the embodiment of the present application. Figure 6 The specific steps are as follows:

[0117] Step S601 : in response to a user instruction to start a first application, create a first task stack corresponding to the first application, and monitor the first task stack corresponding to the first application through a monitoring service.

[0118] When the display device 200 starts an application, it will create a corresponding task stack (Task) for the application. The task stack includes the application page activity associated with the corresponding application, and manages these application pages through the task stack to ensure the normal operation of the application.

[0119] Based on this, the display device 200 creates a corresponding first task stack for the first application in response to the instruction to start the first application, and manages the application pages associated with the first application through the first task stack. The application pages associated with the first application include the second page to be displayed in the second window.

[0120] In some embodiments, the display device 200 may be configured to register a monitoring service upon startup, the monitoring service being used to monitor the status of a task stack. The task stack status includes an Appeared state and a Vanished state. If the monitoring service detects that a task stack has been created, it can be determined that the corresponding application has been started; if the monitoring service detects that a task stack has been vanished, it can be determined that the corresponding application has been exited.

[0121] In one example, the ShellTaskOrganizer service registers a listening service (ITaskOrganizer) with the TaskOrganizerController service in the system service.

[0122] Step S602: When the monitoring service monitors that the first task stack has been created, a first window container associated with the first task stack is created.

[0123] The display device 200 monitors the creation of the first task stack through the monitoring service, indicating that the first application has been started and the application page of the first application can be displayed. When displaying the second window corresponding to the first application, it is necessary to limit the visible area of the second window on the screen and the window hierarchy of the second window. In this way, the second window of a specified size can be displayed at a specified position on the screen, and the effect of the second window being visible / invisible to the user can be achieved.

[0124] The window container corresponds to the application and is used to accommodate the application windows associated with the corresponding application, wherein each application window corresponds to an application page associated with the application. The window container is used to define the window properties of each application window contained therein. The window properties may include the visible area and window level of the window on the screen. In other words, the area displayed on the screen by the application window in the window container cannot exceed the visible area defined by the window container, and the window level of the application window in the window container is consistent with the window level defined by the window container. It can be seen that the window container can define the size, position and window level of the application window from the underlying logic.

[0125] Based on this, after starting the first application, a first window container associated with the first task stack is created, so as to define window properties of each application window associated with the first application through the first window container, thereby constraining the display effect of each application window.

[0126] The first window container associated with the first task stack means that the first window container is used to accommodate application windows associated with each application page in the first task stack. Since the application page includes the second page, the first window container accommodates the second window associated with the second page. Among them, the accommodation relationship between the window container and each application window can be achieved through mounting. By mounting each application window under the first window container, a superior-subordinate relationship between the window container and the application window can be formed, where the mounted object (window container) is the superior and the mounter (application window) is the subordinate. The subordinate is restricted by the superior. For example, the window properties of the application window cannot exceed the window properties defined by the window container.

[0127] In some embodiments, a surface controller can be used to manage container parameters of corresponding window containers. Each window container corresponds to a surface controller, and different window containers correspond to different surface controllers. The display device 200 can modify the container parameters of the corresponding window container through the surface controller. In some embodiments, the container parameters may include the visible area defined by the window container, the window hierarchy, etc.

[0128] Based on this, the display device 200 can be configured to, after creating a window container corresponding to a task stack, generate a surface controller corresponding to the window container, and further establish a mapping relationship between the task stack and the surface controller. In this way, when displaying an application, the display device 200 can quickly obtain the surface controller that has a mapping relationship with the task stack corresponding to the application, and then use the surface controller to manage the window properties defined by the corresponding window container. Since the window container accommodates the application windows associated with the application, it can achieve the effect of adjusting the window properties of each application window.

[0129] The display device 200 can manage the mapping relationship between the task stack of each launched application and the surface controller in the form of a mapping relationship list. Specifically, after the display device 200 monitors the creation of a task stack through the monitoring service, it creates a mapping relationship between the task stack and the corresponding surface controller and writes the mapping relationship into the mapping relationship list. After the display device 200 monitors the deregistered task stack through the monitoring service, it deletes the mapping relationship corresponding to the task stack from the mapping relationship list.

[0130] In some embodiments, the display device 200 stores a task stack list, which includes the package name of the application that has created the task stack and a task stack identifier (task ID), wherein the task stack identifier is used to uniquely identify the corresponding task stack.

[0131] After the display device 200 monitors the created task stack through the monitoring service, it obtains the package name of the corresponding application, generates a task stack identifier for identifying the task stack, and writes the package name and task stack identifier of the application corresponding to the task stack into the task stack list.

[0132] After the display device 200 monitors the deregistered task stack through the monitoring service, it deletes the package name and task stack identifier of the application corresponding to the task stack from the task stack list.

[0133] Step S603: Set the visible area defined by the first window container to the entire visible area of the screen, and set the window level defined by the first window container to the top level.

[0134] The visible area defined by the first window container is set to the entire visible area of the screen. Thus, the maximum visible area of each application window contained in the first container window on the screen is the entire visible area of the screen, that is, the application window where the first application is located can be in full screen mode.

[0135] The window level defined by the first window container is set to the top level. Thus, the window levels of all application windows contained in the first container window are all at the top level. That is, the application window where the first application is located is displayed at the top level.

[0136] Step S604: Determine the second page to be displayed in the first task stack.

[0137] In one example, the second page may be an application page that is displayed by default after the first application is started.

[0138] In one example, the second page may be the application page displayed when the first application was last exited.

[0139] Step S605: Display the second window on the top layer according to the entire visible area of the screen, and display the second page in the second window.

[0140] After determining the second page to be displayed, the second window associated with the second page is displayed according to the window properties (the entire visible area and top layer of the screen) defined by the first window container, and the second page is displayed in the second window.

[0141] Therefore, when the display device 200 starts the first application, the second window can be displayed in full screen by setting the visible area defined by the first container window to the entire visible area on the screen, and the window level defined by the first container window can be set to the top layer so that the second window is displayed on the upper layer of the first window.

[0142] Step S402 : In response to a user instruction to enter the multi-window mode, if the multi-window mode is the first mode, create a first task stack corresponding to the first application, and monitor the first task stack through a pre-registered monitoring service.

[0143] In some embodiments, the control application may provide an entry to the multi-window mode, and the user may input an instruction to enter the multi-window mode based on the entry to the multi-window mode. For example, the entry may be configured in a shortcut menu, a system settings menu, a sidebar, etc.

[0144] In some embodiments, a designated key may be provided on the control device 100, and a key value of the designated key is mapped to the multi-window mode. The user may input an instruction to enter the multi-window mode based on the designated key.

[0145] In some embodiments, in response to a user instruction to enter the multi-window mode, the display device 200 may display selection information to allow the user to indicate the multi-window mode (the first mode or the second mode) to be entered.

[0146] In the first embodiment, a user instruction to enter the first mode is taken as an example for specific description.

[0147] In an embodiment of the present application, the display device 200 is configured to determine the application currently displayed on the top layer as the application displayed in the small window, that is, the window where the application currently displayed on the top layer is located needs to be adjusted. In an embodiment of the present application, the second window also needs to be adjusted.

[0148] The display device 200 is configured to, when entering the multi-window mode, recreate the first task stack corresponding to the first application to trigger the monitoring service to monitor the appearance of the first task stack, and then trigger the onTaskAppeared callback to obtain the relevant objects and information used to implement the first mode.

[0149] In one example, the display device 200 may recreate the first task stack when the first application is restarted by restarting the first application.

[0150] The process of the display device 200 monitoring the first task stack through the pre-registered monitoring service can be referred to step S601 and will not be described in detail here.

[0151] Figure 7 This is a timing diagram of the display device 200 provided in an embodiment of the present application displaying multiple applications in the first mode.

[0152] Combine Figure 7 When the display device 200 is powered on, it starts the control application Controller APP and the system interface SystemUI. After the system interface is started, the monitoring service is registered with the system service through the system interface.

[0153] Step S403: When the monitoring service monitors that the first task stack has been created, window information for adjusting the second window is generated.

[0154] Adjusting the second window, that is, reducing the size of the second window and adjusting the position of the second window displayed on the screen. In the first mode, the small window needs to be displayed on the top layer, so there is no need to adjust the window level of the second window.

[0155] Figure 8 The flowchart of the display device 200 provided in the embodiment of the present application determining the window information for adjusting the second window. Figure 8 The specific steps are as follows:

[0156] Step S801: When the monitoring service monitors that the first task stack has been created, a task stack list is obtained.

[0157] The process of the display device 200 managing the task stack list can be referred to step S602 and will not be described in detail here. It can be understood that the acquired task stack list includes the package name of the first application and the task stack identifier corresponding to the first task stack.

[0158] like Figure 7 As shown, the display device 200 starts the first application and creates a first task stack corresponding to the first application in response to the instruction to enter the first mode by controlling the application. After the display device 200 monitors the creation of the first task stack through the monitoring service in the system service, it can trigger the onTaskAppeared callback. The system service writes the package name of the first application and the task stack identifier corresponding to the first task stack into the task stack list, and calls back the updated task stack list to the system interface through the specified interface of the AM service (such as the getRunningTaskInfo interface), and then the system interface passes the updated task stack list to the control application.

[0159] Step S802: Determine the task stack identifier corresponding to the first task stack from the task stack list according to the package name of the first application.

[0160] The task stack identifier corresponding to the first task stack is determined, so that the first task stack can be subsequently determined based on the task stack identifier corresponding to the first task stack, and the first window container and the first surface controller associated with the first task stack can be further determined.

[0161] like Figure 7 As shown, in response to the user's instruction to enter the first mode, the control application can determine the first application to enter the first mode and further determine the package name of the first application. After obtaining the task stack list, the control application can determine the task stack identifier corresponding to the first task stack based on the package name of the first application.

[0162] Step S803: Generate window information according to the task stack identifier corresponding to the first task stack and the default window attributes.

[0163] When entering the first mode, the display device 200 may generate window information according to the window attributes configured for the first mode (default window attributes).

[0164] In one example, the default window attributes may include a default window size, a default window ratio, a default position on the screen, a window level being the top level, and the like.

[0165] Based on the default window attributes and the area information of the entire visible area of the screen, adjustment information of the second window may be generated, such as the window zoom ratio, zoom direction, movement direction, movement distance, adjusted window size, and adjusted window position on the screen.

[0166] In an example, the window information may include: a task stack identifier corresponding to the first task stack, a window horizontal scaling ratio, a window vertical scaling ratio, and a window horizontal and vertical offset (x, y).

[0167] like Figure 7 As shown, after the control application generates window information, it transmits the window information to the system interface.

[0168] In some embodiments, the control application can encapsulate the task stack identifier and adjustment information corresponding to the first task stack into a Parcel object and pass it together to the system interface. The control application can also pass the task stack identifier and adjustment information corresponding to the first task stack to the system interface via an IPC communication mechanism such as Messenger, broadcast, or AIDL.

[0169] Therefore, after monitoring that the first task stack has been recreated, the display device 200 can generate corresponding window information for the first task stack in a targeted manner, and further can adjust the second window in a targeted manner.

[0170] Step S404 : adjusting the visible area defined by the first window container associated with the first task stack from the entire visible area of the screen to the first visible area according to the window information.

[0171] Since the visible area defined by the first window container is used to limit the visible area of each application window associated with the first application on the screen, by adjusting the visible area defined by the first window container, the size and position of each application window on the screen can be adjusted.

[0172] The first visible area is a partial visible area of the entire visible area of the screen.

[0173] Figure 9 The flowchart of the display device 200 adjusting the first window container provided in the embodiment of the present application. Figure 9 The specific steps are as follows:

[0174] Step S901: Obtain a pre-stored mapping relationship list.

[0175] The process of the display device 200 managing the mapping relationship list through the system interface can be referred to step S603, which is not described here in detail.

[0176] like Figure 7 As shown, after the display device 200 monitors the creation of the first task stack through the monitoring service in the system service, it can trigger the onTaskAppeared callback. After the system service creates the first window container and generates the first surface controller corresponding to the first window container, it calls back the first task stack and the first surface controller to the system interface. The system interface creates a mapping relationship between the first task stack and the first surface controller and writes the mapping relationship into the mapping relationship list. The updated mapping relationship list is the pre-stored mapping relationship list to be obtained.

[0177] Step S902: Obtain the first surface controller corresponding to the first task stack according to the mapping relationship list.

[0178] In one example, based on step S803, the display device 200 may determine the first task stack based on the task stack identifier corresponding to the first task stack included in the window information. Furthermore, the display device 200 may determine the mapping relationship corresponding to the first task stack from the mapping relationship list, and obtain the first surface controller corresponding to the first task stack based on the mapping relationship.

[0179] like Figure 7 As shown, the system interface determines the first task stack based on the task stack identifier corresponding to the first task stack in the window information, and further obtains the first surface controller corresponding to the first task stack based on the mapping relationship list.

[0180] Thus, the display device 200 manages the mapping relationship between the task stack and the surface controller corresponding to each launched application through the mapping relationship list. After determining the window information for adjusting the second window, the display device 200 can determine the first surface controller for managing the first window container based on the mapping relationship list, thereby adjusting the visible area defined by the first window container through the first surface controller.

[0181] Step S903 : According to the window information, the visible area defined by the first window container is adjusted from the entire visible area of the screen to the first visible area through the first surface controller.

[0182] The display device 200 may reduce the visible area defined by the first window container from the entire visible area of the screen to the first visible area based on the size information in the window information, and define the position of the first visible area at a first position on the screen based on the position information in the window information.

[0183] Thus, the display device 200 can reduce the visible area defined by the first window container and modify the position of the visible area defined by the first window container on the screen, thereby reducing the second window in the first window container and displaying the second window at the adjusted position.

[0184] Step S405: Display the second window on top of the first window in full screen mode according to the first visible area.

[0185] In some embodiments, the display device 200 may construct an image composition object (such as SurfaceControl.Transaction) or a window container composition object (such as WindowContainer.Transaction) corresponding to the first visible area based on the first surface controller to control the adjustment of window properties of the second window.

[0186] like Figure 7 As shown, the system interface constructs an image synthesis object, and adjusts the second window by applying the constructed image synthesis object to enter the first mode.

[0187] like Figure 5C As shown, the display device 200 can reduce the second window 52 in response to the instruction to enter the first mode, and display the reduced second window 52 in the upper right corner of the screen.

[0188] Thus, the display device 200 can pre-register a monitoring service for monitoring the task stack. When entering the first mode, by creating the first task stack of the first application, when the monitoring service detects that the first task stack has been created, it can trigger the modification of the visible area defined by the first window container. This is equivalent to bypassing the application and directly adjusting the window properties from the underlying logic to achieve rendering of the corresponding window. There is no need for the display device 200 to pre-configure system parameters to enable the first mode, and it is not limited by the application's own support for the first mode.

[0189] In some embodiments, the display device 200 may adjust the position of the second window on the screen and / or adjust the size / ratio of the second window in response to a user's instruction to adjust the second window.

[0190] The display device 200 modifies the visible area defined by the first window container by modifying the container parameters of the first window container, thereby achieving the effect of adjusting the second window. This process can be referred to steps S404-S405 and steps S901-S903, which will not be repeated here.

[0191] In some embodiments, the display device 200 may exit the first mode when the monitoring service detects that the first task stack has been deregistered. Figure 7 As shown, the display device 200 monitors the deregistered first task stack through the monitoring service in the system service, triggering onTaskVanished to feedback to the system interface that the first task stack is deregistered. Based on this result, the system interface deletes the mapping relationship between the first task stack and the first surface controller from the mapping relationship list and sends a notification to the control application that the first application has been exited. The control application exits the first mode based on this notification.

[0192] In some embodiments, after exiting the first mode, the display device 200 may resume displaying the second window in full screen mode, or close the second window and display the first window in full screen mode.

[0193] Example 2

[0194] Figure 10The display device 200 provided in the embodiment of the present application displays a flow chart of multiple applications in the second mode. Figure 10 The specific steps are as follows:

[0195] Step S1001, in response to the user's instruction to enter the multi-window mode, if the multi-window mode is the second mode, obtain the total number N of split-screen areas indicated by the user, and the N split-screen applications indicated by the user to be used in the second mode, where N is an integer greater than or equal to 2.

[0196] The user's instruction to enter the second mode includes the total number N of split-screen areas.

[0197] For example, the user indicates the second mode and further indicates the three-split screen mode. Accordingly, the total number N of split screen areas is 3.

[0198] The user's instruction to enter the second mode includes N split-screen applications used in the second mode. The N split-screen applications may include or exclude the second application to which the first page belongs. The total number of split-screen applications is equal to the total number of split-screen areas.

[0199] In some embodiments, the user may indicate the correspondence between N split-screen applications and N split-screen areas in the instruction for entering the second mode.

[0200] Step S1002: Create a task stack corresponding to the split-screen application, and call the multi-window interface to call the task management controller through the multi-window interface to create N root task containers.

[0201] The process of the display device 200 creating a task stack corresponding to the split-screen application can refer to the process of creating the first task stack in Example 1, which is not repeated here. The task stack corresponding to the split-screen application includes the application page associated with the split-screen application.

[0202] Each root task container (Root Task) corresponds to a split-screen area, and different root task containers correspond to different split-screen areas. The root task container is used to define the visible area on the screen for the windows contained in the root task container, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area. In other words, the root task container is used to constrain the visible area on the screen of the application windows it contains so that the application windows it contains match the corresponding split-screen area.

[0203] In an embodiment of the present application, the display device 200 adds a multi-window interface and defines the multi-window interface to call a task organizer controller. The task organizer controller is used to create a root task container. Thus, the display device 200 can directly call the task organizer controller to create a root task container by calling the multi-window interface.

[0204] Figure 11 The flowchart of the display device 200 creating a root task container provided by the embodiment of the present application. Figure 11 The specific steps are as follows:

[0205] Step S1101 : Calculate the region information of the visible area of each split-screen region on the screen according to the total number N of split-screen regions.

[0206] In some embodiments, the region information may include position information of the split-screen region on the screen, the size of the split-screen region, etc.

[0207] In an example, the display device 200 may calculate the region information of the visible area of each split screen region on the screen by evenly dividing the entire visible area of the screen according to the total number N of split screen regions.

[0208] In another example, the display device 200 may calculate the area information of the visible area of each split-screen area on the screen according to the split-screen strategy corresponding to the total number of split-screen areas N. For example, the split-screen strategy for a quad split screen is to display in two rows, with the upper row being evenly divided to form three split-screen areas, and the lower row corresponding to the remaining split-screen area.

[0209] In yet another example, the display device 200 may determine corresponding area information based on a split-screen area customized by a user.

[0210] In some embodiments, after the display device 200 determines the region information corresponding to each split-screen region, it can add an identifier for indicating the corresponding split-screen region to the region information.

[0211] Step S1102 : calling the multi-window interface to call the task management controller through the multi-window interface to create a corresponding root task container according to the region information.

[0212] The size of the visible area defined by the corresponding root task container is set according to the size information in the area information, and the position of the visible area defined by the corresponding root task container on the screen is set according to the position information in the area information.

[0213] In some embodiments, the task management controller may create a root task container using a task container constructor (such as Task.Builder), and may set the size and position of the visible area defined by the root task container according to the area information by calling a resize method.

[0214] Figure 12 This is a timing diagram of the display device 200 provided in an embodiment of the present application displaying multiple applications in the second mode.

[0215] like Figure 12 As shown, the display device 200 responds to the user's instruction to enter the second mode by controlling the application, starts N split-screen applications, and sends an instruction to the system interface to create a root task container. In response to the instruction, the system interface calculates the area information of the split-screen area according to the total number N of split-screen areas and adds corresponding marks. The system interface adds a multi-window interface, which can call the task management controller in the system service through the multi-window interface, so that the task management controller can use the task container constructor ( Figure 12 (not shown) constructs N root task containers. After the task container constructor constructs N root task containers, the task management controller calls the resize method to set the visible area defined by each root task container according to the area information, completing the creation of N root task containers. After completing the creation of N root task containers, the system service sends a notification to the system interface, and the system interface passes the notification to the control application.

[0216] Therefore, the display device 200 creates a root task container according to the area information of the corresponding split-screen area through the task management controller, which can effectively ensure that the application windows contained in the root task container are displayed in the corresponding split-screen area, thereby ensuring the split-screen effect between multiple split-screen applications.

[0217] Step S1003: Mount the application window associated with each application page in the task stack to the corresponding root task container.

[0218] By adjusting the mounting relationship between the application window and the upper-level mountee, the application window associated with the split-screen application is mounted under the corresponding root task container. After adjusting the mounting relationship, the visible area of the application window of the split-screen application on the screen will be adjusted to be constrained by the visible area defined by the root task container, that is, the application window of the split-screen application will match the corresponding split-screen area.

[0219] like Figure 12As shown, after receiving the notification that the root task container has been created, the control application obtains the task stack identifier corresponding to each split-screen application (the process of obtaining the task stack identifier in Example 1 can be referred to, which is not repeated here), and sends an instruction to enter the second mode to the system interface. The system interface calls the AM interface of the system service to mount the application window associated with the task stack corresponding to the task stack identifier to the corresponding root task container.

[0220] Step S1004: adjust the application window corresponding to the corresponding split-screen application according to the visible area defined by the root task container, display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window.

[0221] The visible area defined based on the root task container can effectively constrain the visible area of the contained application window on the screen, thereby achieving a split-screen effect.

[0222] Figures 13A and 13B The display device 200 provided by the embodiment of the present application displays an interaction diagram of multiple applications in the second mode.

[0223] like Figure 13A As shown, the display device 200 displays the first window 131 in full screen and displays the first page in the first window 131. The display device 200 responds to the user's instruction to enter the second mode, such as the instruction to enter the four-split screen mode, and indicates four split-screen applications, including the second application to which the first page belongs, and also including application A, application B and application C. The display device 200 calculates the area information corresponding to each split-screen area based on the total number N of split-screen areas being 4, taking the display device 200 as an example of dividing the entire visible area of the screen evenly, and calls the task management controller through the multi-window interface to create four root task containers (such as root task container a, root task container b, root task container c and root task container d), and sets the visible area defined by each root task container based on the calculated area information. After creating the four root task containers, the application windows associated with the second application, application A, application B and application C are respectively mounted under the corresponding root task containers. For example, if the application window associated with the second application is mounted under the root task container a, the application window associated with application A is mounted under the root task container b, the application window associated with application B is mounted under the root task container c, and the application window associated with application C is mounted under the root task container d, if the visible area defined by the root task container a is the upper left corner of the screen, the visible area defined by the root task container b is the upper right corner of the screen, the visible area defined by the root task container c is the lower left corner of the screen, and the visible area defined by the root task container d is the lower right corner of the screen, Figure 13BAs shown, the second application is displayed in the upper left corner of the screen, application A is displayed in the upper right corner of the screen, application B is displayed in the lower left corner of the screen, and application C is displayed in the lower right corner of the screen.

[0224] Thus, when the display device 200 enters the second mode, it can directly call the task management controller for creating a root task container through the multi-window interface to create root task containers corresponding to multiple split-screen areas. Then, by mounting the application windows corresponding to the multiple split-screen applications under different root task containers, the application windows of the multiple split-screen applications can be displayed in split screens on the screen by using the root task container's function of limiting the visible area of the windows within it. It can be seen that there is no need for the display device 200 to pre-configure system parameters to enable the second mode switch, and it is not limited by the application's own support for the second mode.

[0225] Example 3

[0226] Based on Example 1, in the first mode, the user can split the first window located in the lower layer to enter the third mode, that is, display multiple split-screen applications in the lower layer and display a second window in a non-full-screen state in the upper layer.

[0227] Figure 14 The display device 200 provided in the embodiment of the present application displays a flow chart of multiple applications in the third mode. Figure 14 The specific steps are as follows:

[0228] Step S1401, in response to the user's instruction to enter the multi-window mode, if the multi-window mode is the third mode, obtain the total number M of split-screen areas indicated by the user, and the M split-screen applications indicated by the user to be used in the third mode, where M is an integer greater than or equal to 2.

[0229] In response to a user's control instruction, the display device 200 obtains focus on the first window. When the first window obtains focus, the display device 200 may enter the third mode in response to a user's instruction to enter the third mode. The instruction to enter the third mode is similar to the instruction to enter the second mode.

[0230] Step S1401 may refer to step S1001 and will not be described in detail here.

[0231] Step S1402: Create a task stack corresponding to the split-screen application, and call the multi-window interface to call the task management controller through the multi-window interface to create M root task containers.

[0232] The task stack corresponding to a split-screen application includes the application pages associated with the split-screen application. Each root task container corresponds to a split-screen area. The root task container is used to define the window hierarchy of the windows contained in the root task container and the visible area on the screen. The visible area defined by the root task container corresponds to the corresponding split-screen area, and the window hierarchy is located below the second window.

[0233] The main difference is that, in embodiment 3, the root task container needs to define a window level lower than the window level of the second window to ensure that the second window can maintain the first mode.

[0234] Step S1403: Mount the application window associated with each application page in the task stack to the corresponding root task container.

[0235] Step S1404: adjust the application window corresponding to the corresponding split-screen application according to the visible area defined by the root task container, display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window.

[0236] The adjusted application windows are displayed in the lower layer of the second window.

[0237] Steps S1403 to S1404 may refer to steps S1003 to S1004 and are not described in detail here.

[0238] Figure 15 Schematic diagram of an interface displaying multiple applications in the third mode provided by an embodiment of the present application. For example, if a user indicates a two-screen split, where the split-screen applications include application A and application B, display device 200 creates application window 151 and application window 152 below second window 52, with application A displayed in application window 151 and application B displayed in application window 152.

[0239] Therefore, in the first mode, the display device 200 can continue to perform split-screen operations in the lower layer of the second window to enter the third mode, and this split-screen operation does not require the display device 200 to pre-configure system parameters to turn on the split-screen mode switch, and will not be limited by the application's own support for the split-screen mode.

[0240] Example 4

[0241] Based on the first embodiment, the display device 200 may be configured with a multi-window mode switching function to implement switching between the first mode and the second mode.

[0242] Figure 16 Flowchart of the display device 200 switching multi-window mode provided in the embodiment of the present application. Figure 16The specific steps are as follows:

[0243] Step S1601 , in response to a mode switching instruction input by the user, calling a multi-window interface to call a task management controller through the multi-window interface to create two root task containers, each root task container corresponding to a split-screen area.

[0244] The root task container is used to define the visible area of the window contained in the root task container on the screen, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area;

[0245] Step S1601 may refer to step S1002 and will not be described in detail here.

[0246] In some embodiments, in response to the mode switching instruction, the display device 200 first identifies whether the first page is a designated page, such as a Launcher page, and if it is a designated page, the display device 200 terminates the mode switching.

[0247] Step S1602 : Acquire a first task stack corresponding to the first application and a second task stack to which the first page belongs.

[0248] The first task stack includes an application page associated with the first application, and the second task stack includes an application page associated with the application to which the first page belongs.

[0249] When the first application and the second application to which the first page belongs have been started, the task stacks corresponding to the two applications can be directly obtained.

[0250] Step S1603: Mount the application window associated with the application page in the first task stack and the application window associated with the application page in the second task stack to corresponding root task containers respectively.

[0251] Step S1604: Adjust the first window and the second window according to the visible area defined by the root task container, and display the adjusted first window and the second window in the corresponding split-screen area, and display the first page in the adjusted first window and the second page in the adjusted second window.

[0252] Steps S1603 to S1604 may refer to steps S1003 to S1004 and are not described in detail here.

[0253] Thus, the display device 200 can flexibly switch between the first mode and the second mode, and the display device 200 does not need to pre-configure system parameters to turn on the switches of the first mode and the second mode, and is not restricted by the application's own support for the first mode and the second mode.

[0254] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The above embodiments are selected and described to better explain the content of this disclosure, thereby enabling those skilled in the art to better use the embodiments.

Claims

1. A display device, characterized in that: include: The display is configured to: display a first window and a first page in the first window, wherein the first window is in a full-screen state; The controller is configured as: In response to a user instruction to start a first application, displaying a second window on top of the first window, and displaying a second page of the first application in the second window, wherein the second window is in a full-screen state; In response to a user instruction to enter a multi-window mode, if the multi-window mode is a first mode, creating a first task stack corresponding to the first application, and monitoring the first task stack through a pre-registered monitoring service, wherein the first task stack includes an application page associated with the first application, and the application page includes the second page; When the monitoring service monitors that the first task stack has been created, generating window information for adjusting the second window; adjusting, based on the window information, a visible area defined by a first window container associated with the first task stack from the entire visible area of the screen to a first visible area, the first window container including an application window corresponding to each application page, the application window including the second window, wherein the first window container is used to define a visible area of the application window on the screen; The display is controlled to display the second window in the upper layer of the first window in the full-screen state according to the first visible area.

2. The display device according to claim 1, wherein The controller, in response to a user instruction to start a first application, displays a second window on top of the first window, and displays a second page of the first application in the second window, and is specifically configured to: In response to an instruction from the user to start the first application, creating the first task stack corresponding to the first application, and monitoring the first task stack corresponding to the first application through the monitoring service; When the monitoring service monitors that the first task stack has been created, creating the first window container associated with the first task stack; Setting the visible area defined by the first window container to the entire visible area of the screen, and setting the window level defined by the first window container to the top level; determining the second page to be displayed in the first task stack; The display is controlled to display the second window at the top layer according to the entire visible area of the screen, and the second page is displayed in the second window.

3. The display device according to claim 1, wherein When the monitoring service monitors that the first task stack has been created, the controller generates window information for adjusting the second window, and is specifically configured as follows: When the monitoring service monitors that the first task stack has been created, obtaining a task stack list, the task stack list including the package name of the application that has created the task stack and the task stack identifier, the task stack identifier being used to uniquely identify the corresponding task stack, wherein the application list includes the package name of the first application and the task stack identifier of the first task stack; Determining, from the task stack list according to the package name of the first application, a task stack identifier corresponding to the first task stack; The window information is generated according to the task stack identifier corresponding to the first task stack and default window attributes.

4. The display device according to claim 3, wherein The controller adjusts the visible area defined by the first window container associated with the first task stack from the entire visible area of the screen to the first visible area, and is specifically configured to: Obtaining a pre-stored mapping relationship list, the mapping relationship list including mapping relationships between task stacks and surface controllers, the mapping relationships being stored when the monitoring service monitors the creation of a task stack, wherein the surface controller is used to manage container parameters of a window container associated with the corresponding task stack, the container parameters including a visible area defined by the window container; According to the mapping relationship list, obtaining a first surface controller corresponding to the first task stack; According to the window information, the visible area defined by the first window container is adjusted from the entire visible area of the screen to the first visible area through the first surface controller.

5. The display device according to claim 1, wherein The controller adjusts the visible area defined by the first window container associated with the first task stack from the entire visible area of the screen to the first visible area according to the window information, and is specifically configured to: reducing the visible area defined by the first window container from the entire visible area of the screen to the first visible area according to the size information in the window information; And, according to the position information in the window information, the position of the first visible area is defined as a first position of the screen.

6. The display device according to claim 1, wherein When the display displays a first window and displays a first page in the first window, the controller is further configured to: In response to a user instruction to enter the multi-window mode, if the multi-window mode is the second mode, obtaining a total number N of split-screen areas indicated by the user and N split-screen applications indicated by the user for use in the second mode, where N is an integer greater than or equal to 2; Creating a task stack corresponding to the split-screen application, and calling a multi-window interface to call a task management controller through the multi-window interface to create N root task containers, wherein the task stack corresponding to the split-screen application includes an application page associated with the split-screen application, each of the root task containers corresponds to a split-screen area, and the root task container is used to define a visible area on the screen for a window contained in the root task container, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area; Mounting the application window associated with each application page in the task stack to the corresponding root task container; Control the display to adjust the application window corresponding to the split-screen application according to the visible area defined by the root task container, display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window.

7. The display device according to claim 6, wherein: The controller creates a task stack corresponding to the split-screen application and calls a multi-window interface to call a task management controller through the multi-window interface to create N root task containers. The controller is specifically configured as follows: Calculating, according to the total number N of the split-screen areas, area information of a visible area of each of the split-screen areas on the screen; Calling the multi-window interface to call the task management controller through the multi-window interface to create the corresponding root task container according to the area information; The size of the visible area defined by the corresponding root task container is set according to the size information in the area information, and the position of the visible area defined by the corresponding root task container in the screen is set according to the position information in the area information.

8. The display device according to any one of claims 1 to 5, characterized in that: After the controller controls the display to display the second window in the first visible area on an upper layer of the first window in a full-screen state, the controller is further configured to: In response to a user instruction to enter a multi-window mode, if the multi-window mode is a third mode, obtaining a total number M of split-screen areas indicated by the user and M split-screen applications indicated by the user for use in the third mode, where M is an integer greater than or equal to 2; Creating a task stack corresponding to the split-screen application, and calling a multi-window interface to call a task management controller through the multi-window interface to create M root task containers, wherein the task stack corresponding to the split-screen application includes an application page associated with the split-screen application, each of the root task containers corresponds to a split-screen area, and the root task container is used to define a window hierarchy of windows contained in the root task container and a visible area on the screen, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area, and the window hierarchy is located below the second window; Mounting the application window associated with each application page in the task stack to the corresponding root task container; Control the display to adjust the application window corresponding to the corresponding split-screen application according to the visible area defined by the root task container, and display the adjusted application window in the corresponding split-screen area, and display the application page associated with the corresponding split-screen application in the adjusted application window, wherein each adjusted application window is displayed in the lower layer of the second window.

9. The display device according to any one of claims 1 to 5, characterized in that: After the controller controls the display to display the second window in the first visible area on an upper layer of the first window in a full-screen state, the controller is further configured to: In response to a mode switching instruction input by a user, calling a multi-window interface to call a task management controller through the multi-window interface to create two root task containers, each of the root task containers corresponding to a split-screen area, the root task container being used to define a visible area on the screen of a window contained in the root task container, wherein the visible area defined by the root task container corresponds to the corresponding split-screen area; Obtaining the first task stack corresponding to the first application and the second task stack to which the first page belongs, wherein the first task stack includes an application page associated with the first application, and the second task stack includes an application page associated with the application to which the first page belongs; Mounting the application window associated with the application page in the first task stack and the application window associated with the application page in the second task stack to the corresponding root task container respectively; Control the display to adjust the first window and the second window according to the visible area defined by the root task container, and display the adjusted first window and second window in the corresponding split-screen area, and display the first page in the adjusted first window and the second page in the adjusted second window.

10. A multi-window display method, characterized in that: Applied to a display device, the display device displays a first window and a first page in the first window, wherein the first window is in a full-screen state; The method comprises: In response to a user instruction to start a first application, displaying a second window on top of the first window, and displaying a second page of the first application in the second window, wherein the second window is in a full-screen state; In response to a user instruction to enter a multi-window mode, if the multi-window mode is a first mode, creating a first task stack corresponding to the first application, and monitoring the first task stack through a pre-registered monitoring service, wherein the first task stack includes an application page associated with the first application, and the application page includes the second page; When the monitoring service monitors that the first task stack has been created, generating window information for adjusting the second window; adjusting, based on the window information, a visible area defined by a first window container associated with the first task stack from the entire visible area of the screen to a first visible area, the first window container including an application window corresponding to each application page, the application window including the second window, wherein the first window container is used to define a visible area of the application window on the screen; The display is controlled to display the second window in the upper layer of the first window in the full-screen state according to the first visible area.

Images