Display device and media asset playing method

Abstract

Embodiments of the invention show a display device and a media asset playing method, and relate to the field of media asset playing, the method comprising: in a case of displaying a multi-window page, in response to an instruction of switching a first window to a full-screen mode, changing the first window from a small-window state to a full-screen state, canceling display of a second window, and sending a play pause instruction to the second window, and recording the window change state as a multi-window to full-screen state. And under the condition that a return instruction is received, when the acquired window change state is from multiple windows to a full screen, changing the first window into a small window state, restoring to display the second window, and sending a media resource playing instruction to the second window. According to the embodiment of the invention, after the multiple windows enter the full-screen state, the page of the multiple windows can be directly returned by inputting the return instruction, multiple operations are not needed, and the operation path is shortened. Decoding pause operation is carried out on non-full-screen windows from multiple windows to a full screen, so that time consumption and operation are reduced, and the continuity of media resource playing is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a media playback method. Background Art

[0002] Multi-window mode allows users to simultaneously view or interact with multiple content sources on the same screen. This mode is ideal for those who want to browse other information or channels without disrupting the viewing experience of the main content. Multi-window mode displays multiple windows on the screen, each displaying media from different sources, such as TV signals, DLNA (Digital Living Network Alliance) push notifications, and Miracast projection.

[0003] In multi-window mode, full-screen controls can be displayed in each window. Users can enter single-window full-screen mode from multi-window mode by selecting full-screen controls. However, if the user wants to return to multi-window mode at this time, they need to re-enter multi-window mode by entering the multi-window application, which requires complex operations, resulting in a long operation path and low efficiency. Moreover, when switching from multi-window to full-screen state, the media resources in non-full-screen windows are disconnected from playback, resulting in the need to restart playback and re-project the screen when entering multi-window mode again, which takes a long time and extends the operation path. Summary of the Invention

[0004] Some embodiments of the present application provide a display device and media playback method. After a multi-window display enters full-screen mode, a return command can be entered to directly return to the multi-window page, shortening the user's operation path. When the multi-window display enters full-screen mode, decoding of non-full-screen windows is paused, eliminating the need to restart playback and screen casting when returning to the multi-window page, reducing time and operation, and improving the consistency of media playback.

[0005] In a first aspect, some embodiments of the present application provide a display device, including:

[0006] A display configured to display a user interface;

[0007] A controller is coupled to the display and is configured to:

[0008] In a case where a multi-window page is displayed, in response to a user inputting an instruction to switch a first window to a full-screen mode, the first window is changed from a small window state to a full-screen state, the multi-window page including a first window and a second window, the first window being used to display an image of a first media asset, and the second window being used to display an image of a second media asset;

[0009] canceling the display of the second window and sending a pause playback instruction to the second window to pause decoding of the image of the second media asset;

[0010] Record the window change state as multi-window to full-screen state;

[0011] When receiving a return instruction input by the user, obtain the window change state;

[0012] When the window change state is multi-window to full-screen state, change the first window from full-screen state to small-window state;

[0013] Resume displaying the second window, and send a media asset playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

[0014] The above technical solution has the following advantages or beneficial effects: After entering the full-screen state from multi-windows, by inputting a return instruction, it is possible to directly return to the multi-window page, shortening the user operation path. When changing from multi-windows to full-screen, the decoding operation of non-full-screen windows is paused, so that when returning to the multi-window page, there is no need to restart playback and screen mirroring, reducing the time consumption and operations and improving the continuity of media asset playback.

[0015] In some embodiments, after the controller executes recording the window change state as multi-window to full-screen state, it is further configured to:

[0016] When receiving a start multi-window application instruction input by the user, change the first window from full-screen state to small-window state;

[0017] Resume displaying the second window, and send a media asset playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

[0018] The above technical solution has the following advantages or beneficial effects: When changing from multi-windows to full-screen, the decoding operation of non-full-screen windows is paused. When restarting the multi-window application, there is no need to restart playback and screen mirroring, reducing the time consumption and operations and improving the continuity of media asset playback.

[0019] In some embodiments, after the controller executes recording the window change state as multi-window to full-screen state, it is further configured to: Mark the first window as the full-screen window;

[0020] After the controller executes resuming displaying the second window, it is further configured to:

[0021] Record the window change state as full-screen to multi-window state;

[0022] In response to a return instruction input by the user, obtain the window change state;

[0023] When the window changes from the full-screen state to the multi-window state, the first window marked as the full-screen window changes from the full-screen state to the small-window state;

[0024] Cancel the display of the second window, and send a pause-play instruction to the second window to pause the decoding of the image of the second media asset.

[0025] The above technical solution has the following advantages or beneficial effects: After entering the multi-window state from the full-screen state, the user can directly return to the single-window full-screen page by inputting a return instruction, shortening the user operation path.

[0026] In some embodiments, when the controller displays the multi-window page, it is further configured to:

[0027] Obtain the audio playback mode;

[0028] When the audio playback mode is mixed playback, control the audio output device to play the audio of the first media asset and the audio of the second media asset;

[0029] When the audio playback mode is single-tone playback, control the audio output device to play the audio of the first media asset or the audio of the second media asset.

[0030] The above technical solution has the following advantages or beneficial effects: Setting different audio playback modes can provide users with more choices of audio playback modes, meeting the users' audio playback needs.

[0031] In some embodiments, when the controller executes to obtain the audio playback mode, it is further configured to:

[0032] If the content sources of the first media asset and the second media asset are preset content sources, obtain the audio playback mode as mixed playback;

[0033] If the content source of the first media asset or the second media asset is not a preset content source, obtain the audio playback mode as single-tone playback.

[0034] The above technical solution has the following advantages or beneficial effects: According to the content resources of the media assets played in multiple windows, the audio playback mode can be quickly determined, facilitating subsequent control of the audio decoding of the media assets in different windows.

[0035] In some embodiments, when controlling the audio output device to play the audio of the first media asset and the audio of the second media asset, the controller executes to send a pause-play instruction to the second window to pause the decoding of the image of the second media asset, and is further configured to:

[0036] Send a pause-play instruction to the second window to pause the decoding of the image and audio of the second media asset;

[0037] The controller executes sending a media playback instruction to the second window to continue decoding the image of the second media, and is further configured to:

[0038] Send a media playback instruction to the second window to continue decoding the image and audio of the second media;

[0039] Control the audio output device to play the audio of the second media.

[0040] The above technical solution has the following advantages or beneficial effects: When playing the audio of multiple media simultaneously, while pausing the decoding of the media image, it is also necessary to pause the decoding of the media audio to avoid interference of the second media audio on the playback of the first media. When restoring the display of the multi-window page, while continuing to decode the media image, it is also necessary to continue decoding the media audio to meet the user's needs.

[0041] In some embodiments, in the case of controlling the audio output device to play the audio of the second media, the controller executes sending a pause playback instruction to the second window to pause decoding the image of the second media, and is further configured to:

[0042] Send a pause playback instruction to the second window to pause decoding the image and audio of the second media;

[0043] Send an audio playback instruction to the first window to start decoding the audio of the first media, and control the audio output device to play the audio of the first media.

[0044] The above technical solution has the following advantages or beneficial effects: In the case of playing the audio of the second media alone on the multi-window page, when the user wants to switch to the full screen of the first window, while pausing the decoding of the image and audio of the second media, it is also necessary to start decoding the audio of the first media to achieve audio-visual synchronization of the first media.

[0045] In some embodiments, the controller executes sending a media playback instruction to the second window to continue decoding the image of the second media, and is further configured to:

[0046] Send an audio pause instruction to the first window to pause decoding the audio of the first media;

[0047] Send a media playback instruction to the second window to continue decoding the image and audio of the second media;

[0048] Control the audio output device to play the audio of the second media.

[0049] The above technical solution has the following advantages or beneficial effects: When restoring the display of the multi-window page from the full screen page of the first window, while continuing to decode the image and audio of the second media, it is also necessary to pause decoding the audio of the first media to quickly restore to the original multi-window page audio playback mode.

[0050] In some embodiments, when the controller is displaying a multi-window page, it is further configured to:

[0051] Record the window change state as a multi-window state;

[0052] If a return instruction input by the user is received, obtain the window change state;

[0053] When the window change state is a multi-window state, exit the multi-window application.

[0054] The above technical solution has the following advantages or beneficial effects: The return instruction in this application is not just a switch between multi-window and single-window full screen, but performs different operations according to different window change states. Among them, when the window change state is a single state, the multi-window application can be directly exited.

[0055] In a second aspect, some embodiments of the present application provide a media asset playback method, including:

[0056] When displaying a multi-window page, in response to an instruction input by the user to switch the first window to full-screen mode, change the first window from the small-window state to the full-screen state. The multi-window page includes a first window and a second window. The first window is used to display the image of the first media asset, and the second window is used to display the image of the second media asset;

[0057] Cancel the display of the second window, and send a pause playback instruction to the second window to pause decoding the image of the second media asset;

[0058] Record the window change state as the multi-window to full-screen state;

[0059] When a return instruction input by the user is received, obtain the window change state; <s

[0060] When the window change state is the multi-window to full-screen state, change the first window from the full-screen state to the small-window state;

[0061] Restore the display of the second window, and send a media asset playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

[0062] The above technical solution has the following advantages or beneficial effects: After entering the full-screen state from the multi-window, the multi-window page can be directly returned by inputting a return instruction, shortening the user operation path. When changing from multi-window to full-screen, the non-full-screen window is paused for decoding, so that there is no need to restart and screen mirror when returning to the multi-window page, reducing the time consumption and operations, and improving the coherence of media asset playback.

[0063] The technical solution provided by the embodiments of the present application, after multiple windows enter the full-screen state, can directly return to the multi-window page by inputting a return instruction, without the user having to perform multiple operations to re-enter the multi-window page, shortening the user operation path. When changing from multiple windows to full screen, the non-full-screen windows are paused for decoding operations, so that when returning to the multi-window page, there is no need to restart the broadcast and screen mirroring, reducing the time consumption and operations, and improving the continuity of media asset playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0065] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application;

[0066] Figure 2 Schematic diagram of the hardware configuration of the display device provided by some embodiments of the present application;

[0067] Figure 3 Schematic diagram of the software configuration of the display device provided by some embodiments of the present application;

[0068] Figure 4 Timing diagram of a media asset playback method provided by some embodiments of the present application;

[0069] Figure 5 Flowchart of a media asset playback method provided by some embodiments of the present application;

[0070] Figure 6 Schematic diagram of a setting menu box provided by some embodiments of the present application;

[0071] Figure 7 Schematic diagram of a multi-window mode selection box provided by some embodiments of the present application;

[0072] Figure 8 Schematic diagram of the first multi-window page provided by some embodiments of the present application;

[0073] Figure 9 Schematic diagram of the second multi-window page provided by some embodiments of the present application;

[0074] Figure 10 Schematic diagram of a menu page provided by some embodiments of the present application;

[0075] Figure 11Schematic diagram of another multi-window mode selection box provided by some embodiments of the present application;

[0076] Figure 12 Schematic diagram of the third multi-window page provided by some embodiments of the present application;

[0077] Figure 13 Software architecture diagram of a multi-window application provided by some embodiments of the present application;

[0078] Figure 14 Schematic diagram of a full-screen page of the first window provided by some embodiments of the present application;

[0079] Figure 15 Schematic diagram of another setting page provided by some embodiments of the present application;

[0080] Figure 16 Timing diagram of another media asset playing method provided by some embodiments of the present application. Detailed implementation manners

[0081] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0082] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the implementation manners described next, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0083] The terms "first", "second", "third", etc. in the specification, claims and the above drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0084] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0085] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform the functions related to the element.

[0086] In the embodiments of the present application, the display device 200 generally refers to a device with the capabilities of screen display and data processing. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0087] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided in some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. Among them, the control device 100 is used to receive the operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0088] The mobile terminal 300 can be used as a control device to perform the human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 for data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and they can be connected and communicated through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0089] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running the application program for controlling the display device 200.

[0090] As Figure 1 also shown, the display device 200 also communicates with the server 400 for data communication through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0091] The display device 200 can provide a broadcast reception TV function, and can also additionally provide a smart network TV function with computer support functions, including but not limited to, network TV, smart TV, Internet Protocol TV (IPTV), etc.

[0092] Figure 2 For some embodiments of the present application Figure 1 is the hardware configuration block diagram of the display device 200.

[0093] In some embodiments, the display device 200 may include at least one of a tuner-demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0094] In some embodiments, the detector 230 is configured to collect signals of the external environment or for interacting with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0095] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is configured to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu control interface, and a user control UI interface, etc.

[0096] In some embodiments, the communication device 220 is a component for communicating with an external device or a server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0097] The communication device 220 can enable the display device 200 to communicate with an external device or a server 400 in a wireless or wired connection manner. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 20 (should be 200 here) with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device, or can indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0098] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0099] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0100] In some embodiments, the user may input a user command in the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0101] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200, or may be an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0102] In some embodiments, the user input interface 280 can be used to receive instructions from the user input.

[0103] To perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0104] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0105] The operating system can be divided into different modules or levels according to the functions implemented. For example, as Figure 3 shown, in some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviation "application layer"), the application framework layer (abbreviation "framework layer"), the system library layer, and the kernel layer.

[0106] In some embodiments, the application layer is used to provide services and interfaces for applications, so that the display device 200 can run the applications and interact with users based on the applications. At least one application can run in the application layer. These applications can be window programs, system setting programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementation, the application packages in the application layer are not limited to the above examples.

[0107] The application layer includes multi-window applications. The multi-window applications are used to display multiple windows and display images from different content sources in the multiple windows. The multi-window applications include UI components, and the UI components are used to display the multi-window interface and operation buttons.

[0108] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, and this center decides to let the applications in the application layer take actions. Through the API interface, the application can access the resources in the system and obtain the services of the system during execution.

[0109] As Figure 3 shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interface and interaction of the application. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface; the decoding manager is used to coordinate and control the decoding operations of the respective players corresponding to multiple windows for media assets. The resource manager is used to record the changes in the window state. The content providers include TV signals, DLNA push, and Miracast screen mirroring.

[0110] In some embodiments, the activity manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and backward movement of applications. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, the display window can be reduced, jittered, distorted, and displayed in a small window or full screen in a multi-window mode.

[0111] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is intended to achieve.

[0112] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 3 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0113] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0114] The multi-window mode is a function that allows users to view or operate multiple content sources on the same screen simultaneously. This mode is suitable for users who want to browse other information or channels without affecting the viewing experience of the main content. The multi-window mode can display multiple windows on the screen, and different windows can display media assets from different content sources. The content sources can be TV signals, DLNA push, and Miracast screen mirroring, etc.

[0115] In multi-window mode, full-screen controls can be displayed in each window. The user can enter single-window full-screen mode from multi-window mode by selecting the full-screen control. If the user presses the back button at this time, that is, inputs a return instruction, it will not return to multi-window mode but directly exit the multi-window application. If the user wants to return to multi-window mode again at this time, they need to enter the multi-window mode again by entering the multi-window application, which requires complex operations, resulting in a long operation path and low efficiency. Moreover, when switching from multi-window to full-screen state, the media assets in non-full-screen windows are played in a disconnected manner, resulting in the need to restart playback and re-cast the screen when entering multi-window mode again, increasing both the time consumption and the operation path.

[0116] Exemplarily, as Figure 4 shown, the control display 260 is controlled to display a multi-window page, where the multi-window page includes a first window and a second window. The first window displays an image of the first media asset, and the second window displays an image of the second media asset. After the first window receives the user's confirmation operation on the full-screen control in the first window, it sends a maximize window request to the window manager. The window manager processes the window maximization request, maximizes / fullscreens the first window, changes the display size of the first window to the full-screen size, then hides the second window, and stops playing the second media asset in the second window, that is, sends an instruction to stop decoding to the second window to stop decoding the data of the second media asset. The window manager sends a message indicating entering full-screen mode to the UI component of the multi-window application.

[0117] When the first window is full-screen displayed, the user may perform two operations: 1) The UI component of the multi-window application receives the return instruction input by the user pressing the back button of the control device 100, and then exits the multi-window application. 2) The setting module receives the instruction to invoke the setting menu input by the user pressing the menu button of the control device 100, controls the display 260 to display the setting menu page, and the setting menu page includes multi-window controls. If the setting module receives the user's confirmation operation on the multi-window control, it sends a restore multi-window instruction to the window manager. The window manager restores the first window to a small window, restores the display of the second window, and re-initializes the player of the second window, waiting for the terminal device to reconnect, cast the screen, and play again.

[0118] As can be seen from the above method, 1) after switching from multiple windows to full screen, the return key cannot quickly return to the multiple-window mode. Instead, it is necessary to first enter the settings menu through operations, and then it is necessary to perform multiple operations to select the multiple-window control among the numerous controls in the settings menu before the multiple-window page can be displayed. The operation path is complex. 2) After returning to the multiple-window mode again, the previous playback has been disconnected, and the user needs to reconnect the playback. Therefore, after switching from the multiple-window mode to the single-window full-screen mode, if you want to return from the single-window full-screen mode to the multiple-window mode again, the user needs to perform complex operations and re-cast the screen. To reduce the user operation and waiting time when switching from the multiple-window mode to the single-window full-screen mode and then back to the multiple-window mode, an embodiment of the present application provides a display device 200. The structure and functions of each part of the display device 200 can refer to the above embodiments. In addition, based on the display device 200 shown in the above embodiments, some functions of the display device 200 are further improved in this embodiment. As Figure 5 shown, the controller 250 is configured to perform the following steps:

[0119] Step S501: In the case of displaying a multiple-window page, receive a user input instruction to switch the first window to the full-screen mode.

[0120] In some embodiments, the step of displaying a multiple-window page includes:

[0121] In the case of displaying the home page (Launcher), receive a user input instruction to open the settings page, control the display 260 to display a settings menu box on top of the home page. The settings menu box includes a multiple-window control. After receiving a confirmation operation of the user on the multiple-window control, control the display 260 to display a multiple-window mode selection box on top of the home page. The multiple-window mode selection box includes a first mode control, a second mode control, and a third mode control. Different mode controls are used to represent different content sources that can be supported. After receiving a confirmation operation of the user on the first mode control, the second mode control, or the third mode control, the display 260 can be controlled to display a multiple-window page.

[0122] Exemplarily, the first mode control is used to support content from at least one terminal device Miracast screen mirroring. The second mode control is used to support content from TV information, as well as content from at least one terminal device Miracast screen mirroring or DLNA push. The third mode control is used to support content from at least one terminal device DLNA push. It should be noted that in the case of displaying the home page, it is recommended that the user select the first mode control and the third mode control. If a user input instruction to select the second mode control is received, the live TV program application can be started and then the multiple-window page can be displayed.

[0123] Miracast screen mirroring uses Wi-Fi Direct technology to establish a peer-to-peer connection directly without relying on an existing network, and can mirror the content of the entire screen, including the real-time operation interface. Miracast screen mirroring is suitable for situations where the screen content of a device needs to be displayed immediately, such as when presenting a presentation, playing a game, or watching an online video and wanting to synchronously display it on a large screen. Miracast screen mirroring provides a closer synchronization experience because it mirrors your screen in real time; it supports two-way data flow and theoretically allows for more interaction between two devices.

[0124] DLNA push is based on a home network (wired or wireless) and allows compatible devices such as smartphones, tablets, personal computers, etc. to discover and play content from a media server. It is mainly used to push multimedia files (such as music, videos, and pictures). DLNA push is suitable for sharing and playing media content within a local area network, and users can select specific media files for playback. DLNA push supports asynchronous operations, that is, you can do other things after selecting a playlist; it only supports one-way data flow, from the server to the client.

[0125] When displaying a multi-window page, a preset number of windows can be directly displayed. For example, the first window and the second window can be directly displayed. When displaying a multi-window page, one window can be displayed first, and then the number of windows can be appropriately increased and the windows can be arranged according to the real-time transmitted picture.

[0126] Taking the display of the first window and the second window in a multi-window page as an example, the first window and the second window can wait to display the images of the first media asset and the second media asset pushed by the DLNA push or Miracast screen mirroring of the terminal device that has established a communication connection with the display device 200.

[0127] Exemplarily, in the case of displaying the home page, an instruction to open the settings menu bar input by the user pressing the menu key of the control device 100 is received, and a settings menu box is displayed on the upper layer of the home page. As Figure 6 shown, the settings menu box includes a multi-window control 61. After receiving the instruction for the user to select the multi-window control 61, a multi-window mode selection box is displayed on the upper layer of the home page. As Figure 7 shown, the multi-window mode selection box includes a first mode control 71, a second mode control 72, and a third mode control 73. After receiving the instruction for the user to select the third mode control 73, a multi-window page is displayed. As Figure 8 shown, the multi-window page includes a first window 81 and a second window 82. When the first terminal device pushes the first media asset to the first window and the second terminal device pushes the second media asset to the second window, a multi-window page as shown in Figure 9 can be displayed.

[0128] In some other embodiments, the step of displaying a multi-window page includes:

[0129] In the case of playing a TV program, receive an instruction from the user to open the settings page, control the display 260 to display the settings page on top of the TV program page. The settings page includes multi-window controls. After receiving the user's confirmation operation on the multi-window controls, the display 260 can be controlled to display a multi-window page. Among them, the multi-window page includes a first window and a second window. The first window displays the TV program screen, and the second window waits for the terminal device DLNA to push or Miracast to project media resource images that are connected to the display device 200.

[0130] Exemplarily, in the case of playing a TV program, receive an instruction from the user to open the settings page by pressing the menu key of the control device 100, and display the menu page on top of the TV program screen. As Figure 10 shown, the menu page includes multi-window control 101. After receiving the user's instruction to select the multi-window control 101, a multi-window mode selection box can be displayed on top of the TV program screen. As Figure 11 shown, the multi-window mode selection box includes a first mode control 71, a second mode control 72, and a third mode control 73. After receiving the user's instruction to select the second mode control 72, display the multi-window page. After receiving the user's instruction to select the multi-window control 101, the multi-window page can also be directly displayed. As Figure 12 shown, the multi-window page includes a first window 81 and a second window 82. Among them, the first window 81 displays the TV program screen. The second window 82 waits for the terminal device DLNA to push or Miracast to project media resource images.

[0131] In some embodiments, the instruction to switch the first window to the full-screen mode can be received by receiving the user's confirmation operation on the full-screen control corresponding to the first window, and the instruction to switch the first window to the full-screen mode can also be received by receiving the user's confirmation operation on the first window.

[0132] Exemplarily, in Figure 9In this case, the multi-window page includes a first window 81, a second window 82, and a focus 83. Below the first window 81, there are also a full-screen control 811, a fast-back control 812, a pause control 813, a fast-forward control 814, a sound control 815, and an exit control 816. The fast-back control 812 is used to rewind the playback progress of the first media asset by 15 seconds. The pause control 813 is used to pause the playback of the first media asset. The fast-forward control 814 is used to fast-forward the playback progress of the first media asset by 15 seconds. The sound control 815 is used to control the playback and pause of the audio. The exit control 816 is used to terminate the Miracast screen mirroring or DLNA push. The user can input an instruction to switch the first window to the full-screen mode by selecting the first window 81 or the full-screen control 811.

[0133] In some embodiments, as Figure 13 shown, the multi-window application software architecture includes a user interface layer, a business logic layer, and a data layer. The user interface layer consists of UI components and is the user interface of the multi-window application, mainly used to display the multi-window interface and operation buttons. The UI component specifically refers to the parent container that hosts multiple small windows and mainly receives user operations. The business logic layer is used to control each service, including a window manager, a decoding manager, and a resource manager. The data layer is mainly the source of the playback data, including a TV signal, a DLNA service, and a Miracast service.

[0134] When the multi-window page is displayed, the first window can directly receive the user's confirmation operation on the full-screen control and then send a window maximization request to the window manager. When the multi-window page is displayed, the UI component can receive the user's confirmation operation on the full-screen control of the first window and send a full-screen instruction to the first window. The first window sends a window maximization request to the window manager.

[0135] When the multi-window page is first displayed, the window manager sends the multi-window state to the resource manager. The resource manager obtains the window change state. Since the multi-window page is first displayed, the recorded information of the window change state is empty. After receiving the multi-window state sent by the window manager, the window change state can be directly recorded as the multi-window state. If a return instruction input by the user is received at this time, the window change state can be obtained, and in the case where the window change state is the multi-window state, the multi-window application can be exited.

[0136] Step S502: Change the first window from the small-window state to the full-screen state.

[0137] Upon receiving the window maximization request sent by the first window, the window manager processes the window maximization request and adjusts the size of the first window to the full-screen size.

[0138] Step S503: Cancel the display of the second window and send a pause play instruction to the second window to pause the decoding of the image of the second media asset.

[0139] The window manager can hide or cancel the display of the second window and send a pause play instruction to the second window. The second window sends the pause play instruction to the decoding manager. The decoding manager controls the decoder to pause the decoding of the image of the second media asset. The window manager can also call the decoding manager to pause the decoding of the image of the second media asset corresponding to the second window.

[0140] In some embodiments, the content source of the second window is Miracast screen mirroring. After the decoding manager pauses the decoding of the image of the second media asset, the terminal device will continuously send image / video data to the display device 200, and the display device 200 will still receive the image / video data but will not decode and display the image / video data.

[0141] In some embodiments, the content source of the second window is DLNA push. After the decoding manager pauses the decoding of the image of the second media asset, it is no longer necessary to obtain image / video data from the specified address, nor is it necessary to decode and display.

[0142] It should be noted that pausing decoding means temporarily interrupting the current decoding process but retaining the state of the decoder and other relevant information. The decoder still remains in the initialization state, and the decoding resources are not released, so that decoding can continue quickly from the pause point later. Stopping decoding means completely terminating the current decoding process and clearing all states and resources related to the decoding. Once the decoding process is stopped, all decoding progress will be lost. If playback is required again, the decoder must be re-initialized from the beginning and the media file must be loaded.

[0143] Step S504: Record the window change state as the multi-window to full-screen state.

[0144] The window manager also sends the window state (full-screen state) to the resource manager. The resource manager obtains the window change state. Since when the multi-window page is first displayed, the window change state has been recorded as the multi-window state. After receiving the full-screen state sent by the window manager, the window change state can be recorded as the multi-window to full-screen state. The window manager can also send the decoding state of the second window to the resource manager and record it by the resource manager.

[0145] In some embodiments, the window manager also sends the full-screen window (the first window) to the resource manager. The resource manager marks the first window as the full-screen window.

[0146] It should be noted that the embodiments of the present application do not limit the execution order of steps S502 - S504.

[0147] Exemplarily, in Figure 9 when receiving a confirmation operation of the user on the first window 81 or the full-screen control 811, it controls the display 260 to display the full-screen page of the first window. As Figure 14 shown. The full-screen page of the first window only displays the first media asset image.

[0148] In some embodiments, the decoding states of the decoders corresponding to the first window and the second window can also be sent to the resource manager and recorded by the resource manager. For example, the decoding state of the decoder corresponding to the first window is in decoding, and the decoding state of the decoder corresponding to the second window is paused decoding.

[0149] Step S505: Receive a return instruction input by the user.

[0150] In some embodiments, when the first window is in full-screen display, the embodiments of the present application can receive the return instruction input by the user by receiving the user pressing the return key of the control device 100.

[0151] In other embodiments, when the first window is in full-screen display, the embodiments of the present application can receive the return instruction input by the user by receiving the user's confirmation operation on the return control in the first window.

[0152] Exemplarily, as Figure 14 shown, the full-screen page of the first window includes a return control 141. The user can input a return instruction to the display device 200 by selecting the return control 141.

[0153] Step S506: Obtain the window change state.

[0154] When the UI component of the multi-window application receives the return instruction, it sends a message for querying the window change state to the resource manager, and the resource manager sends the window change state to the window manager. Among them, the decoding states of the decoders corresponding to the first window and the second window can also be obtained.

[0155] Step S507: When the window change state is from multi-window to full-screen state, change the first window from the full-screen state to the small-window state.

[0156] When the window change state is from multi-window to full-screen state, the window manager cancels the full-screen state of the first window and changes the first window from the full-screen state to the small-window state, that is, the full-screen size of the first window changes to the small-window size. Among them, the small-window size refers to the size of the first window when the first window and the second window are displayed simultaneously.

[0157] Step S508: Resume displaying the second window, and send a media playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

[0158] When the window manager changes the window state from multi-window to full-screen, the second window is restored for display. When the decoding state of the decoder corresponding to the second window is paused decoding, a media asset playback instruction is sent to the second window, and the second window sends the media asset playback instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the image of the second media asset. The window manager can also call the decoding manager to continue decoding the image of the second media asset corresponding to the second window.

[0159] In some embodiments, the content source of the second window is Miracast screen mirroring. When the decoding manager starts decoding the image of the second media asset, the terminal device sends the latest image / video data to the display device 200, and the display device 200 can receive the image / video data and decode and display the image / video data.

[0160] In some embodiments, the content source of the second window is DLNA push. When the decoding manager continues to decode the image of the second media asset, it can continue to obtain image / video data from a specified address and decode and display it.

[0161] Exemplarily, in Figure 14 , a return instruction input by the user pressing the return key of the control device 100 is received, and the display 260 is controlled to display a multi-window page as shown in Figure 9 .

[0162] Among them, if when the first window is in full-screen display, the terminal device corresponding to the second window receives an instruction from the user to exit screen mirroring, the terminal device can send an instruction to exit screen mirroring to the display device 200. The window manager sends a stop decoding instruction to the second window, and the second window sends the stop decoding instruction to the decoding manager. The decoding manager controls the decoder to stop decoding the second media asset and sends the decoding state of the decoder corresponding to the second window to the resource manager so that the resource manager updates its decoding state to stop decoding. After receiving the return instruction input by the user, the second window is restored for display, and when the decoding state is stop decoding, the player of the second window is re-initialized, waiting for the terminal device to reconnect and play.

[0163] The embodiments of the present application memorize the change of the window state through a state variable, perform special processing on the return key / return instruction, and determine the subsequent execution logic according to the state variable, improving the interaction of the multi-window play large-screen / small-screen switching. After the multi-window enters the full-screen state, the multi-window page can be directly returned by inputting a return instruction, shortening the user operation path. When switching from multi-window to full-screen, the non-full-screen window is paused for decoding, so that there is no need to restart playback and screen mirroring when returning to the multi-window page, reducing the time consumption and operations and improving the coherence of media asset playback.

[0164] In some embodiments, when the first window is in full-screen display and a user input instruction to exit the first window is received, the UI component sends a message querying the window change status to the resource manager, and the resource manager sends the window change status to the window manager. When the window change status is from multi-window to full-screen, the window manager changes the first window from full-screen to small-window state and sends a stop-playback instruction to the first window to stop decoding the image of the first media asset. The window manager also sends a command to resume displaying the second window and sends a media asset playback instruction to the second window, and the second window sends a media asset playback instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second media asset. Additionally, the positions of the first window and the second window can be swapped, or the display of the first window can be cancelled and the second window can be full-screened. In the embodiments of the present application, when the first window is in full-screen display and an exit instruction is received, the media asset screen of the second window can be quickly displayed.

[0165] In some embodiments, after step S504: recording the window change status as from multi-window to full-screen, a user input instruction to start a multi-window application may be received. In response to this instruction, the first window is changed from full-screen to small-window state, the second window is restored for display, and a media asset playback instruction is sent to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

[0166] The setting module may receive a user input instruction to start a multi-window application and send an instruction to resume the multi-window to the window manager. The window manager changes the first window from full-screen to small-window state, restores the display of the second window, and sends a media asset playback instruction to the second window. The second window sends a media asset playback instruction to the decoding manager, and the decoding manager controls the decoder to continue decoding the image of the second media asset, and the second window displays the image of the second media asset.

[0167] Exemplarily, in Figure 14 , an instruction to open the settings page is received by pressing the menu key of the control device 100 by the user, and the settings page is displayed on top of the first window. As Figure 15 shows, the settings page includes a multi-window control 101. After receiving an instruction for the user to select the multi-window control 101, a multi-window page as shown in Figure 9 is displayed.

[0168] In some embodiments, after resuming the display of the second window and sending a media playback instruction to the second window, record the window change state as the full-screen to multi-window state, and mark the first window as the full-screen window. In response to the return instruction input by the user, obtain the window change state. When the window change state is the full-screen to multi-window state, change the first window marked as the full-screen window from the full-screen state to the small window state, cancel the display of the second window and send a pause playback instruction to the second window to pause the decoding of the image of the second media asset.

[0169] When resuming the display of the multi-window page, the window manager can send the multi-window state to the resource manager. The resource manager obtains that the current window change state is the multi-window to full-screen state, and the first window is marked as the full-screen window. After receiving the multi-window state sent by the window manager, it can directly record the window change state as the full-screen to multi-window state, and the first window is marked as the full-screen window. After the UI component of the multi-window application receives the return instruction input by the user pressing the return key of the control device 100, it sends a message to query the window change state to the resource manager, and the resource manager sends the window change state to the window manager. When the window change state is the full-screen to multi-window state, the window manager changes the first window marked as the full-screen window from the full-screen state to the small window state, cancels the display of the second window and sends a pause playback instruction to the second window to pause the decoding of the image of the second media asset.

[0170] Exemplarily, after responding to the instruction for the user to select the multi-window control 101 and displaying the multi-window page as shown in Figure 9 After that, receive the return instruction input by the user pressing the return key of the control device 100, and control the display 260 to display the full-screen page of the first window as shown in Figure 14 Shown.

[0171] After the embodiment of the present application enters the multi-window state from the full screen, it can directly return to the single-window full-screen page by inputting a return instruction, shortening the user operation path.

[0172] In some embodiments, the window change state recorded by the resource manager can be only a single state or the switching of the last two states. Among them, the single state includes the multi-window state and the full-screen state. The switching of the last two states includes the multi-window to full-screen state and the full-screen to multi-window state. This way of recording the window change state can only support the return operation to the previous state.

[0173] In other embodiments, the window change state recorded by the resource manager can be a single state and the switching of multiple last two states. Each time a window state is received, a record information of a state change is added at the last position, and each time a return instruction is received, a state change at the last position is reduced.

[0174] Exemplarily, the window change state can be multi-window state - multi-window to full-screen (first window) state - full-screen (first window) to multi-window state - multi-window to full-screen (second window) state, where the full-screen window in the brackets is marked. After receiving the first return instruction, the full-screen second window page can become a multi-window page, and at this time, the window change state changes to multi-window state - multi-window to full-screen (first window) state. After receiving the second return instruction, the multi-window page can become the full-screen first window page, and at this time, the window change state changes to multi-window state.

[0175] In some embodiments, when displaying a multi-window page, the audio playback mode can also be obtained. The audio playback mode includes mixed playback and single-tone playback. Mixed playback means allowing multiple media assets to play audio data simultaneously. Single-tone playback means only allowing one media asset to play audio data.

[0176] When the audio playback mode is mixed playback, while displaying the image of the first media asset in the first window and the image of the second media asset in the second window, control the audio output device 270 to play the audio of the first media asset and the audio of the second media asset.

[0177] When the audio playback mode is single-tone playback, while displaying the image of the first media asset in the first window and the image of the second media asset in the second window, control the audio output device 270 to play the audio of the first media asset or the second media asset specified by the user. Among them, the audio data corresponding to the media asset in the first window can be played by default.

[0178] As Figure 9 shown, the audio playback of the first media asset and the second media asset can be controlled through the sound control controls below the first window and the second window. Among them, in the case of single-tone playback, when the user has started playing the audio of the first media asset and then receives the confirmation operation of the user on the sound control control under the second window, a pause audio decoding instruction can be sent to the first window to pause the playback of the audio of the first media asset, and a start audio decoding instruction can be sent to the second window to start playing the audio of the second media asset.

[0179] In some embodiments, the step of obtaining the audio playback mode includes: determining whether the content sources of the first media asset and the second media asset are both preset content sources. If the content sources of the first media asset and the second media asset are both preset content sources, then obtain the audio playback mode as mixed playback. If the content source of the first media asset or the second media asset is not a preset content source, then obtain the audio playback mode as single-tone playback. The preset content source is Miracast screen mirroring.

[0180] Exemplarily, single - tone playback includes the following scenarios: TV signal + Miracast screen mirroring, TV signal + DLNA push, and DLNA push + DLNA push. Mix - tone playback includes the following scenario: Miracast screen mirroring + Miracast screen mirroring.

[0181] In some other embodiments, the step of obtaining the audio playback mode includes: obtaining the multi - window mode. If the multi - window mode is the first mode, then obtain the audio playback mode as mix - tone playback. If the multi - window mode is the second mode or the third mode, then obtain the audio playback mode as single - tone playback.

[0182] In still some other embodiments, the step of obtaining the audio playback mode includes: obtaining the flag bit of the audio playback mode. If the flag bit of the audio playback mode is a preset value, then obtain the audio playback mode as mix - tone playback. If the flag bit of the audio playback mode is not the preset value, then obtain the audio playback mode as single - tone playback. The flag bit of the audio playback mode is changed by the user's selection of the single - tone playback control and the mix - tone playback control on the audio playback mode page selection surface.

[0183] In the scenario of mix - tone playback, that is, while the first window displays the image of the first media asset and the second window displays the image of the second media asset, play the audio of the first media asset and the audio of the second media asset. If a command to switch the first window to full - screen mode is received from the user input, the first window can be changed from the small - window state to the full - screen state, the display of the second window can be cancelled, and a pause - playback command can be sent to the second window to pause decoding the image and audio of the second media asset, and record the window change state as multi - window to full - screen state. In response to the return command input by the user, obtain the window change state. When the window change state is multi - window to full - screen state, change the first window from the full - screen state to the small - window state, resume displaying the second window, and send a media - asset playback command to the second window to continue decoding the image and audio of the second media asset, and display the image of the second media asset in the second window and control the audio output device 270 to play the audio of the second media asset.

[0184] In the scenario of single - tone playback, that is, while the first window displays the image of the first media asset and the second window displays the image of the second media asset, play the audio of the second media asset. If a command to switch the first window to full - screen mode is received from the user input, the first window can be changed from the small - window state to the full - screen state, and the display of the second window can be cancelled. Then send a pause - playback command to the second window to pause decoding the image and audio of the second media asset, and send an audio - playback command to the first window to start decoding the audio of the first media asset, and control the audio output device 270 to play the audio of the first media asset. Also record the window change state as multi - window to full - screen state.

[0185] In response to a return instruction input by the user, obtain the window change state. When the window change state is from the multi-window state to the full-screen state, change the first window from the full-screen state to the small-window state, and resume displaying the second window. Then send an audio pause instruction to the first window to pause decoding the audio of the first media asset, and send a media asset play instruction to the second window to continue decoding the image and audio of the second media asset, and display the image of the second media asset in the second window and control the audio output device to play the audio of the second media asset.

[0186] In the scenario of single-tone playback, that is, while the first window displays the image of the first media asset and the second window displays the image of the second media asset, play the audio of the first media asset. If a command to switch the first window to the full-screen mode is received from the user input, the first window can be changed from the small-window state to the full-screen state, cancel the display of the second window, and then send a pause play instruction to the second window to pause decoding the image of the second media asset. In response to a return instruction input by the user, obtain the window change state. When the window change state is from the multi-window state to the full-screen state, change the first window from the full-screen state to the small-window state, resume displaying the second window, and send a media asset play instruction to the second window to continue decoding the image of the second media asset.

[0187] In some embodiments, the timing diagram of the media asset playback method can be as Figure 16 shown. The UI components of the multi-window application display a multi-window page. Among them, the multi-window page includes a first window and a second window. The first window displays the image of the first media asset, and the second window displays the image of the second media asset. After the first window receives the confirmation operation of the user on the full-screen control in the first window, it sends a maximize window request to the window manager. The window manager processes the window maximization request, maximizes / fullscreens the first window, changes the display size of the first window to the full-screen size, then hides the second window, and pauses playing the second media asset in the second window, that is, sends a pause play instruction to the second window. The second window sends a decode play decode instruction to the decode manager. The decode manager controls the decoder to pause decoding the second media asset. The window manager sends the window state to the resource manager. The resource manager records the window change state as from the multi-window state to the full-screen state. The window manager also sends a message to enter the full-screen mode to notify the UI components of the multi-window application.

[0188] When the first window is displayed full screen, the user may perform two operations: 1) The UI component of the multi-window application receives a return instruction input by the user pressing the return key of the control device 100. The UI component sends a message querying the window change status to the resource manager, and the resource manager sends the window change status to the window manager. When the window change status is from multi-window to full-screen status, the window manager cancels the full-screen status of the first window, changes the first window from full-screen status to small-window status, resumes the display of the second window, and sends a media playback instruction to the second window. The second window sends the media playback instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second media to display the image of the second media in the second window.

[0189] 2) The setting module receives a setting menu invocation instruction input by the user pressing the menu key of the control device 100, and controls the display 260 to display a setting menu page, which includes a multi-window control. After the setting module receives the confirmation operation of the user on the multi-window control, it sends a multi-window restoration instruction to the window manager. The window manager cancels the full-screen status of the first window, changes the first window from full-screen status to small-window status, resumes the display of the second window, and sends a media playback instruction to the second window. The second window sends the media playback instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second media to display the image of the second media in the second window.

[0190] The embodiments of the present application optimize the multi-window and single-window switching logic. When switching from multi-window to single-window full screen, the window maximization button can be clicked to hide other windows and pause their playback. When switching from single-window full screen to multi-window, just press the return key to directly restore the multi-window layout and resume the playback of other windows. The embodiments of the present application also optimize the playback control logic. When in single-window full screen, the playback of other windows is paused; when returning to multi-window, the playback of other windows is automatically resumed. The embodiments of the present application also support the following scenarios: TV signal + Miracast screen mirroring, TV signal + DLNA push, DLNA push + DLNA push, Miracast screen mirroring + Miracast screen mirroring. The present application directly returns from single-window full screen to the multi-window page through the return key, reducing the operation steps, achieving a smooth switch to the previous user interface, and significantly improving the user experience. Through the optimization of the pause / resume playback logic, a natural and smooth window size switching experience is achieved.

[0191] Some embodiments of the present application also provide a computer-readable storage medium, which can store a program. When the computer-readable storage medium is configured in a display device or a server, the program steps involved in the media asset playback method in the above embodiments can be included when the program is executed. Among them, the computer storage medium can be a magnetic disk, an optical disc, a read-only memory (ROM), or a random access memory (RAM), etc.

[0192] An embodiment of the present application provides an electronic device, which includes: a processor and a memory for storing executable instructions of the processor. Among them, the processor is used to read the executable instructions from the memory and execute the instructions to implement the media asset playback method in the above embodiments.

[0193] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0194] For the sake of convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are for better explaining the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, Including: A display; Configured to display a user interface; A controller, coupled to the display and configured to: In the case of displaying a multi-window page, in response to an instruction from a user input to switch a first window to full-screen mode, change the first window from a small-window state to a full-screen state. The multi-window page includes a first window and a second window. The first window is used to display an image of a first media asset, and the second window is used to display an image of a second media asset; Cancel the display of the second window, and send a pause-playback instruction to the second window to pause decoding the image of the second media asset; Record the window change state as multi-window to full-screen state; In the case of receiving a return instruction from a user input, obtain the window change state; In the case where the window change state is multi-window to full-screen state, change the first window from a full-screen state to a small-window state; Resume the display of the second window, and send a media-playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

2. The display device according to claim 1, wherein After the controller executes recording the window change state as multi-window to full-screen state, it is further configured to: In the case of receiving a start multi-window application instruction from a user input, change the first window from a full-screen state to a small-window state; Resume the display of the second window, and send a media-playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

3. The display device according to claim 1, wherein After the controller executes recording the window change state as multi-window to full-screen state, it is further configured to: Mark the first window as a full-screen window; After the controller executes resuming the display of the second window, it is further configured to: Record the window change state as full-screen to multi-window state; In response to a return instruction from a user input, obtain the window change state; In the case where the window change state is full-screen to multi-window state, change the first window marked as a full-screen window from a full-screen state to a small-window state; Cancel the display of the second window, and send a pause-playback instruction to the second window to pause decoding the image of the second media asset.

4. The display device according to claim 1, wherein, When the controller is displaying a multi-window page, it is further configured to: Obtain an audio playback mode; When the audio playback mode is mixed playback, control an audio output device to play the audio of the first media asset and the audio of the second media asset; When the audio playback mode is single-tone playback, control the audio output device to play the audio of the first media asset or the audio of the second media asset.

5. The display device according to claim 4, wherein When the controller executes obtaining the audio playback mode, it is further configured to: If the content sources of the first media asset and the second media asset are preset content sources, obtain the audio playback mode as mixed playback; If the content source of the first media asset or the second media asset is not a preset content source, obtain the audio playback mode as single-tone playback.

6. The display device according to claim 4, characterized in that When controlling the audio output device to play the audio of the first media asset and the audio of the second media asset, the controller is further configured to execute sending a pause playback instruction to the second window to pause decoding the image of the second media asset: Send a pause playback instruction to the second window to pause decoding the image and audio of the second media asset; The controller is further configured to execute sending a media asset playback instruction to the second window to continue decoding the image of the second media asset: Send a media asset playback instruction to the second window to continue decoding the image and audio of the second media asset; Control the audio output device to play the audio of the second media asset.

7. The display device according to claim 4, characterized in that When controlling the audio output device to play the audio of the second media asset, the controller is further configured to execute sending a pause playback instruction to the second window to pause decoding the image of the second media asset: Send a pause playback instruction to the second window to pause decoding the image and audio of the second media asset; Send an audio playback instruction to the first window to start decoding the audio of the first media asset and control the audio output device to play the audio of the first media asset.

8. The display device according to claim 7, characterized in that, The controller is further configured to execute sending a media asset playback instruction to the second window to continue decoding the image of the second media asset: Send an audio pause instruction to the first window to pause decoding the audio of the first media asset; Send a media asset playback instruction to the second window to continue decoding the image and audio of the second media asset; Control the audio output device to play the audio of the second media asset.

9. The display device according to claim 1, wherein When the controller displays a multi-window page, it is further configured to: Record the window change state as a multi-window state; If a return instruction input by the user is received, obtain the window change state; When the window change state is the multi-window state, exit the multi-window application.

10. A media asset playing method, characterized in that, Include: When displaying a multi-window page, in response to an instruction input by the user to switch the first window to full-screen mode, change the first window from the small-window state to the full-screen state. The multi-window page includes a first window and a second window. The first window is used to display the image of the first media asset, and the second window is used to display the image of the second media asset; Cancel the display of the second window and send a pause playback instruction to the second window to pause decoding the image of the second media asset; Record the window change state as a multi-window to full-screen state; When a return instruction input by the user is received, obtain the window change state; When the window change state is the multi-window to full-screen state, change the first window from the full-screen state to the small-window state; Restore the display of the second window and send a media asset playback instruction to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

Images