Display device and media asset display method

Abstract

Some embodiments of the present application show a display device and a media asset display method, the method comprising: when a playing condition of a first media asset is satisfied, transmitting a first page to a shared rendering pipeline, decoding first media asset data of the first media asset to obtain a video frame, and transmitting the video frame to the shared rendering pipeline; performing image synthesis on the first page and the video frame through a shared rendering pipeline based on a layer position relationship of a screen display layer to obtain a second page; the layer position relationship is that the media asset display layer is located on the upper layer of the user interface layer, the first page is located on the user interface layer, and the video frame is located on the media asset display layer; and displaying the second page. According to the embodiment of the invention, the first page is displayed on the user interface layer of the OSD layer, the video frame is displayed on the media asset display layer of the OSD layer, and image synthesis is performed on the first page and the video frame on the upper layer of the user interface layer based on the media asset display layer, so that the technical effect that media assets are covered and displayed on the first page is achieved.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a media asset display method. Background Technology

[0002] With the widespread adoption of smart TVs, the advertising capabilities of TV terminals have become a key focus for manufacturers and advertisers. Smart TVs typically feature various formats, including boot-up ads, launcher ads, and carousel ads. To further improve ad reach and user attention, some platforms have begun introducing overlay pop-up ads, which can be displayed on top of the homepage.

[0003] Smart TVs using the Android system have built-in system window management. This management system can manage all windows and assign different display layers to different window types. It can place the video layer of pop-up ads on top of the current page, creating an overlay ad effect. However, some TVs do not use Android and lack system window management capabilities. Because the video layer playing the ads is fixed below the on-screen display (OSD) layer of the homepage, overlay pop-up ads cannot be displayed. Summary of the Invention

[0004] Some embodiments of this application provide a display device and a media asset display method. A first page is displayed in the user interface layer of the OSD layer, and video frames are displayed in the media asset display layer of the OSD layer. Based on the media asset display layer being above the user interface layer, the first page and video frames are image-composite to achieve the technical effect of displaying media assets over the first page.

[0005] In a first aspect, some embodiments of this application provide a display device, including: The monitor is configured to display the first page; The controller coupled to the display is configured as follows: When the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain video frames, and the video frames are transmitted to the shared rendering pipeline. Based on the layer position relationship of the screen display layer, the first page and video frames are image composited using a shared rendering pipeline to obtain the second page. The screen display layer includes a user interface layer and a media asset display layer. The layer position relationship is that the media asset display layer is located above the user interface layer, the first page is located in the user interface layer, and the video frames are located in the media asset display layer. Control the monitor to display the second page.

[0006] The above technical solution has the following advantages or beneficial effects: the first page is displayed in the user interface layer of the OSD layer, the video frame is displayed in the media asset display layer of the OSD layer, and the first page and the video frame are image composited based on the media asset display layer above the user interface layer to achieve the technical effect of media asset overlay display on the first page.

[0007] In some embodiments, after the control display shows the second page, the controller is configured to: Start the timer; If the received key instruction is the first key instruction before the timer reaches the preset duration, the operation corresponding to the first key instruction will be executed. The first key instruction is the key instruction to jump to the details page of the first media asset. If the received key instruction is the second key instruction, the operation corresponding to the second key instruction will not be executed. The second key instruction is a key instruction other than the first key instruction. When the timer reaches the preset duration, if a third button instruction is received, the operation corresponding to the third button instruction is executed. The third button instruction includes the first button instruction and the second button instruction.

[0008] The above technical solution has the following advantages or beneficial effects: when the timer has not reached the preset duration, it only responds to the instruction to jump to the media asset details page, while blocking other instructions. This can prevent users from stopping media asset playback due to accidental exit instructions before they have understood the content of the media asset playback. After the preset duration is reached, all buttons can be opened and button operations can be executed in a timely manner.

[0009] In some embodiments, the controller performs image compositing on the first page and video frames based on the layer position relationship of the screen display layer through a shared rendering pipeline to obtain a second page, which is further configured to: By using a shared rendering pipeline, the video frame is divided into a first region image and a second region image, and the first region image and the second region image are displayed in different areas in the video frame; Obtain the transparency of each first position in the first region image, and convert the second region image into a target format to obtain the third region image, wherein the target format is an image format including transparency; The transparency of each first position in the first region image is filled with the transparency of the second position in the third region image corresponding to the first position to obtain the fourth region image; Based on the layer position relationship of the screen display layer, the images of the first page and the fourth area are composited to obtain the second page.

[0010] The above technical solution has the following advantages or beneficial effects: A shared rendering pipeline can avoid the context overhead caused by switching between multiple pipelines. By precisely mapping the transparency of each pixel in the first region image to the corresponding position in the format-converted third region, a fourth region image is generated, ensuring that semi-transparent UI elements blend naturally with the video content and avoiding the problem of hard edges or black backgrounds caused by the loss of the alpha channel during format conversion.

[0011] In some embodiments, the first page includes a carousel for looping multiple second media assets. The controller, upon meeting the playback conditions of the first media assets, transmits the first page to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a first pause playback command is sent to the carousel player so that the carousel player responds to the first pause playback command, pauses the loop playback of multiple second media assets, and records the playback progress; Upon receiving the first pause message from the carousel player, the first page of the loop that pauses the playback of multiple second media assets is transmitted to the shared rendering pipeline.

[0012] The above technical solution has the following advantages or beneficial effects: pausing the switching of the second media asset before playing the first media asset can prevent audio aliasing, bandwidth contention, or decoder resource contention caused by the simultaneous playback of multiple audio and video streams, ensuring that the first media asset obtains complete system resources and user attention.

[0013] In some embodiments, after the control display shows the second page, the controller is further configured to: If a message indicating that the first media asset has finished playing or has been interrupted is received, control the display to show the first page; Send a first playback command to the carousel player so that the carousel player responds to the first playback command and loops multiple second media assets in the first page, starting from the playback progress.

[0014] The above technical solution has the following advantages or beneficial effects: After the first media asset stops playing, the first page is restored, and multiple second media assets continue to play in a loop from the breakpoint. When the user returns to the original page, the carousel content is not reset or changed, maintaining the original playback rhythm and avoiding repeated viewing or information omission caused by starting from the beginning.

[0015] In some embodiments, the first page includes a signal source preview window for playing preview content of the signal source. The controller, upon meeting the playback conditions of the first media asset, transmits the first page to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a second pause playback command is sent to the signal source preview module to cause the signal source preview module to pause the playback of the preview content of the signal source; After receiving the second pause playback message from the signal source preview module, the first page of the preview content of the paused signal source is transmitted to the shared rendering pipeline.

[0016] The above technical solution has the following advantages or beneficial effects: pausing the preview content playback before playing the first media asset can prevent the first media asset and the signal source preview from being decoded / rendered simultaneously, thus avoiding memory bandwidth overload.

[0017] In some embodiments, after the control display shows the second page, the controller is further configured to: If a message indicating that the first media asset has finished playing or has been interrupted is received, control the display to show the first page; Send a second playback command to the signal source preview module so that the signal source preview module responds to the second playback command and plays the preview content of the signal source in the signal source preview window.

[0018] The above technical solution has the following advantages or beneficial effects: After the first media asset stops playing, the first page is restored and the preview content of the signal source is played in the signal source preview window. When the user returns to the original page, the signal source preview immediately restores the dynamic content, avoiding the sense of disconnect where the page has been returned but the preview has not started, and achieving synchronous restoration of visual and functional aspects.

[0019] In some embodiments, the controller, upon meeting the playback conditions of the first media asset, decodes the first media asset data to obtain a video frame and transmits the video frame to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a playback request for the first media asset is sent to the server; Receive the first media asset data sent by the server based on the playback request; Media asset playback mode for acquiring primary media assets; If the media asset playback mode is to overlay display video, the first media asset data is decoded to obtain video frames, and the video frames are transmitted to the shared rendering pipeline.

[0020] The above technical solution has the following advantages or beneficial effects: Media asset data is decoded only when the playback mode is an overlay display video, and the generated video frames are transmitted to the shared rendering pipeline for full-screen or top-level overlay rendering. This reduces the load on the shared rendering pipeline and ensures smooth compositing of the overlay display video.

[0021] In some embodiments, before decoding the first media asset data to obtain video frames, the controller is further configured to: Retrieve preview images from preset storage locations or primary media asset data; Transfer the preview image to the shared rendering pipeline; Based on the layer position relationship of the screen display layer, the first page and the preview image are composited using the shared rendering pipeline to obtain the third page, with the preview image located in the media asset display layer. Control the monitor to display the third page.

[0022] The above technical solution has the following advantages or beneficial effects: After triggering the media asset playback conditions, the content placeholder image appears almost instantly, rather than a black screen, loading circle, or frozen original page. This reduces user anxiety and improves the smoothness of interaction. After the first frame of the video is decoded, the preview image can be directly replaced, achieving flicker-free switching.

[0023] Secondly, some embodiments of this application provide a media asset display method, including: When the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain video frames, and the video frames are transmitted to the shared rendering pipeline. Based on the layer position relationship of the screen display layer, the first page and video frames are image composited using a shared rendering pipeline to obtain the second page. The screen display layer includes a user interface layer and a media asset display layer. The layer position relationship is that the media asset display layer is located above the user interface layer, the first page is located in the user interface layer, and the video frames are located in the media asset display layer. Control the monitor to display the second page.

[0024] The above technical solution has the following advantages or beneficial effects: the first page is displayed in the user interface layer of the OSD layer, the video frame is displayed in the media asset display layer of the OSD layer, and the first page and the video frame are image composited based on the media asset display layer above the user interface layer to achieve the technical effect of media asset overlay display on the first page.

[0025] In this embodiment, when the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain video frames, which are then transmitted to the shared rendering pipeline. Based on the layer position relationship of the screen display layer, the shared rendering pipeline performs image compositing on the first page and the video frames to obtain a second page. The screen display layer includes a user interface layer and a media asset display layer, with the media asset display layer located above the user interface layer, the first page located in the user interface layer, and the video frames located in the media asset display layer. The display screen is then controlled to show the second page. In this embodiment, the first page displays the user interface layer of the OSD layer, and the video frames are displayed in the media asset display layer of the OSD layer. Based on the media asset display layer being above the user interface layer, image compositing is performed on the first page and the video frames to achieve the technical effect of media assets being displayed over the first page. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application; Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application; Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application; Figure 4 A flowchart illustrating a media asset display method provided in some embodiments of this application; Figure 5 A flowchart illustrating an advertising request method provided for some embodiments of this application; Figure 6 A schematic diagram of a second page provided for some embodiments of this application; Figure 7 A flowchart illustrating an advertising playback method provided in some embodiments of this application; Figure 8 A timing diagram illustrating a media asset display method provided in some embodiments of this application; Figure 9 An infrastructure block diagram provided for some embodiments of this application; Figure 10 A schematic diagram of a first page provided for some embodiments of this application; Figure 11 A flowchart illustrating a method for interrupting media asset playback provided in some embodiments of this application; Figure 12 A flowchart illustrating a media asset playback method provided in some embodiments of this application. Detailed Implementation

[0028] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0029] In this embodiment, display device 200 generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0030] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch operation, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.

[0031] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0032] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0033] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television and Internet Protocol television.

[0034] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0035] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.

[0036] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0037] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0038] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, the communication device 220 may include a WiFi module. When the display device 200 supports Bluetooth connection communication, the communication device 220 may include a Bluetooth module.

[0039] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0040] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0041] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0042] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface 280 receives the user input commands through the graphical user interface (GUI).

[0043] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0044] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0045] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.

[0046] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0047] like Figure 3 As shown, the display device system is divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0048] The application layer mainly includes commonly used applications on TV, as well as the application framework. The commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0049] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interface for these functions (toolbar, status bar, menu, dialog box).

[0050] Native apps can support online or offline access, push notifications, or access to local resources.

[0051] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0052] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. The drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.

[0053] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0054] With the widespread adoption of smart TVs, the advertising capabilities of TV terminals have become a key focus for manufacturers and advertisers. Smart TVs typically feature various formats such as boot-up ads, launcher ads, and carousel ads. To further improve ad reach and user attention, some platforms have begun introducing overlay pop-up ads, which can be displayed on top of the current homepage.

[0055] Smart TVs using the Android system have built-in system window management. This management system can manage all windows and assign different display layers (hierarchical relationships) to different window types. This allows pop-up ads to be placed above the homepage, achieving a comprehensive ad display effect. However, some TVs do not use Android but run on a Linux framework, lacking system window management capabilities. In these cases, the video layer playing the ads is usually fixed below the screen display layer showing the homepage.

[0056] To display the ad playback window located at the bottom of the homepage, a transparent area can be drawn on the homepage at the position corresponding to the ad playback window, so that the content displayed in the ad playback window can be shown to the user. However, this ad is an embedded ad.

[0057] Furthermore, the OSD display layer typically only handles the rendering of static interface elements, including icons, text, background textures, and user interface controls. These devices lack the ability to decode video content and directly output it to the OSD layer for display. As a result, video content can usually only be output to the frame buffer in an exclusive manner, making it impossible to overlay and display it in real time with UI elements on interactive interfaces such as application interfaces and launchers.

[0058] In summary, because the positional relationship between the video layer and the OSD layer has not changed, and the video content cannot be decoded and output to the OSD layer for display, the overlay pop-up advertisement cannot be displayed when there is no system window management.

[0059] To display overlay pop-up ads without system window management, this application provides a display device 200. The structure and functions of each part of the display device 200 can be found in the above embodiments. Furthermore, based on the display device 200 shown in the above embodiments, this embodiment further improves some functions of the display device 200. For example... Figure 4 As shown, controller 250 is configured to perform the following steps: Step S401: When the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain a video frame, and the video frame is transmitted to the shared rendering pipeline.

[0060] Before determining whether the playback conditions of the first media asset are met, the display 260 can be controlled to display the first page in response to the user's input command to open the first page. The first page can be the boot page of the display device 200, the launcher homepage, the channel switching page, or the interactive entry page, etc.

[0061] In some embodiments, one implementation of determining whether the playback conditions of the first media asset are met may include: determining whether the boot process has been completed; if the boot process has been completed, the playback conditions of the first media asset are met; if the boot process has not been completed, the playback conditions of the first media asset are not met.

[0062] In some embodiments, one implementation of determining whether the playback conditions of the first media asset are met may include: determining whether it is the first time the first page is displayed; if it is the first time the first page is displayed, then the playback conditions of the first media asset are met; if it is not the first time the first page is displayed, then the playback conditions of the first media asset are not met.

[0063] In some embodiments, one implementation of determining whether the playback conditions of the first media asset are met may include: starting a timer when there is no focus operation; if the timer duration exceeds a preset duration, the playback conditions of the first media asset are met; if the timer duration does not exceed the preset duration or the timer terminates (with focus operation), the playback conditions of the first media asset are not met.

[0064] First-level media assets can include videos and / or images. Video content can be advertisements, and video display effects can include pop-up windows, full-screen or partial coverage, a mix of transparent and semi-transparent displays, semi-transparent mask displays, 3D graphic overlay displays, corner overlays, full-screen static displays, video playback mixed with UI elements, and dynamic linkage between animation and UI elements. First-level media assets also support control via gamepad and remote control directional keys, automatic countdown closing, and continuation playback in a small window.

[0065] In some embodiments, when the playback conditions of the first media asset are met, decoding the first media asset data to obtain a video frame and transmitting the video frame to the shared rendering pipeline may include: when the playback conditions of the first media asset are met, sending a playback request for the first media asset to the server, then receiving the first media asset data sent by the server based on the playback request, and obtaining the media asset playback mode of the first media asset; if the media asset playback mode is an overlay display video, then decoding the first media asset data to obtain a video frame and transmitting the video frame to the shared rendering pipeline. Wherein, if the media asset playback mode is an image, then decoding is not required, and the image can be directly transmitted to the shared rendering pipeline to display the image on top of the user interface layer. If the media asset playback mode is an embedded video, then decoding the first media asset data to obtain a video frame and displaying the video frame on the video layer is sufficient. The overlay display video may include 3D video.

[0066] The server can be configured for the following for the primary media asset: 1) Display frequency control, such as: booting up only once; 2) Whether the duration limit can be skipped; 3) Whether to add countdown exit logic; 4) Whether to enter an external page via the OK button; 5) Whether to automatically restore the Launcher scene state after playback is complete. The server scheduling method can be REST API pull, HTTP push + long connection, CDN edge cache delivery, and AI dynamic bidding system.

[0067] In some embodiments, the ad request method may be as follows: Figure 5As shown. The Launcher sends an ad data request to the ad state machine. The ad state machine checks preconditions, namely whether the network is on, whether the End User License Agreement (EULA) is authorized, and whether the device is powered on. If any condition is not met, the current playback stops; if all conditions are met, an ad data request is sent to the ad server. The ad server returns response data. If the response data indicates a request failure, the current playback stops; if the response data indicates a request success, a formatting request is sent to the data processing module. The formatting request includes the response data. The data processing module identifies the ad type. If it is a video ad, it sends a data request to the Video Ad Serving Template (VAST) server, and the VAST server returns template data. The data processing module sends a formatting completion message to the ad state machine, which includes the template data. The ad state machine creates an ad instance based on the template data, and returns a creation success message to the ad state machine after the ad instance is created. The ad state machine sends a playback preparation completion message to the launcher. The ad state machine is used to manage ad lifecycle, frequency control, and skip logic. The ad state machine can be set with switches to control ad playback and skipping.

[0068] The system determines whether to display ads, the ad type, and the triggering method for the playback process based on multiple constraints, including user behavior, system status, and advertising operations. User behavior includes: number of launches, frequently opened applications, usage duration, and viewing preferences. System status includes network availability, chip load, and memory availability. Multiple advertising constraints include exposure frequency control (e.g., a maximum of X times within N hours), priority preemption, category tag matching, and bidding ranking when multiple ads are competing.

[0069] In some embodiments, the display device 200 runs a browser process and a media asset playback process. The browser process processes the first page, i.e., page data, through the shared rendering pipeline and sends it to the display 260 so that the display 260 displays the first page. When the Launcher detects that the playback conditions of the first media asset are met, it can also send a playback request for the first media asset to the server 400. It can receive the first media asset data sent by the server, and then call the media asset playback process through inter-process communication (IPC) between the browser process and the media asset playback process so that the media asset playback process decodes the first media asset data, obtains video frames, and transmits the video frames to the shared rendering pipeline. The inter-process communication can be implemented through an IPC communication module, which is used for message passing and state synchronization between the browser process and the media asset playback process.

[0070] The media asset playback process independently parses and decodes the video stream of the first media asset using either a hardware codec or a software codec, generating graphical frame data, i.e., video frames, without relying on system-wide window management or the SurfaceView in the Android system. The media asset playback process can be equivalent to a media player, or it can be a main process or a sub-process within a media player; its function is to perform operations such as decoding the media asset.

[0071] This application implements decoding, transparency blending, and display functions based on the GStreamer multimedia framework. The GStreamer multimedia framework includes a decoding plugin (ESDecoder), a transformation plugin (Transform), and a display plugin (DFBSink). The decoding plugin decodes the video stream in the first media asset data through a Human User Interface (HUI). The media asset playback process can call the decoding plugin to receive the video stream, perform hardware decoding through the HUI interface, and then send the decoded video frames to the transformation plugin (Transform).

[0072] This application's embodiments reuse the thumbnail function's decoding plugin. Addressing the issue that the HUI thumbnail interface only supports single-frame callbacks and is unsuitable for continuous playback, this application can mask the frame discarding logic in thumbnail mode, extend the HUI interface to support continuous frame callbacks, and resolve the impact of the HUI layer's pause mechanism on continuous playback. Based on the image height returned by the HUI interface being aligned to 64 bytes (2560×720 → 2560×704), the cropping region (crop_bottom=16) can be handled in the conversion plugin to maintain the correct aspect ratio for image processing. Since the framebuffer address provided by MTK cannot be directly accessed, the vdec_remap method can be used for address mapping, sharing memory through the DMA-buf mechanism. This application can also distinguish playback scenarios through video play mode parameters, dynamically constructing corresponding pipeline structures, and supporting mixed playback modes (such as 3D advertisements + audio).

[0073] In some embodiments, the first media asset data requires a certain amount of time from decoding to display, during which time a blank or black screen will be displayed on the first page. To avoid user confusion regarding the content, a preview image can be displayed first, and then replaced once the first media asset data display process is complete. The preview image can be stored in a preset storage location on the display device 200, or it can be added to the first media asset data sent by the server 400.

[0074] Specific implementation methods may include: before decoding the first media asset data to obtain video frames, a preview image can be obtained from a preset storage location or the first media asset data. This preview image is then transmitted to the shared rendering pipeline. Based on the layer position relationship of the screen display layer, the shared rendering pipeline performs image compositing on the first page and the preview image to obtain the third page, with the preview image located on the media asset display layer. Finally, the monitor 260 is controlled to display the third page. Alternatively, after using the shared rendering pipeline to perform image compositing on the first page and video frames to obtain the second page, displaying the second page can be replaced by displaying the third page. Furthermore, the preview image can also be displayed when the video buffer reaches 50%.

[0075] The embodiments of this application can achieve a transition effect of preloading and displaying static images and then switching to video, avoiding a bad visual experience for users by having blank or black screens occupying space while waiting for video decoding and display.

[0076] Step S402: Based on the layer position relationship of the screen display layer, the first page and video frames are composited using the shared rendering pipeline to obtain the second page. The screen display layer includes a user interface layer and a media asset display layer. The layer position relationship is as follows: the media asset display layer is located above the user interface layer, the first page is located in the user interface layer, and the video frames are located in the media asset display layer.

[0077] A shared rendering pipeline is an architectural design in modern graphics systems used to uniformly process graphics / video content from multiple sources and efficiently composite the final image. Its core goal is to avoid resource waste, timing discrepancies, and compositing conflicts caused by multiple independent rendering paths, achieving high-performance, low-latency, and highly consistent multi-layer display.

[0078] In some embodiments, one implementation of combining a first page and a video frame to obtain a second page by using a shared rendering pipeline based on the layer position relationship of the screen display layer may include: dividing the video frame into a first region image and a second region image using a shared rendering pipeline. The first region image and the second region image have different display areas in the video frame. Then, the transparency of each first position in the first region image is obtained, and the second region image is converted to a target format to obtain a third region image, the target format being an image format including transparency. The transparency of each first position in the first region image is used to fill the transparency of the second position in the third region image corresponding to the first position, to obtain a fourth region image. Finally, based on the layer position relationship of the screen display layer, the first page and the fourth region image are combined to obtain the second page.

[0079] For example, the decoded video frame is in NV21 format with a resolution of 2560×720. This video frame is separated into a left image (1280×720) and a right image (1280×720). The right image is converted from NV21 to ARGB format, and the transparency value at each position is identified from the left image. The transparency values ​​of the left image are then used to fill the transparency (A channel) of the right image, resulting in the processed image. This processed image is then composited with the first page to obtain the second page.

[0080] A shared rendering pipeline can include a conversion plugin and a display plugin. The conversion plugin is used for image format conversion and transparency compositing, while the display plugin is used to draw images to the OSD layer via the Direct Frame Buffer (DFB) interface, supporting correct display of transparency. This application's embodiments reuse the basic functionality of the display plugin and extend support for transparency channel processing, ensuring rendering efficiency is synchronized with video.

[0081] In this embodiment, the decoded video frames can be written to the OSD layer of the display device through a frame buffer mapping method, so that the video is presented in real time on the OSD layer without the need for the system to perform additional layer compositing.

[0082] The user interface layer only overlays pop-up elements drawn by the media asset display layer, without affecting the underlying business UI logic. Furthermore, it supports interactive capabilities such as click-to-jump, remote closure, billing callback, exposure monitoring, mute control, and playback interruption callback. The media asset playback process uses an internal video rendering engine to decode video frames in real time, combined with an internal clock synchronization mechanism, ensuring smooth, stutter-free ad playback. Even if the Launcher UI performs numerous animations and page refreshes, no frame drops will occur in the ad display.

[0083] This application embodiment outputs video frames directly to the OSD layer through the media asset playback process, forming the ability to overlay video content in the Launcher or system interface, which is a groundbreaking system-level graphics processing and media rendering.

[0084] It should be noted that this application can use HTML + CSS front-end rendering, or it can use OpenGL / Vulkan 2D HUD layer overlay, DirectFB overlay, DRM hardware overlay, and WebGPU rendering plane, etc. Even if the rendering implementation is different, as long as the media asset presentation layer has a higher display priority than the Launcher UI layer, and the media content can be played in real time, it is acceptable.

[0085] Step S403: Control the display to show the second page.

[0086] For example, the second page can be as follows: Figure 6 As shown. The top layer of the first page displays a video with a mix of transparent and semi-transparent elements.

[0087] In some embodiments, after the display shows the second page, a timer can also be started. If the received key instruction is a first key instruction (which is a key instruction to jump to the details page of the first media asset) before the timer reaches its preset duration, and the received key instruction is a second key instruction (which is a key instruction other than the first key instruction), the operation corresponding to the first key instruction is executed. If the received key instruction is a second key instruction (which is a key instruction other than the first key instruction), the operation corresponding to the second key instruction is not executed. If the received key instruction is a third key instruction (which includes both the first and second key instructions) after the timer reaches its preset duration, and the received key instruction is a third key instruction (which includes both the first and second key instructions), the operation corresponding to the third key instruction is executed. For example, the first key instruction can be the instruction corresponding to the confirmation key, and the second key instruction can be the instruction corresponding to the back key or the exit key.

[0088] In some embodiments, the advertising playback method may be as follows: Figure 7 As shown. After creating an ad instance, the ad instance is mounted to a global DOM container, providing a stable and manageable host environment for the ad content, ensuring that the ad can be correctly inserted into the page and rendered. Then, the ad template is mounted to the container to actually render the ad's HTML structure into the page, making it visible and interactive. Next, a player instance is created. The player sends the start parameters to the Data Management Platform (DMP) module, and the DMP module starts playback and sends a start success message to the player. The player sends interactive styles to the browser process and sends intercepted key press messages to the key press monitoring module. The browser process displays the interactive styles. The key press monitoring module starts a timer, listening for user key presses during the countdown. If an OK key is received, the start operation is executed, i.e., the ad details page is displayed; if other key presses are received, the interception is not performed. After the countdown ends, the key press interception is lifted, allowing the user to terminate the ad display using the back button.

[0089] After the advertisement finishes playing, the player can send a completion message to the user interface module. The user interface module then cancels the display of interactive styles. Alternatively, interactive styles can continue to be displayed after the advertisement finishes playing. The key monitoring module can listen for all key presses and, upon receiving the user's input of the back or close key, exit the advertisement page, thus canceling the display of interactive styles.

[0090] In some embodiments, the timing diagram of the media asset display method can be as follows: Figure 8As shown. When the Launcher detects that the playback conditions of the first media asset are met, it transmits the first page to the browser process. The browser process transmits the first page to the shared rendering pipeline and sends a call command to the media asset playback process. The media asset playback process decodes the first media asset data to obtain video frames and transmits the video frames to the shared rendering pipeline. Based on the layer position relationship of the screen display layer, the shared rendering pipeline performs image compositing on the first page and the video frames to obtain the second page, and sends the second page to the display 260, which displays the second page.

[0091] In some embodiments, the infrastructure diagram can be as follows: Figure 9 As shown. The application layer includes the Launcher. The Launcher can send operation signals or page navigation signals during user interaction to the browser process. The middleware layer includes the browser process and the media asset playback process. The browser process includes a page rendering module, an OSD layer generation module, a strategy parsing module, and a rendering and decoding signaling control module. The page rendering module is used to transmit the first page to the shared rendering pipeline, and is also used for displaying the ad DOM, countdown timer, and navigation buttons. The media asset display layer generation module is used to generate the user interface layer and the media asset display layer. The strategy parsing module is used to parse the ad data sent by the server. The rendering and decoding signaling control module is used to send playback instructions, statuses, and events to the media asset playback process.

[0092] The media asset playback process includes a media asset loader, a decoder (hardware / software decoding), a renderer, and a playback status reporting module. The media asset loader loads the media assets. The decoder decodes the media assets. The renderer sends the decoded video frames directly to the shared rendering pipeline. The playback status reporting module reports the playback status to the server (400).

[0093] The hardware layer includes a hardware decoder, a display driver, and a HUI interface. The hardware decoder uses dedicated hardware to decode video and audio. The display driver outputs image data to the monitor. The HUI interface is used by the media playback process to perform operations such as decoding.

[0094] Server 400 includes a Content Delivery Network (CDN), a delivery rules engine, and a billing and reporting interface. The CDN caches videos and distributes them to users based on proximity. The delivery rules engine determines whether the ad request sent by display device 200 meets the display conditions according to preset strategies, thus deciding whether to return ad data. The billing and reporting interface records ad impressions / clicks and other behaviors, and performs billing and settlement accordingly, while also providing data support for performance analysis.

[0095] This application embodiment adopts a dual-process collaborative architecture of browser process and media asset playback process. The browser process is responsible for running the Launcher interface and UI rendering of the display device 200, while the media asset playback process is independently responsible for the playback, decoding, and rendering of the advertising video content. The two processes communicate with each other through system message queues or IPC interfaces to complete the scheduling, rendering, playback control, and status feedback of advertisements. Unlike the implementation method where the display device 200 renders pop-up advertisements directly within the same process, this application embodiment is based on a multi-process isolation system architecture in Linux, separating user interface rendering from media decoding to ensure both system stability and playback performance. When the interface switches quickly or background business is blocked, the advertisement playback can still remain independent and stable, avoiding stuttering, black screen, or flickering issues. In addition, the multi-process mode can also ensure the rendering priority of key advertisements and improve the reach rate of commercial placements.

[0096] The browser process introduces a media asset presentation layer, which sits above the Launcher's main UI and uses a transparent background to achieve an overlay pop-up effect. Upon receiving the ad delivery strategy instruction, the browser process creates the media asset presentation layer (the pop-up window) in the interface layer and sends a playback request to the media asset playback process. The media asset playback process parses the ad stream and returns video frames, which are then displayed in the media asset presentation layer using shared memory or shared rendering relationships, thus completing the entire display chain.

[0097] Compared to distributed, same-process implementations, the dual-process solution in this application has the following advantages: 1) UI blocking will not affect media decoding, playback will not be interrupted, and it has strong stability. 2) Multiple processes provide advertisements with independent execution space, unaffected by other page logic, achieving a higher display success rate. 3) Process isolation reduces the risk of crash propagation and improves system security. 4) The decoder can be controlled by the system's underlying layer, ensuring consistent operation on different vendors' CPUs, GPUs, or decoding architectures, with higher hardware compatibility. 5) All display states can be reported in a standardized manner, enabling advertisers to fully evaluate the campaign's effectiveness and facilitating accurate billing and tracking.

[0098] The embodiments of this application can achieve overlay advertising display capabilities without modifying the underlying Linux graphics stack or introducing a new system-level window composition framework, minimizing system modifications, ensuring compatibility with existing software architectures, and enabling rapid deployment to mass-produced devices.

[0099] This application's embodiments can also perform exposure reporting, playback completion reporting, click reporting, and failure reporting, and each delivery can be fully recorded and traced. Through strategy configuration, the system can support advanced display capabilities such as targeted delivery, frequency control restrictions, prevention of excessive reach, and A / B testing.

[0100] In some embodiments, to reduce memory usage, ad rendering and media playback can be integrated into the same browser runtime environment, retaining only the media playback thread and the front-end rendering thread. Overlay advertising is still implemented through a unified rendering layer; only the structure is changed, not the process logic.

[0101] In some embodiments, if the browser process receives a message from the media asset playback process indicating that the playback of the first media asset has been completed or interrupted, it can cancel the display of the media asset presentation layer, that is, it can restore the display of the first page.

[0102] In some embodiments, the first page includes a carousel slot for looping multiple second media assets. One implementation of transmitting the first page to the shared rendering pipeline when the playback conditions of the first media asset are met may include: controlling the display 260 to display the first page when the playback conditions of the first media asset are met, and then sending a first pause playback command to the carousel player, causing the carousel player to pause the looping playback of the multiple second media assets and record the playback progress in response to the first pause playback command. After receiving the first pause playback message sent by the carousel player, the first page with the looping playback of the multiple second media assets paused is transmitted to the shared rendering pipeline. The shared rendering pipeline is used to perform image compositing on the first page and video frames to obtain the second page, which is then displayed.

[0103] After displaying the second page, if a message indicating that the first media asset has finished playing or has been interrupted is received, a first playback command is sent to the carousel player so that the carousel player responds to the first playback command and loops multiple second media assets in the first page, starting from the playback progress.

[0104] For example, such as Figure 10 As shown, the first page includes a carousel position 101, which is used to sequentially display images 1 to 5 every 2 seconds. When the playback conditions of the first media asset are met, the carousel position 101 can pause the loop display, that is, after displaying image 2, it will not switch again, the playback progress will be recorded as image 2, and then the page after the first media asset and the first page are superimposed will be displayed, as shown. Figure 6 As shown. After the first media asset finishes playing, the display can be restored as shown. Figure 10 As shown on the page, carousel position 101 can continue to be displayed in a loop according to the playback progress of image 2.

[0105] In some embodiments, the first page includes a signal source preview window for playing preview content of the signal source. One implementation of transmitting the first page to the shared rendering pipeline when the playback conditions of the first media asset are met may include: controlling the display 260 to display the first page and sending a second pause playback command to the signal source preview module to cause the signal source preview module to pause playback of the signal source preview content. After receiving the second pause playback message from the signal source preview module, the first page with the paused playback of the signal source preview content is transmitted to the shared rendering pipeline. The shared rendering pipeline is used to perform image compositing on the first page and video frames to obtain a second page, which is then displayed.

[0106] After displaying the second page, if a playback completion or interruption message for the first media asset is received, a second playback command is sent to the signal source preview module so that the signal source preview module responds to the second playback command and plays the preview content of the signal source on the first page.

[0107] For example, such as Figure 10 As shown, the first page includes a signal source preview window 102, which displays preview content of recently played signal sources or recommended positions. When the playback conditions of the first media asset are met, the signal source preview window 102 can pause the playback of the preview content, display the video frames played during the pause, or display the image corresponding to the default signal source. Then, the page after the first media asset and the first page are overlaid is displayed, such as... Figure 6 As shown. After the first media asset finishes playing, the display can be restored as shown. Figure 10 On the page shown, the signal source preview window 102 can continue to play the preview content.

[0108] This application embodiment can uniformly take over remote control input and pause Launcher automatic behaviors, such as carousel loops and automatic playback of recommended slots, to ensure that the advertising process is not interrupted. Upon completion of playback, it automatically exits the media asset display layer and restores the interface focus position and state.

[0109] like Figure 11 As shown, media playback is interrupted after the second page is displayed in the following scenarios: Scenario 1: After the system message listening module detects STR standby, shutdown, or scheduled shutdown messages, it pushes a shutdown notification to the player. The player stops media playback and sends an interruption message to the Launcher. The Launcher cancels the display of the media presentation layer through the browser process to restore the display of the first page.

[0110] Scenario 2: When the screen casting service detects a screen casting initiation or request, it pushes a screen casting trigger message to the player. The player stops media playback and sends an interruption message to the Launcher. The Launcher cancels the display of the media presentation layer through the browser process to restore the display of the first page, and then sends a media closing message to the screen casting service to initiate the screen casting process.

[0111] Scenario 3: The application launcher detects the user's command to launch the application and pushes an application launch message to the player. The player stops media playback, cancels key blocking, and then sends a resource release command to the resource manager. The resource manager releases the player's resources and then sends a resource release complete message to the player. The player sends a media close message to the application launcher, causing the application launcher to start the application.

[0112] Scenario 4: After detecting a source switching operation, the source switching module pushes a source switching message to the player to stop media playback and sends an interrupt message to the Launcher. The Launcher cancels the display of the media presentation layer through the browser process to restore the display of the first page, and then sends a media close message to the source switching module to start the source switching process.

[0113] Scenario 5: After detecting a forced upgrade, the upgrade service pushes an upgrade notification to the player. The player stops media playback and then sends a resource release command to the resource manager. The resource manager releases the player's resources and then sends a resource release complete message to the player. The player sends a media close message to the upgrade service, causing the upgrade service to begin the upgrade process.

[0114] Scenario 6: Upon detecting a "close / exit" command, the Launcher sends a stop message to the ad state machine. The ad state machine sends a "terminate playback" message to the player, which stops media playback and then sends a "release resources" command to the resource manager. The resource manager releases timers, state locks, and player resources, and then sends a "resource release complete" message to the player. The player then sends a playback status reset message to the ad state machine.

[0115] In some embodiments, after displaying the second page, the system pop-up service, upon receiving an instruction to display a message pop-up, may send a message pop-up display message to the media asset playback process if it detects that the first media asset is playing. The media asset playback process sends a message indicating that the message pop-up's layer is lower than the media asset display layer to the system pop-up service. The system pop-up service transmits the message pop-up content to the shared rendering pipeline. Using the shared rendering pipeline, based on the layer position relationship of the screen display layer, image compositing is performed on the first page, the message pop-up, and the video frame to obtain and display the composite page. The message pop-up is located above the user interface layer and below the media asset display layer. In this embodiment, if a message pop-up is displayed while the first media asset is playing, the message pop-up does not obstruct the playback of the first media asset.

[0116] In some embodiments, after the browser process invokes the media asset playback process, if the media asset playback process detects a playback error or a failed VAST request, it can report the reason for the playback failure to the advertising state machine. The advertising state machine triggers a fallback logic on the browser process. The fallback logic is 3D video → regular video → image. If the browser process obtains the fallback resource, it can recreate the player to play the fallback resource. If it does not obtain the fallback resource, it terminates the playback of the media asset.

[0117] In some embodiments, if playback fails due to ad rendering failure, the first page can be automatically restored. If playback fails due to network unavailability, locally cached ads can be used or display can be stopped. If playback fails due to media asset decoding failure, the encoding format and resolution can be downgraded for playback. If playback fails due to rendering thread lag, the browser can be hot-restarted while maintaining the business state.

[0118] In this embodiment of the application, to ensure playback stability and compatibility with the main interface interaction during the advertisement display process, a unified judgment and processing mechanism is implemented for multiple types of input conditions. 1) Processing mechanism for normal and abnormal input. During advertisement playback, the system can receive various types of input, such as user operations, platform instructions, and playback status feedback. When the input is normal, the system executes according to a predetermined strategy, such as continuing playback, restoring the interface after playback ends, or redirecting. When the input is abnormal, such as network interruption, media resource decoding failure, rendering error, etc., the system captures the abnormality through the player status detection module, immediately terminates the current playback process, closes the media asset display layer, and restores to the main interface, ensuring the continuity and availability of the overall system.

[0119] 2) Single and Multiple Input Processing Mechanism. When the system receives a single input event within a short period of time, it directly triggers the corresponding processing flow, such as executing a jump or exiting ad playback. When multiple inputs or sudden continuous inputs occur, the system filters based on the priority rules defined in the input management module, processing only the highest priority event to avoid duplicate processing or conflicting inputs that could cause process chaos, while ensuring the determinism and consistency of the playback status.

[0120] 3) Handling of changes in playback status (on / off). When ad playback is on, the media asset display layer has the highest interface priority, and user input is handled uniformly by the ad logic. After playback is off, the system automatically reverts to the main interface logic, and all input events are responded to by the main interface module again, ensuring consistent behavior after the state switch.

[0121] 4) Handling of Conditions Satisfying and Not Satisfying. Some advertising strategies define preconditions for skipping, interacting, or triggering actions. Examples include the end of a countdown, completion of creative loading, and enabling redirection permissions. When the condition is met, the system allows the corresponding action to be executed; when the condition is not met, the system blocks or delays the relevant operation. By judging these conditions, the effectiveness of strategy execution and the integrity of ad presentation are ensured.

[0122] 5) Input / no input handling mechanism. If the system detects valid input during playback, it will enter the corresponding interaction process; if no input is detected during the entire playback cycle, it will proceed according to the normal playback process until playback is completed, and will automatically exit the media asset display layer and restore the original interface after playback ends.

[0123] 6) Handling of start and end condition inputs. Upon receiving a start condition (such as a browser initiating a playback request), the system initializes the media module, loads the rendering layer, and enters the playback process. Upon receiving an end condition (such as playback completion, strategy termination, external interruption, etc.), the system sequentially executes steps such as playback stop, resource release, and interface restoration to ensure a complete and closed process.

[0124] 7) Differentiated processing of relevant and irrelevant inputs. The system processes inputs related to ad playback (such as confirmation, return, and redirection). Meanwhile, for inputs unrelated to playback (such as volume adjustment and system menu access), the system decides whether to pass them through to the underlying platform according to a predetermined strategy to ensure the independence of ad display from system control logic.

[0125] 8) Handling mechanisms for intermediate critical conditions or state transitions. Several critical conditions may occur during playback, such as the countdown reaching a boundary, the playback state changing from loading to playable, and system resource switching. At the critical point, the system triggers a state machine transition, adjusting ad layer permissions, input strategies, or playback flow to ensure the stability of the transition process and the consistency of the playback experience.

[0126] 9) Handling mechanism for changes in any state, mode, or parameter during the playback process. If changes occur during playback due to factors such as network quality changes, media resolution switching, changes in decoding capabilities, or system resource usage, the system will downgrade, buffer, or retry the playback process based on the current playback mode and strategy. If necessary, playback can be stopped and the main interface restored to ensure platform availability is not affected.

[0127] In some embodiments, the media asset playback process can be as follows: Figure 12 As shown. The Launcher page is displayed, ad creatives are requested, the server returns the creatives, the browser process creates the ad DOM, and calls the media playback process via IPC commands. The media playback process loads the ad video and renders the ad video frames using the GPU. The Launcher page can be displayed again after normal playback completes. Playback is interrupted upon receiving an abnormal operation message, allowing a return to the Launcher page. Receiving the OK key input allows navigation to the ad landing page, and the Launcher page can be displayed again after closing the ad. Receiving the back or exit key immediately ends ad playback and restores the Launcher page. Receiving system-level messages such as screen mirroring or standby allows closing the ad and restoring the Launcher page. During multiple key inputs, the highest-priority action is executed, and the Launcher page is displayed again after processing.

[0128] This application embodiment implements overlay pop-up video ad display in a Launcher scenario on a pure Linux platform without window compositing services. The video and static interface coexist, video playback does not preempt interface focus, the UI automatically recovers after playback, and it supports ad lifecycle and interactive control. During OSD rendering, in conjunction with the browser process front-end control layer, input event interception, skipping countdowns, automatic destruction upon playback completion, key blocking and restoration, focus state restoration, and Launcher rollback can be implemented.

[0129] Compared to solutions that rely on Android window management, the embodiments of this application have a different implementation path, are less invasive, have a wider range of applications, and stronger commercial scalability. They can be applied to large-scale deployments of smart TV products of different brands, models, and Linux architectures.

[0130] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the first page; The controller coupled to the display is configured to: When the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain a video frame, and the video frame is transmitted to the shared rendering pipeline. The shared rendering pipeline performs image compositing on the first page and the video frame based on the layer position relationship of the screen display layer to obtain the second page; wherein, the screen display layer includes a user interface layer and a media asset display layer, and the layer position relationship is such that the media asset display layer is located above the user interface layer, the first page is located in the user interface layer, and the video frame is located in the media asset display layer; Control the display to show the second page.

2. The display device according to claim 1, characterized in that, After controlling the display to show the second page, the controller is configured to: Start the timer; If the received key instruction is a first key instruction and the timer has not reached the preset duration, the operation corresponding to the first key instruction is executed. The first key instruction is a key instruction to jump to the details page of the first media asset. If the received key instruction is the second key instruction, the operation corresponding to the second key instruction will not be executed. The second key instruction is a key instruction other than the first key instruction. When the timer reaches the preset duration, if a third button instruction is received, the operation corresponding to the third button instruction is executed. The third button instruction includes the first button instruction and the second button instruction.

3. The display device according to claim 1, characterized in that, The controller performs image compositing on the first page and the video frame based on the layer position relationship of the screen display layer through the shared rendering pipeline to obtain a second page, which is further configured as follows: The video frame is divided into a first region image and a second region image through the shared rendering pipeline. The first region image and the second region image have different display areas in the video frame. The transparency of each first position in the first region image is obtained, and the second region image is converted into a target format to obtain a third region image, wherein the target format is an image format including transparency; The transparency of each first position in the first region image is filled with the transparency of the second position in the third region image corresponding to the first position to obtain the fourth region image; Based on the layer position relationship of the screen display layer, the first page and the fourth region image are composited to obtain the second page.

4. The display device according to claim 1, characterized in that, The first page includes a carousel slot for looping multiple second media assets. The controller, upon meeting the playback conditions of the first media asset, transmits the first page to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a first pause playback command is sent to the carousel player, so that the carousel player responds to the first pause playback command, pauses the loop playback of multiple second media assets, and records the playback progress; Upon receiving the first pause message from the carousel player, the first page of the loop that pauses the playback of multiple second media assets is transmitted to the shared rendering pipeline.

5. The display device according to claim 4, characterized in that, After controlling the display to show the second page, the controller is further configured to: If a playback completion or interruption message for the first media resource is received, the display is controlled to show the first page; A first playback command is sent to the carousel player, so that the carousel player responds to the first playback command and loops multiple second media assets on the first page starting from the playback progress.

6. The display device according to claim 1, characterized in that, The first page includes a signal source preview window, which is used to play a preview of the signal source. The controller, upon meeting the playback conditions of the first media asset, transmits the first page to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a second pause playback command is sent to the signal source preview module to cause the signal source preview module to pause the playback of the preview content of the signal source; After receiving the second pause playback message sent by the signal source preview module, the first page of the preview content of the paused signal source is transmitted to the shared rendering pipeline.

7. The display device according to claim 6, characterized in that, After controlling the display to show the second page, the controller is further configured to: If a playback completion or interruption message for the first media resource is received, the display is controlled to show the first page; A second playback command is sent to the signal source preview module, so that the signal source preview module responds to the second playback command and plays the preview content of the signal source in the signal source preview window.

8. The display device according to claim 1, characterized in that, When the playback conditions of the first media asset are met, the controller decodes the first media asset data to obtain a video frame and transmits the video frame to the shared rendering pipeline, and is further configured to: When the playback conditions of the first media asset are met, a playback request for the first media asset is sent to the server; Receive the first media data sent by the server based on the playback request; Obtain the media playback mode of the first media asset; If the media asset playback mode is to display video overlay, the first media asset data is decoded to obtain video frames, and the video frames are transmitted to the shared rendering pipeline.

9. The display device according to claim 1, characterized in that, Before decoding the first media asset data to obtain video frames, the controller is further configured to: Obtain the preview image from the preset storage location or the first media asset data; The preview image is transmitted to the shared rendering pipeline; Based on the layer position relationship of the screen display layer, the shared rendering pipeline performs image compositing on the first page and the preview image to obtain the third page, wherein the preview image is located in the media asset display layer; Control the display to show the third page.

10. A method for displaying media assets, characterized in that, include: When the playback conditions of the first media asset are met, the first page is transmitted to the shared rendering pipeline, and the first media asset data of the first media asset is decoded to obtain a video frame, and the video frame is transmitted to the shared rendering pipeline. The shared rendering pipeline performs image compositing on the first page and the video frame based on the layer position relationship of the screen display layer to obtain the second page; wherein, the screen display layer includes a user interface layer and a media asset display layer, and the layer position relationship is such that the media asset display layer is located above the user interface layer, the first page is located in the user interface layer, and the video frame is located in the media asset display layer; Control the display to show the second page.

Images