Display device and media display method
Patent Information
- Application Number
- CN202610704240.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-20
- Publication Date
- 2026-09-25
AI Technical Summary
[0004]然而,由于正片解码器暂停后,虽然停止帧数据更新,但依然可以使用显示载体,导致显示的屏幕中仍残留有正片的最后一帧画面
[0013]上述技术方案具有如下优点或有益效果:在切换到第二媒资播放之前,可以提前解码第二媒资的媒资数据。在到达第二预设进度时,第二解码器已经有了准备好的、连续的视频帧数据。此时再停止第一解码器并移交句柄,显示模块可以立即获取到第二解码器的图像,避免了因第二解码器启动慢、缓冲不足而导致的黑屏或花屏等现象。
Smart Images

Figure CN122824931A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display device technology, and in particular to a display device and a media asset display method. Background Technology
[0002] With the continuous improvement of the performance of smart terminal devices such as smart TVs, set-top boxes, tablets, and smartphones, and the increasing complexity of their operating systems, multi-channel playback support has become a standard feature of these devices. To enhance the user viewing experience during playback, advertisements can be inserted and displayed through multi-channel playback.
[0003] Multi-channel playback refers to running multiple independent decoders simultaneously on the same smart terminal device to concurrently decode and render multiple different audio and video streams. When using multi-channel playback for ad insertion, the main video decoder is first used to decode and render the main video. When the main video reaches a specified point, the decoding and playback process of the main video is paused, and the ad decoder is simultaneously started to decode and display the ad content.
[0004] However, because the main video decoder stops updating frame data after pausing, the display medium can still be used, resulting in the last frame of the main video remaining on the screen. If an advertisement is rendered directly at this time, the advertisement will be superimposed on the last frame of the main video. Especially when the resolution or aspect ratio of the main video and the advertisement are inconsistent, the underlying residual frame of the main video cannot be completely covered by the advertisement, resulting in the main video being exposed in the edge areas. Summary of the Invention
[0005] Some embodiments of this application provide a display device and a media asset display method. By setting the number of handles used to obtain the display carrier to 1 through the handle management module, it can be ensured that only one decoder holds the handle at any given time, thereby displaying only the image corresponding to the frame data transmitted by one decoder. This can effectively prevent the phenomenon of image superposition caused by multiple decoders transmitting data to the display module at the same time.
[0006] In a first aspect, some embodiments of this application provide a display device, including: monitor; The controller is configured as follows: In response to the command to open the media asset application, the number of target handles is set to 1 through the handle management module. The target handle is the credential for obtaining the display carrier. The display carrier is used to carry the decoded frame data and render the frame data into a graphical resource object of visual image. In response to the instruction of the first media asset in the media asset playback application, the first media asset data of the first media asset is decoded by the first decoder to obtain the first frame data; The first decoder sends a first request to the handle management module, so that the handle management module sends the target handle to the first decoder based on the first request; The first decoder sends the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier. When the first media asset is played to the first preset progress, the second media asset data is decoded by the second decoder to obtain the second frame data; Stop sending the first frame data to the display module through the first decoder, and send a second request to the handle management module through the second decoder, so that the handle management module stops the first decoder from using the target handle based on the second request, and sends the target handle to the second decoder; The second frame data and the display carrier corresponding to the target handle are sent to the display module through the second decoder, so that the display module can display the second image corresponding to the second frame data based on the display carrier.
[0007] The above technical solution has the following advantages or beneficial effects: by setting the number of handles used to obtain the display carrier to 1 through the handle management module, it can be ensured that only one decoder holds the handle at the same time, so that only the frame data transmitted by one decoder is displayed, which can effectively prevent the phenomenon of screen superposition caused by multiple decoders transmitting data to the display module at the same time.
[0008] In some embodiments, after the number of target handles is set to 1 via the handle management module, the controller is further configured to: The handle management module requests a display medium from the display module.
[0009] The above technical solution has the following advantages or beneficial effects: by applying for a display carrier after setting a target handle, the acquisition and initialization of the display carrier can be completed in advance before the media asset playback. During the media asset switching process, there is no need to perform time-consuming display carrier application and initialization operations, thereby avoiding the phenomenon of a brief black screen and significantly improving the user viewing experience.
[0010] In some embodiments, after the second frame data and the display carrier corresponding to the target handle are sent to the display module via the second decoder, so that the display module displays the second image corresponding to the second frame data based on the display carrier, the controller is further configured to: After the second media asset is played, the first decoder sends a third request to the handle management module, so that the handle management module stops the second decoder from using the target handle based on the third request and sends the target handle to the first decoder. The first decoder continues to send the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier.
[0011] The above technical solution has the following advantages or beneficial effects: After the second media asset is played, the first decoder can reacquire the target handle and the display carrier corresponding to the target handle, and then send the display carrier to the display module so that the display module can resume displaying the first media asset's picture based on the previously paused progress, without reloading, thus maintaining playback continuity.
[0012] In some embodiments, the controller execution stops sending the first frame data to the display module via the first decoder, and sends a second request to the handle management module via the second decoder, which is further configured to: When the first media asset is played to the second preset progress, the sending of the first frame data to the display module through the first decoder is stopped, and a second request is sent to the handle management module through the second decoder. The second preset progress is later than the first preset progress.
[0013] The above technical solution has the following advantages or beneficial effects: Before switching to the playback of the second media asset, the media asset data of the second media asset can be decoded in advance. When the second preset progress is reached, the second decoder already has prepared, continuous video frame data. At this point, stopping the first decoder and handing over the handle allows the display module to immediately obtain the image from the second decoder, avoiding black screen or screen distortion caused by slow startup or insufficient buffering of the second decoder.
[0014] In some embodiments, the controller execution setting of the number of target handles to 1 via the handle management module is further configured as follows: Get the currently set quantity flag used to represent the number of target handles; When the quantity flag is 1, the number of target handles is set to 1 through the handle management module.
[0015] The above technical solution has the following advantages or beneficial effects: By introducing a quantity flag, the behavior of limiting the number of target handles to 1 is no longer hardcoded into the code, but is transformed into a configurable parameter. Without recompiling or updating the application, users can change the configured number of target handles, thus adapting to more application scenarios and meeting personalized setting needs.
[0016] In some embodiments, the controller executes an instruction in response to a first media asset in a media asset playback application, decodes the first media asset data of the first media asset through a first decoder to obtain first frame data, which is further configured to: In response to the instruction of the first media asset in the media asset application, the first playback link of the first media asset is obtained through the media asset application and sent to the first player; The first media asset data is downloaded from the first playback link through the first player and sent to the first decoder; The first media data is decoded by the first decoder to obtain the first frame data.
[0017] The above technical solution has the following advantages or beneficial effects: the media asset application is used to obtain the link, the player is used to download the media asset, and the decoder is used for data processing. Only the playback link needs to be passed in as required, and the underlying player and decoder can be adapted without modification, which greatly reduces development and maintenance costs.
[0018] In some embodiments, when the controller executes the function of decoding the second media asset data of the second media asset through the second decoder to obtain the second frame data when the first media asset is played to the first preset progress, the controller is further configured to: When the first media asset reaches the first preset progress, the second playback link of the second media asset is obtained through the media asset application, and the second playback link is sent to the second player; The second media asset data is downloaded from the second playback link through the second player and sent to the second decoder; The second frame data is obtained by decoding the second media data using the second decoder.
[0019] The above technical solution has the following advantages or beneficial effects: the media asset application is used to obtain the link, the player is used to download the media asset, and the decoder is used for data processing. Only the playback link needs to be passed in as required, and the underlying player and decoder can be adapted without modification, which greatly reduces development and maintenance costs.
[0020] In some embodiments, the controller sends the first frame data and the display carrier corresponding to the target handle to the display module via the first decoder, which is further configured to: The first decoder obtains the display carrier corresponding to the target handle in the handle management module; The first frame of data and the display carrier are sent to the display module through the first decoder.
[0021] The above technical solution has the following advantages or beneficial effects: when playing the first media asset, there is no need to perform time-consuming operations such as requesting a display carrier from the display module and initialization operations. It is only necessary to obtain the display carrier from the handle management module, thereby speeding up the display of the first media asset and reducing the user's waiting time.
[0022] In some embodiments, the controller executes the sending of the second frame data and the display carrier corresponding to the target handle to the display module via the second decoder, which is further configured to: The display carrier corresponding to the target handle in the handle management module is obtained through the second decoder; The second frame data and the display carrier are sent to the display module via the second decoder.
[0023] The above technical solution has the following advantages or beneficial effects: when playing the second media asset, there is no need to perform time-consuming operations such as requesting a display carrier from the display module and initialization operations. It is only necessary to obtain the display carrier from the handle management module, thereby speeding up the display of the second media asset and reducing the user's waiting time.
[0024] Secondly, some embodiments of this application provide a media asset display method, including: In response to the command to open the media asset application, the number of target handles is set to 1 through the handle management module. The target handle is the credential for obtaining the display carrier. The display carrier is used to carry the decoded frame data and render the frame data into a graphical resource object of visual image. In response to the instruction of the first media asset in the media asset playback application, the first media asset data of the first media asset is decoded by the first decoder to obtain the first frame data; The first decoder sends a first request to the handle management module, so that the handle management module sends the target handle to the first decoder based on the first request; The first decoder sends the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier. When the first media asset is played to the first preset progress, the second media asset data is decoded by the second decoder to obtain the second frame data; Stop sending the first frame data to the display module through the first decoder, and send a second request to the handle management module through the second decoder, so that the handle management module stops the first decoder from using the target handle based on the second request, and sends the target handle to the second decoder; The second frame data and the display carrier corresponding to the target handle are sent to the display module through the second decoder, so that the display module can display the second image corresponding to the second frame data based on the display carrier.
[0025] The above technical solution has the following advantages or beneficial effects: by setting the number of handles used to obtain the display carrier to 1 through the handle management module, it can be ensured that only one decoder holds the handle at the same time, so that only the frame data transmitted by one decoder is displayed, which can effectively prevent the phenomenon of screen superposition caused by multiple decoders transmitting data to the display module at the same time.
[0026] The technical solution provided in this application embodiment can, in response to an instruction to open a media asset application, set the number of target handles to 1 through a handle management module. The target handle is a credential for obtaining a display carrier, which is a graphical resource object used to carry decoded frame data and render the frame data into a visual image. In response to an instruction to play a first media asset in the media asset application, the first media asset data of the first media asset is decoded by a first decoder to obtain the first frame data. Then, a first request is sent to the handle management module through the first decoder, causing the handle management module to send the target handle to the first decoder based on the first request. Finally, the first decoder sends the first frame data and the display carrier corresponding to the target handle to the display module, causing the display module to display the first image corresponding to the first frame data based on the display carrier. When the first media asset reaches a first preset progress, the second media asset data of the second media asset is decoded by a second decoder to obtain the second frame data. Then, the sending of the first frame data to the display module through the first decoder is stopped, and a second request is sent to the handle management module through the second decoder, causing the handle management module to stop the first decoder from using the target handle based on the second request and send the target handle to the second decoder. Finally, the second frame data and the display carrier corresponding to the target handle are sent to the display module through the second decoder, so that the display module displays the second image corresponding to the second frame data based on the display carrier. In this embodiment, the handle management module sets the number of handles used to obtain the display carrier to 1, which ensures that only one decoder holds the handle at any given time, thereby displaying only the image corresponding to the frame data transmitted by one decoder. This effectively prevents the phenomenon of image superposition caused by multiple decoders transmitting data to the display module at the same time. Attached Figure Description
[0027] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0028] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application; Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application; Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application; Figure 4 A flowchart illustrating a first media asset display method provided in some embodiments of this application; Figure 5Timing diagrams for a first media asset display method provided in some embodiments of this application; Figure 6 A flowchart illustrating a second media asset display method provided in some embodiments of this application; Figure 7 Timing diagrams for a second media asset display method provided in some embodiments of this application; Figure 8 A flowchart illustrating a third media asset display method provided in some embodiments of this application; Figure 9 Timing diagrams for a third media asset display method provided in some embodiments of this application; Figure 10 Timing diagram for a fourth media asset display method provided in some embodiments of this application. Detailed Implementation
[0029] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.
[0030] In this embodiment, display device 200 generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
[0031] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch operation, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.
[0032] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.
[0033] like Figure 1The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0034] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television and Internet Protocol television.
[0035] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.
[0036] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.
[0037] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0038] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.
[0039] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, the communication device 220 may include a WiFi module. When the display device 200 supports Bluetooth connection communication, the communication device 220 may include a Bluetooth module.
[0040] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.
[0041] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.
[0042] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0043] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).
[0044] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.
[0045] In some embodiments, the user input interface 280 can be used to receive instructions from user input. For example, the user input interface 280 can receive text information entered by the user in the user interface. The user input interface 280 can also receive confirmation instructions from the user regarding controls in the user interface. The user input interface 280 can also receive voice instructions entered by the user.
[0046] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.
[0047] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.
[0048] like Figure 3 As shown, the display device system is divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.
[0049] The application layer mainly includes commonly used applications on TV, as well as the application framework. The commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps.
[0050] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interface for these functions (toolbar, status bar, menu, dialog box).
[0051] Native apps can support online or offline access, push notifications, or access to local resources.
[0052] In this embodiment, the application layer includes a media asset application. The media asset application is an application used to manage digital content such as video, audio, images, and text.
[0053] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.
[0054] In this embodiment, the middleware layer includes a first player, a second player, a first decoder, and a second decoder. The first and second players provide a unified playback interface for media asset applications and are responsible for calling the decoders to decode and render audio and video. The first and second decoders are used to call the HAL interface to decode media asset data.
[0055] Given that the management of display media is typically distributed across the operating system and application layers, lacking a unified, intelligent, and scene-aware core mechanism, it is difficult to accurately and dynamically control the switching timing of multi-channel and single-channel displays, and to promptly and thoroughly reclaim or hide unnecessary display media based on scene changes. This application's embodiment adds a handle management module to the middleware layer.
[0056] The handle management module has the following functions: 1) Dynamically setting the number of target handles; 2) Requesting the necessary display carriers for the set target handles for subsequent use; 3) Allocating target handles based on received handle acquisition requests, and ensuring that only one decoder can use the target handle at a time when the number of target handles is 1; 4) During media asset switching playback, there is no need to request display carriers again, and the media asset screen can be refreshed directly.
[0057] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. The drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.
[0058] In this embodiment, the HAL interface includes a display module. The display module is used to render the decoded frame data based on the display carrier and send the rendered image to the display 260 for display.
[0059] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.
[0060] With the continuous improvement of the performance of smart terminal devices such as smart TVs, set-top boxes, tablets, and smartphones, and the increasing complexity of their operating systems, multi-channel playback support has become a standard feature of these devices. To enhance the user viewing experience during playback, advertisements can be inserted and displayed through multi-channel playback.
[0061] Multi-channel playback refers to running multiple independent decoders simultaneously on the same terminal device and concurrently decoding and rendering multiple different audio and video streams. For example... Figure 4As shown, when inserting ads using multi-channel playback, the main video source is first loaded with the main video asset data, and the main video decoder is used to decode and render the main video asset data. The ad asset data is preloaded from the ad video source and decoded using the ad decoder, but not rendered. When the main video reaches a specified point, the decoding and display process of the main video data is paused, and the decoded ad asset data is displayed. After the ad playback ends, the ad decoder exits, and the main video resumes display.
[0062] In some embodiments, the timing diagram of the media asset display method can be as follows: Figure 5 As shown. In response to the instruction to play the main feature, the media asset application sends a link to load the main feature playback to the main feature player. The main feature player downloads and parses the main feature media asset data, i.e., the main feature elementary stream (ES), and sends the main feature media asset data to the main feature decoder. The main feature decoder decodes the main feature media asset data to obtain the main feature frame data, and after requesting the main feature display carrier from the display module, sends the main feature display carrier and the main feature frame data to the display module. The display module displays the main feature screen corresponding to the main feature frame data based on the main feature display carrier.
[0063] Before the main feature reaches a designated point in the video, the media asset application sends a link to load the ad playback to the ad player. The ad player downloads and parses the ad media asset data, then sends it to the ad decoder. The ad decoder decodes the ad media asset data to obtain the ad frame data.
[0064] When the main feature reaches a designated point in the playback, the media asset application sends a command to pause playback to the main feature player, which then forwards the pause command to the main feature decoder. The main feature decoder then stops sending main feature frame data to the display module. Simultaneously, the media asset application sends a command to play an advertisement to the advertisement player, which in turn forwards the command to the advertisement decoder. After requesting an advertisement display medium from the display module, the advertisement decoder sends the advertisement display medium and advertisement frame data to the display module. The display module then displays the advertisement corresponding to the advertisement frame data based on the advertisement display medium.
[0065] However, because the main video decoder stops updating frame data after pausing, it still uses the display medium requested by the main video decoder, resulting in the last frame of the main video remaining on the displayed screen. If an advertisement is rendered directly at this time, the advertisement will be superimposed on the last frame of the main video. Especially when the resolution or aspect ratio of the main video and the advertisement are different, the underlying residual frame of the main video cannot be completely covered by the advertisement, resulting in the main video being exposed in the edge areas.
[0066] To avoid the overlay of advertising images on the main video, this application provides a display device 200. The structure and functions of each part of the display device 200 can be found in the above embodiments. Furthermore, based on the display device 200 shown in the above embodiments, this embodiment further improves some functions of the display device 200. For example… Figure 6 As shown, controller 250 is configured to perform the following steps: Step S601: In response to the instruction to open the media asset application, the number of target handles is set to 1 through the handle management module.
[0067] A handle is an identifier or index number issued by the operating system or software to an application for security and management convenience, used to indirectly access system resources. The handle hides the actual memory address and internal structure of the system resource. Applications cannot directly access or tamper with this low-level information; they can only manipulate the handle through functions provided by the operating system, thus ensuring system security and stability. A handle can also be understood as a generalized pointer; its specific form may be an integer, an object, or a real pointer, and its purpose is to establish a unique connection between the accessed object and the target object. System resources may include a display medium; in this embodiment, the target handle is the credential for obtaining the display medium. This credential can be an identifier or index number, etc.
[0068] The display carrier in this embodiment is a graphics resource object used to carry decoded frame data and render the frame data into a visual image. The display carrier may include video memory, layers, buffers, and compositor resources.
[0069] Video memory (VRAM) is a high-speed memory designed specifically for graphics processing units (GPUs). Its core function is to provide the GPU with a high-bandwidth data access channel, used to temporarily store all the data required by the GPU when processing graphics, such as textures, vertex information, depth buffers, and the final rendered frame data.
[0070] A buffer is a contiguous area of memory used to hold image pixel data; the most common form is the frame buffer. Essentially, a buffer is a two-dimensional array where each element corresponds to the color value of one or more pixels ultimately displayed on the screen.
[0071] Layers are the basic units for compositors to combine images. They are not just buffers containing pixel data, but composite objects that encapsulate the buffer and its related metadata.
[0072] The compositor is a key component in the graphics display pipeline. It is responsible for collecting all the layers to be displayed and efficiently blending them into a single, complete final image frame based on their respective properties, which is then displayed on the monitor 260.
[0073] In some embodiments, in response to an instruction to open a media asset application, a handle management module can be started, and the number of target handles can be directly set to 1 through the handle management module.
[0074] In some embodiments, in response to an instruction to open a media asset application, a handle management module can be activated. This module can retrieve the currently set quantity flag, which represents the number of target handles. If the quantity flag is 1, the handle management module sets the number of target handles to 1. If the quantity flag is 2, the handle management module sets the number of target handles to 2.
[0075] In some embodiments, setting a quantity flag to characterize the number of target handles may include: controlling the display 260 to display the display management page in response to an instruction to open the display management page, wherein the display management page includes an audio concurrency processing quantity control. If a user confirmation operation is received on the audio concurrency processing quantity control and the audio concurrency processing quantity is set to 1, the quantity flag to characterize the number of target handles is set to 1. If a user confirmation operation is received on the audio concurrency processing quantity control and the audio concurrency processing quantity is set to 2, the quantity flag to characterize the number of target handles is set to 2.
[0076] In some embodiments, the display device 200 may use only one decoder to decode the media asset data. In scenarios where playback switches from the first media asset to the second, to play the second media asset, the playback instance displaying the first media asset is forcibly destroyed, and the original screen buffer in the graphics card is cleared. At this time, the first media asset image on the screen is instantly erased, and decoder resources are released. Before playing the second media asset, the playback startup process needs to be re-executed, the second media asset data is loaded, parameters are reconfigured, and the decoder is started. After the decoder starts, it is necessary to wait until the first frame of the second media asset is successfully decoded and sent to the display buffer before the second media asset image can be displayed. This results in a period of time after the first media asset image disappears before the second media asset image can be displayed, and the user's eye can perceive this unavoidable black screen gap.
[0077] To avoid black screen issues caused by decoding resource release and restarts, in this embodiment, the display device 200 can use two decoders simultaneously to decode media data. For example... Figure 7As shown, after displaying the image of the first media asset, if switching to the second media asset, the media asset application can send the instruction to display the second media asset to the decoder of the second media asset via the player of the second media asset. That is, after the second decoder, it needs to first request a display carrier and perform display carrier initialization operations from the display module, and then send the display carrier to the display module. After the display module sends the decoded frame data of the second media asset to the display module, it can display the image of the second media asset based on the display carrier. Since the process of the second decoder requesting a display carrier and initializing it also takes some time, the image of the second media asset cannot be displayed on the screen in a timely manner, resulting in a flickering black screen due to the temporary display of a blacked-out image. In other words, there is a significant delay between underlying resource reclamation, layer destruction / hiding, and screen updates during media asset switching. This delay causes a brief black screen phenomenon.
[0078] In order to avoid the phenomenon of brief black screen when switching media assets, this embodiment of the application can request a display carrier from the display module after setting the number of target handles to 1 through the handle management module.
[0079] In some embodiments, the display carrier includes a buffer, and the handle management module can request a buffer corresponding to the maximum resolution from the display module. For example, the display module includes buffers corresponding to different resolutions, and can request the buffer with the highest resolution. The resolution can be 4K, 2K, or 1080p, etc.
[0080] In scenarios where the allocated buffer resolution is not the maximum resolution, if the buffer required for the decoded video frame is larger than the allocated resolution buffer, only a portion of the media asset will be displayed on the screen. To display the complete media asset on the screen, you can choose to scale the media asset frame data, but this will require additional video memory resources.
[0081] In this embodiment, the handle management module pre-allocates a buffer corresponding to the maximum resolution. When the resolution of the decoded video frame matches the buffer, the media asset image can be displayed completely. When the resolution of the decoded video frame is less than the buffer's resolution, drawing operations can be performed only within a specific rectangular area of the buffer, while the rest remains unchanged. An offset can also be calculated to ensure that the decoded video frame is drawn precisely in the center of the buffer corresponding to the maximum resolution. This embodiment not only achieves clear and complete display of the video image but also avoids the video memory overhead caused by dynamic scaling, thereby reducing the overall video memory resource usage.
[0082] This application embodiment can request a display carrier after starting the handle management module and setting a target handle, i.e., before playing media asset data. Since the display carrier (including its initialization operation) is completed in advance when the handle management module starts, there is no need to perform time-consuming display carrier request and initialization operations in media asset switching scenarios such as transitioning from the main feature to an advertisement, thereby avoiding the phenomenon of brief black screen and significantly improving the user viewing experience.
[0083] Step S602: In response to the instruction of the first media asset in the media asset playback application, the first media asset data of the first media asset is decoded by the first decoder to obtain the first frame data.
[0084] In some embodiments, one implementation of receiving an instruction to play a first media asset in a media asset application may include: in response to an instruction to open the media asset application, displaying a media asset page corresponding to the media asset application. The media asset page includes at least one media asset control. Receiving a user's confirmation operation on the media asset control via a remote control constitutes receiving an instruction to play the first media asset in the media asset application. The media asset control confirmed by the user is the control corresponding to the first media asset.
[0085] In some embodiments, one implementation of receiving an instruction to play a first media asset in a media asset application may include: in response to an instruction to open the media asset application, displaying the media asset page corresponding to the media asset application. Receiving a user's voice command to play the first media asset is equivalent to receiving an instruction to play the first media asset in the media asset application.
[0086] In some embodiments, one implementation of decoding the first media asset data of the first media asset using a first decoder to obtain the first frame data in response to an instruction from the media asset application may include: obtaining a first playback link of the first media asset through the media asset application in response to an instruction from the media asset application, and sending the first playback link to a first player; then downloading the first media asset data from the first playback link through the first player, and sending the first media asset data to the first decoder; finally decoding the first media asset data using the first decoder to obtain the first frame data.
[0087] It should be noted that, in the embodiments of this application, the first media asset data can be video data, the first decoder can be a video decoder, the first frame data can be video frame data, and the first decoder can be a positive decoder.
[0088] In some embodiments, after the media asset application sends the first playback link to the first player, the first player can also download the first audio data from the first playback link and send the first audio data to the audio decoder. Then, the audio decoder decodes the first audio data to obtain the first decoded audio, and then sends the first decoded audio to the audio output device for playback of the first decoded audio.
[0089] Step S603: Send a first request to the handle management module through the first decoder, so that the handle management module sends the target handle to the first decoder based on the first request.
[0090] In response to the instruction to play the first media asset, the media asset application can send the instruction to the first decoder via the first player. The first decoder can then send a first request to obtain the target handle to the handle management module. The first request includes the request sender, i.e., the first decoder. The handle management module can send the target handle to the request sender, i.e., the first decoder, and record the current user of the target handle, i.e., the first decoder.
[0091] Step S604: The first frame data and the display carrier corresponding to the target handle are sent to the display module through the first decoder, so that the display module displays the first image corresponding to the first frame data based on the display carrier.
[0092] In some embodiments, one implementation of sending the first frame data and the display carrier corresponding to the target handle to the display module through the first decoder may include: obtaining the display carrier corresponding to the target handle in the handle management module through the first decoder, and then sending the first frame data and the display carrier to the display module through the first decoder.
[0093] After obtaining the target handle, the first decoder can send a display carrier acquisition request to the handle management module. This request includes the target handle. The handle management module can parse the target handle from the request and then send the corresponding display carrier to the first decoder. The first decoder can then send the first frame data and the display carrier to the display module. The first decoder only needs to send the display carrier to the display module once; it can continuously send the decoded first frame data to the display module, allowing the display module to continuously render and display the first image corresponding to the received first frame data based on the display carrier.
[0094] One implementation of the display module displaying the first image corresponding to the first frame of data on the display carrier may include: the display module can use video memory as a high-speed workspace, where it creates and manages buffers to store various types of data required for rendering. The rendering pipeline writes the first frame data into a specific frame buffer. This buffer, as a content source, is encapsulated into a specified layer along with metadata attributes such as position and transparency. The compositor collects all layers to be displayed, performs combination calculations based on their Z-axis order and blending mode, and finally generates a single first image frame, which is then submitted to the display 260 for the display 260 to display the first image.
[0095] Step S605: When the first media asset is played to the first preset progress, the second media asset data of the second media asset is decoded by the second decoder to obtain the second frame data.
[0096] In some embodiments, when the first media asset is played to a first preset progress point, one implementation of decoding the second media asset data of the second media asset using a second decoder to obtain the second frame data may include: when the first media asset is played to the first preset progress point, obtaining a second playback link for the second media asset through a media asset application and sending the second playback link to a second player. Then, the second player downloads the second media asset data from the second playback link and sends the second media asset data to the second decoder. Finally, the second decoder decodes the second media asset data to obtain the second frame data.
[0097] It should be noted that the second media asset data in this application embodiment can be video data, the second decoder can be a video decoder, the second frame data can be video frame data, and the second decoder can be an advertising decoder.
[0098] In some embodiments, after the media asset application sends the second playback link to the second player, the second player can also download the second audio data from the second playback link and send the second audio data to the audio decoder. The audio decoder then decodes the second audio data to obtain the second decoded audio, and then sends the second decoded audio to the audio output device for playback of the second decoded audio.
[0099] In some embodiments, the second media asset can be an advertisement inserted into the first media asset. When the first media asset reaches the advertisement insertion progress, the media asset application can send an advertisement retrieval request to the ad server. The ad server can then send an advertisement playback link to the media asset application, enabling the media asset application to send the advertisement playback link to the second player, and the second player to download the advertisement media asset data.
[0100] In some embodiments, the second media asset may be a media asset segment related to the current playback progress of the first media asset. When the first media asset reaches a first preset progress point, the media asset application may obtain the playback link of the media asset segment related to the first preset progress point, so that the media asset application sends the playback link of the media asset segment to the second player, and the second player downloads the media asset data corresponding to the media asset segment.
[0101] For example, at the 00:10:00 time point of the first media asset, i.e., the funny clip where A mentions B singing song XX, an associated playback link is set and labeled as the funny clip of B singing song XX. When the first media asset plays to the 00:10:00 progress point, the media asset application can directly send the associated playback link to the second player, which will then download the media asset data corresponding to the clip. Alternatively, the media asset application can send the associated playback link to the second player after the user selects to play a media asset clip, and the second player will then download the corresponding media asset data. It should be noted that after the media asset clip finishes playing, the current first media asset needs to continue playing. This method eliminates the need for users to manually search for videos, helping them quickly locate and watch content of interest, improving the viewing experience and information acquisition efficiency.
[0102] Step S606: Stop sending the first frame data to the display module through the first decoder, and send a second request to the handle management module through the second decoder, so that the handle management module stops the first decoder from using the target handle based on the second request, and sends the target handle to the second decoder.
[0103] In some embodiments, when the first media asset reaches a first preset playback progress, or when the user jumps to the first preset playback progress via a user-input jump command, the media asset application may send a command to pause playback of the first media asset to the first player, and the first player will then send the command to pause playback of the first media asset to the first decoder. The first decoder will no longer send the first frame data to the display module. When the first media asset reaches a first preset playback progress, or when the user jumps to the first preset playback progress via a user-input jump command, the media asset application may also send a command to play a second media asset to the second player, and the second player will then send the command to play the second media asset to the second decoder. The second decoder will send a second request to the handle management module.
[0104] For example, the first preset playback progress is 00:10:00. When a user input is received to jump the playback progress from 00:00:00 to 00:10:00, the first decoder no longer sends the first frame data to the display module, and the second decoder sends a second request to the handle management module.
[0105] In some embodiments, when the first media asset reaches a second preset playback progress, the media asset application can send a command to pause playback of the first media asset to the first player, and the first player will then send the command to pause playback of the first media asset to the first decoder. The first decoder will no longer send the first frame data to the display module. When the first media asset reaches the second preset playback progress, the media asset application can also send a command to play the second media asset to the second player, and the second player will then send the command to play the second media asset to the second decoder. The second decoder will send a second request to the handle management module.
[0106] For example, the first preset playback progress is 00:09:30, and the second preset playback progress is 00:10:00. When the first media asset reaches 00:09:30, the second decoder decodes the second media asset data to obtain the second frame data. When the first media asset reaches 00:10:00, the first decoder no longer sends the first frame data to the display module, and the second decoder sends a second request to the handle management module.
[0107] The media asset application can send the instruction to play the second media asset to the second decoder via the second player. The second decoder can send a second request to the handle management module to obtain the target handle. This second request includes the request sender, i.e., the second decoder. Upon receiving the second request, the handle management module can stop the first decoder from using the target handle by sending a stop-use notification to the recorded user, i.e., the first decoder. After receiving the stop-use notification, the first decoder will no longer use the display medium corresponding to the target handle. The handle management module can also send the target handle to the request sender, i.e., the second decoder, and record the current user of the target handle, i.e., the second decoder.
[0108] In some embodiments, the first decoder may stop sending the first frame data to the display module after receiving an instruction from the media asset application via the first player to pause playback of the first media asset. Alternatively, the first decoder may mark the target handle or display carrier as empty upon receiving a stop-use notification, thereby ceasing the transmission of the first frame data to the display module for display.
[0109] Step S607: The second frame data and the display carrier corresponding to the target handle are sent to the display module through the second decoder, so that the display module displays the second image corresponding to the second frame data based on the display carrier.
[0110] In some embodiments, one implementation of sending the second frame data and the display carrier corresponding to the target handle to the display module via the second decoder may include: obtaining the display carrier corresponding to the target handle in the handle management module via the second decoder, and then sending the second frame data and the display carrier to the display module via the second decoder.
[0111] After obtaining the target handle, the second decoder can send a display carrier acquisition request to the handle management module. This request includes the target handle. The handle management module can parse the target handle from the request and then send the corresponding display carrier to the second decoder. The second decoder can then send the display carrier, second frame data, and the display carrier to the display module. The second decoder only needs to send the display carrier to the display module once; it can continuously send the decoded second frame data to the display module, allowing the display module to continuously render and display the second image corresponding to the received second frame data based on the display carrier.
[0112] One implementation of the display module displaying the second image corresponding to the second frame data on the display carrier may include: the display module can use video memory as a high-speed workspace, where it creates and manages buffers to store various types of data required for rendering. The rendering pipeline writes the second frame data into a specific frame buffer. This buffer, as a content source, is encapsulated into a specified layer along with metadata attributes such as position and transparency. The compositor collects all layers to be displayed, performs combination calculations based on their Z-axis order and blending mode, and finally generates a single second image frame, which is then submitted to the display 260 for displaying the second image.
[0113] It should be noted that because the second decoder uses the same display medium as the first decoder, the second image and the first image have the same layer. After the second decoder sends the display medium to the display module, the second image replaces the last frame of the first media asset displayed on the screen, thus ensuring that only the second image is displayed on the screen.
[0114] In this embodiment, when playing a first media asset on a multi-channel playback device, if a second media asset needs to be inserted into the first media asset, the target handle can be configured to 1 through the handle management module, i.e., it is changed to single-channel playback. After obtaining the target handle, the second media asset is sent for display, which will directly cover the last frame of the currently displayed first media asset, effectively preventing image overlap.
[0115] In some embodiments, the media asset display method may be as follows: Figure 8 As shown, the handle management module sets the number of target handles to 1. When playing the main feature, the main feature decoder obtains and decodes the main feature data from the main feature video source, then obtains the target handle, and pushes and displays the main feature image through the target handle. When an advertisement needs to be played, the advertisement decoder obtains and decodes the advertisement data from the advertisement video source, then obtains the target handle, and at this time, the main feature decoder stops using the target handle. The advertisement decoder pushes and displays the advertisement image through the target handle. After a target handle is stopped from use, it needs to be obtained again before it can be used again.
[0116] In some embodiments, the timing diagram of the media asset display method can be as follows: Figure 9 As shown. After receiving the user's instruction to open the application, the media asset application sends the number of target handles (1) to the handle management module. The handle management module sets the number of target handles to 1, then requests a display carrier from the display module and performs display carrier initialization. After receiving the user's instruction to play the first media asset, the media asset application sends the first playback link of the first media asset to the first player. The first player downloads and parses the first media asset data, also known as the first basic bitstream, from the playback link and sends the first media asset data to the first decoder. The first decoder decodes the first media asset data to obtain the first frame data. The media asset application sends the instruction to play the first media asset to the first decoder through the first player. The first decoder sends the first request to the handle management module. The handle management module sends the target handle to the first decoder and records the user. The first decoder obtains the display carrier from the handle management module based on the target handle and sends the display carrier and the first frame data to the display module. The display module displays the first image corresponding to the first frame data based on the display carrier.
[0117] When the first media asset reaches the first preset playback progress, the media asset application sends a second playback link for the second media asset to the second player. The second player downloads and parses the second media asset data, also known as the second basic bitstream, from the playback link and sends it to the second decoder. The second decoder decodes the second media asset data to obtain the second frame data.
[0118] When the first media asset reaches the second preset playback progress, the media asset application sends a pause instruction to the first decoder via the first player. The first decoder stops sending the first frame data to the display module. The media asset application then sends a play instruction for the second media asset to the second decoder via the second player. The second decoder sends a second request to the handle management module. The handle management module sends the target handle to the second decoder, records the user, and sends a stop-use notification to the first decoder. The first decoder stops using the target handle. The second decoder retrieves the display carrier from the handle management module based on the target handle and sends the display carrier and the second frame data to the display module. The display module displays the second image corresponding to the second frame data based on the display carrier.
[0119] In some embodiments, after the second media asset is played, a third request is sent to the handle management module through the first decoder, so that the handle management module stops the second decoder from using the target handle based on the third request and sends the target handle to the first decoder; then the first decoder continues to send the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier.
[0120] In some embodiments, after the second media asset playback is complete, the media asset application can send an instruction to continue playing the first media asset to the first decoder via the first player. The first decoder can then send a third request to the handle management module. The handle management module can stop the second decoder from using the target handle, i.e., send a stop-use notification to the recorded user, i.e., the second decoder. Upon receiving the stop-use notification, the second decoder marks the target handle or display medium as empty. The handle management module can also send the target handle to the first decoder and record the current user of the target handle, i.e., the first decoder.
[0121] In some embodiments, the timing diagram of the media asset display method can be as follows: Figure 10 As shown. After detecting the end of playback of the second media asset, the second player sends a playback end message to the media asset application. The media asset application sends a pause command to the second player. The media asset application sends a command to the first decoder via the first player to continue playing the first media asset. The first decoder sends a third request to the handle management module. The handle management module sends the target handle to the first decoder, records the user, and sends a stop-use notification to the second decoder. The second decoder stops using the target handle. The first decoder retrieves the display carrier from the handle management module based on the target handle and sends the display carrier and the first frame data to the display module. The display module displays the first image corresponding to the first frame data based on the display carrier. The media asset application sends a command to close the second media asset to the second player, causing the second player to exit the second decoder, i.e., destroy the second player.
[0122] This application embodiment adds a handle management module, which can configure the number of target handles according to the multi-channel playback scenario. In scenarios where multi-channel display is not required, the display carrier is restricted to meet the requirement of displaying only one channel of the image. The handle management module can also request the display carrier in advance, reducing the black screen time between multi-channel switching, reducing the increased porting costs caused by platform differences, and optimizing the user's viewing experience.
[0123] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A display device, characterized in that, include: monitor; The controller is configured as follows: In response to the instruction to open the media asset application, the number of target handles is set to 1 through the handle management module. The target handle is the credential for obtaining the display carrier. The display carrier is used to carry the decoded frame data and render the frame data into a graphical resource object of a visual image. In response to an instruction to play the first media asset in the media asset application, the first media asset data of the first media asset is decoded by the first decoder to obtain the first frame data; The first decoder sends a first request to the handle management module, so that the handle management module sends the target handle to the first decoder based on the first request; The first decoder sends the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier. When the first media asset is played to the first preset progress, the second media asset data of the second media asset is decoded by the second decoder to obtain the second frame data; The first frame data is stopped from being sent to the display module through the first decoder, and a second request is sent to the handle management module through the second decoder, so that the handle management module stops the first decoder from using the target handle based on the second request, and sends the target handle to the second decoder; The second decoder sends the second frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the second image corresponding to the second frame data based on the display carrier.
2. The display device according to claim 1, characterized in that, After setting the number of target handles to 1 via the handle management module, the controller is further configured as follows: The handle management module requests a display medium from the display module.
3. The display device according to claim 1, characterized in that, After the second frame data and the display carrier corresponding to the target handle are sent to the display module via the second decoder, so that the display module displays the second image corresponding to the second frame data based on the display carrier, the controller is further configured to: After the second media asset is played, the first decoder sends a third request to the handle management module, so that the handle management module stops the second decoder from using the target handle based on the third request, and sends the target handle to the first decoder; The first decoder continues to send the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier.
4. The display device according to claim 1, characterized in that, The controller's execution of stopping the transmission of the first frame data to the display module via the first decoder, and sending a second request to the handle management module via the second decoder, is further configured as follows: When the first media asset is played to the second preset progress, the transmission of the first frame data to the display module through the first decoder is stopped, and a second request is sent to the handle management module through the second decoder. The second preset progress is later than the first preset progress.
5. The display device according to claim 1, characterized in that, The controller executes the setting of the number of target handles to 1 via the handle management module, and is further configured as follows: Obtain the currently set quantity flag bit used to represent the number of target handles; When the quantity flag is 1, the number of target handles is set to 1 by the handle management module.
6. The display device according to claim 1, characterized in that, The controller executes an instruction in response to playing the first media asset in the media asset application, and decodes the first media asset data of the first media asset through the first decoder to obtain the first frame data, which is further configured as follows: In response to an instruction to play a first media asset in the media asset application, the first playback link of the first media asset is obtained through the media asset application, and the first playback link is sent to the first player; The first media asset data is downloaded from the first playback link by the first player and sent to the first decoder. The first media data is decoded by the first decoder to obtain the first frame data.
7. The display device according to claim 1, characterized in that, When the first media asset reaches a first preset progress point, the controller decodes the second media asset data using a second decoder to obtain the second frame data, which is further configured as follows: When the first media asset is played to the first preset progress, the second playback link of the second media asset is obtained through the media asset application, and the second playback link is sent to the second player; The second media asset data is downloaded from the second playback link by the second player, and the second media asset data is sent to the second decoder; The second media data is decoded by the second decoder to obtain the second frame data.
8. The display device according to claim 2, characterized in that, The controller, by sending the first frame data and the display carrier corresponding to the target handle to the display module through the first decoder, is further configured to: The first decoder obtains the display carrier corresponding to the target handle in the handle management module; The first frame data and the display carrier are sent to the display module through the first decoder.
9. The display device according to claim 2, characterized in that, The controller, by sending the second frame data and the display carrier corresponding to the target handle to the display module through the second decoder, is further configured to: The display carrier corresponding to the target handle in the handle management module is obtained through the second decoder; The second frame data and the display carrier are sent to the display module via the second decoder.
10. A method for displaying media assets, characterized in that, include: In response to the instruction to open the media asset application, the number of target handles is set to 1 through the handle management module. The target handle is the credential for obtaining the display carrier. The display carrier is used to carry the decoded frame data and render the frame data into a graphical resource object of a visual image. In response to an instruction to play the first media asset in the media asset application, the first media asset data of the first media asset is decoded by the first decoder to obtain the first frame data; The first decoder sends a first request to the handle management module, so that the handle management module sends the target handle to the first decoder based on the first request; The first decoder sends the first frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the first image corresponding to the first frame data based on the display carrier. When the first media asset is played to the first preset progress, the second media asset data of the second media asset is decoded by the second decoder to obtain the second frame data; The first frame data is stopped from being sent to the display module through the first decoder, and a second request is sent to the handle management module through the second decoder, so that the handle management module stops the first decoder from using the target handle based on the second request, and sends the target handle to the second decoder; The second decoder sends the second frame data and the display carrier corresponding to the target handle to the display module, so that the display module displays the second image corresponding to the second frame data based on the display carrier.