Display device and media data display method

Abstract

Some embodiments of the present application show a display device and a method for displaying media data, the method comprising: obtaining first media data; decoding the first media data by using a first hardware decoder, and displaying the decoded first media data in a first playing window; downloading second media data; if the controller comprises a second hardware decoder, sending the second media data to the second hardware decoder to make the second hardware decoder decode the second media data, and displaying the decoded second media data in a second playing window; pausing playing of the second media data; setting a preset area of the first playing window to a transparent state, the preset area having a correlation with a display position of the second playing window. The method can make a user watch the first media data, and preview the second media data to be played through a small window, reduce the abrupt feeling of suddenly inserting the second media data, and improve user experience.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for displaying media assets. Background Technology

[0002] A relatively new use case for digital television is the dynamic insertion of advertisements from broadband during broadcasts, thereby increasing the flexibility of advertising delivery.

[0003] To address this issue, solutions often involve reducing the latency of inserting broadband ads by pre-decoding ad video frames when they are needed, and then quickly switching to the ad at the scheduled time. However, because the ad content is not very relevant to the current broadcast content, users often experience a jarring feeling, which diminishes their viewing experience. Summary of the Invention

[0004] Some embodiments of this application provide a display device and a method for displaying media assets. When a user is watching first media asset data, a small window previews the second media asset data that will be played soon, reducing the abruptness of suddenly inserting the second media asset data and improving the user experience.

[0005] In a first aspect, some embodiments of this application provide a display device, including:

[0006] The monitor is configured to display the first playback window;

[0007] The controller is configured as follows:

[0008] Obtain first-hand media asset data;

[0009] The first media data is decoded using a first hardware decoder, and the decoded first media data is sent to the display so that the display shows the decoded first media data in the first playback window.

[0010] Download second media asset data;

[0011] If the controller is configured with a second hardware decoder, the second media data is sent to the second hardware decoder so that the second hardware decoder decodes the second media data and sends the decoded second media data to the display so that the display shows the decoded second media data in the second playback window, which is located below the first playback window;

[0012] The playback of second media data has been suspended.

[0013] The preset area of ​​the first playback window is set to a transparent state, and the position of the preset area is related to the display position of the second playback window.

[0014] In some embodiments, the controller is configured to:

[0015] The display is controlled to show preview text and countdown information of the second media data in a browser window, which is located above the first playback window.

[0016] In some embodiments, the controller performing the download of the second media asset data is further configured to:

[0017] Obtain playback parameters for the second media asset data, the playback parameters including the video object and playback time of the second media asset data;

[0018] Upon reaching the first time point, the source address of the video object is obtained, where the first time point is the time point of the first preset duration before the playback time;

[0019] If the second media asset data is streaming media data, initiate a data request based on the source address, download the streaming media file, parse the streaming media protocol, and download the second media asset data based on the streaming media file and the streaming media protocol.

[0020] If the second media asset data is not streaming media data, a data request is initiated based on the source address to download the second media asset data.

[0021] In some embodiments, the controller is further configured to set a preset area of ​​the first playback window to a transparent state:

[0022] Upon reaching the second time point, the preset area of ​​the first playback window is set to a transparent state. The second time point is a time point two preset durations before the playback time, and the second preset duration is less than the first preset duration.

[0023] In some embodiments, the controller is configured to:

[0024] When the playback time of the second media data arrives, the playback of the first media data is paused, and the playback of the second media data begins. The second playback window is located above the first playback window, and the display size of the second playback window is the same as the size of the display area of ​​the monitor.

[0025] In some embodiments, the controller is configured to:

[0026] If the controller is not configured with a second hardware decoder, the first segment of media data in the second media data is sent to the browser decoding module. The first segment of media data is the second media data of the previous preset number of frames.

[0027] The browser decoding module decodes the target frame video data and sends it to the display so that the display shows the decoded target frame video data in the browser window, which is located above the first playback window.

[0028] In some embodiments, the controller is configured to:

[0029] The display is controlled to show preview text and countdown information of the second media data in the browser window.

[0030] In some embodiments, the controller is configured to:

[0031] The browser decoding module is used to decode the first segment of media data;

[0032] When the second media data playback time is reached, the first segment of decoded media data is displayed in the browser window, and the display size of the browser window is the same as the size of the display area of ​​the monitor.

[0033] The second segment of media data in the second media data is sent to the first hardware decoder so that the first hardware decoder can decode the second segment of media data. The second segment of media data is the data in the second media data other than the first segment of media data.

[0034] After the first segment of media data finishes playing, the browser window is set to a transparent state, and the decoded second segment of media data is played in the first playback window.

[0035] Secondly, some embodiments of this application provide a method for displaying media asset data, including:

[0036] Obtain first-hand media asset data;

[0037] The first media data is decoded using a first hardware decoder, and the decoded first media data is sent to the display so that the display shows the decoded first media data in the first playback window.

[0038] Download second media asset data;

[0039] If the controller includes a second hardware decoder, the second media data is sent to the second hardware decoder so that the second hardware decoder decodes the second media data, and the decoded second media data is sent to the display so that the display shows the decoded second media data in a second playback window, the second playback window being located below the first playback window;

[0040] The playback of second media data has been suspended.

[0041] Set a preset area of ​​the first playback window to a transparent state, and the position of the preset area corresponds to the display position of the second playback window.

[0042] In some embodiments, the method further includes:

[0043] The display is controlled to show the second media data preview text and countdown information in a browser window, which is located above the first playback window.

[0044] Some embodiments of this application provide a display device and a method for displaying media assets. When a user is watching first media asset data, the playback time of second media asset data is obtained. The second media asset data is downloaded in advance before playback, decoded by a second hardware decoder, playback of the second media asset data is paused, and the decoded first frame data is displayed in a second playback window below the current first playback window. Before playback of the second media asset data, a preset area of ​​the first playback window is set to transparent, so that the first frame of the second media asset data is displayed in the second playback window. This application embodiment uses a small window to predict the upcoming playback of the second media asset data, reducing the abruptness of suddenly inserting the second media asset data and improving the user experience. Attached Figure Description

[0045] Figure 1 An operational scenario between a display device and a control device according to some embodiments is illustrated;

[0046] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments is shown;

[0047] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments is shown;

[0048] Figure 4 A software configuration diagram of a display device 200 according to some embodiments is shown;

[0049] Figure 5 A flowchart of a media asset data display method according to some embodiments is shown;

[0050] Figure 6 A flowchart of a method for downloading second media asset data according to some embodiments is shown;

[0051] Figure 7 A schematic diagram of a user interface provided according to some embodiments is shown;

[0052] Figure 8 A schematic diagram of a user interface provided according to some embodiments is shown;

[0053] Figure 9 A schematic diagram of a user interface provided according to some embodiments is shown;

[0054] Figure 10 A schematic diagram of a user interface provided according to some embodiments is shown;

[0055] Figure 11 A schematic diagram of a user interface provided according to some embodiments is shown;

[0056] Figure 12 A schematic diagram of a user interface provided according to some embodiments is shown;

[0057] Figure 13 A schematic diagram of a user interface provided according to some embodiments is shown;

[0058] Figure 14 A schematic diagram of a user interface provided according to some embodiments is shown. Detailed Implementation

[0059] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0060] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0061] The terms "first," "second," and "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0062] The term “comprising” and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0063] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 2 This is one specific embodiment of the display device of this application.

[0064] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0065] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0066] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0067] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.

[0068] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0069] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0070] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0071] like Figure 3 The display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0072] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0073] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0074] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0075] The display 260 also includes a touch screen, which is used to receive input control commands from the user's fingers by sliding or clicking on the touch screen.

[0076] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0077] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0078] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0079] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0080] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0081] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0082] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0083] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0084] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0085] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0086] like Figure 4 As shown, the display device system is divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0087] The application layer mainly includes commonly used applications on TVs, as well as the application framework. The commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0088] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interface for these functions (toolbar, status bar, menu, dialog box).

[0089] Native apps can support online or offline access, push notifications, or access to local resources.

[0090] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0091] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. The drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.

[0092] In some embodiments, during the playback of the first media asset data, it may be necessary to insert the second media asset data at a preset time point. For example, it may be necessary to switch to playing advertisements from broadband in broadcast video. For example, in the Hbbtv (Hybrid Broadcast / Broadband TV) application, targeted advertising (TA) from broadband may be inserted. When broadband advertisements need to be played, the latency of inserting and playing advertisements can be reduced by pre-decoding the advertisement video frames, and then quickly switching to advertisements at the time when broadband advertisements are needed. However, since the advertisement content is not very relevant to the current broadcast content, and the switching operation is unknown to the user, the user will have a very abrupt feeling, which reduces the user's viewing experience.

[0093] To address the above technical problems, this application provides a display device 200. The structure and functions of each part of the display device 200 can be found in the above embodiments. Furthermore, based on the display device 200 shown in the above embodiments, this embodiment further improves some functions of the display device 200, such as… Figure 5 As shown, controller 250 performs the following steps:

[0094] Controller 250 executes step S501: acquire first media asset data;

[0095] In some embodiments, the first media asset data is broadband video data or media asset data corresponding to a network channel. The system receives a user input instruction to play the first media asset data, obtains the storage address of the first media asset data, and retrieves the first media asset data from that storage address. The first media asset data includes first video data and first audio data. The first video data is video stream data, and the first audio data is audio stream data. During the download process, the audio and video data need to be downloaded frame by frame to the display device 200 in sequence.

[0096] In some embodiments, the video data and audio data of the first media asset data can be stored in the same storage address, or the video data and audio data can be stored in different storage addresses. However, when downloading data, the video data and audio data need to be downloaded to the display device 200 at the same time.

[0097] In some embodiments, the first media asset data is the media asset data corresponding to a broadcast channel. Upon receiving a user input command to open a broadcast channel, the tuner / demodulator samples the analog signal and converts it into a digital signal stream, which includes the first media asset data. After conversion, the first media asset data is transmitted to a demultiplexer; the demultiplexer performs a demultiplexing operation on the first media asset data. The first media asset data includes first video data and first audio data.

[0098] The controller 250 executes step S502: using the first hardware decoder to decode the first media data, and sending the decoded first media data to the display so that the display shows the decoded first media data in the first playback window.

[0099] In some embodiments, the controller 250 includes at least one hardware decoder. If the controller 250 includes only one hardware decoder, the display device supports single-channel hardware decoding; if the controller 250 includes two or more hardware decoders, the display device supports multi-channel hardware decoding.

[0100] In some embodiments, the acquired first media asset data is in an encoded format, which the display device cannot directly display and play. It needs to be sent to a decoder for decoding. The decoded first media asset data can then be displayed and played by the display device. The decoder includes a hardware decoder and a software decoder. The hardware decoder uses GPU (Graphics Processing Unit) resources to decode the video stream.

[0101] In some embodiments, the demultiplexed first media asset data is sent to a first hardware decoder. The first hardware decoder decodes the first video data in the first media asset data to obtain decoded first video data, sends the decoded first video data to a graphics rendering module for processing, and displays the decoded first video data in a first playback window on a display 260. The first hardware decoder decodes the first audio data in the first media asset data to obtain decoded first audio data, sends the decoded first audio data to an audio output interface 270, and plays the decoded first audio data through the audio output interface 270. The first video data displayed on the display 260 corresponds to the first audio data played by the audio output interface 270 to achieve audio-visual synchronization.

[0102] Controller 250 executes step S503: Download the second media data;

[0103] In some embodiments, the playback time of the second media asset data is obtained before downloading the second media asset data.

[0104] The playback time of the second media asset data is the time when the first media asset data is switched to the second media asset data.

[0105] In some embodiments, the controller 250 calls a browser interface to pass relevant playback parameters for inserting the second media asset data. These playback parameters include the presentation timestamp (PTS) of the second media asset data.

[0106] In some embodiments, the playback time of the second media asset data is the system time. For example, the playback time of the second media asset data is set to 8:00:00 AM.

[0107] In some embodiments, the playback time of the second media asset is the same as the playback duration of the first media asset. For example, if the first media asset is broadcast video, the playback time starts from when the user switches to the broadcast channel, and the second media asset begins playing when the user's viewing time reaches 30 minutes. Alternatively, if the first media asset is broadband video, the viewing time is counted when the user starts playing the broadband video, excluding time spent fast-forwarding, rewinding, and pausing. The second media asset begins playing when the user's viewing time reaches 30 minutes.

[0108] In some embodiments, the playback time of the second media asset data is the time displayed on the playback progress bar of the first media asset data. For example, the playback time of the second media asset data is 00:15:00 when the playback progress bar of the first media asset data is displayed.

[0109] In some embodiments, the second media asset data includes second video data and second audio data. The second media asset data is broadband video, which can be an advertising video, the next media asset data to be played after the first media asset data, or a promotional video, highlight clip, or edited clip of the next media asset data after the first media asset data.

[0110] In some embodiments, the second media data can be downloaded before the second media data is played, for example: the second media data is downloaded at a first time point, where the first time point is a time point with a first preset duration before the playback time;

[0111] In some embodiments, the playback time of the second media asset data is 8:00:00 AM system time, and the first preset duration is 30 seconds. The second media asset data is downloaded when the system time reaches 7:59:30 AM.

[0112] In some embodiments, the playback time of the second media asset data is 30 minutes, the playback duration of the first media asset data is 30 seconds, and the second media asset data is downloaded when the playback duration of the first media asset data is 29 minutes and 30 seconds.

[0113] In some embodiments, the playback time of the second media asset data is 00:15:00, the time displayed on the playback progress bar of the first media asset data, and the first preset duration is 30 seconds. The second media asset data is downloaded at 00:14:30, the time displayed on the playback progress bar of the first media asset data.

[0114] In some embodiments, the controller 250 calls a browser interface to pass relevant playback parameters for the insertion of the second media asset data. These playback parameters also include the video object corresponding to the second media asset data. The video object is essentially a tag.

[0115] like Figure 6 As shown, the step of downloading the second media asset data includes:

[0116] Step S601: Obtain the source address in the video object, that is, obtain the src attribute from the video object. The src attribute includes the URL (Uniform Resource Locator), which specifically refers to the source address.

[0117] Step S602: Determine whether the second media asset data is streaming media data;

[0118] In some embodiments, the step of determining whether the second media asset data is streaming media data includes:

[0119] Get the file extension of the second media asset data, or get the file extension of the second media asset data from the video object;

[0120] If the file extension of the second media asset data is a streaming media file extension, then the second media asset data is streaming media data;

[0121] If the file extension of the second media asset data is not a streaming media file extension, then the second media asset data is not streaming media data.

[0122] For example, if the file extension of the obtained second media asset data is .mpd, then the second media asset data is streaming media data; if the file extension of the obtained second media asset data is not .mpd, but .mp4 or .m3u8, then the second media asset data is not streaming media data.

[0123] If the second media asset data is streaming media data, execute step S603: initiate a data request based on the source address, download the streaming media file, parse the streaming media protocol; download the second media asset data based on the streaming media file and the streaming media protocol;

[0124] An HTTP request is initiated based on the URL in the `src` attribute to download the streaming media manifest file. The streaming media protocol is then parsed to download the secondary media asset data. The manifest file is essentially an XML file. By parsing the streaming media protocol, information such as the storage address of the streaming video slices containing the secondary media asset data can be obtained from the manifest file, and the secondary media asset data is downloaded based on the storage address.

[0125] If the second media asset data is not streaming media data, execute step S604: initiate a data request based on the source address to download the second media asset data, that is, initiate an HTTP request based on the URL in the src attribute to download the second media asset data.

[0126] In some embodiments, the downloaded second media asset data is transmitted to a demultiplexer so that the demultiplexer performs a demultiplexing operation on the second media asset data.

[0127] Controller 250 executes step S504: Determine whether the controller includes a second hardware decoder;

[0128] In some embodiments, the capabilities of the display device can be obtained, including the number of hardware decoders the display device supports. When the controller 250 has only one hardware decoder, the display device's capability is to support single-channel hardware decoding, meaning the display device can only perform hardware decoding and display of one audio / video data stream simultaneously. When the controller 250 has two hardware decoders, the display device's capability is to support dual-channel hardware decoding, meaning the display device can perform hardware decoding and display of two audio / video data streams simultaneously.

[0129] In some embodiments, the hardware decoding capability of the display device can also be obtained separately.

[0130] The steps for determining whether the controller includes a second hardware decoder include:

[0131] Obtain the hardware decoding capability of the display device;

[0132] Determine whether the display device's hardware decoding capability is a single-channel hardware decoding capability;

[0133] If the display device has a single-channel hardware decoding capability, then the controller does not include a second hardware decoder.

[0134] If the display device's hardware decoding is not a single-channel hardware decoding capability, then the controller is determined to include a second hardware decoder.

[0135] If the controller includes a second hardware decoder, the controller 250 executes step S505: sending the second media data to the second hardware decoder so that the second hardware decoder decodes the second media data, and sending the decoded second media data to the display so that the display shows the decoded second media data in the second playback window;

[0136] In some embodiments, the demultiplexed second media asset data is sent to a second hardware decoder. The second hardware decoder decodes the second video data in the second media asset data to obtain decoded second video data, sends the decoded second video data to the graphics rendering module for processing, and displays the decoded second video data in the second playback window on the display 260. The second hardware decoder decodes the second audio data in the second media asset data to obtain decoded second audio data, and sends the decoded second audio data to the audio output interface 270.

[0137] Controller 250 executes step S506: Pause playback of the second media data.

[0138] The pause interface of the underlying second hardware decoder is invoked to pause the playback of the second media asset data, and the size and position of the second playback window are set. The second playback window is located below the first playback window.

[0139] In some embodiments, the second hardware decoder decodes the second video data, and after rendering, the decoded second video data is displayed by the second playback window. Since the playback of the second media data is paused at this time, the current second playback window displays the first frame of the second video data, but does not play the second audio data.

[0140] In some embodiments, the first frame of the second video data can be set as a representative image. For example, advertisers can set an icon image or a landmark product image as the first frame of the advertising video. The first frame of a film or television drama can be an image with an exciting plot or a text image containing a plot summary.

[0141] In some embodiments, the second playback window is positioned as close as possible to the edge of the display area to avoid occupying the key display area of ​​the first playback window. For example, the second playback window is positioned at one of the four corners of the display area. The display area of ​​the second playback window is much smaller than the display area of ​​the display area, so that the second playback window does not occupy the display area of ​​the first playback window as much as possible, while allowing the user to clearly see the content of the second playback window.

[0142] It should be noted that during the download and playback of the second media asset data, the first media asset data plays normally. That is, the process of acquiring the first media asset data continues normally, the first hardware decoder decodes the first media asset data, and the decoded first media asset data is sent to the monitor so that the monitor displays the decoded first media asset data in the first playback window. Since the first playback window plays in full screen and is positioned above the second playback window, it can obscure the content displayed in the second playback window, such as... Figure 7 As shown.

[0143] The controller 250 executes step S507: setting a preset area of ​​the first playback window to a transparent state, wherein the position of the preset area is related to the display position of the second playback window.

[0144] In some embodiments, after the display shows the decoded second media data in the second playback window and pauses the playback of the second media data, the preset area of ​​the first window can be directly set to a transparent state.

[0145] In some embodiments, upon reaching a second time point, a preset area of ​​the first playback window is set to a transparent state, wherein the second time point is a time point a second preset duration before the playback time, and the first preset duration is longer than the second preset duration.

[0146] In some embodiments, the playback time of the second media data is 8:00:00 AM system time, and the second preset duration is 10 seconds. When the system time reaches 7:59:50 AM, the preset area of ​​the first playback window is set to a transparent state.

[0147] In some embodiments, the playback time of the second media data is 30 minutes, the playback duration of the first media data is 10 seconds, and when the playback duration of the first media data is 29 minutes and 50 seconds, the preset area of ​​the first playback window is set to a transparent state.

[0148] In some embodiments, the playback time of the second media asset data is 00:15:00, the time displayed by the playback progress bar of the first media asset data, and the second preset duration is 10 seconds. At 00:14:50, the preset area of ​​the first playback window is set to a transparent state.

[0149] It should be noted that the relationship between the position of the preset area and the display position of the second playback window means that the preset area and the second playback window are displayed in the same area on the monitor, so that the content of the lower-level second playback window can be displayed to the user, such as... Figure 8 As shown.

[0150] In some embodiments, the controller 250 further performs the following: before the second media data is played, for a second preset time, controlling the display to display preview text and countdown information of the second media data in a browser window, the browser window being positioned above the first playback window.

[0151] In some embodiments, a browser window can be placed above the first playback window, and the browser window displays the preview text and countdown information of the second media asset data. The browser window is transparent except for the preview text and countdown information, so as not to affect the playback of the first media asset data and the display of the first frame of the second media asset data, such as... Figure 9 As shown.

[0152] For example, the preview text and countdown information could be "An advertisement from the internet will play in 10 seconds," with the countdown time changing over time. Users can further understand that the advertisement corresponding to the second playback window will play in 10 seconds, avoiding the abrupt feeling of suddenly switching videos. At the same time, if users do not want to watch the advertisement, they can change the channel or perform other operations in a timely manner.

[0153] For example, the countdown message in the preview text could be "XXX movie / TV show will play in 10 seconds," and the countdown time would change as time progressed. Users could then learn that the movie / TV show corresponding to the second playback window would be broadcast in 10 seconds, allowing them to know in advance what movie / TV show they would be watching.

[0154] In some embodiments, the controller 250 further performs the following: before the second media data playback reaches a second preset duration, while setting a preset area of ​​the first playback window to a transparent state, it calls the playback interface of the underlying second hardware decoder to start playing the second media data. The second video data in the second media data is displayed normally by the display 260, while the second audio data in the second media data is played silently or not at all. Alternatively, the media data preceding the second preset duration of the second media data can be set to silent media data to avoid affecting the playback of the first audio data. The media data preceding the second preset duration of the second media data can be an edited version of an advertisement video, a trailer for a movie or TV series, a highlight reel, or a clip, so that users can understand the general content of the advertisement or the next video in advance before deciding whether to continue watching. The second media data, excluding the media data preceding the second preset duration, contains the main content. For example, the first 10 seconds of the second media data may play an edited version in a small window, and the main content may play in a full-screen window after 10 seconds.

[0155] In some embodiments, the controller 250 further performs the following: before the second media data playback reaches a third preset duration, it calls the start interface of the underlying second hardware decoder to begin playing the second media data. Here, the second video data in the second media data is displayed normally on the display 260, while the second audio data in the second media data is played silently or not at all. Alternatively, the media data for the third preset duration before the second media data can be set to silent media data to avoid affecting the playback of the first audio data. Here, the media data for the third preset duration before the second media data can be an edited version of advertising video data, a trailer for a movie or TV series, a highlight reel, or a clip, so that users can get a general idea of ​​the content of the advertisement or the next video before deciding whether to continue watching. The second media data, excluding the media data for the third preset duration before the third preset duration, consists of the main content. The third preset duration is shorter than the second preset duration.

[0156] The controller 250 executes step S508: when the playback time of the second media data is reached, the playback of the first media data is paused, and the playback of the second media data is started. The second playback window is located above the first playback window, and the display size of the second playback window is the same as the size of the display area of ​​the monitor.

[0157] In some embodiments, when the playback time of the second media data is reached, the pause interface of the underlying first hardware decoder is called to pause the playback of the first media data. The playback interface of the underlying second hardware decoder is then called to start playback of the second media data. The second playback window is changed to full-screen mode and placed on top of the first playback window to display the second media data in full-screen mode on the current display. Figure 10 As shown.

[0158] In some embodiments, instead of changing the vertical position of the first and second playback windows, the first playback window can be set to a transparent state so that the current display 260 shows the second playback window in full screen, such as... Figure 11 As shown.

[0159] In some embodiments, the display size of the second playback window is smaller than the size of the display area of ​​the monitor.

[0160] In some embodiments, when the playback time of the second media asset data is reached, the browser window cancels the display of the second media asset data preview text and countdown information, that is, the browser window is set to a fully transparent state.

[0161] In some embodiments, when the second playback window is in the small window state, it is already in the playback state. When the playback time of the second media data is reached, there is no need to call the playback interface of the underlying second hardware decoder again, and the second playback window can be displayed directly.

[0162] If the controller includes a second hardware decoder, the controller 250 executes step S509: sending the first segment of media data in the second media data to the browser decoding module, wherein the first segment of media data is the second media data of the previous preset number of frames;

[0163] In some embodiments, when obtaining the keyframe interval of the second media asset data, the first segment of media asset data is the second media asset data corresponding to an integer multiple of the keyframe interval. For example, if the keyframe interval of the second media asset data is 60 frames, then the first segment of media asset data can be the second media asset data of the first 60 frames, or the second media asset data of the first 120 frames, etc.

[0164] Keyframes, also called I-frames or intrapictures, are typically the first frame of each Group of Pictures (GOP). They are moderately compressed and used as reference points for random access, essentially functioning as an image. A GOP is a video compression technique used by MPEG. A keyframe is a crucial frame in inter-frame compression coding; it is a fully compressed coded frame; during decoding, the complete image can be reconstructed using only the keyframe data; and keyframes are generated without referencing other frames.

[0165] The controller 250 executes step S510: using the browser decoding module to decode the target frame video data and send it to the display, so that the display shows the decoded target frame video data in the browser window, the browser window being located above the first playback window.

[0166] In some embodiments, after the first segment of media asset data in the second media asset data is sent to the browser decoding module, the target frame video data can be directly decoded by the browser decoding module and sent to the display.

[0167] In some embodiments, before the second media data is played, the target frame video data is decoded by the browser decoding module and sent to the display.

[0168] In some embodiments, decoding the target frame video data using the browser's decoding module essentially involves decoding the target frame video data using software decoding technology. The target frame video data is the first keyframe video data. If the first video segment contains multiple keyframe video data, the target frame video data can also be set to other keyframe video data.

[0169] In some embodiments, the demultiplexed first segment of media data is sent to the browser decoding module. The browser decoding module decodes the target frame video data and sends the decoded target frame video data to the browser rendering module for processing, and the display 260 displays the decoded target frame video data in the browser window.

[0170] In some embodiments, the target frame video data can be set as a representative image. For example, advertisers can set an icon image or a landmark product image as the target frame video data for an advertising video. The target frame video data for a film or television series can be an image with a compelling storyline or a text image containing a synopsis.

[0171] In some embodiments, the browser window is positioned as close as possible to the edge of the display area to avoid occupying the key display area of ​​the first playback window. For example, the browser window may be located in one of the four corners of the display area. The display area of ​​the browser window is much smaller than the display area of ​​the monitor, so that the browser window does not occupy the display area of ​​the first playback window as much as possible, while still allowing the user to clearly see the content of the browser window.

[0172] It should be noted that during the download of the second media asset data to the target frame video data, the first media asset data plays normally. That is, the process of acquiring the first media asset data, decoding it using the first hardware decoder, and sending the decoded first media asset data to the monitor ensures that the monitor displays the decoded first media asset data in the first playback window. Because the browser window is displayed as a small window, although it is positioned above the first playback window, it only partially obscures the content displayed in the first playback window, such as... Figure 12 As shown.

[0173] In some embodiments, preview text and countdown information for the second media asset data are displayed in the browser window.

[0174] Controller 250 executes step S511: Decodes the first segment of media data using the browser decoding module;

[0175] In some embodiments, after the step of decoding the target frame video data using the browser decoding module and sending it to the display, the first segment of media data can be directly decoded using the browser decoding module.

[0176] In some embodiments, before the second media data is played, the browser decoding module decodes the first segment of media data, where the fourth preset duration is less than the second preset duration.

[0177] In some embodiments, the playback time of the second media data is 8:00:00 AM system time, and the fourth preset duration is 5 seconds. When the system time reaches 7:59:55, the first segment of media data is decoded using the browser decoding module.

[0178] In some embodiments, the playback time of the second media data is 30 minutes, the playback duration of the first media data is 5 seconds, and when the playback duration of the first media data is 29 minutes and 55 seconds, the first media data segment is decoded using the browser decoding module.

[0179] In some embodiments, the playback time of the second media asset data is 00:15:00, the time displayed on the playback progress bar of the first media asset data, and the fourth preset duration is 5 seconds. At 00:14:55, the first segment of media asset data is decoded using the browser decoding module.

[0180] In some embodiments, the first segment of media asset data in the demultiplexed second media asset data is sent to the browser decoding module. The browser decoding module decodes the video data in the first segment of media asset data to obtain decoded video data. The browser decoding module also decodes the audio data in the first segment of media asset data to obtain decoded audio data.

[0181] Controller 250 executes step S512: When the second media data playback time is reached, the decoded first segment of media data is displayed in the browser window. The display size of the browser window is the same as the size of the display area of ​​the monitor. Figure 13 As shown.

[0182] In some embodiments, the browser decoding module sends the decoded video data to the browser rendering module for processing, and the display 260 displays the decoded video data in the browser window. The browser decoding module sends the decoded audio data to the audio output interface 270, and the audio output interface 270 plays the decoded audio data.

[0183] Controller 250 executes step S513: sending the second segment of media data in the second media data to the first hardware decoder, so that the first hardware decoder decodes the second segment of media data, wherein the second segment of media data is the data in the second media data other than the first segment of media data;

[0184] In some embodiments, the second segment of media asset data in the demultiplexed second media asset data is sent to the first hardware decoder. The first hardware decoder decodes the video data in the second segment of media asset data to obtain decoded video data. The first hardware decoder decodes the audio data in the second segment of media asset data to obtain decoded audio data.

[0185] Controller 250 executes step S514: After the first segment of media data has finished playing, the browser window is set to a transparent state, and the decoded second segment of media data is played in the first playback window, such as... Figure 14 As shown.

[0186] In some embodiments, after the first segment of media data has finished playing, the first hardware decoder sends the decoded video data to the graphics rendering module for processing, and the display 260 displays the decoded video data in the browser window. The first hardware decoder sends the decoded audio data to the audio output interface 270, and the audio output interface 270 plays the decoded audio data.

[0187] In some embodiments, after the controller 250 executes step S509, it may further perform the following: before the second media data playback reaches a second preset duration, the video data in the first segment of media data is decoded using the browser decoding module, and the decoded video data is sent to the browser rendering module for rendering, and the decoded video data is displayed in the browser window by the display 260. The video data in the first segment of media data is displayed normally by the display 260, but is not played; or, the media data before the second preset duration of the first segment of media data is silent media data to avoid affecting the playback of the first audio data. The media data before the second preset duration of the first segment of media data may be an edited version of an advertisement video, a trailer for a movie or TV series, a highlight reel, or an edited clip, so that users can understand the general content of the advertisement or the next video in advance before deciding whether to continue watching.

[0188] In some embodiments, the controller further performs the following: before the playback of the second media data reaches a third preset duration, it decodes the video data in the first media data segment using the browser decoding module, sends the decoded video data to the browser rendering module for rendering, and displays the decoded video data in the browser window using the display 260. The video data in the first media data segment is displayed normally by the display 260, but is not played; alternatively, the media data for the second preset duration preceding the first media data segment is silent media data to avoid affecting the playback of the first audio data. The media data for the third preset duration preceding the first media data segment can be an edited version of an advertisement video, a trailer for a film or television drama, a highlight reel, or a clip, allowing users to preview the general content of the advertisement or the next video before deciding whether to continue watching.

[0189] Some embodiments of this application provide a media asset data display method. The method is applicable to a display device, which includes a display and a controller. The controller is configured to: acquire first media asset data; decode the first media asset data using a first hardware decoder; send the decoded first media asset data to the display so that the display shows the decoded first media asset data in a first playback window; download second media asset data; if the controller is configured with a second hardware decoder, send the second media asset data to the second hardware decoder so that the second hardware decoder decodes the second media asset data and sends the decoded second media asset data to the display so that the display shows the decoded second media asset data in a second playback window, the second playback window being located below the first playback window; pause playback of the second media asset data; and set a preset area of ​​the first playback window to a transparent state, the position of the preset area being related to the display position of the second playback window. This method allows users to anticipate the upcoming playback of second media asset data through a small window while viewing the first media asset data, reducing the abruptness of suddenly inserting the second media asset data and improving the user experience.

[0190] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0191] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the first playback window; The controller is configured as follows: Obtain first-hand media asset data; The first media data is decoded using a first hardware decoder, and the decoded first media data is sent to the display so that the display shows the decoded first media data in the first playback window. Download second media asset data; If the controller is configured with a second hardware decoder, the second media data is sent to the second hardware decoder so that the second hardware decoder decodes the second media data and sends the decoded second media data to the display so that the display shows the decoded second media data in the second playback window, which is located below the first playback window; Pause playback of the second media asset data to display the first frame image of the second media asset data in the second playback window. The first frame image is used to represent the content of the second media asset data as an icon image, product image, or text image. Set a preset area of ​​the first playback window to a transparent state, and the position of the preset area is related to the display position of the second playback window; If the controller is not configured with a second hardware decoder, the first segment of media data in the second media data is sent to the browser decoding module. The first segment of media data is the second media data of the previous preset number of frames. The browser decoding module decodes the target frame video data and sends it to the display so that the display shows the decoded target frame video data in the browser window. The browser window is located above the first playback window, and the target frame video data is the first keyframe video data. The browser decoding module is used to decode the first segment of media data; When the second media data playback time is reached, the first segment of decoded media data is displayed in the browser window, and the display size of the browser window is the same as the size of the display area of ​​the monitor. The second segment of media data in the second media data is sent to the first hardware decoder so that the first hardware decoder can decode the second segment of media data. The second segment of media data is the data in the second media data other than the first segment of media data. After the first segment of media data finishes playing, the browser window is set to a transparent state, and the decoded second segment of media data is played in the first playback window.

2. The display device according to claim 1, characterized in that, The controller is configured as follows: The display is controlled to show preview text and countdown information of the second media data in a browser window, which is located above the first playback window.

3. The display device according to claim 1, characterized in that, The controller, which executes the download of the second media asset data, is further configured to: Obtain playback parameters for the second media asset data, the playback parameters including the video object and playback time of the second media asset data; Upon reaching the first time point, the source address of the video object is obtained, where the first time point is the time point of the first preset duration before the playback time; If the second media asset data is streaming media data, initiate a data request based on the source address, download the streaming media file, and parse the streaming media protocol; Download the second media asset data according to the streaming media file and the streaming media protocol; If the second media asset data is not streaming media data, a data request is initiated based on the source address to download the second media asset data.

4. The display device according to claim 3, characterized in that, The controller is configured to set a preset area of ​​the first playback window to a transparent state, and is further configured to: Upon reaching the second time point, the preset area of ​​the first playback window is set to a transparent state. The second time point is a time point two preset durations before the playback time, and the second preset duration is less than the first preset duration.

5. The display device according to claim 1, characterized in that, The controller is configured as follows: When the playback time of the second media data arrives, the playback of the first media data is paused, and the playback of the second media data begins. The second playback window is located above the first playback window, and the display size of the second playback window is the same as the size of the display area of ​​the monitor.

6. The display device according to claim 1, characterized in that, The controller is configured as follows: The display is controlled to show preview text and countdown information of the second media data in the browser window.

7. A method for displaying media assets, characterized in that, include: Obtain first-hand media asset data; The first media data is decoded using a first hardware decoder, and the decoded first media data is sent to the display so that the display shows the decoded first media data in the first playback window. Download second media asset data; If the controller is configured with a second hardware decoder, the second media data is sent to the second hardware decoder so that the second hardware decoder decodes the second media data and sends the decoded second media data to the display so that the display shows the decoded second media data in the second playback window, which is located below the first playback window; Pause playback of the second media asset data to display the first frame image of the second media asset data in the second playback window. The first frame image is used to represent the content of the second media asset data as an icon image, product image, or text image. Set a preset area of ​​the first playback window to a transparent state, and the position of the preset area is related to the display position of the second playback window; If the controller is not configured with a second hardware decoder, the first segment of media data in the second media data is sent to the browser decoding module. The first segment of media data is the second media data of the previous preset number of frames. The browser decoding module decodes the target frame video data and sends it to the display so that the display shows the decoded target frame video data in the browser window. The browser window is located above the first playback window, and the target frame video data is the first keyframe video data. The browser decoding module is used to decode the first segment of media data; When the second media data playback time is reached, the first segment of decoded media data is displayed in the browser window, and the display size of the browser window is the same as the size of the display area of ​​the monitor. The second segment of media data in the second media data is sent to the first hardware decoder so that the first hardware decoder can decode the second segment of media data. The second segment of media data is the data in the second media data other than the first segment of media data. After the first segment of media data finishes playing, the browser window is set to a transparent state, and the decoded second segment of media data is played in the first playback window.

8. The method according to claim 7, characterized in that, The method further includes: The display is controlled to show the second media data preview text and countdown information in a browser window, which is located above the first playback window.

Images