Display device and media asset multi-speed playing method

Abstract

The embodiment of the invention discloses a display device and a media asset multi-speed playing method, and the method comprises the steps: obtaining a target multi-speed and metadata of a first media asset in response to a multi-speed setting instruction when the first media asset is played; determining a target decoding capability parameter based on the metadata and a decoding mode supported by the display device; based on the metadata and the target decoding capability parameter, a reference playing capability parameter is determined, and the reference playing capability parameter represents the playing capability required by playing the first media asset at the speed of one time; based on the target multiplied speed, the metadata and the target decoding capability parameter, a multiplied speed playing capability parameter is determined, and the multiplied speed playing capability parameter represents the playing capability required by playing the first media asset at the target multiplied speed; based on the reference playing capability parameter and the speed-multiplying playing capability parameter, matching a target speed-multiplying playing strategy from at least one pre-configured speed-multiplying playing strategy; and playing the first media asset at the target speed based on the target speed playing strategy. In this way, the dynamic matching speed-multiplying playing strategy can be realized.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for playing media assets at double speed. Background Technology

[0002] Media players typically have playback speed strategies for different speed settings. When playing a video at a target speed, the player retrieves the corresponding target speed playback strategy and plays the video at that speed accordingly. This method doesn't consider the actual playback environment and network speed, failing to balance video playback quality and system performance. For example, when a user sets the playback speed to 8x, the player retrieves the target speed playback strategy. This strategy is configured to determine the target time point to which the seek (jump) occurs and play the nearest I-frame. In other words, this target speed playback strategy sacrifices frame continuity for a significantly faster playback speed. However, under favorable network conditions and with powerful device decoding capabilities, a more advanced playback speed strategy might be supported for 8x playback. Summary of the Invention

[0003] This application provides a display device and a method for playing media assets at different speeds. By integrating multiple factors such as source metadata, decoding capabilities, and playback speed, the method dynamically and adaptively matches the target playback speed strategy corresponding to the target playback speed.

[0004] In a first aspect, some embodiments of this application provide a display device, including: The monitor is configured to display video feeds; A controller, coupled to the display, is configured to: When playing the first media asset, in response to the speed setting command, the target speed indicated by the speed setting command is obtained, and the metadata of the first media asset is obtained; Based on the metadata of the first media asset and the decoding methods supported by the display device, a target decoding capability parameter is determined; wherein, the target decoding capability parameter is used to characterize the decoding capability required by the display device to decode the first media asset; Based on the metadata and the target decoding capability parameters, a baseline playback capability parameter is determined; wherein, the baseline playback capability parameter is used to characterize the playback capability required when playing the first media asset at one speed; Based on the target playback speed, the metadata, and the target decoding capability parameters, playback speed capability parameters are determined; wherein, the playback speed capability parameters are used to characterize the playback capability required when playing the first media asset at the target playback speed; Based on the baseline playback capability parameters and the speed playback capability parameters, a target speed playback strategy is matched from at least one pre-configured speed playback strategy; the target speed playback strategy includes the data acquisition method and decoding method used when playing the first media asset at the target speed. Based on the target playback speed strategy, the first media asset is played at the target playback speed.

[0005] The embodiments of the first aspect described above have the following beneficial effects: Metadata typically contains key attributes of media assets, such as bitrate, resolution, frame rate, and encoding format. These key attributes affect the transmission efficiency and network bandwidth when the media asset is played at double speed. The display device itself is configured with a decoding method (e.g., hardware decoding and / or software decoding), and the decoding method affects the smoothness and clarity of the media asset when played at double speed. Therefore, by fusing metadata and the decoding methods supported by the device, the target decoding capability parameters are obtained to determine the decoding capability required by the display device to decode the first media asset. By fusing media asset metadata and target decoding capability parameters, baseline playback capability parameters are obtained to determine the complete and smooth playback at 1.0x speed. (i.e., normal playback) The playback capability required by the first media asset, the baseline playback capability parameter is a reference indicator used to match the speed playback strategy; by fusing the target speed, the metadata and the target decoding capability parameter, the speed playback capability parameter is determined to determine the playback capability required to play the first media asset at the target speed (not 1.0 speed). Then, using the baseline playback capability parameter and the speed playback capability parameter, the target speed playback strategy is dynamically matched from at least one speed playback strategy pre-configured by the player. The target speed playback strategy is at least compatible with the playback attributes and device decoding capability of the first media asset, so that the speed playback strategy can adapt to the speed playback environment of the media asset, taking into account both playback quality and device performance.

[0006] In some embodiments, the metadata includes the encoding format and frame rate of the first media asset; the controller performs a process based on the metadata of the first media asset and the decoding methods supported by the display device to determine target decoding capability parameters, specifically configured to: determine the target decoder to be used based on the encoding format of the first media asset and the decoding methods supported by the display device; wherein, the target decoder is one of a hardware decoder and a software decoder; if the target decoder is the software decoder, then the target decoding capability parameters are determined based on the frame rate and encoding format of the first media asset.

[0007] This embodiment offers the following advantages: Different display devices may support different decoding methods; some support hardware decoding, some support software decoding, and some may support both hardware and software decoding simultaneously. The encoding format of the media asset may also require different decoding methods; some media assets may require hardware decoding, some may require software decoding, and some may be compatible with both. Therefore, based on the encoding format of the currently playing first media asset and the decoding methods supported by the display device, the type of target decoder to be used can be determined. The target decoder is either a hardware decoder (performing hardware decoding) or a software decoder (performing software decoding). If the target decoder is a software decoder, different encoding formats require different software decoding capabilities. Since the frame rate represents the number of frames played per second, achieving a specific frame rate also requires decoding capabilities. Therefore, based on the encoding format and frame rate of the first media asset, the target decoding capability parameters are determined, allowing the target decoding capability parameters to adapt to the device's decoding capabilities, the encoding format of the first media asset, and the frame rate requirements, thereby improving the accuracy of dynamic matching of the playback speed strategy.

[0008] In some embodiments, if the target decoder is the software decoder, the controller performs the following: if the target decoder is the software decoder, the controller determines the target decoding capability parameter based on the frame rate and encoding format of the first media asset. Specifically, the controller is configured to: obtain the target decoding capability parameter mapped to the encoding format of the first media asset based on the mapping relationship between the encoding format and the decoding capability parameter. The target decoding capability parameter is one of a first decoding capability parameter, a second decoding capability parameter, and a third decoding capability parameter. Wherein, the first decoding capability parameter is the product of the first preset capability coefficient and the frame rate, the second decoding capability parameter is the product of the second preset capability coefficient and the frame rate, and the third decoding capability parameter is the product of the third preset capability coefficient and the frame rate; the first preset capability coefficient is less than the second preset capability coefficient, and the second preset capability coefficient is less than the third preset capability coefficient.

[0009] This embodiment offers the following advantages: If the target decoder is a software decoder, since software decoding relies on the CPU to execute the decoding algorithm for video restoration, and different encoding formats have different requirements for CPU decoding performance, the display device can pre-set the mapping relationship between the encoding format and decoding capability parameters. This allows the acquisition of the target decoding capability parameters mapped to the encoding format of the first media asset. The target decoding capability parameters are one of three: a first decoding capability parameter, a second decoding capability parameter, and a third decoding capability parameter. Specifically, the first decoding capability parameter corresponds to low CPU decoding performance, the second decoding capability parameter corresponds to medium CPU decoding performance, and the third decoding capability parameter corresponds to high CPU decoding performance. This provides three levels of decoding capability parameters for different encoding formats. All three parameters are related to the frame rate, i.e., they are the product of a preset capability coefficient and the frame rate. Different levels of decoding capability parameters correspond to different preset capability coefficients. Therefore, for software decoding, the target decoding capability parameters can be quickly obtained through the encoding format. This improves the matching efficiency of the playback speed adjustment strategy and, by considering the media asset encoding format and decoding capability when matching the target playback speed, improves the matching accuracy of the playback speed adjustment strategy.

[0010] In some embodiments, the controller performs a determination of target decoding capability parameters based on the metadata of the first media asset and the decoding method supported by the display device. Specifically, it is configured to: if the target decoder is the hardware decoder, then determine the first decoding capability parameter as the target decoding capability parameter.

[0011] This embodiment has the following beneficial effects: If the target decoder is a hardware decoder, since hardware decoding is performed through a dedicated chip or hardware module, it has the characteristics of low power consumption and does not depend on the CPU. Therefore, there is no need to consider the relationship between the media asset encoding format and the CPU decoding performance. Hardware decoding adopts a general decoding capability parameter, which is the first decoding capability parameter corresponding to low CPU decoding performance.

[0012] In some embodiments, the metadata further includes the bitrate and resolution of the first media asset; the controller performs a process to determine playback speed capability parameters based on the target playback speed, the metadata, and the target decoding capability parameters, specifically configured as follows: if the first media asset is a media asset transmitted over a network, then a second transmission capability parameter is determined based on the target playback speed, the resolution, the bitrate, and the network transmission rate; wherein, the second transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at the target playback speed; if the target decoder is the hardware decoder, then the playback speed capability parameters are determined based on the second transmission capability parameter and the target decoding capability parameter; if the target decoder is the software decoder, then the playback speed capability parameters are determined based on the target playback speed, the second transmission capability parameter, and the target decoding capability parameter.

[0013] This embodiment has the following beneficial effects: For media assets transmitted over a network (such as media assets provided by video applications, media assets played by browsers, etc.), to ensure the smoothness of media asset playback at different speeds, it is necessary to consider not only the resolution and bitrate of the media asset itself, but also the target playback speed, and the actual network transmission rate. Thus, based on the target playback speed, resolution, bitrate, and network transmission rate, a second transmission capability parameter is obtained to determine the required transmission rate when playing the first media asset at the target playback speed. This ensures that the amount of data transmitted per unit time meets the requirements when playing the first media asset at the target playback speed, avoiding stuttering during playback. The required playback speed capability differs depending on the decoding mechanism (hardware decoding or software decoding). Specifically, during software decoding, the playback speed capability parameter needs to be determined based on the second transmission capability parameter, the target decoding capability parameter, and the target playback speed. A higher target playback speed in software decoding requires a higher playback speed capability. Since hardware decoding uses a dedicated chip or hardware module for decoding, the decoding capability of the hardware decoder is fixed and unaffected by playback speed. Therefore, during hardware decoding, the playback speed capability parameter is determined based on the second transmission capability parameter and the target decoding capability parameter. In this way, for media assets transmitted over the network, the playback attributes of the media assets, the network transmission rate, and the decoding capability can be integrated to dynamically match the target playback speed strategy, thereby improving the accuracy of dynamic matching of playback speed strategy.

[0014] In some embodiments, the controller performs the following: determining a baseline playback capability parameter based on the metadata and the target decoding capability parameter; specifically configured to: determine a first transmission capability parameter based on the resolution of the first media asset; wherein the first transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at 1x speed; and determine the baseline playback capability parameter based on the first transmission capability parameter and the target decoding capability parameter.

[0015] This embodiment has the following beneficial effects: Since the higher the resolution, the larger the amount of data that needs to be transmitted per unit time, in order to ensure the clarity of the media asset picture, high-resolution media assets often require higher transmission capability parameters to support the data transmission needs. Therefore, when the first media asset is played completely and smoothly at 1x speed (normal playback), the first transmission capability parameter is positively correlated with the resolution. The first transmission capability is determined based on the resolution of the first media asset to determine the transmission rate required when playing the first media asset normally. The baseline playback capability parameter is determined based on the first transmission capability parameter and the target decoding capability parameter, thereby providing a reference baseline for dynamically matching the target speed playback strategy.

[0016] In some embodiments, the controller performs a process of matching a target playback speed strategy from at least one pre-configured playback speed strategy based on the baseline playback capability parameter and the playback speed adjustment parameter. Specifically, the controller is configured to: if the playback speed adjustment parameter is not greater than the baseline playback capability parameter, then determine the target playback speed strategy as a first playback speed strategy; the first playback speed strategy refers to acquiring the audio and video data of the first media asset based on the target playback speed and decoding the audio and video data; if the playback speed adjustment parameter is greater than the baseline playback capability parameter, and if the playback speed adjustment parameter is not greater than a preset multiple of the baseline playback capability parameter, then determine the target playback speed strategy. The strategy is a second speed playback strategy; the second speed playback strategy refers to acquiring the audio and video data of the first media asset based on the target speed, decoding keyframes in the video data of the first media asset, and not decoding the audio data of the first media asset; if the speed playback capability parameter is greater than a preset multiple of the baseline playback capability parameter, then the target speed playback strategy is determined to be a third speed playback strategy; the third speed playback strategy refers to determining at least one target time node to jump to based on the target speed, acquiring and decoding target keyframes from the video data of the first media asset, and not decoding the audio data of the first media asset, wherein the target keyframe is the keyframe closest to the target time node.

[0017] This embodiment has the following beneficial effects: Based on the baseline playback capability parameters and the preset multiplier, multiple playback capability ranges can be constructed. The target playback speed strategy is matched from at least one pre-configured playback speed strategy of the player according to the range to which the playback speed capability parameters belong. If the playback speed capability parameters are less than or equal to the baseline playback capability parameters, it indicates that playback resources (including transmission and decoding resources) are sufficient to support full data loading and full decoding. In this case, the matched target playback speed strategy is the first playback speed strategy, which acquires the audio and video data of the first media asset based on the target multiplier and decodes all the audio and video data. If the baseline playback capability parameters are less than or equal to the baseline playback capability parameters multiplied by the preset multiplier, it indicates that playback resources are slightly insufficient. In this case, the matched target playback speed strategy is the second playback speed strategy, which decodes only keyframes (I-frames) and skips other non-keyframes (such as P-frames and B-frames), thereby reducing decoding complexity, reducing resource consumption, and ensuring the smoothness of the first media asset's playback speed. If the playback speed capability parameter is greater than the baseline playback capability parameter multiplied by the preset multiplier, it indicates that playback resources are severely insufficient. In this case, a seek degradation scheme is implemented. Based on the target playback speed, at least one target time node to be sought is determined, the nearest target keyframe near the target time node is searched, and the target keyframe is decoded. This sacrifices the continuity of the picture to achieve the feasibility of ultra-high playback speed, ensuring that the user's need for fast browsing can still be supported even when playback resources are extremely limited.

[0018] In some embodiments, the controller performs a process of determining a second transmission capability parameter based on the target speed multiplier, the resolution, the bitrate, and the network transmission rate. Specifically, this is configured to: obtain a target influence factor mapped to the encoding format of the first media asset based on the mapping relationship between the encoding format and the influence factor; wherein the influence factor is used to characterize the degree of influence of the encoding format of the media asset on the transmission rate; and determine the second transmission capability parameter based on the target influence factor, the target speed multiplier, the resolution, the bitrate, and the network transmission rate.

[0019] This embodiment offers the following advantages: Some encoding formats require higher transmission rates, while others require lower transmission rates. Therefore, to measure the impact of different encoding formats on transmission rates, the display device can preset a mapping relationship between encoding formats and influence factors. The influence factor characterizes the degree of influence of the media asset's encoding format on the transmission rate. Thus, when determining the second transmission capability parameter, the target influence factor mapped to the encoding format of the first media asset is obtained. This target influence factor is then fused with the target playback speed, resolution, bitrate, and network transmission rate to obtain the second transmission capability parameter. This second transmission capability parameter can adapt to the transmission capabilities required by media assets with different encoding formats, thereby improving the accuracy of dynamically matching playback speed strategies.

[0020] In some embodiments, the controller performs a process to determine playback speed capability parameters based on a target playback speed, the metadata, and the target decoding capability parameters. Specifically, this is configured as follows: if the first media asset is a local media asset, or if the first media asset is a media asset transmitted based on the Server Message Block Protocol, then a third transmission capability parameter is determined based on the target playback speed and the resolution; wherein, the third transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at the target playback speed; if the target decoder is the hardware decoder, then the playback speed capability parameters are determined based on the third transmission capability parameter and the target decoding capability parameters; if the target decoder is the software decoder, then the playback speed capability parameters are determined based on the target playback speed, the third transmission capability parameter, and the target decoding capability parameters.

[0021] This embodiment has the following advantages: If the first media asset is a local media asset, the media asset data is stored in the local disk, and the transmission relies on the device's internal bus, resulting in extremely low latency and sufficient bandwidth. If the first media asset is a media asset transmitted based on the SMB (Server Message Block) protocol, the media asset data is stored on a shared server within the local area network (LAN), where the LAN bandwidth is far higher than the playback bitrate requirement, and the latency is extremely low, making the transmission bottleneck insignificant. Therefore, when the first media asset is a local media asset or a media asset played based on the SMB protocol, the impact of the transmission rate can be almost ignored. Thus, a third transmission capability parameter can be determined based on the target playback speed and resolution. This third transmission capability parameter represents the transmission rate required when playing local or SMB media assets at the target playback speed. During software decoding, the playback speed capability parameter needs to be determined based on the third transmission capability parameter, the target decoding capability parameter, and the target playback speed. Since hardware decoding is performed through a dedicated chip or hardware module, the decoding capability of the hardware decoder is fixed and unaffected by the playback speed. Therefore, during hardware decoding, the playback speed capability parameter is determined based on the third transmission capability parameter and the target decoding capability parameter. In this way, for local media assets or SMB media assets, the playback attributes and decoding capabilities of the media assets can be combined to dynamically match the target playback speed strategy from at least one pre-configured playback speed strategy, thereby improving the accuracy of dynamic matching of playback speed strategy.

[0022] Secondly, some embodiments of this application also provide a method for playing media assets at double speed, including: When playing the first media asset, in response to the speed setting command, the target speed indicated by the speed setting command is obtained, and the metadata of the first media asset is obtained; Based on the metadata of the first media asset and the decoding methods supported by the display device, a target decoding capability parameter is determined; wherein, the target decoding capability parameter is used to characterize the decoding capability required by the display device to decode the first media asset; Based on the metadata and the target decoding capability parameters, a baseline playback capability parameter is determined; wherein, the baseline playback capability parameter is used to characterize the playback capability required when playing the first media asset at one speed; Based on the target playback speed, the metadata, and the target decoding capability parameters, playback speed capability parameters are determined; wherein, the playback speed capability parameters are used to characterize the playback capability required when playing the first media asset at the target playback speed; Based on the baseline playback capability parameters and the speed playback capability parameters, a target speed playback strategy is matched from at least one pre-configured speed playback strategy; the target speed playback strategy includes the data acquisition method and decoding method used when playing the first media asset at the target speed. Based on the target playback speed strategy, the first media asset is played at the target playback speed.

[0023] The embodiments of the second aspect above have the following beneficial effects: Metadata typically contains key attributes of media assets, such as bitrate, resolution, frame rate, and encoding format. These key attributes affect the transmission efficiency and network bandwidth when the media asset is played at double speed. The display device itself is configured with a decoding method (e.g., hardware decoding and / or software decoding), and the decoding method affects the smoothness and clarity of the media asset when played at double speed. Therefore, by fusing metadata and the decoding methods supported by the device, the target decoding capability parameters are obtained to determine the decoding capability required by the display device to decode the first media asset; by fusing media asset metadata and target decoding capability parameters, the baseline playback capability parameters are obtained to determine the playback speed at 1.0x (i.e., normal speed). The playback capability required by the first media asset (for normal playback) is defined by a baseline playback capability parameter, which serves as a reference indicator for matching the playback speed strategy. By fusing the target playback speed, the metadata, and the target decoding capability parameter, the playback speed parameter is determined to ascertain the required playback capability for playing the first media asset at the target playback speed (not 1.0x). Then, using the baseline playback capability parameter and the playback speed parameter as key parameters, the target playback speed strategy is dynamically matched from at least one playback speed strategy pre-configured by the player. This target playback speed strategy is at least compatible with the playback attributes of the first media asset and the device's decoding capability, enabling the playback speed strategy to adapt to the media asset's playback speed environment while balancing playback quality and device performance. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in some embodiments of this application or in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application; Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application; Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application; Figure 4 A schematic diagram of a media asset playback architecture provided for some embodiments of this application; Figure 5 A schematic diagram of a media asset playback interface provided in some embodiments of this application; Figure 6 This is a schematic diagram illustrating the configuration of the playback speed adjustment strategy of the player provided in some embodiments of this application; Figure 7 A schematic diagram of a media asset playback architecture 2 provided in some embodiments of this application; Figure 8 Flowcharts of media asset speed-up playback methods provided in some embodiments of this application; Figure 9 A schematic diagram illustrating the player matching speed playback strategy provided in some embodiments of this application; Figure 10 A schematic diagram illustrating the principle of the first-speed playback strategy provided in some embodiments of this application; Figure 11 A schematic diagram of the principle of the second-speed playback strategy provided in some embodiments of this application. Figure 1 ; Figure 12 A schematic diagram of the principle of the second-speed playback strategy provided in some embodiments of this application. Figure 2 ; Figure 13 A schematic diagram illustrating the principle of the third-speed playback strategy provided in some embodiments of this application; Figure 14 A timing interaction diagram of a media asset speed-up playback method provided in some embodiments of this application. Detailed Implementation

[0026] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0027] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0028] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0029] In this application embodiment, the term "display device" generally refers to a device with screen display and data processing capabilities. For example, display devices include, but are not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, and augmented reality devices.

[0030] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0031] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0032] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0033] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0034] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0035] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0036] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.

[0037] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0038] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0039] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0040] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0041] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface 280 receives the user input commands through the graphical user interface (GUI).

[0042] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0043] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0044] In some embodiments, the user input interface 280 can be used to receive instructions from user input, such as media playback instructions, speed setting instructions, etc.

[0045] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0046] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0047] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0048] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0049] In some embodiments, see Figure 3 The application layer can run multiple applications, such as application 1, application 2, application 3, application 4, etc. This application addresses media asset playback speed adjustment by implementing a dynamic adaptive matching playback speed strategy. Therefore, the application layer can run video applications, player applications, and other related applications that support media asset playback speed adjustment. The controller can implement the technical solutions of the embodiments of this application by running at least one related application in the application layer.

[0050] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0051] See Figure 3 In this embodiment, the application framework layer includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0052] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0053] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0054] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The kernel layer can contain at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0055] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0056] Figure 4 This is a schematic diagram of a media asset playback architecture provided for some embodiments of this application.

[0057] See Figure 4 The media asset playback architecture consists of a media asset application and a player. The media asset application provides on-demand video sources and allows users to adjust settings such as playback speed and resolution. In response to a command to play the first media asset, the media asset application can launch its corresponding player, and playback is achieved through the collaboration of various modules within the player.

[0058] See Figure 4 The player includes, but is not limited to: resource acquisition module, demultiplexing module (Demux), decoding module (Codec), synchronization module (VSYNC), and rendering module (Render).

[0059] The resource acquisition module is used to acquire multimedia data from media assets through various means. It acts as the player's "input terminal," providing a data source for subsequent modules. For example, for local media assets, the resource acquisition module can acquire the multimedia data from files on the local disk. The resource acquisition module can also acquire multimedia data from media assets through other transmission protocols, including but not limited to: HTTP (Hypertext Transfer Protocol), SMB (Server Message Block), and HLS (HTTP Live Streaming).

[0060] The demultiplexing module is used to demultiplex the multimedia data of media assets, splitting the mixed data stream into independent video streams, audio streams, and subtitle streams, thus preparing for subsequent decoding. The demultiplexing module is also used to parse the metadata of the media assets from the multimedia data. This metadata includes, but is not limited to, encoding format, frame rate, bitrate, resolution, and audio sampling rate.

[0061] The decoding module is used to decode the video and audio streams, restoring the video stream to its original YUV format video frames and the audio stream to its original PCM format audio data. YUV is the color space format for video, where Y represents luminance, U represents chrominance, and V represents chroma. It can be converted to RGB (Red, Green, Blue) format for subsequent rendering. PCM (Pulse Code Modulation) is a linear pulse code for audio, which will be converted to an analog audio signal during subsequent rendering.

[0062] In some embodiments, based on the decoding methods supported by the display device, the decoding module may include at least one of a hardware decoder and a software decoder. The hardware decoder implements hardware decoding through a dedicated decoding chip. Hardware decoding is CPU-independent, featuring low power consumption and high efficiency, reducing CPU load. However, it is limited by the encoding formats supported by the hardware, and adaptation to new encoding formats may be delayed. The software decoder performs decoding processing by executing software programs through the CPU. It has strong compatibility and supports various encoding formats, but it is highly dependent on the CPU, consuming more CPU resources and consuming more power. It may also cause stuttering when playing high-bitrate media.

[0063] The synchronization module uses the vertical synchronization (VSYNC) mechanism to keep video and audio playing in sync, meaning that the display time of video frames is strictly aligned with the playback time of audio, thus avoiding audio-visual desynchronization issues.

[0064] The rendering module converts decoded YUV video frames into RGB format or other image formats supported by the display device, and draws them onto the screen display area (e.g., media playback interface), thus achieving video rendering. The rendering module also converts decoded PCM audio data into analog audio signals and plays the audio through the display device's audio output channel (e.g., speakers, headphones, audio equipment), thus achieving audio rendering. The rendering module is the player's "output end," converting processed audio and video data into visual and auditory effects perceptible to the user.

[0065] Figure 5 This is a schematic diagram of a media asset playback interface provided in some embodiments of this application.

[0066] The media asset application responds to the instruction to play the first media asset by launching the player and following the instructions. Figure 4 The example media asset playback architecture starts playing the first media asset, causing the media asset playback interface to appear on the screen. See also Figure 5 The media playback interface includes a speed setting button 51, which is used to set the playback speed of the first media asset.

[0067] The media asset application responds to the user clicking the speed setting button 51, see [link / reference]. Figure 5 The playback interface displays a playback speed list 51a at the top. This list includes options corresponding to at least one playback speed configured for the first media asset, such as "0.8X", "1.0X", "1.5X", "2.0X", "4.0X", "8.0X", and other ultra-high playback speed options. Users can then set / switch the playback speed of the first media asset based on the playback speed list 51a, thereby achieving playback of the first media asset at a target speed.

[0068] Figure 6 This is a schematic diagram illustrating the configuration of the playback speed adjustment strategy of the player provided in some embodiments of this application.

[0069] See Figure 6 For example, the player has different playback speed strategies corresponding to different speeds. The speed values ​​and playback strategies can be matched one-to-one. For example, "4.0X" corresponds to the second playback speed strategy. Multiple speed values ​​can also correspond to the same playback speed strategy. For example, "0.8X", "1.0X", "1.5X", and "2.0X" all correspond to the first playback speed strategy.

[0070] In some embodiments, see Figure 6As the playback speed value increases, the playback speed strategy gradually degrades. Degradation means that the playback quality gradually decreases, such as reduced image clarity, discontinuous images, or incomplete content. That is, the playback speed strategy levels are: First speed playback strategy > Second speed playback strategy > Third speed playback strategy > ...

[0071] In some embodiments, the media asset application, in response to a speed setting command, obtains the target speed indicated by the speed setting command and sends a speed playback command to the player, which includes the target speed. Thus, the player, in response to the speed playback command, obtains the target speed playback strategy corresponding to the target speed based on a preset correspondence between speed and speed playback strategies, and, based on the target speed playback strategy, plays the first media asset at the target speed.

[0072] For example, based on Figure 5 In the example media playback interface, if the user selects the "4.0X" option in the speed list 51a, then see... Figure 6 If the player determines that "4.0X" corresponds to the second speed playback strategy, then it will play the first media resource based on the second speed playback strategy.

[0073] The above-described implementation scheme represents a static matching of playback speed strategies, failing to consider factors such as the actual playback environment and network transmission speed, and thus cannot balance video playback quality and system performance. For example, when a user sets the playback speed to 8.0x, the player determines that 8.0x corresponds to the third-speed playback strategy. However, if the current network conditions are good and the device's decoding capabilities are strong, it may support playing the first media asset at 8.0x speed based on the second-speed playback strategy, without having to implement the lower-level third-speed playback strategy, which would further degrade the media asset playback quality.

[0074] Figure 7 This is a schematic diagram of a media asset playback architecture 2 provided in some embodiments of this application.

[0075] Compared to Figure 4 See the example media asset playback architecture 1. Figure 7 In Media Asset Playback Architecture 2, a strategy matching module is added to the player. This strategy matching module is used to dynamically match the playback speed strategy.

[0076] In some embodiments, see Figure 7 During the playback of the first media asset, the media asset application responds to the speed setting command, obtains the target speed indicated by the speed setting command, and sends a speed playback command to the strategy matching module, which includes the target speed.

[0077] In some embodiments, see Figure 7In response to the speed-up playback command, the strategy matching module obtains the metadata (MetaData) of the first media asset parsed by the demultiplexing module. The metadata includes, but is not limited to, encoding format, frame rate, bit rate, resolution, etc.

[0078] In some embodiments, see Figure 7 In response to playback speed adjustment commands, the strategy matching module can also obtain the decoder type configured by the decoding module. The decoder type includes at least one of hardware and software decoders. Thus, the strategy matching module can determine the decoding methods supported by the display device based on the decoder type, which include at least one of hardware and software decoding.

[0079] In some embodiments, see Figure 7 The strategy matching module can dynamically match a suitable target playback speed strategy from at least one pre-configured playback speed strategy of the player, based on the target playback speed, the metadata of the first media asset, and the decoding methods supported by the display device. This target playback speed strategy includes the data acquisition method and decoding method used when playing the first media asset at the target playback speed. Thus, the strategy matching module can guide the data acquisition method of the resource acquisition module and the decoding method used by the decoding module based on the target playback speed strategy. The core concept of this application lies in how the player implements dynamic matching of the target playback speed strategy, that is, focusing on the software program configuration of the strategy matching module.

[0080] Figure 8 A flowchart illustrating a method for playing media assets at double speed according to some embodiments of this application.

[0081] The media asset playback speed adjustment method is executed by the controller 250. The controller 250 can implement the media asset playback speed adjustment method by running the media asset application and the player. The method includes: Step S81: When playing the first media asset, in response to the speed setting command, obtain the target speed indicated by the speed setting command, and obtain the metadata of the first media asset. The metadata includes, but is not limited to: encoding format, frame rate, bitrate, resolution, etc.

[0082] In some embodiments, the player typically starts playing the first media asset at 1x speed (1.0X) by default. During the playback of the first media asset, see [link to relevant documentation]. Figure 5 Users can set the playback speed (i.e., target speed) of the first media asset through the speed list 51a, thereby inputting a speed setting command. The media asset application can then obtain the target speed indicated by the speed setting command. For example, if the user selects the 4.0X option, the target speed indicated by the speed setting command is 4.0.

[0083] In some embodiments, the player can use a demultiplexing module to separate independent video and audio streams from the multimedia data of the first media asset, and can also parse the metadata of the first media asset.

[0084] Step S82: Determine the target decoding capability parameters based on the metadata of the first media asset and the decoding methods supported by the display device.

[0085] The target decoding capability parameter (DecodeCap1) is used to characterize the decoding capability required by the display device to decode the first media asset.

[0086] In some embodiments, different display devices may support different decoding methods. Some display devices support hardware decoding, some support software decoding, and some may support both hardware and software decoding simultaneously. Therefore, the player can determine the decoding method supported by the display device by the encoder type configured in the decoding module. For example, if the decoding module is configured with both hardware and software decoders, then the display device supports both hardware and software decoding.

[0087] In some embodiments, the encoding format of the media asset includes, but is not limited to, MPEG2, H.264 / AVC, VP8, H.265 / HEVC, VP9, ​​and AV1. Different encoding formats require different decoding methods; some media asset encoding formats require hardware decoding, some require software decoding, and some media asset encoding formats are compatible with both hardware and software decoding.

[0088] In some embodiments, the policy matching module in the player can determine the target decoder to be used based on the encoding format in the metadata and the decoding methods supported by the display device obtained from the decoding module, so as to ensure that the decoding module can decode the first media asset through the target decoder. The target decoder can be either a hardware decoder or a software decoder.

[0089] In some embodiments, if the policy matching module determines that the candidate encoders capable of decoding the first media asset include hardware encoders and software encoders, it determines the candidate decoder with the higher priority as the target decoder based on the decoder priority. Here, decoder priority is used to specify the priority between the hardware decoder and the software decoder.

[0090] In some embodiments, the decoder priority can be configured such that the hardware decoder has a higher priority than the software decoder. This prioritizes hardware decoding, reducing power consumption and CPU load, and improving the smoothness of the first media asset playback.

[0091] In some embodiments, if the target encoder is a software encoder, since different encoding formats require different software decoding capabilities, and the frame rate represents the number of frames played per second of the media asset, the decoding capability is also required to achieve a specific frame rate. Therefore, the strategy matching module can determine the target decoding capability parameters based on the encoding format and frame rate of the first media asset, so that the target decoding capability parameters can be adapted to the device decoding capability, the encoding format and frame rate requirements of the first media asset, and improve the accuracy of dynamic matching of the speed playback strategy.

[0092] In some embodiments, if the target decoder is a software decoder, since software decoding relies on the CPU to execute the decoding algorithm for video restoration, and different encoding formats have different requirements for CPU decoding performance, the strategy matching module can pre-define a mapping table A. This mapping table A is used to record the mapping relationship between encoding formats and decoding capability parameters (DecodeCap). Table 1 provides an example of a mapping table A: Table 1

[0093] In some embodiments, referring to Table 1, LCPU represents the first decoding capability parameter, MCPU represents the second decoding capability parameter, and HCPU represents the third decoding capability parameter. The policy matching module obtains the target decoding capability parameter (DecodeCap1) mapped to the encoding format of the first media asset based on mapping table A. DecodeCap1 is one of LCPU, MCPU, and HCPU. For example, if the encoding format of the first media asset is H.264 / AVC, then the DecodeCap1 mapped to H.264 / AVC is LCPU.

[0094] In some embodiments, LCPU < MCPU < HCPU. Here, LCPU represents the lowest level of CPU performance required for software decoding, corresponding to low CPU decoding performance; MCPU represents the middle level of CPU performance required for software decoding, corresponding to medium CPU decoding performance; and HCPU represents the highest level of CPU performance required for software decoding, corresponding to high CPU decoding performance. The higher the CPU performance requirement for software decoding, the stronger the decoding capability needed.

[0095] In some embodiments, LCPU = first preset capability coefficient × frame rate, MCPU = second preset capability coefficient × frame rate, and HCPU = third preset capability coefficient × frame rate, wherein the first preset capability coefficient < the second preset capability coefficient < the third preset capability coefficient. The first, second, and third preset capability coefficients are not limited; for example, the first preset capability coefficient can be set to 1, the second preset capability coefficient to 2, and the third preset capability coefficient to 3, then LCPU = 1 × frame rate, MCPU = 2 × frame rate, and HCPU = 3 × frame rate.

[0096] Thus, for software decoding, different encoding formats are mapped to DecodeCap, which can be divided into three levels: LCPU, MCPU, and HCPU. All three are related to the frame rate, meaning they are the product of a preset capability coefficient and the frame rate. Different levels of DecodeCap correspond to different preset capability coefficients. For software decoding, the target decoding capability parameter (DecodeCap1) can be quickly obtained through the encoding format. This improves the matching efficiency of the playback speed adjustment strategy and, by considering both the media asset encoding format and decoding capability when matching the target playback speed, enhances the matching accuracy of the playback speed adjustment strategy.

[0097] In some embodiments, if the target encoder is a hardware encoder, since hardware decoding is performed through a dedicated chip or hardware module, it features low power consumption and does not rely on the CPU. Therefore, there is no need to consider the relationship between the media encoding format and the CPU decoding performance. The decoding capability of the hardware decoder is fixed. Therefore, a general decoding capability parameter can be used during hardware decoding. The general decoding capability parameter is the first decoding capability parameter corresponding to low CPU decoding performance, that is, DecodeCap1=LCPU during hardware decoding.

[0098] Step S83: Determine the baseline playback capability parameters based on metadata and target decoding capability parameters.

[0099] In some embodiments, higher resolution requires a larger amount of data to be transmitted per unit time. To ensure the clarity of the media asset, high-resolution media assets often require higher transmission capabilities to support data transmission needs. Therefore, when playing the first media asset completely and smoothly at 1x speed (normal playback), the strategy matching module can determine the first transmission capability parameter (BaseBitrateCap) based on the resolution of the first media asset. BaseBitrateCap is used to characterize the transmission rate required for playing the first media asset completely and smoothly at 1x speed. BaseBitrateCap is positively correlated with resolution.

[0100] In some embodiments, BaseBitrateCap = resolution.

[0101] In some embodiments, the strategy matching module may determine the baseline playback capability parameter (NormalCap) based on the first transmission capability parameter (BaseBitrateCap) and the target decoding capability parameter (DecodeCap1). NormalCap characterizes the playback capability required for complete and smooth playback of the first media asset at 1x speed, i.e., the playback capability required for normal playback of the first media asset.

[0102] In some embodiments, NormalCap = BaseBitrateCap × DecodeCap1. NormalCap can be used as a benchmark reference for dynamically matching playback speed strategies.

[0103] Step S84: Determine the playback speed capability parameters based on the target playback speed, target decoding capability parameters, and metadata of the first media asset.

[0104] In some embodiments, the first media asset can be a local media asset, in which case the resource acquisition module obtains the multimedia data of the first media asset from a file on the local disk.

[0105] In some embodiments, the first media asset may be a media asset transmitted over a network, where "network" may be a wide area network (WAN) or a local area network (LAN). Network transmission protocols include, but are not limited to, HTTP, HLS, and SMB protocols.

[0106] If the first media asset is transmitted over a network, to ensure smooth playback, it is necessary to consider not only the target playback speed, the resolution and bitrate of the first media asset itself, but also the impact of the actual network transmission rate. In some embodiments, the strategy matching module can determine a second transmission capability parameter (BitrateCap) based on the target playback speed, resolution, bitrate, and actual network transmission rate. BitrateCap is used to characterize the transmission rate required when playing the first media asset at the target playback speed, thereby ensuring that the amount of data transmitted per unit time meets the requirements when playing the first media asset at the target playback speed, and avoiding stuttering during playback.

[0107] In some embodiments, BitrateCap = Speed ​​× Resolution × Bitrate / Network transmission rate.

[0108] In some embodiments, the policy matching module can monitor the network transmission rate in real time. The network transmission rate represents the number of bits transmitted per unit time (in bps), also known as bitrate. The policy matching module can use specialized network performance testing tools (such as speed test tools) to monitor the bitrate and, in conjunction with resolution, bitrate, and target speed multiplier, calculate BitrateCap.

[0109] In some embodiments, some encoding formats require higher transmission rates, while others require lower transmission rates. Therefore, to measure the impact of different encoding formats on transmission rate, the display device can preset a mapping relationship between encoding formats and influence factors, where the influence factor characterizes the degree of influence of the media asset's encoding format on transmission rate. The strategy matching module can preset a mapping relationship table B, which records the mapping relationship between encoding formats and influence factors. Table 2 illustrates a mapping relationship table B: Table 2

[0110] In some embodiments, referring to Table 2, for encoding formats with higher transmission rate requirements, the larger the bandwidth occupied, the larger the mapping influence factor. For example, the influence factor of MPEG2 encoding format mapping is set to 2, and the influence factor of AV1 encoding format mapping is 1.

[0111] In some embodiments, the strategy matching module can obtain the target impact factor (Factor1) mapped by the encoding format of the first media asset based on the mapping relationship between the encoding format and the impact factor recorded in the mapping relationship table B, and determine the second transmission capability parameter (BitrateCap) based on the target impact factor (Factor1), target speed, resolution, bit rate and network transmission rate.

[0112] In some embodiments, BitrateCap = Factor1 × Speed ​​× Resolution × Bitrate / Network transmission rate.

[0113] In this way, when determining the second transmission capability parameter (BitrateCap), the target influence factor mapped by the encoding format of the first media asset is obtained. The target influence factor is then fused with the target speed, resolution, bit rate, and network transmission rate to obtain BitrateCap. This allows BitrateCap to adapt to the transmission capabilities required by media assets with different encoding formats, thereby improving the accuracy of the dynamic matching speed playback strategy.

[0114] Hardware decoding and software decoding have different decoding mechanisms and require different playback speed capabilities. In some embodiments, if the target decoder is a hardware decoder, since hardware decoding is performed through a dedicated chip or hardware module, the decoding capability of the hardware decoder is fixed and is not affected by the playback speed. Therefore, the strategy matching module can determine the playback speed capability parameter (SpeedCap) based on the second transmission capability parameter (BitrateCap) and the target decoding capability parameter (DecodeCap1).

[0115] In some embodiments, if the target decoder is a software decoder, since software decoding relies on the CPU to execute the decoding algorithm program, software decoding is affected by the playback speed. The higher the target speed (Speed) during software decoding, the higher the requirement for playback speed capability. Therefore, the strategy matching module can determine the playback speed capability parameter (SpeedCap) based on the target speed (Speed), the second transmission capability parameter (BitrateCap), and the target decoding capability parameter (DecodeCap1).

[0116] In some embodiments, for hardware decoding, SpeedCap = BitrateCap × DecodeCap1. For software decoding, SpeedCap = BitrateCap × Speed ​​× DecodeCap1. Thus, for media assets transmitted over a network, playback attributes (resolution, bitrate, etc.), network transmission rate, and decoding capabilities can be combined to match the target playback speed strategy, improving the accuracy of dynamic matching of the playback speed strategy.

[0117] Step S85: Based on the baseline playback capability parameters and the speed playback capability parameters, match the target speed playback strategy from at least one pre-configured speed playback strategy.

[0118] Step S86: Based on the target playback speed strategy, play the first media asset at the target playback speed.

[0119] The target playback speed strategy includes the data acquisition and decoding methods used when playing the first media asset at the target playback speed. Thus, the strategy matching module can guide the resource acquisition module's data acquisition method and the decoding module's decoding method based on the target playback speed strategy, thereby achieving playback of the first media asset at the target playback speed.

[0120] In some embodiments, the strategy matching module can construct multiple playback capability ranges based on the baseline playback capability parameter (NormalCap) and a preset multiplier, and match the target multiplier playback strategy from at least one multiplier playback strategy pre-configured by the player by determining the range to which the speed playback capability parameter (SpeedCap) belongs.

[0121] Figure 9 This is a schematic diagram illustrating the player matching speed playback strategy provided in some embodiments of this application.

[0122] In some embodiments, see Figure 9 The player can pre-configure at least one playback speed strategy, including: a first playback speed strategy, a second playback speed strategy, and a third playback speed strategy, with the strategies decreasing in level sequentially.

[0123] In some embodiments, see Figure 9 If SpeedCap≤NormalCap, it indicates that there are sufficient playback resources (including transmission resources and decoding resources) to support full data loading and full decoding. In this case, the target playback speed strategy is the first playback speed strategy.

[0124] Figure 10 This is a schematic diagram illustrating the principle of the first speed playback strategy provided in some embodiments of this application.

[0125] In some embodiments, see Figure 10 The first-speed playback strategy can be configured as follows: acquire audio and video data of the first media asset based on the target speed, and perform full decoding on the audio and video data. Full decoding refers to decoding both the video and audio streams, and decoding all video frames (including I-frames, P-frames, and B-frames) in the video stream. For example, if the target speed is 2.0X, the resource acquisition module in the player needs to acquire twice the amount of audio and video data per unit time. After the demultiplexing module demultiplexes the audio and video data, the decoding module performs full decoding on the video and audio streams. Then, the synchronization module performs synchronized processing on the audio and video, and finally, the rendering module presents the picture and sound.

[0126] In some embodiments, see Figure 9 If NormalCap < SpeedCap ≤ NormalCap × preset multiple, it indicates that the playback resources are slightly insufficient to support full decoding. In this case, the target playback speed strategy will be the second playback speed strategy.

[0127] Figure 11 A schematic diagram of the principle of the second-speed playback strategy provided in some embodiments of this application. Figure 1 .

[0128] In some embodiments, see Figure 11 The second-speed playback strategy can be configured as follows: acquire the audio and video data of the first media asset based on the target speed, decode the keyframes in the video data of the first media asset, but do not decode the audio data of the first media asset. For example, if the target speed is 8.0X, the resource acquisition module in the player may need to acquire 8 times the amount of audio and video data per unit time. After the demultiplexing module demultiplexes the audio and video data, the decoding module only captures and decodes the I-frames in the video stream, filters out other frames, and discards the audio and video data, i.e., it does not decode the audio stream.

[0129] Keyframes (I-frames), as the starting point of a GOP (Group of Pictures), contain complete image information. I-frame decoding is independent of other frames; that is, I-frames can be decoded independently. Therefore, when playback resources are insufficient, the decoding module can identify the category of each video frame in the video stream, capture keyframes (I-frames), and filter out non-keyframes (such as P-frames and B-frames). This way, the decoding module only decodes keyframes (I-frames), saving CPU resources and reducing bandwidth requirements. This ensures the smooth playback of the first media asset at the target speed when playback resources are limited, and guarantees the priority output of key scenes. Furthermore, prioritizing the decoding and display of keyframes when playback resources are limited means that the audio stream may be discarded, i.e., not decoded. This avoids a poor user experience due to unclear audio and also prevents audio from consuming playback resources.

[0130] Figure 12 A schematic diagram of the principle of the second-speed playback strategy provided in some embodiments of this application. Figure 2 .

[0131] In some embodiments, see Figure 12 The second playback speed strategy can also be configured to: acquire and decode only the keyframes of the first media asset based on the target playback speed. In this embodiment, the resource acquisition module can download only the keyframes (I-frames) of the first media asset and not download non-keyframes (such as P-frames and B-frames), thereby reducing the consumption of network transmission resources, reducing bandwidth, saving playback resources, and ensuring the smoothness of playing the first media asset at the target playback speed. For example, if the target playback speed is 8.0X, the resource acquisition module acquires 8 keyframes of the first media asset per unit time to form a keyframe sequence; the decoding module decodes the keyframes in the keyframe sequence sequentially based on the display timestamp, and finally the rendering module renders and displays the keyframe sequence.

[0132] In some embodiments, see Figure 9 If SpeedCap > NormalCap × preset multiplier, it indicates a severe shortage of playback resources. In this case, a seek downgrade scheme will be implemented, meaning the target playback speed strategy will be the third-speed playback strategy.

[0133] Figure 13 This is a schematic diagram illustrating the principle of the third-speed playback strategy provided in some embodiments of this application.

[0134] In some embodiments, see Figure 13 The third-speed playback strategy is configured as follows: based on the target speed, determine at least one target time point to jump to; search for and decode the target keyframe from the video data of the first media asset; do not decode the audio data of the first media asset. The target keyframe is the keyframe closest to the target time point. This third-speed playback strategy is based on a seek-forward mechanism, sacrificing visual continuity for the feasibility of ultra-high speed playback, ensuring that even with extremely limited / insufficient playback resources, the user's need for fast browsing can still be supported.

[0135] In some embodiments, the player can execute a third-speed playback strategy based on seek_target_position = current_seek_position + current_escape_time × Speed.

[0136] Here, seek_target_position represents the target time node to be sought, and Speed ​​represents the target speed multiplier.

[0137] `current_seek_position` represents the system clock, measured in nanoseconds. The initial value of `current_seek_position` is the initial position PTS (Presentation Time Stamp), which corresponds to the initial position node at the start of the first seek. From the video data of the first media asset, the nearest I-frame (i.e., the target keyframe) to `current_seek_position` is found. The position node PTS corresponding to the completion of the target keyframe's playback is assigned to `current_seek_position`, thus dynamically updating `current_seek_position` with each seek action.

[0138] `current_escape_time` represents the playback interval between two consecutive seek actions. The product of `current_escape_time` and the target speed (`Speed`) represents the theoretical duration to be "skipped" on the playback timeline of the first media asset. The initial value of `current_escape_time` can be preset (e.g., 1000 nanoseconds), and can be dynamically updated subsequently using the formula: `current_escape_time = current_seek_time - last_seek_time`. Here, `last_seek_time` is the previous `current_seek_time`, and its initial value is `initialposition PTS`.

[0139] In some embodiments, the resource acquisition module can perform a seek action based on the dynamically updated seek_target_position, and then download the target keyframe at the seek_target_position; the decoding module decodes the target keyframe and discards the audio stream data, thereby enabling the feasibility of ultra-high speed playback based on the seek fast-forward mechanism, ensuring that the user's need for fast browsing can still be supported even when playback resources are extremely limited / insufficient. It should be noted that the matching conditions and strategy configuration of the speed playback strategy are not limited to the embodiments of this application.

[0140] In some embodiments, when performing step S84, if the first media asset is a local media asset, the media asset data is stored in the local disk, and the transmission relies on the device's internal bus, resulting in extremely low latency and sufficient bandwidth. If the first media asset is a media asset transmitted based on the SMB (Server Message Block) protocol, the media asset data is stored on a shared server within the local area network (LAN). The LAN bandwidth is much higher than the playback bitrate requirement, and the latency is extremely low, so the transmission bottleneck is not significant. Therefore, when the first media asset is a local media asset or a media asset played based on the SMB protocol, the impact of the transmission rate can be almost ignored.

[0141] In some embodiments, if the first media asset is a local media asset, or if the first media asset is a media asset transmitted based on the SMB protocol, the policy matching module can determine a third transmission capability parameter (BitrateCap3) based on the target speed and resolution. BitrateCap3 is used to characterize the transmission rate required when playing the first media asset (local or SMB) at the target speed.

[0142] In some embodiments, BitrateCap3 = Speed ​​× resolution.

[0143] In some embodiments, if the target decoder is a hardware decoder, since hardware decoding is performed by a dedicated chip or hardware module, the decoding capability of the hardware decoder is fixed and is not affected by the playback speed. Therefore, the strategy matching module can determine the playback speed capability parameter (SpeedCap) based on the third transmission capability parameter (BitrateCap3) and the target decoding capability parameter (DecodeCap1).

[0144] In some embodiments, if the target decoder is a software decoder, software decoding relies on the CPU to execute the decoding program. Different speeds, transmission rates, and decoding capabilities will affect the speed playback capability. Therefore, the strategy matching module can determine the speed playback capability parameter (SpeedCap) based on the target speed (Speed), the third transmission capability parameter (BitrateCap3), and the target decoding capability parameter (DecodeCap1).

[0145] In some embodiments, if the first media asset is a local media asset, or the first media asset is a media asset transmitted based on the SMB protocol, for hardware decoding, SpeedCap = BitrateCap3 × DecodeCap1; for software decoding, SpeedCap = BitrateCap3 × Speed ​​× DecodeCap1. Thus, for local or SMB media assets, media asset playback attributes and decoding capabilities can be combined to match the target playback speed strategy from at least one pre-configured playback speed strategy of the player, improving the accuracy of dynamic matching of playback speed strategies.

[0146] In the above embodiments, the data typically contains key attributes of the media asset, such as bitrate, resolution, frame rate, and encoding format. These key attributes affect the transmission efficiency and network bandwidth when the media asset is played at double speed. The display device itself is configured with a decoding method (e.g., hardware decoding and / or software decoding), and the decoding method affects the smoothness and clarity of the media asset when played at double speed. Therefore, by fusing metadata and the decoding methods supported by the device, the target decoding capability parameters are obtained to determine the decoding capability required by the display device to decode the first media asset. By fusing media asset metadata and target decoding capability parameters, baseline playback capability parameters are obtained to determine the playback speed at 1.0x. The playback capability required for normal playback of the first media asset is determined. This baseline playback capability parameter serves as a reference indicator for matching the playback speed strategy. By fusing the target playback speed, the metadata, and the target decoding capability parameter, the playback speed parameter is determined to ascertain the required playback capability for playing the first media asset at the target speed (not 1.0x). Then, using these two key parameters—the baseline playback capability parameter and the playback speed parameter—the target playback speed strategy is dynamically matched. This target playback speed strategy is at least compatible with the playback attributes of the first media asset and the device's decoding capability, ensuring that the playback speed strategy can adapt to the media asset's playback speed environment while balancing playback quality and device performance. For different types of media assets, such as those transmitted over a network, the impact of the actual network transmission rate needs to be considered. However, for local media assets or media assets played via SMB, the impact of the transmission rate can be ignored.

[0147] Compared to Figure 6 The example demonstrates a static matching playback speed strategy. This application integrates multiple influencing factors such as media asset metadata, decoding capabilities, and network transmission capabilities to achieve a dynamic matching playback speed strategy, emphasizing the strategy's "adaptability." Assuming the media asset uses hardware decoding, when the network transmission rate is high (e.g., the actual network transmission rate is twice the bitrate), if playback is at 8.0x speed, then SpeedCap = (8 × resolution × bitrate / actual transmission rate) × DecodeCap1. This SpeedCap may fall within the range of 4 × NormalCap. In this case, the player can match a second playback speed strategy (decoding only I-frames) instead of using a lower-level third playback speed strategy (seek fast forward), thereby improving the media asset playback speed effect.

[0148] Figure 14 A timing interaction diagram of a media asset speed-up playback method provided in some embodiments of this application.

[0149] See Figure 14 In this sequential interaction logic, the interaction objects include media asset applications and players.

[0150] See Figure 14 In response to the instruction to start playing the first media asset, the media asset application launches the player and sends a first playback instruction to the player. This first playback instruction includes a preset playback speed, which is the default speed used by the media asset application when starting playback; the first speed is 1.0X. The player, responding to the first playback instruction, plays the first media asset at the preset playback speed based on this first speed playback strategy.

[0151] See Figure 14 The media asset application, in response to the speed setting command, obtains the target speed indicated by the speed setting command and sends a second playback command to the player, the second playback command including the target speed. The player, in response to the second playback command, determines NormalCap and SpeedCap based on the type of the first media asset (local media asset, SMB media asset, or other network media asset), metadata, the target speed, and the decoding method supported by the display device. Based on NormalCap, SpeedCap, and a preset speed, the player dynamically matches the target speed playback strategy from at least one pre-configured speed playback strategy, and plays the first media asset at the target speed. The target speed playback strategy is one of a first speed playback strategy, a second speed playback strategy, and a third speed playback strategy.

[0152] In some embodiments, Figure 14 The player can include a resource acquisition module, a demultiplexing module, a decoding module, a synchronization module, and a rendering module. The player can determine a target playback speed strategy that matches the target playback speed by running these modules and through the cooperation between these modules. Based on the target playback speed strategy, the player plays the first media asset at the target playback speed. The specific implementation method can be referred to the aforementioned related embodiments, which will not be repeated here.

[0153] Some embodiments of this application also provide a computer storage medium that can store a program. When the computer storage medium is configured in the display device 200, the program, when executed, can include the program steps involved in the media asset speed-up playback method in the above embodiments. The computer storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0154] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0155] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the foregoing exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be made based on the foregoing teachings. The selection and description of the above embodiments are for the purpose of better explaining the contents of this disclosure, thereby enabling those skilled in the art to better utilize the described embodiments.

Claims

1. A display device, characterized in that, include: The monitor is configured to display video feeds; A controller, coupled to the display, is configured to: When playing the first media asset, in response to the speed setting command, the target speed indicated by the speed setting command is obtained, and the metadata of the first media asset is obtained; Based on the metadata of the first media asset and the decoding methods supported by the display device, a target decoding capability parameter is determined; wherein, the target decoding capability parameter is used to characterize the decoding capability required by the display device to decode the first media asset; Based on the metadata and the target decoding capability parameters, a baseline playback capability parameter is determined; wherein, the baseline playback capability parameter is used to characterize the playback capability required when playing the first media asset at one speed; Based on the target playback speed, the metadata, and the target decoding capability parameters, playback speed capability parameters are determined; wherein, the playback speed capability parameters are used to characterize the playback capability required when playing the first media asset at the target playback speed; Based on the baseline playback capability parameters and the speed playback capability parameters, a target speed playback strategy is matched from at least one pre-configured speed playback strategy; the target speed playback strategy includes the data acquisition method and decoding method used when playing the first media asset at the target speed. Based on the target playback speed strategy, the first media asset is played at the target playback speed.

2. The display device according to claim 1, characterized in that, The metadata includes the encoding format and frame rate of the first media asset; The controller executes the metadata of the first media asset and the decoding method supported by the display device to determine the target decoding capability parameters, which are specifically configured as follows: Based on the encoding format of the first media asset and the decoding method supported by the display device, a target decoder to be used is determined; wherein, the target decoder is one of a hardware decoder and a software decoder; If the target decoder is the software decoder, then the target decoding capability parameters are determined based on the frame rate and encoding format of the first media asset.

3. The display device according to claim 2, characterized in that, If the target decoder is the software decoder, the controller determines the target decoding capability parameters based on the frame rate and encoding format of the first media asset, specifically configured as follows: Based on the mapping relationship between encoding format and decoding capability parameters, the target decoding capability parameter mapped to the encoding format of the first media asset is obtained, wherein the target decoding capability parameter is one of the first decoding capability parameter, the second decoding capability parameter, and the third decoding capability parameter; Wherein, the first decoding capability parameter is the product of the first preset capability coefficient and the frame rate, the second decoding capability parameter is the product of the second preset capability coefficient and the frame rate, and the third decoding capability parameter is the product of the third preset capability coefficient and the frame rate; the first preset capability coefficient is less than the second preset capability coefficient, and the second preset capability coefficient is less than the third preset capability coefficient.

4. The display device according to claim 3, characterized in that, The controller executes the metadata of the first media asset and the decoding method supported by the display device to determine the target decoding capability parameters, which are specifically configured as follows: If the target decoder is the hardware decoder, then the first decoding capability parameter is determined as the target decoding capability parameter.

5. The display device according to claim 4, characterized in that, The metadata also includes the bitrate and resolution of the first media asset; The controller performs a process based on the target playback speed, the metadata, and the target decoding capability parameters to determine the playback speed capability parameters, which are specifically configured as follows: If the first media asset is a media asset transmitted over a network, then a second transmission capability parameter is determined based on the target speed, the resolution, the bit rate, and the network transmission rate; wherein, the second transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at the target speed; If the target decoder is the hardware decoder, then the speed playback capability parameter is determined based on the second transmission capability parameter and the target decoding capability parameter; If the target decoder is the software decoder, then the playback speed capability parameter is determined based on the target playback speed, the second transmission capability parameter, and the target decoding capability parameter.

6. The display device according to claim 5, characterized in that, The controller performs a process based on the metadata and the target decoding capability parameters to determine baseline playback capability parameters, specifically configured as follows: Based on the resolution of the first media asset, a first transmission capability parameter is determined; wherein, the first transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at one speed. The baseline playback capability parameters are determined based on the first transmission capability parameters and the target decoding capability parameters.

7. The display device according to claim 1, characterized in that, The controller performs a matching of a target playback speed strategy from at least one pre-configured playback speed strategy based on the baseline playback capability parameters and the playback speed adjustment parameters. Specifically, it is configured as follows: If the playback speed capability parameter is not greater than the baseline playback capability parameter, then the target playback speed strategy is determined to be the first playback speed strategy; the first playback speed strategy refers to acquiring the audio and video data of the first media asset based on the target playback speed and decoding the audio and video data; If the playback speed capability parameter is greater than the baseline playback capability parameter, and if the playback speed capability parameter is not greater than a preset multiple of the baseline playback capability parameter, then the target playback speed strategy is determined to be the second playback speed strategy. The second speed playback strategy refers to acquiring the audio and video data of the first media asset based on the target speed, decoding the key frames in the video data of the first media asset, but not decoding the audio data of the first media asset. If the playback speed capability parameter is greater than a preset multiple of the baseline playback capability parameter, then the target playback speed strategy is determined to be the third playback speed strategy. The third speed playback strategy refers to determining at least one target time node to jump to based on the target speed, obtaining and decoding the target keyframe from the video data of the first media asset, without decoding the audio data of the first media asset, wherein the target keyframe is the keyframe closest to the target time node.

8. The display device according to claim 5, characterized in that, The controller determines a second transmission capability parameter based on the target speed multiplier, the resolution, the bit rate, and the network transmission rate, specifically configured as follows: Based on the mapping relationship between encoding format and influence factor, the target influence factor of the encoding format mapping of the first media asset is obtained; wherein, the influence factor is used to characterize the degree of influence of the encoding format of the media asset on the transmission rate. The second transmission capability parameter is determined based on the target impact factor, the target speed multiplier, the resolution, the bit rate, and the network transmission rate.

9. The display device according to claim 5, characterized in that, The controller performs a process based on the target playback speed, the metadata, and the target decoding capability parameters to determine the playback speed capability parameters, which are specifically configured as follows: If the first media asset is a local media asset, or if the first media asset is a media asset transmitted based on the Server Message Block Protocol, then a third transmission capability parameter is determined based on the target speed and the resolution; wherein, the third transmission capability parameter is used to characterize the transmission rate required when playing the first media asset at the target speed. If the target decoder is the hardware decoder, then the speed playback capability parameter is determined based on the third transmission capability parameter and the target decoding capability parameter; If the target decoder is the software decoder, then the playback speed capability parameter is determined based on the target playback speed, the third transmission capability parameter, and the target decoding capability parameter.

10. A method for playing media assets at double speed, characterized in that, include: When playing the first media asset, in response to the speed setting command, the target speed indicated by the speed setting command is obtained, and the metadata of the first media asset is obtained; Based on the metadata of the first media asset and the decoding methods supported by the display device, a target decoding capability parameter is determined; wherein, the target decoding capability parameter is used to characterize the decoding capability required by the display device to decode the first media asset; Based on the metadata and the target decoding capability parameters, a baseline playback capability parameter is determined; wherein, the baseline playback capability parameter is used to characterize the playback capability required when playing the first media asset at one speed; Based on the target playback speed, the metadata, and the target decoding capability parameters, playback speed capability parameters are determined; wherein, the playback speed capability parameters are used to characterize the playback capability required when playing the first media asset at the target playback speed; Based on the baseline playback capability parameters and the speed playback capability parameters, a target speed playback strategy is matched from at least one pre-configured speed playback strategy; the target speed playback strategy includes the data acquisition method and decoding method used when playing the first media asset at the target speed. Based on the target playback speed strategy, the first media asset is played at the target playback speed.

Images