Display device, terminal device and dynamic adjustment method of coding parameters

Abstract

The invention provides a display device, a terminal device and a coding parameter dynamic adjustment method, and the method comprises the steps: obtaining load item values of the display device through a load monitoring module in a process of receiving a media asset code sent by the terminal device, and setting a grading value interval for each load item value according to the number of load states. And when the load item numerical value is located in the grading numerical value interval, marking a load state corresponding to the grading numerical value interval as a target load state, and sending first state information of the target load state to the terminal equipment, and the terminal equipment adjusts the resolution parameter of the media asset code according to the first state information. According to the embodiment, the coding parameter of the terminal equipment is reversely adjusted through the load state of the display equipment, so that the terminal equipment dynamically adjusts the coding parameter according to the load scene corresponding to the display equipment, and the stability of audio and video transmission is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular, to a display device, a terminal device, and a method for dynamically adjusting encoding parameters. Background Art

[0002] During the transmission of audio-visual data, a display device can act as a receiving device to receive the audio-visual data sent by a terminal device for display. During the transmission of audio-visual data, the terminal device needs to encode the audio-visual data for easy transmission. To improve the stability of audio-visual interactive transmission between the terminal device and the receiving device, the terminal device needs to dynamically adjust encoding parameters to adapt to complex transmission environments, so as to reduce the stuttering that occurs when the receiving device receives and plays audio-visual data.

[0003] The terminal device can achieve dynamic adjustment of encoding parameters through network status detection. For example, during the transmission of audio-visual data, by monitoring channel parameters such as network bandwidth fluctuations and bit error rates, encoding parameters such as bit rate and resolution are adjusted to adapt to the resource reception capabilities of different receiving devices in different network scenarios.

[0004] However, the implementation of dynamically adjusting encoding parameters according to the network status does not consider the load situation of the receiving device. When the receiving device is in a high-load situation, receiving audio-visual data with a high bit rate will increase the load pressure on the receiving device, resulting in data reception stuttering or crashing caused by excessive receiving device load even in a good network environment, affecting the user experience. Summary of the Invention

[0005] The present application provides a display device, a terminal device, and a method for dynamically adjusting encoding parameters to solve the problem of stuttering during playback caused by not considering the load situation of the receiving device during the transmission of media data.

[0006] In a first aspect, some embodiments of the present application provide a display device, including a display and a controller. The display is configured to display a user interface, and the controller is configured to:

[0007] During the process of receiving the media encoding sent by the terminal device, obtain the load item value of the display device through a load monitoring module, where the load item value is used to characterize the load status of the display device, and the media encoding is obtained by encoding media data through an encoder of the terminal device;

[0008] According to the number of load statuses, set a hierarchical value range for each load item value, and the hierarchical value range corresponds to one of the load statuses; the number of load statuses is determined according to the number of preset numerical levels;

[0009] When the value of the load item is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status;

[0010] Send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter of the media encoding when the encoder encodes the media data according to the first status information;

[0011] Receive the media encoding obtained by the terminal device encoding the media data with the encoder after adjusting the resolution parameter.

[0012] The above technical solution has the following beneficial effects or advantages: By real-time monitoring the value of the load item during the process of the display device receiving the media encoding and dynamically adjusting the resolution parameter of the terminal device based on the hierarchical range of the load status, it effectively solves the problem of relying on the network status to adjust the encoding parameter while ignoring the load of the receiving end. By associating the load status with the hierarchical value range, it can actively feedback the status information when the display device is under high load, trigger the terminal device to reduce the resolution parameter, thereby reducing the rendering pressure of the display device, improving the stability of maintaining audio and video transmission in high-load scenarios, and enhancing the user experience.

[0013] In some embodiments, the value of the load item includes the processor occupancy rate and the memory margin, and the controller executes the step of setting the hierarchical value range for each load item value according to the number of the load statuses, and is specifically configured as:

[0014] According to the number of the load statuses, set the number of the first hierarchical thresholds of the processor occupancy rate, and set the number of the second hierarchical thresholds of the memory margin; the first hierarchical threshold is used to represent the demarcation value of the processor occupancy rate between different load statuses; the second hierarchical threshold is used to represent the demarcation value of the memory margin between different load statuses;

[0015] According to the number of the first hierarchical thresholds, divide the first hierarchical value range of the processor occupancy rate, and according to the number of the second hierarchical thresholds, divide the second hierarchical value range of the memory margin.

[0016] The above technical solution has the following beneficial effects or advantages: By specifically defining the load item as the processor occupancy rate and the memory margin, and respectively setting the first and second hierarchical thresholds, it improves the monitoring accuracy of the resource status of the display device. The first hierarchical threshold divides the processor occupancy rate interval, and the second hierarchical threshold divides the memory margin interval, so that the determination of the load status can take into account the real-time status of the computing resource and the storage resource, thereby providing more accurate resolution adjustment for the terminal device and enhancing the adaptability of the encoding parameter to the load status of the receiving end.

[0017] In some embodiments, when the load item value is within the hierarchical value range, the controller executes the step of marking the load state corresponding to the hierarchical value range as the target load state, and is specifically configured as follows:

[0018] When the processor occupancy rate is within the first hierarchical value range, mark the load state corresponding to the first hierarchical value range as the first load state;

[0019] When the memory margin is within the second hierarchical value range, mark the load state corresponding to the second hierarchical value range as the second load state;

[0020] Mark the load state with a relatively higher load among the first load state and the second load state as the target load state.

[0021] The above technical solution has the following beneficial effects or advantages: Using the higher of the first load state and the second load state as the target load state, when the processor occupancy rate and the memory margin are in different hierarchical ranges, the state representing a higher load is preferentially selected for feedback, ensuring that the terminal device always uses the highest load as the adjustment basis when adjusting the resolution. For example, in the case where the memory margin is sufficient but the processor occupancy rate is too high, the high load state related to the processor is selected to trigger the resolution to be lowered, preventing the judgment based on a single load item index and improving the accuracy of determining the load.

[0022] In some embodiments, the controller is further configured to:

[0023] Analyze the media asset encoding to obtain the encoding frame rate for characterizing the number of frames encoded by the encoder of the terminal device per unit time;

[0024] Obtain, through the load monitoring module, the rendering frame rate for characterizing the number of frames of the media asset encoding rendered by the display device per unit time;

[0025] Calculate the difference result between the encoding frame rate and the rendering frame rate;

[0026] Generate target frame rate information according to the difference result;

[0027] Send the target frame rate information to the terminal device, so that the terminal device adjusts the encoding frame rate of the encoder according to the target frame rate information;

[0028] Receive the media asset encoding obtained by the terminal device encoding the media asset data using the encoder after adjusting the encoding frame rate.

[0029] The above technical solution has the following beneficial effects or advantages: By comparing the difference between the encoding frame rate and the rendering frame rate, target frame rate information is generated to achieve frame rate matching between the display device and the terminal device. When the rendering frame rate of the display device is lower than the encoding frame rate of the terminal device, a positive difference indicates that the terminal device reduces the encoding frame rate to avoid the accumulation of frame data that has not been rendered in time; otherwise, the encoding frame rate is increased to make full use of the idle resources of the display device, improving the frame processing efficiency while ensuring the picture quality and enhancing the playback smoothness.

[0030] In some embodiments, the controller performs the step of sending frame rate adjustment information corresponding to the difference result to the terminal device according to the difference result, and is specifically configured as:

[0031] When the difference result is positive, generate first target frame rate information for instructing the terminal device to reduce the encoding frame rate according to the number of rendered frames;

[0032] When the difference result is negative, generate second target frame rate information for instructing the terminal device to increase the encoding frame rate according to the number of rendered frames;

[0033] Send the first target frame rate information to the terminal device, or send the second target frame rate information to the terminal device.

[0034] The above technical solution has the following beneficial effects or advantages: Different target frame rate information is generated according to the positive and negative directions of the difference result, thereby establishing a differentiated frame rate control strategy. When there is a positive difference, the frame rate is actively reduced through the first target frame rate information to prevent the display device from discarding frame data due to insufficient processing capacity; when there is a negative difference, the frame rate is increased through the second target frame rate information to enhance the picture smoothness when the load of the display device permits.

[0035] In some embodiments, the hierarchical numerical intervals are arranged in the order of increasing load. When the value of the load item increases to the next hierarchical numerical interval of the current hierarchical numerical interval, the controller is further configured as:

[0036] Update the target load status according to the load status corresponding to the next hierarchical numerical interval;

[0037] Send second status information of the updated target load status to the terminal device so that the terminal device reduces the resolution parameter according to the second status information;

[0038] Receive the media encoding obtained by the encoder of the terminal device encoding the media data according to the reduced resolution parameter.

[0039] The above technical solutions have the following beneficial effects or advantages: When the value of the load item enters a higher classification interval, the target load status is immediately updated and the resolution is triggered to decrease, so as to quickly adjust the encoding parameters of the terminal device when the load increases. Through the classification intervals sorted by load level, when it is detected that the processor occupancy rate or memory margin reaches the current threshold, the second status information can be immediately sent to the terminal device, so that the terminal device reduces the resolution parameter. The present application effectively prevents system overload caused by sudden load increase through a real-time negative feedback mechanism. For example, when a background process is suddenly started on a display device, the resolution of the input media asset can be timely reduced to release computing resources and maintain playback continuity.

[0040] In some embodiments, when the value of the load item decreases to the upper classification value interval of the current classification value interval, the controller is further configured to:

[0041] Update the target load status according to the load status corresponding to the upper classification value interval;

[0042] Send the third status information of the updated target load status to the terminal device, so that the terminal device increases the resolution parameter according to the third status information;

[0043] Receive the media encoding obtained by the encoder of the terminal device encoding the media data according to the increased resolution parameter.

[0044] The above technical solutions have the following technical effects or advantages: When the load is released and reduced, it actively triggers the resolution improvement of the terminal device and makes full use of the released system resources. When the value of the load item falls back to a lower classification interval, the terminal device is notified to increase the resolution parameter through the third status information, and the video picture quality is restored on the premise of ensuring smooth playback, realizing the dynamic optimization adjustment of the resolution parameter.

[0045] In some embodiments, it further includes a communication device, and the communication device is configured to create a transmission channel with the terminal device through the Real-Time Transport Control Protocol. The step of the controller executing to send the first status information of the target load status to the terminal device is specifically configured to:

[0046] Send a channel creation request to the terminal device;

[0047] Obtain the consent information fed back by the user in response to the creation request from the terminal device;

[0048] In response to the consent information, create a transmission channel with the terminal device through the communication device;

[0049] Send the first status information to the terminal device through the transmission channel.

[0050] The above technical solution has the following technical effects or advantages: By establishing a transmission channel through the Real-Time Transport Control Protocol (RTCP), the real-time performance and reliability of the status information feedback are improved. Compared with the general transmission protocol used in traditional network status monitoring, the transmission channel established through the RTCP provides lower transmission latency and higher packet arrival rate, enabling the first status information to be delivered to the terminal device in a timely and accurate manner.

[0051] In a second aspect, some embodiments of the present application provide a terminal device, including an encoder configured to perform encoding on media asset data to obtain media asset encoding; a processor configured to:

[0052] Send the media asset encoding to the display device, so that during the process of the display device receiving the media asset encoding sent by the terminal device, the load item value of the display device is obtained through the load monitoring module, and according to the number of the load states, a hierarchical value interval is set for each load item value; wherein, the load item value is used to characterize the load state of the display device; the hierarchical value interval corresponds to one of the load states; the number of the load states is determined according to the number of preset numerical levels;

[0053] Receive the first status information sent by the display device; the first status information is the status information corresponding to the target load state obtained by the display device marking the load state corresponding to the hierarchical value interval when the load item value is within the hierarchical value interval;

[0054] Adjust the resolution parameter when the encoder performs encoding on the media asset data according to the first status information;

[0055] Send the media asset encoding obtained by performing encoding on the media asset data by the encoder after adjusting the resolution parameter to the display device.

[0056] In a third aspect, some embodiments of the present application provide a method for dynamically adjusting encoding parameters, which is applied to the display device described in the first aspect. The method includes:

[0057] During the process of receiving the media asset encoding sent by the terminal device, obtain the load item value of the display device through the load monitoring module, wherein the load item value is used to characterize the load state of the display device;

[0058] Set a hierarchical value interval for each load item value according to the number of the load states, the hierarchical value interval corresponds to one of the load states, and the media asset encoding is obtained by the encoder of the terminal device performing encoding on the media asset data;

[0059] When the value of the load item is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status; the number of load statuses is determined according to the number of preset numerical levels;

[0060] Send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter when the encoder encodes the media data according to the first status information;

[0061] Receive the media encoding obtained by the terminal device encoding the media data with the encoder after adjusting the resolution parameter.

[0062] As can be seen from the above technical solutions, the present application provides a display device, a terminal device, and a method for dynamically adjusting encoding parameters. In the process of receiving the media encoding sent by the terminal device, the method obtains the value of the load item of the display device through the load monitoring module, and sets hierarchical value ranges for each load item value according to the number of load statuses. When the value of the load item is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status, and send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter of the media encoding according to the first status information. In this embodiment, the encoding parameters of the terminal device are adjusted reversely according to the load status of the display device, so that the terminal device dynamically adjusts the encoding parameters according to the load scenario corresponding to the display device, improving the stability of audio and video transmission. Description of the Drawings

[0063] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0064] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application;

[0065] Figure 2 Schematic diagram of the hardware configuration of the display device provided by some embodiments of the present application;

[0066] Figure 3 Schematic diagram of the software configuration of the display device provided by some embodiments of the present application;

[0067] Figure 4 Flowchart of the display device performing dynamic adjustment of encoding parameters provided by some embodiments of the present application;

[0068] Figure 5 A timing diagram for a display device provided in some embodiments of the present application to perform dynamic adjustment of encoding parameters;

[0069] Figure 6 A flowchart for a display device provided in some embodiments of the present application to divide a first hierarchical numerical interval;

[0070] Figure 7 A flowchart for a display device provided in some embodiments of the present application to divide a second hierarchical numerical interval;

[0071] Figure 8 A flowchart of the first embodiment for a display device provided in some embodiments of the present application to determine a target load state;

[0072] Figure 9 A flowchart of the second embodiment for a display device provided in some embodiments of the present application to determine a target load state;

[0073] Figure 10 A flowchart for a display device provided in some embodiments of the present application to determine target frame rate information;

[0074] Figure 11 A flowchart for a display device in some embodiments of the present application to interact with a terminal device to adjust the encoding frame rate of the terminal device;

[0075] Figure 12 A flowchart for a display device provided in some embodiments of the present application to instruct a terminal device to increase encoding parameters;

[0076] Figure 13 A flowchart for a display device provided in some embodiments of the present application to instruct a terminal device to decrease encoding parameters;

[0077] Figure 14 A flowchart of the first embodiment for a display device provided in some embodiments of the present application to update a target load state;

[0078] Figure 15 A flowchart of the second embodiment for a display device provided in some embodiments of the present application to update a target load state. Detailed implementation manners

[0079] Embodiments will be described in detail below, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following examples do not represent all embodiments consistent with the present application. They are merely examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0080] It should be noted that the brief description of the terms in this application is only for the convenience of understanding the following described embodiments, rather than intending to limit the embodiments of this application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0081] In this application, terms such as "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0082] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclusively include. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0083] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to that element.

[0084] In the embodiments of this application, the display device 200 generally refers to a device with the ability to display images and process data. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0085] Figure 1 It is a schematic diagram of the operation scenario between the display device and the control device provided for some embodiments of this application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300 and the control device 100. Among them, the control device 100 is used to receive the operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0086] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and the connection communication can be achieved through network communication protocols to achieve the purpose of one-to-one control operation and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0087] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program that controls the display device 200.

[0088] As Figure 1 also shown in, the display device 200 also communicates with the server 400 through various communication methods for data communication. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0089] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.

[0090] Figure 2 For some embodiments provided in this application Figure 1 is the hardware configuration block diagram of the display device 200 in

[0091] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0092] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of environmental light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0093] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0094] In some embodiments, the communication device 220 is a component for communicating with external devices or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0095] The communication device 220 can enable the display device 200 to communicate with an external device or server 400 through a wireless or wired connection. Among them, the wired connection can connect the display device 200 to the external device through components such as data lines and interfaces. The wireless connection can connect the display device 200 to the external device through wireless signals or wireless networks. The display device 200 can directly establish a connection relationship with the external device, or indirectly establish a connection relationship through a gateway, router, connection device, etc.

[0096] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to n interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0097] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0098] In some embodiments, the user can input a user command on the graphical user interface (Graphical User Interface, GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0099] In some embodiments, the audio output device 270 can be the built-in speaker of the display device 200, or an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 can also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0100] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0101] To perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program for managing and controlling the hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or provide a user interface by running an application program. The operating system also allows users to interact with the display device 200.

[0102] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0103] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0104] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0105] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0106] like Figure 3 As shown, Figure 3 A software configuration diagram of a display device provided for some embodiments of the present application. In some embodiments, the system of the display device 200 can be divided into three layers, namely, an application layer, a middleware layer, and a hardware layer from top to bottom.

[0107] The application layer mainly includes applications on the TV and the application framework. Among them, applications are mainly applications developed based on the browser, such as HTML5 APPs and native applications.

[0108] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the usage interfaces for these functions (toolbars, status bars, menus, dialog boxes).

[0109] Native APPs can support online or offline, message push or local resource access.

[0110] The middleware layer includes various middleware such as TV protocols, multimedia protocols, and system components. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system on the network or different applications, and can achieve the purpose of resource sharing and function sharing.

[0111] The hardware layer mainly includes the HAL interface, hardware, and drivers. Among them, the HAL interface is the unified interface for all TV chips to dock, and the specific logic is implemented by each chip. The drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, WIFI drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers, etc.

[0112] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0113] In some embodiments, the display device 200 can perform data transmission. For example, during the audio and video transmission process, the display device 200 can receive audio and video data sent by other devices for playback or display. Or, the display device 200 can also send audio and video data to other devices so that other devices can play or display the media data from the display device 200.

[0114] For the convenience of description, in this embodiment, the device that receives media data is defined as the receiving-end device, and the device that sends media data is defined as the sending-end device. During the data transmission process, the display device 200 can act as the sending-end device and send media data to the receiving-end device, or can also act as the receiving-end device and receive media data from the sending-end device for playback or display.

[0115] During the data transmission process, it not only involves the reception and display of data, but also involves the pre-processing of data. Taking the terminal device 300 as the sending-end device and the display device 200 as the receiving-end device as an example, that is, the terminal device 300 sends media data to the display device 200.

[0116] To ensure that media asset data can be transmitted to the receiving-end device, i.e., the display device 200, efficiently and stably, the terminal device 300 needs to perform encoding processing on the original media asset data. During the encoding process, the terminal device will adopt a specific encoding algorithm to efficiently compress the media asset data, obtaining a media asset encoding that is convenient for transmission while maintaining the integrity and clarity of the media asset data. Correspondingly, after receiving the media asset encoding, the display device 200 needs to perform decoding on the media asset encoding using the decoding algorithm corresponding to the encoding algorithm.

[0117] However, the actual transmission environment is often complex and variable. Factors such as network conditions, device performance, and transmission distance may all affect the transmission stability of media asset data, resulting in data transmission jams or crashes. Therefore, the terminal device 300 needs to have the ability to dynamically adjust encoding parameters to ensure the transmission quality of media asset data while improving transmission stability and efficiency.

[0118] The terminal device 300 can achieve dynamic adjustment of encoding parameters through network status detection. For example, during the transmission of media asset data, by monitoring channel parameters such as network bandwidth fluctuations and bit error rates to adjust encoding parameters such as bit rate and resolution, so as to adapt to the resource reception capabilities of different receiving-end devices in different network scenarios. For example, the terminal device 300 monitors the change in network bandwidth and finds that the current network bandwidth has fluctuated. To maintain the smoothness of media asset data transmission, the terminal device 300 can reduce the frame rate according to the network bandwidth fluctuation situation to reduce the number of image frames transmitted per second and the encoding frame rate, so that the terminal device 300 matches the encoding parameters according to the network status.

[0119] Although the implementation of the terminal device 300 dynamically adjusting encoding parameters according to the network status reduces the impact of network factors on data transmission, it does not take into account the load situation of the receiving-end device, i.e., the display device 200. When the display device 200 is in a high-load situation, receiving high-bit rate or high-resolution audio and video data will increase the load pressure on the display device 200, resulting in data reception jams or crashes caused by the excessive load of the display device 200 even in a good network environment, affecting the user experience.

[0120] Based on the above technical problems, some embodiments of the present application provide a display device 200, including a controller 250 and a display 260. The display 260 is configured to display a user interface, and the controller 250 is configured to execute a method for dynamically adjusting encoding parameters.

[0121] It should be noted that, in order to reduce the additional adjustment interference of network bandwidth on the encoding parameters of the sending device, this embodiment executes the dynamic adjustment method of encoding parameters in a good network environment to exclude the influence of network fluctuations on the sending device's adjustment of encoding parameters according to the load status of the receiving device. For subsequent embodiments or examples combined with other network states, the network state will be additionally described. In this embodiment, the terminal device 300 is used as the sending device, and the display device 200 is used as the receiving device for exemplary illustration, but the specific device types of the sending device and the receiving device are not limited.

[0122] Figure 4 It is a flowchart of the method for the display device to execute the dynamic adjustment of encoding parameters provided by some embodiments of this application. Figure 5 It is a timing diagram of the method for the display device to execute the dynamic adjustment of encoding parameters provided by some embodiments of this application. The display device 200 executes the dynamic adjustment method of encoding parameters according to the timing relationship as Figure 5 shown. Refer to Figure 4 and Figure 5 , the method includes the following:

[0123] S100: During the process of receiving the media encoding sent by the terminal device, obtain the load item value of the display device through the load monitoring module.

[0124] When the display device 200 receives a data transmission request sent from the terminal device 300, it can generate a prompt message to prompt the user that the terminal device 300, as the sending device, wants to transmit data to the display device 200. The user can, based on the prompt message, input an information instruction to agree to the transmission to the display device 200. The display device 200 can, in response to the information instruction, establish a communication connection with the terminal device 300 through the communication device 220. At this time, the terminal device 300 can, according to the initial encoding parameters, encode the media data to be transmitted through the encoder to obtain the media encoding, and then transmit the media encoding in encoded format to the display device 200 through the communication connection.

[0125] During the process of the display device 200 receiving the media encoding sent by the terminal device 300, it can obtain the load item value of the display device 200 through the load monitoring module, where the load item value is used to characterize the load status of the display device. The load monitoring module can be set at the hardware layer of the display device 200 to detect the load situation of the display device 200 in real time as a hardware module, and feedback it to the application layer through the middleware layer and display it through the user interface so that the user can understand the load usage of the display device 200.

[0126] For different load items, the relationship between the load item value and the load status is also different. The load item value may include the processor occupancy rate and the memory margin. For the processor occupancy rate, the higher the processor occupancy rate, it indicates that the processor of the display device 200 is in a high-load operation state, and the load pressure is greater. Therefore, the processor occupancy rate is positively correlated with the load pressure characterized by the load status. For the memory margin, when the memory margin is low, it indicates that the processes currently running on the display device 200 occupy a large amount of memory, resulting in memory tension and large load pressure. Therefore, the memory margin is negatively correlated with the load pressure characterized by the load status.

[0127] S200: Set a hierarchical value range for each load item value according to the number of the load statuses.

[0128] The load status may include multiple statuses. Taking three load statuses as an example, the load status may include a normal status, that is, the display device 200 runs stably and the load pressure is small; it also includes a warning status, that is, the display device 200 runs relatively stably, but the load item value is relatively higher than that in the normal status and the load pressure is moderate; it also includes an alarm status, that is, the display device 200 runs unstably and the load pressure is large.

[0129] The display device 200 may set a hierarchical value range for each load item value according to the number of the load statuses. The number of the load statuses is determined according to the number of preset value levels. For example, in order to distinguish different load statuses, the display device 200 sets three value levels, then corresponding to three load statuses, that is, the number of the load statuses is 3. Corresponding to the number of the load statuses, the display device 200 may set multiple hierarchical value ranges for the load item values, and the hierarchical value range corresponds to one of the load statuses. For example, corresponding to the three load statuses, the display device 200 may set three different hierarchical value ranges for the load item values, that is, the hierarchical value range A corresponds to the alarm status, the partition value range B corresponds to the warning status, and the hierarchical value range C corresponds to the normal status.

[0130] In some embodiments, the controller 250 may also set multiple hierarchical thresholds for different load item values to divide the hierarchical value range corresponding to the load item values. For example, for the processor occupancy rate, the controller 250 may set the number of the first hierarchical thresholds of the processor occupancy rate according to the number of the load statuses. The first hierarchical threshold is used to represent the boundary value of the processor occupancy rate between different load statuses.

[0131] For example, for three load statuses, such as Figure 6As shown, the controller 250 can set two first classification thresholds. For example, the first classification threshold A is 80%, and the first classification threshold B is 60%. After setting the first classification thresholds, the controller 250 can divide the first classification value range of the processor occupancy rate according to the number of the first classification thresholds. During the process of dividing the first classification value range, the two limit values of the first classification value range can also be combined for the division. The controller 250 can divide the first classification value range A as 80% - 100% according to the first classification threshold A and the maximum limit value 100% of the processor occupancy rate, and the corresponding load state is the warning state. The controller 250 can divide the first classification value range B as 60% - 80% according to the first classification threshold A and the first classification threshold B, and the corresponding load state is the early warning state. The controller 250 can divide the first classification value range C as 0% - 60% according to the first classification threshold B and the minimum limit value 0% of the processor occupancy rate, and the corresponding load state is the normal state. Among them, the first classification threshold A is the demarcation value between the warning state and the early warning state of the processor occupancy rate, and the first classification threshold B is the demarcation value between the early warning state and the normal state of the processor occupancy rate.

[0132] For another example, for the memory margin, as Figure 7 shown, the controller 250 can set the number of the second classification thresholds of the memory margin according to the number of the load states. Among them, the second classification threshold is used to represent the demarcation value between different load states of the memory margin. For three load states, the controller 250 can set two second classification thresholds. For example, the second classification threshold A is 10%, and the second classification threshold B is 20%. After setting the second classification thresholds, the controller 250 can divide the second classification value range of the memory margin according to the number of the second classification thresholds. During the process of dividing the second classification value range, the two limit values of the second classification value range can also be combined for the division.

[0133] Since the preset applications in the display device 200 will occupy a certain amount of memory, the maximum limit value of the memory margin is not 100%. In this embodiment, taking the maximum limit value as 60% as an example for illustration, the minimum limit value of the memory margin can be 0%. In addition, based on the negative correlation between the memory margin and the load pressure, this embodiment also uses the negative correlation for illustrative purposes.

[0134] The controller 250 may divide the second classification value range A into 0% - 10% according to the second classification threshold A and the minimum limit value of 0% of the memory margin, and the corresponding load state is the warning state. The controller 250 may divide the second classification value range B into 10% - 20% according to the second classification threshold A and the second classification threshold B, and the corresponding load state is the early warning state. The controller 250 may divide the second classification value range C into 20% - 60% according to the second classification threshold B and the maximum limit value of 60% of the processor occupancy rate, and the corresponding load state is the normal state. Among them, the second classification threshold A is the demarcation value between the warning state and the early warning state of the memory margin, and the first classification threshold B is the demarcation value between the early warning state and the normal state of the memory margin.

[0135] It should be noted that the classification thresholds corresponding to the above load item values are only for exemplary illustration. For receiving end devices with different performances or different categories, in this embodiment, the classification thresholds corresponding to the load item values, as well as the number of load states and the number of classification value ranges, can be adjusted so that the classification value ranges divided by the controller according to the classification thresholds are more in line with the device performance of the receiving end device, and the accuracy of determining the load state of the receiving end device is improved.

[0136] S300: When the load item value is within the classification value range, mark the load state corresponding to the classification value range as the target load state.

[0137] After obtaining the classification value range, the controller 250 may compare the load item value with each classification value range to determine the classification value range corresponding to the load item value. When the load item value is within the classification value range, the controller 250 may mark the load state corresponding to the classification value range as the target load state to represent the load state reflected by the display device 200 in the load item value.

[0138] In some embodiments, the controller 250 may respectively determine the corresponding load state for different load item values and determine the target load state among multiple load states. Exemplarily, the controller 250 may successively determine the load state of the processor utilization rate and the memory margin. This embodiment does not specifically limit the order of determining the load state of the processor utilization rate and the memory margin.

[0139] Figure 8 It is a flowchart for a display device to determine a target load state provided by some embodiments of the present application. Refer to Figure 8, when the processor occupancy rate is within the first hierarchical numerical range, the load status corresponding to the first hierarchical numerical range can be marked as the first load status. For example, when the processor occupancy rate is 70%, the controller 250 can determine that the processor occupancy rate is within the first hierarchical numerical range B, that is, 60%-80%. At this time, the controller 250 can mark the load status corresponding to the first hierarchical numerical range B, that is, the warning status, as the first load status.

[0140] When the memory margin is within the second hierarchical numerical range, the load status corresponding to the second hierarchical numerical range can be marked as the second load status. For example, when the memory margin is 30%, the controller 250 can determine that the processor occupancy rate is within the second hierarchical numerical range C, that is, 20%-60%. At this time, the controller 250 can mark the load status corresponding to the second hierarchical numerical range C, that is, the normal status, as the second load status.

[0141] After obtaining the first load status and the second load status, the controller 250 needs to determine the target load status among the first load status and the second load status. When the first load status is different from the second load status, the controller 250 can mark the load status with a relatively higher load among the first load status and the second load status as the target load status.

[0142] In the above example, the first load status is the warning status and the second load status is the normal status. Although the display device 200 is in the normal status in terms of the memory margin, however, during the process of receiving media encoding, the display device 200 is still limited by the processor utilization rate in the warning status. Therefore, the controller 250 can mark the warning status with a relatively higher load pressure, that is, the first load status as the target load status.

[0143] From the above technical solutions, it can be seen that in this embodiment, by setting the preference determination rule for the load status. When the processor occupancy rate and the memory margin respectively correspond to different load statuses, the controller 250 preferentially selects the load status representing a higher load pressure as the target load status for feedback, preventing parameter adjustment errors caused by misjudgment of a single load item value and improving the accuracy of marking the target load status.

[0144] As Figure 9 shown, when the first load status and the second load status are the same, for example, both the first load status and the second load status are the warning status, it means that the first hierarchical numerical range where the processor utilization rate is located and the second hierarchical numerical range where the memory margin is located correspond to the same load status, that is, both are in the warning status. Therefore, the controller 250 can mark any one of the first load status or the second load status as the target load status.

[0145] In some embodiments, when the first load state is the same as the second load state, the controller 250 may also add the load item value to the target load state, so as to generate subsequent state information according to the load item value with a relatively higher load pressure among different load item values.

[0146] S400: Send the first state information of the target load state to the terminal device, so that the terminal device adjusts the resolution parameter when the encoder encodes the media data according to the first state information.

[0147] After determining the target load state, the controller 250 may generate first state information according to the target load state, and the first state information is used to instruct the terminal device 300 to adjust the encoding parameters according to the target load state. The controller 250 may send the first state information to the terminal device 300. After receiving the first state information, the terminal device 300 may adjust the resolution parameter of the media encoding according to the first state information according to the current target load state of the display device 200.

[0148] When the target load state is characterized as an alarm state, the controller 250 generates first state information for reducing the resolution parameter to instruct the terminal device 300 to reduce the resolution parameter of the encoding. For example, the resolution parameter of the media data is reduced from 1080P to 720P, and then the encoding is performed to ensure the smoothness of data transmission. When the target load state is characterized as a normal state, the controller 250 generates first state information for increasing the resolution parameter to instruct the terminal device 300 to increase the resolution parameter of the encoding. For example, the resolution parameter of the media data is increased from 720P to 1080P, and then the encoding is performed to make full use of the idle resources of the display device 200 when receiving the media encoding.

[0149] S500: Receive the media encoding obtained by the terminal device encoding the media data with the encoder after adjusting the resolution parameter.

[0150] After the terminal device 300 adjusts the resolution parameter when the encoder encodes the media data according to the first state information, it can start encoding the media data according to the adjusted resolution parameter to generate the adjusted media encoding, and send the media encoding to the display device 200. After receiving the media encoding, the display device 200 may perform corresponding decoding operations on the media encoding to obtain the media data corresponding to the adjusted resolution parameter, and control the display 260 to display the media picture corresponding to the media data.

[0151] As can be seen from the above technical solutions, in this embodiment, by monitoring the load item values during the media asset encoding process of the display device in real time and dynamically adjusting the resolution parameters of the terminal device based on the hierarchical intervals of the load status, the problem in the prior art of only relying on the network status to adjust the encoding parameters while ignoring the load status of the receiving device is effectively solved. By associating the load status with the hierarchical numerical intervals, it is possible to actively feedback the status information when the display device 200 is under high load, triggering the terminal device 300 to reduce the resolution parameters, thereby reducing the pressure on the display device 200 for reception and rendering.

[0152] In some embodiments, after the display device 200 receives the adjusted media asset encoding, the load item values can be obtained again through the load monitoring module. Since the encoder of the terminal device 300 adjusts the resolution parameters of the encoder according to the first status information, the load item values of the display device 200 will be dynamically encoded according to the adjusted media asset encoding. For example, when receiving the media asset data encoded by the encoder of the terminal device 300 after reducing the resolution, the load item values will decrease according to the reduction of the resolution to relieve the rendering pressure on the display device 200.

[0153] In some embodiments, the controller 250 can also obtain the rendering frame rate of the display device 200 after receiving the media asset encoding. The rendering frame rate is used to characterize the number of frames of the media asset encoding rendered by the display device 200 per unit time. The display device 200 can also dynamically adjust the rendering frame rate of the media asset data according to the load status. For example, when the load status switches from the warning state to the alarm state, the controller 250 can reduce the rendering frame rate to reduce the rendering pressure on the display device 200 for displaying the media asset data screen.

[0154] When the rendering frame rate of the display device 200 changes, there may be a problem that the encoding frame rate of the terminal device 300 does not match the rendering frame rate of the display device 200. For example, when the encoding frame rate is greater than the rendering frame rate, the display device 200 cannot render and display the media asset data uploaded by the terminal device 300 in time, resulting in frame accumulation of the screen and causing rendering delay or frame skipping display.

[0155] Based on the above technical scenario, after receiving the media asset encoding, the controller 250 can parse the media asset encoding to obtain the encoding frame rate of the terminal device 300. The encoding frame rate is used to characterize the number of frames encoded by the encoder of the terminal device 300 per unit time. For example, the terminal device 300 can encode 5 frames of the media asset data in one second, that is, the number of encoding frames is 5.

[0156] Figure 10 It is a flowchart for the display device to obtain the target frame rate information provided by some embodiments of the present application. As Figure 10As shown, according to the load status of the display device 200, the controller 250 can obtain the rendering frame rate of the display device 200 through the load monitoring module to determine the current rendering speed of the display device 200, so as to adjust the encoding frame rate of the terminal device 300 according to the current rendering speed of the display device 200. To this end, the controller 250 can calculate the difference result between the encoding frame rate and the rendering frame rate, and generate target frame rate information according to the difference result. Among them, the hardware layer of the terminal device 300 may include an encoder for encoding data, and the target frame rate information is used to instruct the terminal device 300 to adjust the encoding frame rate of the encoder. The display device 200 can send the target frame rate information to the terminal device 300, and the terminal device 300 can adjust the encoding frame rate according to the target frame rate information, and encode the media data according to the adjusted encoding frame rate to obtain media encoding.

[0157] In some embodiments, according to different difference results between the encoding frame rate and the rendering frame rate, the controller 250 can generate different target frame rate information. As Figure 11 shown, when the difference result is positive, it means that the encoding frame rate of the terminal device 300 is greater than the rendering frame number of the display device 200, which will cause frame accumulation in the picture, resulting in problems such as rendering delay or frame skipping display. To overcome the above problems, the controller 250 can generate the first target frame rate information, which is used to instruct the terminal device 300 to reduce the encoding frame rate according to the rendering frame number. After the display device 200 sends the first target frame rate information to the terminal device 300, the terminal device 300 can reduce the encoding frame rate of the encoder according to the first target frame rate information, so that the encoding frame rate is the same as the rendering frame rate, achieving the same encoding speed and rendering frame rate, and improving the smoothness of media data display or playback.

[0158] When the difference result is negative, it means that the encoding frame rate of the terminal device 300 is less than the rendering frame number of the display device 200, resulting in insufficient utilization of the rendering resources of the display device 200, and the encoding speed of the media data is slow, resulting in stuttering when the display device 200 receives and displays the media data. To overcome the above technical problems, the controller 250 can generate the second target frame rate information, which is used to instruct the terminal device 300 to increase the encoding frame rate according to the rendering frame number. After the display device 200 sends the second target frame rate information to the terminal device 300, the terminal device 300 can increase the encoding frame rate of the encoder according to the second target frame rate information, so that the encoding frame rate is increased to the same as the rendering frame rate, so as to fully utilize the rendering resources of the display device 200.

[0159] In some embodiments, when the maximum rendering frame rate of the display device 200 is greater than the maximum encoding frame rate of the encoder of the terminal device 300, if the rendering frame rate of the display device 200 is the maximum rendering frame rate, at least two adjustment methods can be adopted. The first is that the encoder of the terminal device 300 encodes the media data at the maximum encoding frame rate. The second is to inversely adjust the rendering frame rate of the display device 200 through the second target frame rate information, that is, to reduce the rendering frame rate of the display device 200 according to the maximum encoding frame rate of the encoder of the terminal device 300, so that the rendering frame rate of the display device 200 is the same as the maximum encoding frame rate.

[0160] Based on the above scenario, when the difference result is negative, if the display device 200 receives the frame rate adjustment failure information sent by the terminal device 300, it means that the encoder of the terminal device 300 has been adjusted to the maximum encoding frame rate and cannot be increased any further. At this time, the media data can be encoded by the encoder of the terminal device 300 at the maximum encoding frame rate, or the rendering frame rate of the display device 200 can be inversely adjusted through the second target frame rate information.

[0161] In some embodiments, the controller 250 can also send an alarm message to the terminal device 300 when the display device 200 is in an alarm state. The alarm message is used to instruct the terminal device 300 to simultaneously reduce the resolution parameter and encoding frame rate of the encoder to quickly reduce the load pressure of the display device 200.

[0162] In some embodiments, according to the application situation of the application process, the load state of the display device 200 will also change. For example, when a new application process is started on the display device 200, the processor utilization rate will increase, the memory margin will decrease, and the load pressure will increase. When the display device 200 closes an application process, the processor utilization rate will be released, the memory margin will increase, and the load pressure will decrease. When the load of the display device 200 changes, the corresponding load state will also change accordingly. Therefore, the controller 250 needs to feedback the changed load state of the display device 200 to the terminal device 300 so that the terminal device 300 can timely adjust the encoding parameters of the encoder.

[0163] Based on the above scenario, the controller 250 can sort the hierarchical numerical intervals in the order of increasing load. Based on the foregoing example, the sorting result can be the normal state, the warning state, and the alarm state, that is, the load represented by the normal state is lower than the load represented by the warning state, and the load represented by the warning state is lower than the load represented by the alarm state. Correspondingly, the load represented by the hierarchical numerical interval corresponding to the normal state is lower than the load represented by the hierarchical numerical interval corresponding to the warning state, and the load represented by the hierarchical numerical interval corresponding to the warning state is lower than the load represented by the hierarchical numerical interval corresponding to the alarm state.

[0164] When the value of the load item increases to the next classification value range within the current classification value range, the controller 250 can update the load status of the display device 200 according to the next classification value range.

[0165] For example, as Figure 12 shown, when the processor utilization rate increases from 50% to 70%, at this time, the classification value range corresponding to the processor utilization rate switches from the first classification value range C to the first classification value range B. Correspondingly, the load status switches from the normal state to the warning state. The controller 250 needs the first classification value range B to update the first load status from the normal state to the warning state. Since the load status of the display device 200 changes according to the increasing trend of the load pressure, the controller 250 needs to compare the updated first load status with the second load status again to update the target load status.

[0166] If the updated target load status is the updated first load status, the controller 250 can generate second status information according to the updated target load status and send the second status information to the terminal device 300. After receiving the second status information, the terminal device 300 can, according to the second status information, reduce the resolution parameter when the encoder encodes the media data, and encode the media data according to the reduced resolution parameter. The display device 200 can receive the media encoding obtained by the terminal device 300 encoding the media data according to the reduced resolution parameter.

[0167] When the value of the load item decreases to the previous classification value range within the current classification value range, the controller 250 can update the load status of the display device 200 according to the previous classification value range. For example, as Figure 13 shown, when the processor utilization rate decreases from 70% to 50%, at this time, the classification value range corresponding to the processor utilization rate switches from the first classification value range B to the first classification value range C. The controller 250 needs the first classification value range C to update the first load status from the warning state to the normal state.

[0168] Since the load status of the display device 200 changes according to the decreasing trend of the load pressure, the controller 250 needs to compare the updated first load status with the second load status again to update the target load status.

[0169] If the updated target load status is the updated first load status, the controller 250 may generate third status information according to the updated target load status and send the third status information to the terminal device 300. After receiving the third status information, the terminal device 300 may, according to the third status information, increase the resolution parameter when the encoder encodes the media data, and encode the media data according to the increased resolution parameter. The display device 200 may receive the media encoding obtained by the terminal device 300 encoding the media data according to the increased resolution parameter.

[0170] If the updated target load status is not the updated first load status, it indicates that the update of the first load status does not affect the adjustment of the resolution parameter when the terminal device 300 performs encoding, and the controller 250 may not adjust the resolution parameter.

[0171] It should be noted that the above embodiments only exemplarily illustrate the load status update process when the processor utilization rate changes, that is, the update process of the first load status. The display device 200 may also update the second load status in the same manner when the memory margin changes. In addition, the display device 200 may also re-determine the target load status according to the updated first load status and / or the updated second load status. In this process, only the update of the first load status may be involved, or only the update of the second load status may be involved, or the first load status and the second load status may be updated simultaneously.

[0172] For example, as Figure 14 shown, if the first load status is updated from the warning state to the normal state and the second load status remains unchanged as the normal state, the target load status may be updated from the warning state to the normal state according to the change of the first load status. Another example, as Figure 15 shown, if the first load status remains unchanged as the normal state and the second load status is updated from the normal state to the warning state, the target load status may be updated from the normal state to the warning state according to the change of the second load status. Another example, if the first load status is updated from the warning state to the normal state and the second load status is updated from the normal state to the warning state, among the updated first load status and the updated second load status, although the load status representing a higher load is updated from the first load status to the second load status, the load levels represented by the updated second load status and the original first load status are the same. Therefore, the target load status remains unchanged.

[0173] It should be noted that when determining the target load status based on the updated first load status and the updated second load status, the principle of marking the load status with a relatively higher load as the target load status is still followed.

[0174] In some embodiments, sending status information via a communication connection may affect the transmission efficiency of media asset encoding. To this end, the controller 250 may create a transmission channel with the terminal device based on the Real-time Transport Control Protocol (RTCP) via the communication device 220 to transmit the media asset encoding via the communication connection and transmit the status information via the transmission channel.

[0175] Based on this, the controller 250 may send a channel creation request to the terminal device 300. The user may feedback request information based on the signal creation request via the terminal device 300. When the feedback information is consent information, the display device 200 may create a transmission channel with the terminal device based on the Real-time Transport Control Protocol via the communication device 200 and send the status information to the terminal device 300 via the transmission channel.

[0176] It should be noted that in this embodiment, the receiving-end device and the sending-end device may also be other electronic devices. For example, the sending-end device may also be the display device 200, the server 400, or an electronic device integrated with a preset application program, etc.

[0177] In some embodiments, the terminal device 300 may also adjust other encoding parameters according to the load condition of the display device 200. In addition to the resolution parameter and the encoding frame rate of the encoder described above, it may also include the bit rate and the Group of Pictures Length (GOP). The bit rate refers to the number of data bits transmitted or stored per unit time by the terminal device 200. The Group of Pictures Length represents the number of frames included between two key frames (I frames) in video encoding, that is, the total number of all frames from the first I frame to the previous I frame within a Group of Pictures Length. In a Group of Pictures Length, there may be P frames, that is, forward prediction frames. P frames are motion compensation encoded based on the previous frame (I or P frame). There may also be B frames, that is, bidirectional prediction frames. B frames are interpolated encoded based on the front and back frames.

[0178] In some embodiments, when the terminal device 300 receives the second status information, it may also reduce the transmission bit rate of the terminal device 300 according to the second status information to reduce the number of data bits transmitted by the terminal device 300 to the display device 200 per unit time and slow down the data transmission speed. At the same time, the terminal device 300 may increase the Group of Pictures Length to improve the compression efficiency of the media asset encoding by the terminal device and improve the smoothness of data transmission.

[0179] When the terminal device 300 receives the third status information, it can also increase the transmission code rate of the terminal device 300 according to the third status information, so as to increase the number of data bits transmitted from the terminal device 300 to the display device 200 per unit time and improve the utilization rate of transmission resources. At the same time, the terminal device 300 can reduce the group of pictures length to reduce the latency of media asset encoding transmitted by the terminal device and improve the transmission speed.

[0180] Some embodiments of the present application further provide a terminal device 300, including an encoder and a processor. The encoder is configured to perform encoding on media asset data to obtain media asset encoding. The processor is configured to:

[0181] Send the media asset encoding to the display device 200, so that during the process of the display device 200 receiving the media asset encoding sent by the terminal device, the load monitoring module obtains the load item value of the display device 200, and sets a hierarchical value range for each load item value according to the number of the load states. Wherein, the load item value is used to characterize the load state of the display device. The hierarchical value range corresponds to one of the load states.

[0182] Receive the first status information sent by the display device 200. The first status information is the status information corresponding to the target load state obtained by the display device 200 marking the load state corresponding to the hierarchical value range when the load item value is within the hierarchical value range.

[0183] Adjust the resolution parameter of the media asset encoding according to the first status information.

[0184] Send the media asset encoding obtained by performing encoding on the media asset data according to the adjusted resolution parameter to the display device 200.

[0185] Some embodiments of the present application further provide a method for dynamically adjusting encoding parameters, which is applied to the display device 200. The method includes:

[0186] S100: During the process of receiving the media asset encoding sent by the terminal device, obtain the load item value of the display device through the load monitoring module.

[0187] Wherein, the load item value is used to characterize the load state of the display device, and the media asset encoding is obtained by the encoder of the terminal device performing encoding on the media asset data.

[0188] S200: Set a hierarchical value range for each load item value according to the number of the load states.

[0189] Wherein, the hierarchical value range corresponds to one of the load states, and the number of the load states is determined according to the number of preset numerical levels.

[0190] S300: When the value of the load item is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status.

[0191] S400: Send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter when the encoder encodes the media data according to the first status information.

[0192] S500: Receive the media encoding obtained by the terminal device encoding the media data with the encoder after adjusting the resolution parameter.

[0193] As can be seen from the above technical solutions, the present application provides a display device, a terminal device, and a method for dynamically adjusting encoding parameters. During the process of receiving the media encoding sent by the terminal device, the method obtains the value of the load item of the display device through the load monitoring module, and sets hierarchical value ranges for each load item value according to the number of load statuses. When the value of the load item is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status, and send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter of the media encoding according to the first status information. In this embodiment, the encoding parameters of the terminal device are adjusted in reverse according to the load status of the display device, so that the terminal device dynamically adjusts the encoding parameters according to the load scenario corresponding to the display device, improving the stability of audio and video transmission.

[0194] For the same and similar parts among the various embodiments in this specification, reference can be made to each other, and details will not be repeated here.

[0195] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods in the various embodiments or some parts of the embodiments of the present invention.

[0196] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0197] For the sake of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, Including: A display configured to display a user interface; A controller configured to: During the process of receiving the media encoding sent by the terminal device, obtain the load item value of the display device through the load monitoring module, where the load item value is used to characterize the load status of the display device, and the media encoding is obtained by encoding media data through an encoder of the terminal device; According to the number of load statuses, set a hierarchical value range for each load item value, and the hierarchical value range corresponds to one of the load statuses; the number of load statuses is determined according to the number of preset numerical levels; When the load item value is within the hierarchical value range, mark the load status corresponding to the hierarchical value range as the target load status; Send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter when the encoder encodes the media data according to the first status information; Receive the media encoding obtained by the terminal device encoding the media data with the encoder after adjusting the resolution parameter.

2. The display device according to claim 1, wherein The load item value includes the processor occupancy rate and the memory margin. The step of the controller setting the hierarchical value range for each load item value according to the number of load statuses is specifically configured to: According to the number of load statuses, set the number of first hierarchical thresholds for the processor occupancy rate, and set the number of second hierarchical thresholds for the memory margin; the first hierarchical threshold is used to represent the boundary value of the processor occupancy rate between different load statuses; the second hierarchical threshold is used to represent the boundary value of the memory margin between different load statuses; According to the number of first hierarchical thresholds, divide the first hierarchical value range of the processor occupancy rate, and according to the number of second hierarchical thresholds, divide the second hierarchical value range of the memory margin.

3. The display device according to claim 2, characterized in that, The step of the controller marking the load status corresponding to the hierarchical value range as the target load status when the load item value is within the hierarchical value range is specifically configured to: When the processor occupancy rate is within the first hierarchical value range, mark the load status corresponding to the first hierarchical value range as the first load status; When the memory margin is within the second hierarchical value range, mark the load status corresponding to the second hierarchical value range as the second load status; Mark the load status with a relatively higher load among the first load status and the second load status as the target load status.

4. The display device according to claim 1, characterized in that The controller is further configured to: Analyze the media encoding to obtain the encoding frame rate used to characterize the number of frames encoded by the encoder of the terminal device per unit time; Obtain the rendering frame rate used to characterize the number of frames of the media encoding rendered by the display device per unit time through the load monitoring module; Calculate the difference result between the encoding frame rate and the rendering frame rate; Generate target frame rate information according to the difference result; Send the target frame rate information to the terminal device, so that the terminal device adjusts the encoding frame rate of the encoder according to the target frame rate information; Receive the media encoding obtained by encoding the media data by the encoder after adjusting the encoding frame rate by the terminal device.

5. The display device according to claim 4, wherein The step of the controller performing sending, according to the difference result, frame rate adjustment information corresponding to the difference result to the terminal device is specifically configured as: When the difference result is positive, generate first target frame rate information for instructing the terminal device to reduce the encoding frame rate according to the rendering frame number; When the difference result is negative, generate second target frame rate information for instructing the terminal device to increase the encoding frame rate according to the rendering frame number; Send the first target frame rate information to the terminal device, or send the second target frame rate information to the terminal device.

6. The display device according to claim 1, wherein The hierarchical value intervals are arranged in the order of representing the load from low to high. When the load item value increases to the next hierarchical value interval of the current hierarchical value interval, the controller is further configured to: Update the target load state according to the load state corresponding to the next hierarchical value interval; Send second state information of the updated target load state to the terminal device, so that the terminal device reduces the resolution parameter according to the second state information; Receive the media encoding obtained by encoding the media data by the encoder of the terminal device according to the reduced resolution parameter.

7. The display device according to claim 6, wherein When the load item value decreases to the previous hierarchical value interval of the current hierarchical value interval, the controller is further configured to: Update the target load state according to the load state corresponding to the previous hierarchical value interval; Send third state information of the updated target load state to the terminal device, so that the terminal device increases the resolution parameter according to the third state information; Receive the media encoding obtained by encoding the media data by the encoder of the terminal device according to the increased resolution parameter.

8. The display device according to claim 1, wherein It further includes a communication device, and the communication device is configured to create a transmission channel with the terminal device through the Real-Time Transport Control Protocol. The step of the controller performing sending the first state information of the target load state to the terminal device is specifically configured as: Send a channel creation request to the terminal device; Obtain the consent information fed back by the user in response to the creation request by the terminal device; In response to the consent information, create a transmission channel with the terminal device through the communication device; Send the first state information to the terminal device through the transmission channel.

9. A terminal device, characterized in that, Include: An encoder configured to perform encoding on media data to obtain media encoding; A processor configured to: Send the media encoding to the display device, so that during the process of the display device receiving the media encoding sent by the terminal device, the load monitoring module of the display device obtains the load item value of the display device, and sets hierarchical value intervals for each load item value according to the number of load states; wherein, the load item value is used to represent the load state of the display device; each hierarchical value interval corresponds to one load state; the number of load states is determined according to the number of preset numerical levels; Receive the first status information sent by the display device; the first status information is the status information corresponding to the target load status obtained by marking the load status corresponding to the hierarchical value interval when the load item value of the display device is within the hierarchical value interval; Adjust the resolution parameter when the encoder encodes the media asset data according to the first status information; Send the media asset encoding obtained by encoding the media asset data by the encoder after adjusting the resolution parameter to the display device.

10. A method for dynamically adjusting coding parameters, characterized in that, Applied to a display device, the display device includes a display and a controller, the display is configured to display a user interface, and the method includes: During the process of receiving the media asset encoding sent by the terminal device, obtain the load item value of the display device through the load monitoring module, where the load item value is used to characterize the load status of the display device, and the media asset encoding is obtained by encoding the media asset data by the encoder of the terminal device; Set hierarchical value intervals for each load item value according to the number of load statuses, and each hierarchical value interval corresponds to one load status; the number of load statuses is determined according to the number of preset numerical levels; When the load item value is within the hierarchical value interval, mark the load status corresponding to the hierarchical value interval as the target load status; Send the first status information of the target load status to the terminal device, so that the terminal device adjusts the resolution parameter when the encoder encodes the media asset data according to the first status information; Receive the media asset encoding obtained by encoding the media asset data by the encoder of the terminal device after adjusting the resolution parameter.

Images