Display device and layer refresh rate setting method

Abstract

Some embodiments of the present application provide a display device and a method for setting a layer refresh rate. The display device can acquire layer refresh rate support information according to system configuration information, the layer refresh rate support information being used to represent whether a refresh rate supported by an OSD layer reaches a first refresh rate. The display device sets the refresh rate of the OSD layer according to the layer refresh rate support information. In response to an instruction for generating a UI image, the display device acquires a UI image generation time according to the refresh rate of the OSD layer, and generates the UI image according to the UI image generation time. The display device can display the UI image in the OSD layer. The display device can automatically set the refresh rate of the OSD layer according to the system configuration, so as to improve the picture quality of a UI interface in the OSD layer.

Description

Technical Field

[0001] This application relates to the field of display device technology, and more particularly to a display device and a method for setting the refresh rate of a layer. Background Technology

[0002] Display devices refer to terminal devices that can output specific display images. With the rapid development of display devices, their functions will become richer and their performance will become more powerful. They can realize two-way human-computer interaction functions and integrate multiple functions such as audio-visual, entertainment, and data to meet the diverse and personalized needs of users.

[0003] When displaying images, a display device can create a rich user interface by overlaying multiple layers. For example, the display layers of a display device can include video layers and graphics layers. The video layer can provide better image display effects and can be used to display images or videos; the graphics layer has better display response speed and can be used to display the user interface, including various UI interfaces.

[0004] Display devices can display images at different refresh rates. When playing video content, the display device can adjust the refresh rate of the video layer based on the frame rate of the video data to improve the user's viewing experience. However, for the graphics layer that displays the user interface, the display device defaults to a fixed refresh rate. A lower refresh rate for the graphics layer results in poor image quality of the UI interface, leading to a poor viewing experience for the user. Summary of the Invention

[0005] This application provides a display device and a method for setting the refresh rate of a layer, in order to solve the problem in related technologies where the display device sets a fixed refresh rate for the graphics layer by default. A low refresh rate of the graphics layer leads to poor image quality of the UI interface in the graphics layer, resulting in a poor viewing experience for the user.

[0006] In a first aspect, some embodiments of this application provide a display device, including a display, an image generation unit, and a controller. The image generation unit is configured to generate a UI image. The controller is configured to:

[0007] Obtain the system configuration information of the display device, and obtain the layer refresh rate support information based on the system configuration information. The layer refresh rate support information is used to characterize whether the refresh rate supported by the OSD layer reaches the first refresh rate.

[0008] Set the refresh rate of the OSD layer according to the layer refresh rate support information;

[0009] In response to an instruction to generate a UI image, the UI image generation time is obtained based on the refresh rate of the OSD layer;

[0010] Based on the UI image generation time, control the image generation unit to generate the UI image;

[0011] Control the display to show the UI image in the OSD layer.

[0012] Secondly, some embodiments of this application provide a layer refresh rate setting method, applied to a display device, the method including:

[0013] Obtain the system configuration information of the display device, and obtain the layer refresh rate support information based on the system configuration information. The layer refresh rate support information is used to characterize whether the refresh rate supported by the OSD layer reaches the first refresh rate.

[0014] Set the refresh rate of the OSD layer according to the layer refresh rate support information;

[0015] In response to an instruction to generate a UI image, the UI image generation time is obtained based on the refresh rate of the OSD layer;

[0016] Based on the UI image generation time, control the image generation unit to generate the UI image;

[0017] Control the display to show the UI image in the OSD layer.

[0018] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a method for setting the refresh rate of a layer. The display device can obtain layer refresh rate support information based on system configuration information. This layer refresh rate support information is used to characterize whether the refresh rate supported by the OSD layer reaches a first refresh rate. The display device sets the refresh rate of the OSD layer based on the layer refresh rate support information. In response to an instruction to generate a UI image, the display device obtains the UI image generation time based on the OSD layer refresh rate and generates the UI image based on that time. The display device can display the UI image in the OSD layer. The display device can automatically set the refresh rate of the OSD layer based on system configuration to improve the image quality of the UI interface in the OSD layer and enhance the user's viewing experience. Attached Figure Description

[0019] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This illustrates a use case of a display device according to some embodiments;

[0021] Figure 2A hardware configuration block diagram of a control device 100 according to some embodiments is shown;

[0022] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments is shown;

[0023] Figure 4 A software configuration diagram of a display device 200 according to some embodiments is shown;

[0024] Figure 5 Schematic diagrams of user interfaces in some embodiments are shown;

[0025] Figure 6 A schematic diagram of the display function module is shown in some embodiments;

[0026] Figure 7 Schematic diagrams of the video layer and graphics layer in some embodiments are shown;

[0027] Figure 8 The image refresh rate setting interface is shown in some embodiments;

[0028] Figure 9 A schematic diagram of graphics layer refresh rate adjustment mode confirmation information is shown in some embodiments;

[0029] Figure 10 The diagrams show the interaction flowcharts of various components of the display device in some embodiments;

[0030] Figure 11 A schematic diagram of the refresh rate list in some embodiments is shown. Detailed Implementation

[0031] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0032] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0033] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0034] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0035] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 2 This is one specific embodiment of the display device of this application.

[0036] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0037] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0038] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0039] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.

[0040] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0041] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may be configured to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0042] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0043] like Figure 3 The display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0044] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0045] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0046] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0047] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0048] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0049] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0050] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0051] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0052] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0053] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0054] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc.

[0055] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0056] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0057] like Figure 4 As shown, the display device system is divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0058] The application layer mainly includes commonly used applications on TVs, as well as the application framework. The commonly used applications are mainly browser-based applications, such as HTML5 apps, and native apps.

[0059] An application framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interface for these functions (toolbar, status bar, menu, dialog box).

[0060] Native apps can support online or offline access, push notifications, or access to local resources.

[0061] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0062] The hardware layer mainly includes the HAL interface, hardware, and drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. The drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.

[0063] Display device 200 can have various functions, such as browsing web pages, playing media, playing games, and screen mirroring, thereby providing users with a variety of services. Users can control display device 200 to launch a relevant application, thereby enabling the corresponding function.

[0064] In some embodiments, when the user-controlled display device 200 is powered on, the controller 250 can control the display 260 to display the user interface. The user interface can be a specific target image, such as various media resources obtained from a network signal source, including videos, pictures, and other content. The user interface can also be some UI interface of the display device, such as the system main interface. Figure 5 Schematic diagrams of user interfaces from some embodiments are shown. For example... Figure 5 As shown, the user interface includes a first navigation bar 500, a second navigation bar 510, a function bar 520, and a content display area 530. The function bar 520 includes multiple function controls such as "Viewing History," "My Favorites," and "My Applications." The content displayed in the content display area 530 changes according to the selected control in the first and second navigation bars 500 and 510. On the application panel page, users can click the "My Applications" control to input display commands for the application panel page, triggering entry into the corresponding application panel. It should be noted that users can also use other methods to select function controls to trigger entry into the application panel. For example, they can use voice control or search functions to control entry into the application panel page.

[0065] A user interface can contain multiple controls. These controls can be displayed as text, such as the "My Applications" control in the image. These controls can receive user commands. Users can input corresponding commands by clicking these controls. Controls can also be displayed as images, such as control 540 in the image. This type of control can display images, videos, etc. That is, control 540 can directly display video content in the user interface.

[0066] It should be noted that the user interface containing various controls is essentially the system UI, used to display the user's interface. The video content displayed by the display device 200 can be obtained from various media assets on the network and then displayed. The UI and video content can be displayed in different layers on the display device 200. Specifically, the UI can be displayed on the On-Screen Display (OSD) layer, and the video content can be displayed on the video layer. When displaying images, the display device 200 can create a rich user interface by overlaying multiple layers.

[0067] Based on the system hierarchy of the display device 200, the display device 200 can call resources at each layer to form a display screen on the monitor 260, thereby controlling the monitor 260 to display the user interface. To display the user interface, functional modules related to the display process can be configured within the display device 200. Figure 6 The diagram shows a schematic of the display function module in some embodiments, such as Figure 6 As shown, the display device 200 can render and display the user interface in real time through the image producer module, the surfaceflinger module, the hardware composer (HWC) module, the video processing unit hardware (VPU hardware) module, and the screen.

[0068] During the display process, peripherals such as the graphics interface (OpenGLES) of the image generation module, the media player, and the camera can be used to generate the image content to be displayed and pass the image content to the image rendering module. The image rendering module is used to control the display content on the monitor 260, that is, to render the image content through the user interaction layer (UI layer) or the video layer based on the image content.

[0069] To achieve better display results, the image content of the UI layer can be rendered by the GPU component, thus forming display frames in the HWC module. The HWC module stores these frames using both a frame buffer and a video buffer, and the video processing module forms the image content on the corresponding layers. Specifically, image frames generated during video playback are processed through the video plane, while frames from other image elements (such as UI graphics) are processed through the primary OSD plane. Finally, the display device 200 uses the blending unit of the video processing module to create the final image, which is then displayed on the monitor 260.

[0070] In the above embodiments, the display device 200 can overlay multiple layers during the display of the user interface, with different layers displaying different images. In some embodiments, the display device 200 can display images through a video layer and a graphics layer. The video layer can establish a connection with the media player of the image generation module to display the image content generated by the media player through playing media asset data. For example, when the display device 200 plays video media assets, the media player can parse the media asset data to form multiple frames of media asset images and send these frames to the video layer to form a video playback image.

[0071] The video layer can display images based on the content, format, type, decoding specifications, and image quality parameters of media asset data, thereby achieving a better image display effect. For example, for 90Hz high frame rate video media assets, the media player of the display device 200 can directly decode the video data to obtain 90 frames per second and display these 90 frames on the video layer. It should be noted that the video layer is not only used to display video-type media asset content, but also to display other types of media asset content. For example, the video layer can also display image details interfaces to users; that is, image-type media asset data can be decoded by the media player to form multiple frames of the same content, and displayed in the video layer according to the display refresh rate of the monitor 260.

[0072] In some embodiments, the display device 200 can also perform image quality processing on the image content displayed on the video layer, thereby making the image content displayed on the video layer more in line with user needs. For example, the operating system of the display device 200 can preset multiple image quality mode options, including standard, soft, vivid, and eye-protection modes. The user can select one of the image quality modes according to their viewing needs, and the display device 200 can then perform image quality processing on the displayed image content according to the selected image quality mode. For example, when the user selects the vivid mode, the display device 200 will enhance the color saturation and brightness of the image content, making the image content more vivid and bright, and then display the image frame with adjusted image quality through the video layer.

[0073] The OSD layer can refresh and display image-related information in real time based on the interactive operation process of the display device 200, such as graphics, text, and icons. The OSD layer can also display specific device status information. For example, the OSD can be used to display information such as channel, volume, brightness, and contrast. Figure 7 Schematic diagrams of video and graphics layers in some embodiments are shown. For example... Figure 7As shown, the video layer displays video data, while the OSD layer displays various controls used to control the video data, such as pause buttons, playback progress bars, and volume controls. The OSD layer can be displayed above the video layer, allowing graphics and other content displayed in the OSD layer to float above the video playback screen, enabling users to perform interactive operations based on the content displayed in the OSD layer.

[0074] Because the OSD layer needs to respond to user interactions in real time, and its dynamic display effect is superior to that of the video layer, in some embodiments, the display process of the display device 200 can be completed through the cooperation of the video layer and the OSD layer. For example, when a user clicks on an image icon (thumbnail) in the image list interface to control the display device 200 to display the clicked image in full screen, the display device 200 first displays the image thumbnail icon through the OSD layer. After the user clicks the thumbnail icon, the OSD layer displays a transition animation for the full-screen display of the image. After the transition animation is complete, the display device 200 then displays the image content through the video layer.

[0075] For some display devices 200 that require real-time responses to interactive content, in order to present a better real-time response effect, the display device 200 should shorten the delay between the input time of the interactive action and the display result. To this end, in some embodiments, the display device 200 can present a real-time display effect by setting an acceleration layer. That is, in the video process module of the display device 200, an additional external OSD plane can be set on top of the main OSD layer and the video layer. The external OSD plane can be configured with different layer characteristics according to specific display effect requirements. For example, the bitmap refresh mode of the external OSD plane can be modified to make the external OSD plane refresh in real time according to the region, thereby improving the display speed of graphics. In this case, the external OSD plane can be used as an acceleration layer in scenarios with high dynamic range display effects.

[0076] Display devices can display images at different refresh rates. Users can set the display's image refresh rate. Figure 8 The image refresh rate setting interface is shown in some embodiments. For example... Figure 8 As shown, users can access the image refresh rate settings interface through system settings. The image refresh rate settings interface includes multiple image refresh rates that the display device can set, such as 30Hz, 40Hz, 60Hz and 75Hz.

[0077] Alternatively, the image refresh rate can be set dynamically according to the video data frame rate, ensuring synchronization between the refresh rate and the video frame rate. For example, if the video data frame rate is 30 frames per second, then the monitor's image refresh rate is set to 30 frames per second. If the video data frame rate is 60 frames per second, then the monitor's image refresh rate is set to 60 frames per second.

[0078] It's important to note that monitors have a maximum image refresh rate, also known as the physical refresh rate, which is the highest refresh rate the monitor can support. The physical refresh rate determines the maximum image refresh rate the monitor can display. If the frame rate of the video data to be played is higher than the monitor's physical resolution, the monitor cannot synchronize its refresh rate with the video data. In this case, the user can manually set the refresh rate, or the default setting can be used.

[0079] The physical resolution of a monitor varies depending on the system configuration of the display device. The physical refresh rate of a monitor can reach 120Hz or even 144Hz. The higher the physical resolution of the monitor, the higher the refresh rate that can be set, resulting in higher image quality and a better viewing experience for the user.

[0080] The image refresh rate mentioned above refers to the refresh rate of the video layer, which determines the picture quality of the video content that the user can view. However, for the OSD layer, which displays the user interface, various UI interfaces can be displayed, including the display device's system interface and the control interfaces of various applications. Considering the display stability of the layer, the display device will set a fixed refresh rate for the OSD layer by default, rather than allowing the user to adjust it manually. For example, the display device can set the OSD layer refresh rate to 60 frames per second to ensure normal user experience. However, with the improvement of system configuration, the physical resolution of the monitor may far exceed the default refresh rate of the OSD layer. For example, the monitor's physical resolution is 144 Hz, but the default refresh rate of the OSD layer is 60 Hz. In this case, the system performance of the display device can support setting the OSD layer refresh rate higher. For users, a lower refresh rate of the OSD layer will result in poor picture quality of the displayed UI interface, leading to a poor viewing experience.

[0081] To address the aforementioned issues, the display device provided in this application embodiment can have a graphics layer refresh rate adjustment function, which can adaptively adjust the graphics layer refresh rate based on the current system resource conditions of the display device. The display device can be configured with a graphics layer refresh rate adjustment mode. When the OSD layer of the display device requires displaying a UI interface, the display device can determine whether it can support a higher OSD layer refresh rate based on its own system configuration, and thus adaptively set the OSD layer refresh rate. Furthermore, while the display device is displaying video content, the refresh rate of the OSD layer is dynamically adjusted according to the video playback status to ensure the normal display of both the OSD layer and the video layer, thereby improving the user experience.

[0082] In some embodiments, a user can send a graphics refresh rate adjustment mode command to the display device by operating a designated button on the remote control. In practical applications, a pre-defined correspondence is established between the graphics refresh rate adjustment mode command and the remote control button. For example, a graphics refresh rate adjustment mode button is provided on the remote control. When the user touches this button, the remote control sends a graphics refresh rate adjustment mode command to the controller, which then controls the display device to enter the graphics refresh rate adjustment mode.

[0083] You can also set the graphics layer refresh rate adjustment mode option in the system UI interface of the display device. When the user clicks this option, they can control the display device to enter or exit the graphics layer refresh rate adjustment mode.

[0084] In some embodiments, to prevent users from accidentally triggering the graphics layer refresh rate adjustment mode, when the controller receives the graphics layer refresh rate adjustment mode instruction, it can control the display to display the graphics layer refresh rate adjustment mode confirmation information, thereby allowing the user to make a second confirmation as to whether to control the display device to enter the graphics layer refresh rate adjustment mode. Figure 9 A schematic diagram of graphics layer refresh rate adjustment mode confirmation information is shown in some embodiments.

[0085] When a display device needs to display a UI interface in the OSD layer, the OSD refresh rate can be automatically set to improve the user's viewing experience. The UI interface displayed in the OSD layer can be a system interface or an application control interface.

[0086] Figure 10 The diagram illustrates the interaction flowcharts of various components of the display device in some embodiments, including the following steps:

[0087] S101. Obtain the system configuration information of the display device, and obtain the layer refresh rate support information according to the system configuration information. The layer refresh rate support information is used to characterize whether the refresh rate supported by the OSD layer reaches the first refresh rate.

[0088] S102. Set the refresh rate of the OSD layer according to the layer refresh rate support information;

[0089] S103. In response to the instruction to generate a UI interface, obtain the UI image generation time according to the refresh rate of the OSD layer;

[0090] S104. Based on the UI image generation time, control the image generation unit to generate a UI image;

[0091] S105. Control the display to show the UI image in the OSD layer.

[0092] In some embodiments, the controller can set the refresh rate of the OSD layer according to the system configuration of the display device.

[0093] After the display device is powered on, the controller can first obtain the system configuration information of the display device. This system configuration information includes processing resource parameters, graphics processing parameters, and memory bandwidth parameters. Processing resource parameters may include the CPU model and CPU frequency. Graphics processing parameters may include the GPU model and GPU frequency. Memory bandwidth parameters may include the memory bandwidth model and memory bandwidth frequency. Table 1 shows the system configuration information of the display device in some embodiments.

[0094] Table 1

[0095] hardware module model frequency GPU G52*MC1 550M CPU A55*4 1.3G Memory bandwidth 80Mbps 2333MHz

[0096] According to the system configuration shown in Table 1, the maximum refresh rate supported by the OSD layer of the corresponding display device is 120Hz. Therefore, for a display device, when its system configuration meets the conditions shown in Table 1, it means that the refresh rate supported by the OSD layer of the display device can also reach 120Hz.

[0097] The controller can obtain layer refresh rate support information based on system configuration information. This layer refresh rate support information indicates whether the refresh rate supported by the OSD layer reaches a first refresh rate. In this embodiment, the first refresh rate can be set to 120Hz.

[0098] In some embodiments, the controller can determine whether the system configuration of the display device meets the conditions shown in Table 1, thereby obtaining the layer refresh rate support information of the display device, that is, whether the refresh rate supported by the OSD layer reaches the first refresh rate.

[0099] In this embodiment, it is defined that when any system configuration parameter of the display device reaches the level shown in Table 1, it indicates that the refresh rate supported by the OSD layer of the display device can reach the first refresh rate. Therefore, the parameters in Table 1 can be set as preset thresholds.

[0100] If all the display device's processing resource parameters, graphics processing parameters, and memory bandwidth parameters are greater than or equal to their respective preset thresholds (i.e., processing resource parameters are greater than or equal to the processing resource parameter threshold, graphics processing parameters are greater than or equal to the graphics processing parameter threshold, and memory bandwidth parameters are greater than or equal to the memory bandwidth parameter threshold), then the refresh rate support information for the marked layer indicates that the refresh rate supported by the OSD layer has reached the first refresh rate. The processing resource parameter threshold, graphics processing parameter threshold, and memory bandwidth parameter threshold are the parameters listed in Table 1.

[0101] Table 2 shows the system configuration information of the display device in some embodiments.

[0102] Table 2

[0103] hardware module Framework frequency GPU G52*MC2 800M CPU A73*4 1.5G Memory bandwidth 100Mbps 2333MHz

[0104] As shown in Table 2, the CPU model is higher than that in Table 1, and the CPU frequency is also higher than that in Table 1, meaning that the processing resource parameters of the display device are greater than the preset threshold.

[0105] The GPU model is higher than the GPU models in Table 1, and the GPU frequency is higher than the GPU frequency in Table 1, meaning that the graphics processing parameters of the display device are greater than the preset threshold.

[0106] The memory bandwidth model is higher than the memory bandwidth model in Table 1, and the memory bandwidth frequency is equal to the memory bandwidth frequency in Table 1. That is, the memory bandwidth parameter of the display device is greater than or equal to the preset threshold.

[0107] Therefore, the display device configured as shown in Table 2 can achieve the first refresh rate in its OSD layer.

[0108] If at least one of the display device's processing resource parameters, graphics processing parameters, and memory bandwidth parameters is less than a corresponding preset threshold (i.e., the processing resource parameter is less than the processing resource parameter threshold, and / or the graphics processing parameter is less than the graphics processing parameter threshold, and / or the memory bandwidth parameter is less than the memory bandwidth parameter threshold), then the refresh rate support information for the marked layer is that the refresh rate supported by the OSD layer has not reached the first refresh rate.

[0109] In some embodiments, the controller can set the refresh rate of the OSD layer based on layer refresh rate support information.

[0110] If the refresh rate support information indicates that the OSD layer supports a refresh rate up to the first refresh rate, then the refresh rate of the OSD layer is set to the physical refresh rate of the monitor.

[0111] If the refresh rate support information indicates that the OSD layer's supported refresh rate does not reach the first refresh rate, then the OSD layer's refresh rate is set to the second refresh rate. In this embodiment, the second refresh rate can be set to 60Hz to ensure a normal viewing experience for the user interface.

[0112] In response to an instruction to generate a UI image, the controller can generate a UI image. The UI image can be an image of the system interface or an image of the application's control interface.

[0113] The display device includes an image generation unit that can generate various UI images for display in the OSD layer. After setting the refresh rate of the OSD layer, the controller can control the image generation unit to generate UI images, thereby obtaining the final displayed user interface.

[0114] It should be noted that the user interface may contain not only various controls and text information, but also things like... Figure 5 The video content shown in Figure 540. To do this, the controller can first detect whether there is video content to be displayed in the user interface. If so, the controller also needs to configure the video layer to display the video content.

[0115] In some embodiments, media asset data of the target media asset is obtained in response to a target media asset playback instruction. It should be noted that the target media asset playback instruction may be a user-input instruction; for example, a user may launch an application that plays media assets and select a target media asset for playback. In this case, the target media asset playback instruction can be sent by the corresponding application. The target media asset playback instruction may also be indicated by the display device system; for example, the system's main interface may include a media asset recommendation control, such as... Figure 5 As shown in 540, this type of media asset recommendation control can directly play video content, so it is necessary to obtain the corresponding media asset data.

[0116] The controller can decode media asset data to obtain video data. The media asset data is provided by the source and may include both video and audio data. The controller can first demultiplex the media asset data to obtain the original video and audio data. The controller can then decode the original video and audio data separately to obtain playable video and audio data.

[0117] The display device may also include an image processing unit. The controller can control the image processing unit to perform image processing on the video data, thereby acquiring media asset images. The media asset images can be displayed in the video layer.

[0118] When the user interface to be displayed includes both UI images and video content, the controller can combine the two to obtain the final user interface.

[0119] In some embodiments, when the image generation unit generates UI images, the controller can first obtain the UI image generation time based on the refresh rate of the OSD layer. The OSD layer displays multiple frames of UI images at a corresponding refresh rate, and the controller can obtain the generation time of each frame of the UI image.

[0120] The controller can obtain the image display duration based on the refresh rate of the OSD layer. The refresh rate represents the number of images displayed per second. When the refresh rate is 60 frames per second, the display duration of each UI image frame is 1 / 60 of a second. When the refresh rate is 120 frames per second, the display duration of each UI image frame is 1 / 120 of a second.

[0121] The controller can calculate the image generation interval based on the generation time of the previous UI image, the image display duration, and the image request time. The image request time can be either a first time or a second time.

[0122] It's important to note that when generating a UI frame, the corresponding application sends an image generation request. For example, for a system interface, the system application controlling the interface sends image generation requests frame by frame. Similarly, for the control interface of a specific application, that application sends image generation requests frame by frame. In other words, when a UI frame needs to be displayed, the corresponding application sends a request to generate that frame of UI image.

[0123] When the final user interface includes video content, it's necessary to composite the UI image and video content. The application will also send a request to composite the UI image frame with the video data. In other words, when the application instructs the display device to generate a UI image frame, it can send two types of requests.

[0124] In this embodiment, the time when the application sends the request to generate the current frame UI image is referred to as the first time, and the time when the application sends the request to combine the current frame UI image with video data is referred to as the second time. It should be noted that the first and second times do not have a fixed order; the application may request to generate the current frame UI image first, or it may request to combine the current frame UI image with video data first. The image request time can be set to the later of the first and second times.

[0125] If the first time is earlier than the second time, the image request time is the second time; if the first time is later than the second time, the image request time is the first time.

[0126] The controller can calculate the image generation interval using the following formula: T1 + T - T2. Where T1 represents the generation time of the previous UI image, T represents the image display duration, and T2 represents the image request time.

[0127] After calculating the image generation interval, the controller can calculate the sum of the generation time of the previous frame's UI image and the image generation interval to obtain the generation time of the current frame's UI image.

[0128] In some embodiments, the controller can control the image generation unit to generate a UI image based on the UI image generation time. A timer can be preset, and when the system time reaches the UI image generation time, the controller can send a UI image generation command to the image generation unit to instruct the image generation unit to generate the UI image.

[0129] The image generation unit can generate UI images, including designing the UI layout of the image, drawing content, and rendering the image.

[0130] The controller can control the display to show UI images in the OSD layer.

[0131] In some embodiments, when video content is present in the user interface, the controller can perform compositing processing on the media asset image and the UI image to generate the user interface.

[0132] The controller can control the display to show the user interface; the UI image is displayed through the OSD layer, and the media asset image is displayed through the video layer.

[0133] It should be noted that system performance fluctuates significantly when a display device is playing video content. For example, the remaining memory bandwidth of the display device may change considerably, and system performance will affect the actual refresh rate of the OSD layer. If the refresh rate of the OSD layer is always set to a fixed value, it may cause problems with the UI interface. Therefore, the display device can dynamically adjust the refresh rate of the OSD layer.

[0134] In some embodiments, the controller can detect the video display status of the display to determine whether video content is displayed on the display.

[0135] If video data is being displayed on the monitor, the controller can obtain the aspect ratio information of the video data on the monitor. Based on the aspect ratio information, the controller can update the refresh rate of the OSD layer.

[0136] If no video data is displayed on the monitor, the controller may not update the refresh rate settings of the OSD layer.

[0137] In some embodiments, when video data is being displayed on the monitor, the controller can update the refresh rate of the OSD layer differently depending on the display ratio of the video content on the monitor.

[0138] If the video data ratio information indicates that the display shows video data in full screen, the controller can continuously monitor the playback status of the video data to determine whether the video is playing normally.

[0139] If the playback status is "playing", the monitor will always display the video data in full screen. That is, the OSD layer is not currently displaying the UI interface. The controller can detect the remaining percentage of the display device's memory bandwidth and update the refresh rate of the OSD layer according to the remaining percentage of memory bandwidth.

[0140] If playback is stopped, the OSD layer needs to display a user interface, such as a pause control, to allow the user to pause video playback. The controller can then control the image processing unit to stop performing image processing on the video data.

[0141] The image quality processing unit affects system performance, which in turn affects the actual refresh rate of the OSD layer. By stopping the operation of the image quality processing unit, the stability of the OSD layer refresh rate can be guaranteed.

[0142] In some embodiments, if the video data ratio information indicates that the display is not showing video data in full screen, the controller can first control the image quality processing unit to stop performing image quality processing on the video data. In the non-full-screen display state, the user interface contains both video data and UI interface images. At this time, the frame rate of the video data is low, and the workflow of the image quality processing unit can be shut down to improve the stability of the OSD layer refresh rate and ensure the display stability of the UI interface images.

[0143] The controller can detect the playback status of video data.

[0144] If the playback status is "playing," meaning the monitor is not displaying video data in full screen, the controller can detect the remaining percentage of the display device's memory bandwidth and update the refresh rate of the OSD layer based on that percentage.

[0145] If the playback status is stopped, the controller can update the refresh rate of the OSD layer based on the layer refresh rate support information.

[0146] In some embodiments, when updating the refresh rate of the OSD layer based on the remaining memory bandwidth percentage, the controller can first obtain the target memory bandwidth percentage range corresponding to the remaining memory bandwidth percentage based on a preset refresh rate list. Figure 11 A schematic diagram of the refresh rate list in some embodiments is shown. For example... Figure 11 As shown, the refresh rate list stores the correspondence between multiple memory bandwidth percentage ranges and refresh rates. Specifically, when the memory bandwidth percentage is less than 20%, the OSD layer refresh rate is updated to 10Hz. When the memory bandwidth percentage is between 20% and 30%, the OSD layer refresh rate is updated to 15Hz. When the memory bandwidth percentage is between 30% and 40%, the OSD layer refresh rate is updated to 30Hz. When the memory bandwidth percentage is between 40% and 60%, the OSD layer refresh rate is updated to 60Hz. When the memory bandwidth percentage is between 60% and 70%, the OSD layer refresh rate is updated to 120Hz. When the memory bandwidth percentage is greater than 70%, the OSD layer refresh rate is updated to 144Hz.

[0147] The controller can obtain the target refresh rate corresponding to the target memory bandwidth ratio range and update the OSD layer refresh rate to set the target refresh rate.

[0148] In some embodiments, when a user instructs the display to stop showing video content, the controller stops the display from showing video data. The controller can update the refresh rate of the OSD layer based on the display device's layer refresh rate support information to improve the user's viewing experience.

[0149] This application also provides a layer refresh rate setting method, applied to a display device, the method comprising:

[0150] Step 101: Obtain the system configuration information of the display device, and obtain the layer refresh rate support information according to the system configuration information. The layer refresh rate support information is used to characterize whether the refresh rate supported by the OSD layer reaches the first refresh rate.

[0151] Step 102: Set the refresh rate of the OSD layer according to the layer refresh rate support information;

[0152] Step 103: In response to the instruction to generate a UI interface, obtain the UI image generation time according to the refresh rate of the OSD layer;

[0153] Step 104: Based on the UI image generation time, control the image generation unit to generate the UI image;

[0154] Step 105: Control the display to show the UI image in the OSD layer.

[0155] In some embodiments, system configuration information includes processing resource parameters, graphics processing parameters, and memory bandwidth parameters. Obtaining layer refresh rate support information based on system configuration information also includes:

[0156] If the processing resource parameter is greater than or equal to the processing resource parameter threshold, and the graphics processing parameter is greater than or equal to the graphics processing parameter threshold, and the memory bandwidth parameter is greater than or equal to the memory bandwidth parameter threshold, then the refresh rate support information of the marked layer is that the refresh rate supported by the OSD layer has reached the first refresh rate.

[0157] If the processing resource parameter is less than the processing resource parameter threshold, and / or the graphics processing parameter is less than the graphics processing parameter threshold, and / or the memory bandwidth parameter is less than the memory bandwidth parameter threshold, then the refresh rate support information for the marked layer is that the refresh rate supported by the OSD layer has not reached the first refresh rate.

[0158] In some embodiments, setting the refresh rate of the OSD layer according to layer refresh rate support information further includes:

[0159] If the layer refresh rate support information indicates that the OSD layer supports a refresh rate that reaches the first refresh rate, then the refresh rate of the OSD layer is set to the physical refresh rate of the monitor; if the layer refresh rate support information indicates that the OSD layer supports a refresh rate that does not reach the first refresh rate, then the refresh rate of the OSD layer is set to the second refresh rate.

[0160] In some embodiments, it also includes:

[0161] In response to a target media asset playback command, the system acquires the media asset data. It then decodes the media asset data to obtain video data. Finally, it controls the image quality processing unit to perform image quality processing on the video data to obtain the media asset image.

[0162] In some embodiments, controlling the display to show a UI image in the OSD layer further includes:

[0163] Perform compositing processing on media asset images and UI images to generate a user interface. Control the display to show the user interface; wherein, the UI image is displayed through the OSD layer, and the media asset image is displayed through the video layer.

[0164] In some embodiments, obtaining the UI image generation time based on the refresh rate of the OSD layer further includes:

[0165] The image display duration is obtained based on the refresh rate of the OSD layer.

[0166] The image generation interval is calculated based on the generation time of the previous frame UI image, the image display duration, and the image request time. The image request time is either the first time or the second time. The first time is the time when the current frame UI image is requested to be generated, and the second time is the time when the current frame UI image is requested to be combined with the video data. If the first time is earlier than the second time, the image request time is the second time. If the first time is later than the second time, the image request time is the first time.

[0167] Calculate the sum of the generation time of the previous frame's UI image and the image generation interval to obtain the generation time of the current frame's UI image.

[0168] In some embodiments, after controlling the display to show the UI image in the OSD layer, the method further includes:

[0169] Detect the video data display status on the monitor. If video data is being displayed on the monitor, obtain the video data ratio information on the monitor. Update the refresh rate of the OSD layer based on the video data ratio information.

[0170] In some embodiments, if the video data ratio information indicates that the display is displaying video data in full screen, updating the refresh rate of the OSD layer further includes:

[0171] The system detects the playback status of the video data. If playback is in progress, it checks the remaining memory bandwidth of the display device and updates the refresh rate of the OSD layer accordingly. If playback is stopped, it controls the image quality processing unit to stop performing image quality processing on the video data.

[0172] In some embodiments, if the video data ratio information indicates that the display is not displaying video data in full screen, updating the refresh rate of the OSD layer further includes:

[0173] The control unit stops performing image quality processing on the video data. The playback status of the video data is detected. If playback is in progress, the remaining memory bandwidth of the display device is detected, and the refresh rate of the OSD layer is updated accordingly. If playback is stopped, the refresh rate of the OSD layer is updated based on the layer refresh rate support information.

[0174] In some embodiments, updating the refresh rate of the OSD layer based on the remaining percentage of memory bandwidth further includes:

[0175] The target memory bandwidth percentage range corresponding to the remaining memory bandwidth percentage is obtained based on a preset refresh rate list. The refresh rate list stores the correspondence between multiple memory bandwidth percentage ranges and refresh rates. The target refresh rate corresponding to the target memory bandwidth percentage range is obtained, and the refresh rate of the OSD layer is updated to set the target refresh rate.

[0176] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0177] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0178] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0179] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of embodiments suitable for specific application considerations.

Claims

1. A display device, characterized by comprising: The system comprises: a display; an image generation unit configured to generate a UI image; a controller configured to: obtain system configuration information of a display device, and obtain layer refresh rate support information according to the system configuration information, the layer refresh rate support information being used to represent whether a refresh rate supported by an OSD layer reaches a first refresh rate; if the layer refresh rate support information is that the refresh rate supported by the OSD layer reaches the first refresh rate, set the refresh rate of the OSD layer to a physical refresh rate of the display; if the layer refresh rate support information is that the refresh rate supported by the OSD layer does not reach the first refresh rate, set the refresh rate of the OSD layer to a second refresh rate; in response to an instruction indicating to generate a UI image, obtain a UI image generation time according to the refresh rate of the OSD layer; control the image generation unit to generate a UI image according to the UI image generation time; control the display to display the UI image in the OSD layer.

2. The display device of claim 1, wherein, The system configuration information comprises a processing resource parameter, a graphics processing parameter and a memory bandwidth parameter; the controller, when performing the operation of obtaining layer refresh rate support information according to the system configuration information, is further configured to: if the processing resource parameter is greater than or equal to a processing resource parameter threshold value, the graphics processing parameter is greater than or equal to a graphics processing parameter threshold value, and the memory bandwidth parameter is greater than or equal to a memory bandwidth parameter threshold value, mark the layer refresh rate support information as that the refresh rate supported by the OSD layer reaches the first refresh rate; if the processing resource parameter is less than the processing resource parameter threshold value, and / or, the graphics processing parameter is less than the graphics processing parameter threshold value, and / or, the memory bandwidth parameter is less than the memory bandwidth parameter threshold value, mark the layer refresh rate support information as that the refresh rate supported by the OSD layer does not reach the first refresh rate.

3. The display device of claim 1, wherein, Further comprising: a picture processing unit; the controller is further configured to: in response to a target media asset playing instruction, obtain media asset data of a target media asset; perform decoding on the media asset data to obtain video data; control the picture processing unit to perform picture processing on the video data to obtain a media asset image; the controller, when performing the operation of controlling the display to display the UI image in the OSD layer, is further configured to: perform synthesis processing on the media asset image and the UI image to generate a user interface; control the display to display the user interface; wherein the UI image is displayed through the OSD layer, and the media asset image is displayed through a video layer.

4. The display device of claim 3, wherein, The controller, when performing the operation of obtaining a UI image generation time according to the refresh rate of the OSD layer, is further configured to: obtain an image display duration according to the refresh rate of the OSD layer; calculate an image generation interval according to a generation time of a previous frame of UI image, the image display duration and an image request time; the image request time is a first time or a second time, the first time is a time of requesting to generate a current frame of UI image, and the second time is a time of requesting to synthesize the current frame of UI image and video data; if the first time is earlier than the second time, the image request time is the second time; If the first time is later than the second time, the image request time is the first time; The sum of the generation time of the last frame of UI image and the image generation interval is calculated to obtain the generation time of the current frame of UI image.

5. The display device of claim 3, wherein, After the controller controls the display to display the UI image in the OSD layer, the controller is further configured to: detect a video data display state of the display; if the display is displaying video data, obtain video data proportion information of the display; update the refresh rate of the OSD layer according to the video data proportion information.

6. The display device of claim 5, wherein, If the video data proportion information indicates that the display is displaying video data in full screen, the controller that updates the refresh rate of the OSD layer is further configured to: detect a playing state of the video data; if the playing state is playing, detect a memory bandwidth remaining proportion of the display device, and update the refresh rate of the OSD layer according to the memory bandwidth remaining proportion; if the playing state is not playing, control the image quality processing unit to stop performing image quality processing on the video data.

7. The display device of claim 5, wherein, If the video data proportion information indicates that the display is not displaying video data in full screen, the controller that updates the refresh rate of the OSD layer is further configured to: control the image quality processing unit to stop performing image quality processing on the video data; detect a playing state of the video data; if the playing state is playing, detect a memory bandwidth remaining proportion of the display device, and update the refresh rate of the OSD layer according to the memory bandwidth remaining proportion; if the playing state is not playing, update the refresh rate of the OSD layer according to the layer refresh rate support information.

8. The display device according to claim 6 or 7, characterized in that, The controller that updates the refresh rate of the OSD layer according to the memory bandwidth remaining proportion is further configured to: obtain a target memory bandwidth proportion range corresponding to the memory bandwidth remaining proportion based on a preset refresh rate list; the refresh rate list stores a corresponding relationship between a plurality of memory bandwidth proportion ranges and refresh rates; obtain a target refresh rate corresponding to the target memory bandwidth proportion range, and update the refresh rate of the OSD layer to the target refresh rate.

9. A method for setting layer refresh rate, applied to a display device, characterized in that, The method comprises: obtaining system configuration information of a display device, and obtaining layer refresh rate support information according to the system configuration information; the layer refresh rate support information is used to indicate whether a refresh rate supported by an OSD layer reaches a first refresh rate; if the layer refresh rate support information indicates that the refresh rate supported by the OSD layer reaches the first refresh rate, setting the refresh rate of the OSD layer to a physical refresh rate of the display; if the layer refresh rate support information indicates that the refresh rate supported by the OSD layer does not reach the first refresh rate, setting the refresh rate of the OSD layer to a second refresh rate; in response to an instruction indicating generation of a UI image, obtaining a UI image generation time according to the refresh rate of the OSD layer; controlling an image generation unit to generate a UI image according to the UI image generation time; controlling the display to display the UI image in the OSD layer.

Images