Display device and filter effect display method

Abstract

This application provides a display device and a method for displaying filter effects. The method can receive a setting instruction for a target filter mode, wherein the target filter mode is associated with preset target image quality parameters and a preset target color matrix. In response to the setting instruction, a first filter setting interface is invoked, and the target image quality parameters are configured to the video layer through the first filter setting interface. A second filter setting interface is also invoked, and the target color matrix is ​​configured to the graphics layer through the second filter setting interface. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters, and the second filter setting interface is a system-level interface in the display device for configuring filter effect functions in the graphics layer. The method can simultaneously set filter effects for both the video layer and the graphics layer, resulting in a unified filter effect for both layers.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for displaying filter effects. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] The system framework of a display device can be configured with a video plane and an overlay screen display (OSD) layer. Multiple layers are overlaid to create a user interface with rich content. The video plane is the display layer used to present the playback image when the display device plays media. The OSD layer is the display layer used to provide users with various UI elements and information. The display device can specify whether the video or image being played is displayed on the OSD layer or the video plane, thus achieving the desired display effect.

[0004] To improve user experience, display devices can implement various filter effects. If the filter effect is only set for the Video layer or OSD layer, the filter effect displayed on the Video layer and OSD layer will be inconsistent, reducing the display effect. Summary of the Invention

[0005] This application provides a display device and a method for displaying filter effects to solve the problem of inconsistent display effects of different display layers when setting filter effects.

[0006] In a first aspect, this application provides a display device, including a display and a controller. The display is configured to display a user interface; the screen content in the user interface is presented based on a video layer and a graphics layer; the controller is configured to:

[0007] The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are the display parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image.

[0008] In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters.

[0009] The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters;

[0010] Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer;

[0011] The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

[0012] Secondly, this application also provides a filter effect display method, applied to the above-mentioned display device, the method comprising:

[0013] The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are the display parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image.

[0014] In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters.

[0015] The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters;

[0016] Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer;

[0017] The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

[0018] As can be seen from the above technical solutions, this application provides a display device and a method for displaying filter effects. The method can receive a setting instruction for a target filter mode, where the target filter mode is associated with preset target image quality parameters and a preset target color matrix. In response to the setting instruction, a first filter setting interface is invoked, and the target image quality parameters are configured to the video layer through the first filter setting interface. A second filter setting interface is also invoked, and the target color matrix is ​​configured to the graphics layer through the second filter setting interface. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters, and the second filter setting interface is a system-level interface in the display device for configuring filter effect functions in the graphics layer. The method can simultaneously set filter effects for both the video layer and the graphics layer, resulting in a unified filter effect for both layers. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0021] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0022] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0023] Figure 4 Display system structure diagrams provided for some embodiments of this application;

[0024] Figure 5 An architecture diagram of filter mode settings provided in some embodiments of this application;

[0025] Figure 6 A schematic diagram of the comfort vision settings menu interface provided for some embodiments of this application;

[0026] Figure 7 A schematic diagram of the interface of the color vision optimization menu provided in some embodiments of this application;

[0027] Figure 8 A flowchart illustrating the display filter settings menu provided in some embodiments of this application;

[0028] Figure 9The flowchart illustrating the association of image quality parameters and color matrix with filter modes is provided for some embodiments of this application;

[0029] Figure 10 This application provides schematic diagrams illustrating the configuration flow of the Video layer and OSD layer for some embodiments.

[0030] Figure 11 This is a schematic diagram illustrating the process of setting filter effects for the Video layer and OSD layer in some embodiments of this application. Detailed Implementation

[0031] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0032] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0033] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0034] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0035] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0036] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0037] Figure 1This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0038] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0039] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0040] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0041] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0042] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0043] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0044] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0045] In some embodiments, the device interface 240 is used to connect external devices. These include, but are not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), and RGB port. It can also be a composite input / output interface formed by multiple of the above interfaces. For example, the display device 200 can connect an external camera via the USB interface to capture image data of the external environment scene and display it on the monitor 260.

[0046] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0047] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0048] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0049] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0050] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0051] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0052] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0053] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0054] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0055] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0056] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0057] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0058] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0059] like Figure 3 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0060] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0061] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0062] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The kernel layer can contain at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0063] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0064] Based on the aforementioned display device 200, specific images can be displayed. For example, playback images, control interfaces, and other application interfaces. Figure 4 As shown, the display device 200 can render and display images in real time through an image producer module, an image renderer module, a compositer module, a video processing unit hardware (VPU hardware) module, and a screen.

[0065] During the display process, the graphics interface (OpenGLES) of the image generation module can connect to the application on the display device 200 to generate image content and pass it to the image rendering module. The image rendering module controls the display content on the monitor 260, that is, it renders the image content through the user interaction layer (UI layer) or video layer based on the image content. To obtain a better display effect, the image content of the UI layer can be rendered by the GPU component, thereby forming a screen frame for display in the compositing module. The compositing module can form the screen content through software or hardware; for example, the compositing module can be a hardware compositing (HWC) module.

[0066] The compositing module stores image frames using frame buffers and video buffers, and the video processing module forms the image content on the corresponding layers. Specifically, image frames generated during video playback are processed through the video plane to form the image content, while image frames from other graphic elements (such as touch traces and graphics) are processed through the Overlay Screen Display (OSD) layer. Finally, the display device 200 uses the blending unit of the video processing module to create the final image, which is then displayed on the monitor 260.

[0067] In the above embodiments, the display device 200 can display multiple layers overlaid during the display of the user interface, and different layers have different display modes.

[0068] In some embodiments, the display device 200 can display images through a Video layer and an OSD layer. The Video layer can establish a connection with the media player in the image generation module to display the image content generated by the media player through playing media asset data. For example, when the display device 200 plays video media assets, the media player can parse the media asset data to form multiple frames of media asset images, and send these frames to the Video layer to form a video playback image. The Video layer can display images based on the content, format, type, decoding specifications, and image quality parameters of the media asset data, thereby achieving a better image display effect.

[0069] It should be noted that the Video layer is not only used to display video media assets, but also other types of media assets. For example, the Video layer can also display image details, meaning that image-type media asset data can be displayed in the Video layer.

[0070] In some embodiments, the display device 200 can also perform image quality processing on the image content displayed on the Video layer, such as contrast adjustment, brightness adjustment, and color correction, to improve the image quality displayed on the Video layer. For example, the operating system of the display device 200 can preset multiple image quality mode options, including standard, soft, vivid, and eye-friendly. The user can select one of the image quality modes according to their viewing needs, and the display device 200 can then perform image quality processing on the displayed image content according to the selected image quality mode. For example, when the user selects the vivid mode, the display device 200 will enhance the color saturation and brightness of the image content through the Video layer, making the image content more vivid and bright, and then display the image frame with the adjusted image quality through the Video layer.

[0071] The OSD layer can refresh and display image-related information in real time based on the interactive operation process of the display device 200. This includes information such as graphics, text, and icons. Of course, the OSD layer is not only used to display image-type media content, but also other types of media content. For example, the OSD layer can also display video-type media content; that is, the media images obtained by parsing video media can be displayed in the OSD layer.

[0072] Understandably, the Video layer can adjust the image quality of media asset data to achieve image quality processing for the displayed image. The OSD layer, however, does not have the image quality processing capabilities of the Video layer and cannot directly perform image quality adjustments on media asset data.

[0073] To improve smoothness and high-quality display, the display device 200 achieves its display process through the cooperation of the Video layer and the OSD layer. The Video layer displays video media content, while the OSD layer displays various UI elements and information. For example, the Video layer displays video data, while the OSD layer displays various controls for managing the video data, such as pause buttons, progress bars, and volume controls. The OSD layer can be displayed above the Video layer, allowing graphics and other content displayed by the OSD layer to appear on the video playback screen, enabling users to perform interactive operations based on the content displayed by the OSD layer.

[0074] In some embodiments, to improve the user experience, the display device 200 can adjust parameters such as color saturation, contrast, and brightness to allow the displayed content to exhibit different filter effects. For example, color enhancement filters, black and white filters, retro filters, and soft filters can be set according to the user's preferences. For example, for users with color blindness or color weakness, red / green filters, green / red filters, blue / yellow filters, and grayscale modes can be set. For instance, for users with red blindness or red weakness, their ability to distinguish red is lost or weakened, and their sensitivity to the red end of the spectrum is reduced, thus perceiving red as a dark color. Therefore, a red / green filter can be set. For users with green blindness or green weakness, their ability to distinguish green is lost or weakened, and they perceive green as dark black or gray. Therefore, a green / red filter can be set. For users with blue blindness or blue weakness, their ability to distinguish blue and yellow is confused, but they can distinguish red and green. Therefore, a blue / yellow filter can be set. For users with total color blindness, their ability to distinguish colors at all is completely lost, and they only distinguish between light and dark black, gray, and white. They perceive red and green as dark, and yellow and blue as bright. Therefore, a grayscale mode can be set.

[0075] Based on the above display system structure, the image content presented by the display device 200 is based on the Video layer and the OSD layer. In order to improve the image display effect, the display device 200 can simultaneously set the filter effects of the Video layer and the OSD layer, so that the Video layer and the OSD layer ultimately present a unified image display effect.

[0076] In some embodiments, such as Figure 5 The diagram shows the architecture of filter mode settings provided in this application embodiment. The display device 200 includes a settings application in its application layer. This setting application encapsulates a filter settings menu for controlling filter effect settings, allowing user interaction to adjust the display of different filter effects. The filter settings menu includes filter options for multiple filter modes. The display device 200 can respond to a display command for displaying the filter settings menu, controlling the display 260 to display the filter settings menu. When the display 260 displays the filter settings menu, it can respond to a selection command for a target filter option, generating a setting command for the target filter mode corresponding to that option. Responding to this setting command, corresponding display parameters can be set for the Video layer and OSD layer according to the target filter mode, resulting in a unified filter effect for both layers.

[0077] For example, a user can access the comfort viewing settings menu provided by the display device 200 through the control device 100, so that the monitor 260 displays a comfortable viewing experience. Figure 6 The menu interface shown includes several visual settings such as light sensitivity brightness, light sensitivity color temperature, eye protection mode, and color vision optimization.

[0078] When the settings menu is displayed on monitor 260, the user clicks the "Color Optimization" option in the settings menu via control device 100, so that display device 200 controls monitor 260 to display the color optimization menu, i.e. Figure 7 The menu interface shown is as follows. This color vision optimization menu includes filter options such as no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Users can choose the appropriate filter effect mode according to their own needs.

[0079] When a user clicks the "Red / Green Filter" option in the color optimization menu via control device 100, display device 200 can detect the confirmation key value input by control device 100 and generate a setting command for the red / green filter mode based on the current focus location of the filter option. In response to this setting command, the Video layer and OSD layer can be set simultaneously, so that the Video layer and OSD layer present the filter effect of the red / green filter mode.

[0080] In some embodiments, different display device 200 models support different functions. Therefore, the display device 200 can detect whether it supports filter adjustment functions. If the display device 200 supports filter adjustment functions, filter setting operations for the Video layer and OSD layer can be performed. If the display device 200 does not support filter adjustment functions, filter setting operations for the Video layer and OSD layer will not be performed.

[0081] In some embodiments, whether the display device 200 supports filter adjustment functionality can be determined based on the overall attribute list of the display device 200. The overall attribute list includes a series of inherent characteristics and functions of the display device 200, including but not limited to hardware configuration, software version, technical specifications, and other attribute information. Therefore, as... Figure 8 As shown, the display device 200 can obtain the overall attribute list (S801) and read the filter attribute value from the overall attribute list (S802). The filter attribute value is used to indicate whether the display device 200 supports the filter adjustment function. If the filter attribute value is the first attribute value, it means that the display device 200 supports the filter adjustment function, and the display 260 can be controlled to display the filter setting menu (S803). If the filter attribute value is the second attribute value, it means that the display device 200 does not support the filter adjustment function, and the display 260 is controlled not to display the filter setting menu (S804).

[0082] For example, the first attribute value can be 1, indicating that the display device 200 supports the filter adjustment function, and the second attribute value can be 0, indicating that the display device 200 does not support the filter adjustment function.

[0083] In some embodiments, the display device 200 supports a power-on / off memory function for filter modes. When the display device 200 is powered off, it records the current filter mode settings. When the display device 200 is powered on again, it automatically loads and applies the corresponding filter mode based on the previously recorded settings. That is, in response to a power-off command, the display device 200 can record the current filter mode. In response to a power-on command, the display device 200 can retrieve the filter mode recorded during the last power-off and automatically set the corresponding filter parameters for the Video layer and OSD layer based on the recorded filter mode to ensure consistent display effects before and after power-on / off.

[0084] In some embodiments, the display device 200 may also change its current display mode from a filtered mode to an unfiltered mode in response to a setting command instructing it to restore factory settings. That is, when the display device 200 restores its factory settings, it will adjust the display mode to the default mode at the factory, i.e., the unfiltered mode, and the display device 200 will display the original image colors without any filtering.

[0085] In some embodiments, for setting filter effects in the Video layer and OSD layer, the display device 200 can pre-configure the image quality parameters and color matrix corresponding to different filter modes. When setting a filter mode, the image quality parameters and color matrix associated with that filter mode can be directly obtained, and the image quality parameters can be configured in the Video layer, while the color matrix can be configured in the OSD layer. By configuring the image quality parameters and color matrix associated with the filter mode for both the Video layer and the OSD layer simultaneously, a unified filter effect can be achieved for both the Video layer and the OSD layer.

[0086] Among them, the image quality parameters are the display gain parameters in the Video layer that determine the display effect of the image, including parameters related to image display such as color space, color depth, contrast, brightness, and saturation. The color matrix is ​​a transformation matrix that performs pixel value transformations on the image. It can perform linear transformations on the image pixels through matrix operations. For example, the color matrix can be a ColorMatrix, which is a 4x5 floating-point numerical matrix. By performing a matrix multiplication operation between the ColorMatrix and the color value matrix of the image pixels, a new color value matrix is ​​obtained, thereby changing the display effect of the image.

[0087] In some embodiments, such as Figure 9As shown, the display device 200 can define filter type parameters for a filter mode (S901), and set image quality parameters and a color matrix for the filter mode (S902). The filter type parameters characterize the type of filter mode. Then, the association between the image quality parameters and the filter type parameters is established (S903), and the association between the color matrix and the filter type parameters is established (S904). Finally, the image quality parameters and the color matrix are stored (S905). When a target filter mode is set, the target filter type parameters of the target filter mode can be obtained, and the target image quality parameters and target color matrix associated with the target filter mode can be queried based on these target filter type parameters.

[0088] For example, with Figure 7 Taking the filter settings menu as an example, the menu includes five filter modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Values ​​from 0 to 4 can be used as filter type parameters to represent these five modes, respectively. Based on these filter type parameters, corresponding image quality parameters and color matrices are set for each filter mode.

[0089] In some embodiments, when the display device 200 sets the image quality parameters and color matrix of the filter mode, it can acquire a basic sample image and a target sample image, and set the image quality parameters and color matrix of the filter mode according to the basic sample image and the target sample image, wherein the basic sample image is an image without filter effect, and the target sample image is an image with target filter effect.

[0090] For the color matrix, the display device 200 can obtain the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image, calculate the ratio between the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image, and use the ratio as the color matrix.

[0091] Regarding image quality parameters, the display device 200 can acquire the display parameters of the target sample image and the display parameters of the base sample image, calculate the difference between the display parameters of the target sample image and the base sample image, and use this difference as the image quality parameter. That is, the image quality parameter includes an offset parameter value, which is the increase or decrease in the display parameters corresponding to achieving the target filter effect. When configuring the Video layer subsequently, the current image quality parameters of the Video layer can be modified based on the offset in this image quality parameter.

[0092] The display device 200 can also acquire the display parameters of the target sample image and use these parameters as image quality parameters. That is, the image quality parameters include specific display parameters, specifically the display parameters required to achieve the target filter effect. When configuring the Video layer subsequently, the current image quality parameters of the Video layer can be directly changed to these image quality parameters.

[0093] Understandably, by setting image quality parameters and color matrices simultaneously based on sample images with and without filter effects, and configuring them separately in the Video and OSD layers, the consistency of the filter effects ultimately presented in the Video and OSD layers can be improved.

[0094] In some embodiments, such as Figure 10 As shown, for the filter effect settings of the Video layer and OSD layer, the display device 200 can receive the setting instruction of the target filter mode (S1001), wherein the target filter mode is related to the preset target image quality parameters and the target filter mode is related to the preset target color matrix.

[0095] In response to the setting command, the first filter setting interface is invoked (S1002), and the target image quality parameters are configured to the Video layer through the first filter setting interface (S1003), so that the Video layer displays the image based on the target image quality parameters. Simultaneously, the second filter setting interface is invoked (S1004), and the target color matrix is ​​configured to the OSD layer through the second filter setting interface (S1005), so that the OSD layer displays the image according to the target color matrix. By configuring the image quality parameters and color matrix associated with the filter mode for both the Video layer and the OSD layer simultaneously, a unified filter effect is achieved for both the Video layer and the OSD layer.

[0096] The first filter setting interface is a preset interface in the Video layer used to configure image quality parameters. The second filter setting interface is a system-level interface in the display device 200 used to configure filter effect functions in the OSD layer.

[0097] In some embodiments, such as Figure 11 As shown, for the Video layer filter effect setting, the display device 200 can obtain the target filter type parameter of the target filter mode (S1101), and query the target image quality parameter associated with the target filter type parameter (S1102). The image quality parameter is transmitted to the Video layer through the first filter setting interface, and the Video layer adjusts its internal processing mechanism based on the image quality parameter so that the Video layer displays the image based on the target image quality parameter during subsequent playback, presenting the target filter effect.

[0098] In some embodiments, the image quality parameter is a specific display parameter value associated with the filter mode. That is, the display device 200 can call the first filter setting interface to change the current image quality parameter of the Video layer to the target image quality parameter through the first filter setting interface (S1103) so that the Video layer displays the image according to the target image quality parameter.

[0099] In other words, for the filter effect settings of the Video layer, the current image quality parameters of the Video layer can be directly replaced with the specific display parameter values ​​in the image quality parameters associated with the filter mode, so that the Video layer displays the image according to the image quality parameter values ​​associated with the filter mode.

[0100] In some embodiments, the image quality parameter is the offset parameter value associated with the filter mode. That is, the display device 200 can call the first filter setting interface, read the current image quality parameter of the Video layer through the first filter setting interface, and modify the current image quality parameter of the Video layer based on the offset in the target image quality parameter (S1104) so ​​that the Video layer displays the image according to the modified image quality parameter.

[0101] In other words, the filter effect settings for the Video layer can be adjusted based on the offset parameter value associated with the filter mode, on the basis of the current image quality parameters of the Video layer. That is, the current image quality parameters are added or subtracted to modify the current image quality parameters, so that the Video layer displays the image according to the modified image quality parameters.

[0102] Understandably, for the two configuration methods described above, directly adjusting the current image quality parameters of the Video layer to specific values ​​directly replaces the current image quality parameters of the Video layer with new, specific values. This means that all previous image quality parameter settings for the Video layer will be overwritten by the new values, resulting in the display device 200 only displaying one filter effect. On the other hand, adjusting parameter values ​​based on the current image quality parameters of the Video layer preserves the current image quality parameter settings and overlays new image quality parameter adjustments on top of them, allowing the display device 200 to display multiple filter overlay effects.

[0103] For example, if the current Video layer has already been configured with the image quality parameters for the eye protection mode, when setting the red / green filter mode, the image quality parameters of the red / green filter mode will be adjusted on top of the image quality parameters of the eye protection mode, so that the effect of the red / green filter and the effect of the eye protection mode are superimposed together.

[0104] The following is based on Figure 7 Using the five filter modes shown as examples, we will explain the filter effect settings for the Video layer.

[0105] In order to achieve Figure 7 The five filter modes shown indicate that the display device 200 can set a first filter setting interface in the Video layer, and define a process named hsTVSetColorVisionOptimization in the first filter setting interface to set the filter effects. This process includes an identifier (key): s32OptMode. The s32OptMode parameter specifies the type of filter effect, and also includes parameter values ​​associated with the key, representing different filter effect types. The values ​​are numbers from 0 to 4, representing no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode, respectively. Figure 7 The interface shown has no filter options for red / green, green / red, blue / yellow, or grayscale mode.

[0106] This process can receive s32OptMode as an input parameter and load and apply the corresponding image quality parameters required for the filter effects based on the value of this parameter. In the Video layer, when the hsTVSetColorVisionOptimization process is called, it can read the s32OptMode parameter, load the image quality parameters corresponding to the s32OptMode parameter, and thus display the image according to those image quality parameters.

[0107] To implement the above five filter modes, the display device 200 can pre-associate a set of fixed image quality parameters with each filter mode. The optimization principle for the red / green filter mode is to reduce green; the optimization principle for the green / red filter mode is to increase red; the optimization principle for the blue / yellow filter mode is to increase blue; and the optimization principle for the grayscale mode is to set the saturation to 0. The preset image quality parameters may include the offset of white balance parameters and color correction parameters, and the current image quality parameters of the Video layer are adjusted by the offset.

[0108] The table below shows detailed information on image quality parameters.

[0109]

[0110] Taking setting a red / green filter as an example:

[0111] Users Figure 7In the interface shown, select the filter option corresponding to the red / green filter. The settings application will call the first filter setting interface and set the value of the s32OptMode parameter to 1. In the Video layer, this interface will load the image quality parameters corresponding to the red / green filter effect based on the received s32OptMode parameter, and adjust the current image quality parameters of the Video layer based on the image quality parameters corresponding to the red / green filter effect. By adjusting the current image quality parameters of the Video layer by the offset, the relative intensity of red and green in the image can be changed, thus presenting the red / green filter effect.

[0112] The table below shows the offsets for white balance and color correction parameters corresponding to different filter effects. " / " indicates no adjustment is needed, "+" indicates an increase, and "-" indicates a decrease. For example, for a red / green filter, you can increase R by A1, decrease G by B1, and increase B by C1 in the current white balance parameters. Similarly, you can increase the saturation of red by E1, decrease the hue of yellow by G1, increase the saturation of purple by H1, and increase the hue of skin tone by I1 in the current color correction parameters.

[0113]

[0114] In some embodiments, for OSD layer filter effect settings, the display of the OSD layer is implemented by calling the native interface of the operating system of the display device 200. Therefore, the display device 200 can enable and configure filter effect functions based on the native interface (settings.secure) in the operating system. That is, the filter setting item identifier (accessibility_display_daltonizer_enabled) and filter type item identifier (accessibility_display_daltonizer) in the operating system can be set through the settings.secure interface. The two identifiers (keys) accessibility_display_daltonizer_enabled and accessibility_display_daltonizer are used to control the enabling and type of filter effect functions of the display device 200.

[0115] The filter setting item identifier controls the operating status of the filter effect function, indicating whether the OSD layer filter effect function is enabled. When the filter setting item identifier is set to the first parameter, the OSD layer filter effect function is enabled; when the filter setting item identifier is set to the second parameter, the OSD layer filter effect function is disabled.

[0116] Therefore, the display device 200 detects the current display mode, which is either a filter-enabled mode or a filter-free mode. If the current display mode is not a filter-free mode, it calls the second filter setting interface, namely the settings.secure interface, and sets the filter setting item identifier to the first parameter through the second filter setting interface to enable the OSD layer filter effect function. If the current display mode is a filter-free mode, it sets the filter setting item identifier to the second parameter through the second filter setting interface to disable the OSD layer filter effect function.

[0117] For example, with Figure 7 The following examples illustrate five filter modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. When setting the no filter mode, the filter setting indicator can be set to 0 to disable the OSD layer filter effect. When setting the other four filter modes, the filter setting indicator can be set to 1 to enable the OSD layer filter effect.

[0118] The filter type identifier is used to set the type of filter mode, representing the type of filter mode in the OSD layer. This filter type identifier can use different parameter values ​​to represent different filter modes. In some embodiments, the filter type identifier can be synchronized with the filter type parameters representing the filter mode defined by the display device 200. That is, the display device 200 can obtain the target filter type parameters of the target filter mode and set the filter type identifier to the target filter type parameters through the second filter setting interface.

[0119] For example, with Figure 7 The example shown includes five filter modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Values ​​from 0 to 4 are used as filter type parameters to represent these five modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Correspondingly, the filter type identifier can be set to values ​​from 1 to 4 to represent different filter modes, indicating that when the OSD layer filter effect function is enabled, the OSD layer filter mode is one of four: red / green filter, green / red filter, and blue / yellow filter.

[0120] Based on the aforementioned second filter setting interface, when setting the target filter mode, such as Figure 11As shown, the display device 200 can obtain the filter type item identifier as the target filter type parameter (S1101), query the target color matrix associated with the target filter type parameter (S1105), and map it to the Framework layer of the display device 200. It then changes the current color matrix set in the Framework layer to the target color matrix (S1106) to configure the target color matrix in the OSD layer. When a screen needs to be displayed, it can obtain the original color value matrix of the pixels in the screen to be displayed, calculate the target color value matrix based on the target color matrix set in the Framework layer, and display the screen to be displayed in the OSD layer according to the target color value matrix. The target color value matrix is ​​obtained by performing matrix multiplication between the target color matrix and the original color value matrix.

[0121] In other words, by calling the settings.secure interface to modify the system settings in the Framework layer of the operating system, the color matrix configured in the Framework layer is changed, so that the Framework layer can apply the target color matrix associated with the target filter mode to the graphics rendering process, so as to process the image to be displayed through the target color matrix and display the processed image data through the OSD layer, thereby presenting the target filter effect.

[0122] The following is based on Figure 7 Using the five filter modes shown as examples, we will explain the filter effect settings for the OSD layer.

[0123] In order to achieve Figure 7 The five filter modes shown can be enabled and configured on display device 200 via the settings.secure interface. In the Android system, the two identifiers (keys) accessibility_display_daltonizer_enabled and accessibility_display_daltonizer are used to control the enabling and type of filter effects.

[0124] When `accessibility_display_daltonizer_enabled` is 0, the filter effect is turned off. When `accessibility_display_daltonizer_enabled` is 1, the filter effect is turned on. `accessibility_display_daltonizer` has values ​​from 1 to 4, representing four filter modes: red / green, green / red, blue / yellow, and grayscale. Adjusting these two parameters allows you to achieve different filter effects.

[0125] Taking setting a red / green filter as an example:

[0126] Users Figure 7 In the interface shown, selecting the filter option corresponding to the red / green filter triggers the settings application to call the `settings.secure` interface, setting `accessibility_display_daltonizer_enabled` to 1 and `accessibility_display_daltonizer` to 1. At the Framework layer, when a change in the settings in `Settings.Secure` is detected, the color matrix `ColorMatrix` corresponding to the red / green filter effect is loaded based on the value of `accessibility_display_daltonizer`. The modified `ColorMatrix` is then applied to the image rendering process at the Framework layer, and all image data processed by the Framework layer has its color values ​​adjusted according to this `ColorMatrix`. Finally, the processed image data is displayed through the OSD layer.

[0127] Images and videos are composed of pixel arrays and color values. A pixel array is a matrix containing pixels, and color values ​​include RGBA values, where A is the transparency, R is the red channel component, G is the green channel component, and B is the blue channel component. ColorMatrix can change the color values ​​of image pixels based on matrix multiplication operations.

[0128] For example, if the color matrix ColorMatrix is ​​a 4x5 matrix A, and the pixel value matrix of the pixels in the image to be displayed is C, the color value of the pixels can be changed according to the following formula:

[0129]

[0130] In this matrix, A is the ColorMatrix. The first row determines the red channel component of the new color, the second row determines the green channel component, the third row determines the blue channel component, and the fourth row determines the transparency. The values ​​in the fifth column determine the offset of each component. Matrix C is the original pixel value matrix of the image to be displayed, and matrix R is the final pixel value matrix of the image. The filter effect is adjusted by changing the color offset or the corresponding RGBA value coefficients.

[0131] In this embodiment, the filter effects are set simultaneously for both the Video layer and the OSD layer, ensuring a unified filter effect across both. The Video layer uses an interface to configure image quality parameters, allowing for adjustments to these parameters to achieve the desired filter effect. The OSD layer modifies system settings within the Framework layer by calling native interfaces of the operating system, changing the color matrix configured in the Framework layer, and then applying the color matrix to achieve the corresponding filter effect.

[0132] Furthermore, it should be understood that, for Figure 9 , Figure 10 , Figure 11 The specific order in which the operations are described herein is merely exemplary and is not intended to indicate that this order is the only possible order in which these operations can be performed. Those skilled in the art will readily conceive of various ways to reorder the operations described herein.

[0133] Based on the aforementioned display device 200, some embodiments of this application also provide a filter effect display method, applied to the display device 200 described in the above embodiments. The display device 200 may include a display 260 and a controller 250. The display 260 is configured to display a user interface. The screen content in the user interface is presented based on a video layer and a graphics layer. The method includes the following steps:

[0134] Receive the setting command for the target filter mode. The target filter mode is related to the preset target image quality parameters and the preset target color matrix. The target image quality parameters are the display parameters of the image. The color matrix is ​​the transformation matrix that performs pixel value transformation on the image.

[0135] In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer used to configure image quality parameters.

[0136] The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters.

[0137] Call the second filter settings interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer.

[0138] Configure the target color matrix to the graphics layer through the second filter settings interface so that the graphics layer displays the image based on the target color matrix.

[0139] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0140] As can be seen from the above technical solutions, the display device and filter effect display method provided in the above embodiments can receive a setting instruction for a target filter mode. The target filter mode is associated with preset target image quality parameters and a preset target color matrix. In response to the setting instruction, a first filter setting interface is invoked, and the target image quality parameters are configured to the video layer through the first filter setting interface. A second filter setting interface is also invoked, and the target color matrix is ​​configured to the graphics layer through the second filter setting interface. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters, and the second filter setting interface is a system-level interface in the display device for configuring filter effect functions in the graphics layer. The method can simultaneously set filter effects for both the video layer and the graphics layer, enabling both layers to present a unified filter effect.

[0141] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0142] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0143] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The display is configured to show a user interface, the screen content of which is presented based on a video layer and a graphics layer. The controller is configured as follows: The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are display gain parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image. In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters. The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters; Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer; The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

2. The display device according to claim 1, characterized in that, The controller is also configured to: Define the filter type parameter for the filter mode, which is used to characterize the type of filter mode; Obtain a basic sample image and a target sample image, wherein the basic sample image is an image without any filter effect, and the target sample image is an image with the target filter effect; The image quality parameters of the filter mode are set according to the basic sample image and the target sample image. The image quality parameters are the difference between the display parameters of the target sample image and the display parameters of the basic sample image, or the image quality parameters are the display parameters of the target sample image. A color matrix is ​​set based on the basic sample image and the target sample image, wherein the color matrix is ​​the ratio between the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image; Establish the association between the image quality parameters and the filter type parameters, and establish the association between the color matrix and the filter type parameters; Store the image quality parameters and the color matrix.

3. The display device according to claim 2, characterized in that, The controller is configured to configure the target image quality parameters to the video layer through the first filter setting interface, and is also configured to: Obtain the target filter type parameter of the target filter mode; Query the target image quality parameters associated with the target filter type parameter; The target image quality parameters are configured to the video layer through the first filter setting interface.

4. The display device according to claim 3, characterized in that, The controller is configured to configure the target image quality parameters to the video layer through the first filter setting interface, and is also configured to: The current image quality parameters of the video layer are changed to the target image quality parameters through the first filter setting interface, so that the video layer displays the image according to the target image quality parameters.

5. The display device according to claim 3, characterized in that, The controller is configured to configure the target image quality parameters to the video layer through the first filter setting interface, and is also configured to: The current image quality parameters of the video layer are read through the first filter setting interface; The current image quality parameters of the video layer are modified based on the offset in the target image quality parameters so that the video layer displays the image according to the modified image quality parameters.

6. The display device according to claim 1, characterized in that, The controller is also configured to: Detect the current display mode, which is either a filter mode or a no-filter mode; If the current display mode is not the no-filter mode, the filter setting item identifier is set to the first parameter through the second filter setting interface. The first parameter is used to indicate that the filter effect function of the graphics layer is enabled. If the current display mode is no filter mode, the filter setting item identifier is set to the second parameter through the second filter setting interface. The second parameter is used to indicate that the filter effect function of the graphics layer is turned off.

7. The display device according to claim 2, characterized in that, The controller executes the configuration of the target color matrix to the graphics layer through the second filter setting interface, and is also configured to: Obtain the target filter type parameter of the target filter mode; The filter type item identifier is set to the target filter type parameter through the second filter setting interface. The filter type item identifier is used to characterize the type of filter mode of the graphics layer. Query the target color matrix associated with the target filter type parameter; The current color matrix set in the display device frame layer is changed to the target color matrix to configure the target color matrix into the graphics layer.

8. The display device according to claim 7, characterized in that, The controller is also configured to: Obtain the original color value matrix of pixels in the image to be displayed; The target color value matrix is ​​calculated based on the target color matrix set in the framework layer. The target color value matrix is ​​obtained by performing matrix multiplication between the target color matrix and the original color value matrix. The image to be displayed is shown in the graphics layer according to the target color value matrix.

9. The display device according to claim 1, characterized in that, The controller is also configured to: Get the list of system properties; Read the filter attribute value from the overall device attribute list; If the filter attribute value is the first attribute value, then the filter settings menu is displayed. The filter settings menu includes filter options for multiple filter modes. The first attribute value is used to indicate that the display device supports filter adjustment functions. If the filter attribute value is the second attribute value, the filter settings menu will not be displayed. The second attribute value is used to indicate that the display device does not support the filter adjustment function.

10. A method for displaying filter effects, characterized in that, Applied to the display device according to any one of claims 1-9, the method comprises: The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are display gain parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image. In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters. The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters; Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer; The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

Images