Display device and processing method for display device

Abstract

The present application provides a display device and a processing method for a display device. The display device can receive a configuration instruction for a target filter mode, wherein the target filter mode has an association relationship with preset target picture quality parameters and a preset target color matrix; in response to the configuration instruction, a first filter configuration interface is invoked, and the target picture quality parameters of a video layer are configured by means of the first filter configuration interface; a second filter configuration interface is invoked, and the target color matrix of a graphic layer is configured by means of the second filter configuration interface, wherein the first filter configuration interface is an interface preconfigured in the video layer and used for configuring picture quality parameters, and the second filter configuration interface is a system-level interface used for configuring a filter effect function of the graphic layer in the display device. In this way, the display device can simultaneously perform filter effect configuration on the video layer and the graphic layer, so that the video layer and the graphic layer present the same filter effect.

Description

A display device and a processing method for the display device.

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese patent applications filed on April 25, 2024, application number 202410504161.8, and filed on December 31, 2024, application number 202411983110.4, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of display device technology, and in particular to a display device and a processing method for the display device. Background Technology

[0004] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0005] The system framework of a display device can be configured with layers such as a video plane and an OSD (Overlay Screen Display). Multiple layers are overlaid to create a user interface with rich content. The video layer is the display layer used to present the playback image when the display device plays media. The OSD layer is the display layer used to provide users with various UI elements and information. The display device can specify whether the video or image being played is displayed on the OSD layer or the video layer, thus achieving the desired display effect.

[0006] To improve user experience, display devices can implement various filter effects. If the filter effect is only set for the Video layer or OSD layer, the filter effect displayed on the Video layer and OSD layer will be inconsistent, reducing the display effect. Summary of the Invention

[0007] According to some embodiments of this application, a display device is provided, which may include a display, a memory, and at least one processor. The display can be configured to display a user interface; the screen content in the user interface is presented based on a video layer and a graphics layer; the memory can be configured to store a computer program; the at least one processor is connected to the display and the memory, and can be configured to execute the computer program to cause the display device to perform: receiving a setting instruction for a target filter mode, the target filter mode being associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters being display parameters of the image; the color matrix being a transformation matrix that performs pixel value transformation on the image; responding to the setting instruction, calling a first filter setting interface, the first filter setting interface being a preset interface in the video layer for configuring image quality parameters; configuring the target image quality parameters to the video layer through the first filter setting interface so that the video layer displays the image based on the target image quality parameters; calling a second filter setting interface, the second filter setting interface being a system-level interface in the display device for configuring filter effect functions of the graphics layer; configuring the target color matrix to the graphics layer through the second filter setting interface so that the graphics layer displays the image based on the target color matrix.

[0008] According to some embodiments of this application, a processing method for a display device is also provided. The method may include: receiving a setting instruction for a target filter mode, wherein the target filter mode is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters may be display parameters of an image; the color matrix may be a transformation matrix that performs pixel value transformation on the image; responding to the setting instruction, calling a first filter setting interface, wherein the first filter setting interface may be a preset interface in a video layer for configuring image quality parameters; configuring the target image quality parameters to the video layer through the first filter setting interface so that the video layer displays an image based on the target image quality parameters; calling a second filter setting interface, wherein the second filter setting interface may be a system-level interface in the display device for configuring filter effect functions of a graphics layer; configuring the target color matrix to the graphics layer through the second filter setting interface so that the graphics layer displays an image based on the target color matrix. Attached Figure Description

[0009] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of this application;

[0010] Figure 2 is a schematic diagram of the hardware configuration of a display device provided according to some embodiments of this application;

[0011] Figure 3 is a schematic diagram of the software configuration of a display device according to some embodiments of this application;

[0012] Figure 4 is a structural diagram of a display system provided according to some embodiments of this application;

[0013] Figure 5 is an architecture diagram of filter mode settings provided according to some embodiments of this application;

[0014] Figure 6 is a schematic diagram of the settings menu interface for comfortable vision provided according to some embodiments of this application;

[0015] Figure 7 is a schematic diagram of the interface of the color vision optimization menu provided according to some embodiments of this application;

[0016] Figure 8 is a flowchart illustrating the display filter settings menu according to some embodiments of this application;

[0017] Figure 9 is a flowchart illustrating the association of image quality parameters and color matrix with filter modes according to some embodiments of this application;

[0018] Figure 10 is a schematic diagram of the configuration process of the Video layer and OSD layer according to some embodiments of this application;

[0019] Figure 11 is a schematic diagram of the filter effect settings for the Video layer and OSD layer according to some embodiments of this application;

[0020] Figure 12 is a schematic diagram of a scenario illustrating the native Android color correction method according to some embodiments of this application;

[0021] Figure 13 is a schematic flowchart of another processing method for a display device according to some embodiments of this application;

[0022] Figure 14 is a schematic diagram of the wavelength distribution of three types of cone cells according to some embodiments of this application;

[0023] Figure 15 is a schematic diagram of a color correction page scene according to some embodiments of this application;

[0024] Figure 16 is a schematic diagram of a color correction level scenario in a color correction page provided according to some embodiments of this application;

[0025] Figure 17 is a schematic diagram of the logic flow of the native Android image color correction method according to some embodiments of this application;

[0026] Figure 18 is a schematic diagram showing the spatial range seen by a user with no color vision impairment and a user with color vision impairment according to some embodiments of this application;

[0027] Figure 19 is a schematic diagram of the logical flow of an image correction method based on Android native optimization provided in some embodiments of this application;

[0028] Figure 20 is a schematic diagram of the color correction effect provided according to some embodiments of this application;

[0029] Figure 21 is a schematic diagram of the effect of an uncorrected initial image provided according to some embodiments of this application;

[0030] Figure 22 is a schematic diagram of the effect when the correction level is 3 according to some embodiments of this application;

[0031] Figure 23 is a schematic diagram of the effect when the correction level is 5 according to some embodiments of this application;

[0032] Figure 24 is a schematic diagram of the effect when the correction level is 7 according to some embodiments of this application. Detailed Implementation

[0033] The embodiments will now be described in detail, with examples illustrated in the accompanying drawings. The drawings described below are merely some embodiments of this application; those skilled in the art can obtain other drawings based on these drawings without creative effort. In the following description involving the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following examples do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0034] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0035] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0036] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0037] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0038] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, televisions, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0039] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of this application. As shown in Figure 1, a user can operate the display device 200 through touch operation, a mobile terminal 300, and a control device 100. The control device 100 can receive operation commands input by the user and convert these commands into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0040] In some embodiments, the mobile terminal 300 can serve as a control device for performing human-computer interaction between the user and the display device 200.

[0041] In some embodiments, the mobile terminal 300 can also serve as a communication device, which can be used to establish a communication connection with the display device 200 and perform data interaction.

[0042] In some embodiments, the mobile terminal 300 may install software applications with the display device 200 to establish a connection and communication via a network communication protocol, thereby achieving one-to-one control operation and data communication. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 to achieve synchronous display.

[0043] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0044] As also shown in Figure 1, in some embodiments, the display device 200 can also communicate with the server 400 via various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0045] In some embodiments, the display device 200 may provide broadcast television reception functionality, and may also provide intelligent network television functionality with computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0046] Figure 2 is a hardware configuration block diagram of the display device in Figure 1 according to some embodiments of this application.

[0047] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, at least one processor 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0048] In some embodiments, detector 230 may be used to acquire signals of the external environment or interaction with the outside world. For example, detector 230 may include a light receiver, which may be used to acquire ambient light intensity; or, detector 230 may include an image acquisition device, such as a camera, which may be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 may include a sound acquisition device, such as a microphone, which may be used to receive external sounds.

[0049] In some embodiments, the device interface 240 can be used to connect external devices. These may include, but are not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or high-definition component input interfaces (components), Composite Video Broadcast Signal (CVBS) input interface, Universal Serial Bus (USB) input interface, and RGB port. It can also be a composite input / output interface formed by multiple of the above interfaces. For example, the display device 200 can connect an external camera via the USB interface to capture image data of the external environment scene and display it on the monitor 260.

[0050] In some embodiments, the display 260 may include display function components for presenting an image, and driving components for driving the image display. The display 260 may be used to receive and display image signals output from at least one processor 250. For example, the display 260 may be used to display video content, image content, menu control interface components, and user interface (UI) interfaces.

[0051] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0052] In some embodiments, the communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize components such as data cables and interfaces to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly establish a connection through gateways, routers, or connection devices.

[0053] In some embodiments, at least one processor 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output.

[0054] In some embodiments, at least one processor 250 can control the operation of the display device and respond to user operations via various software control programs (computer programs) stored in memory. At least one processor 250 can control the overall operation of the display device 200.

[0055] In some embodiments, at least one processor 250 and tuner 210 may be located in different separate devices, that is, tuner 210 may also be located in an external device of the main device where at least one processor 250 is located, such as an external set-top box.

[0056] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0057] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0058] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0059] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0060] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0061] In some embodiments, the operating system can be divided into different modules or layers according to the functions implemented. For example, as shown in Figure 3, in some embodiments, the system can be divided into four layers, from top to bottom: the Applications layer (hereinafter referred to as the "Application Layer"), the Application Framework layer (hereinafter referred to as the "Framework Layer"), the System Library layer, and the Kernel Layer.

[0062] In some embodiments, the application layer can be used to provide services and interfaces for applications, enabling the display device 200 to run applications and interact with users based on the applications. The application layer can run at least one application, which may be a Windows program included with the operating system, a system settings program, or a clock program, or an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0063] In some embodiments, the framework layer can provide an Application Programming Interface (API) and a programming framework for applications. The application framework layer may include predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications within the application layer. Through the API interface, applications can access system resources and obtain system services during execution.

[0064] As shown in Figure 3, the application framework layer in some embodiments of this application may include a view system, managers, and content providers. The view system can design and implement the application's interface and interactions, and may include lists, grids, text boxes, buttons, etc. Managers may include at least one of the following modules: an Activity Manager for interacting with all running activities in the system; a Location Manager for providing access to system location services to system services or applications; a Package Manager for retrieving various information related to application packages currently installed on the device; a Notification Manager for controlling the display and clearing of notification messages; and a Window Manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0065] In some embodiments, the Activity Manager can be used to manage the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager can be used to manage all window programs, such as obtaining the screen size, determining whether a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, for example, shrinking the display window, shaking the display, or distorting the display.

[0066] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0067] In some embodiments, the kernel layer can be a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as shown in Figure 3, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0068] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0069] Based on the aforementioned display device 200, specific images can be presented. For example, playback images, control interfaces, and other application interfaces. As shown in Figure 4, the display device 200 can render and display images in real time through an image producer module, an image renderer module, a compositor module, a video processing unit (VPU) hardware module, and a screen.

[0070] During the display process, the graphics interface (OpenGLES) of the image generation module can connect to the application on the display device 200 to generate image content and pass it to the image rendering module. The image rendering module can control the display content on the monitor 260, that is, it renders the image content through the user interface layer (UI layer) or video layer based on the image content. To obtain better display effects, the image content of the UI layer can be rendered by the GPU component, thereby forming a frame for display in the compositing module. The compositing module can form the image content through software or hardware; for example, the compositing module can be a hardware compositing (HWC) module.

[0071] The compositing module stores image frames using frame buffers and video buffers, and the video processing module forms the image content on the corresponding layers. Specifically, image frames generated during video playback are processed through the video plane to form the image content, while image frames from other graphic elements (such as touch traces and graphics) are processed through the overlay screen display (OSD) layer. Finally, the display device 200 uses the blending unit of the video processing module to create the final image, which is then displayed on the monitor 260.

[0072] In the above embodiments, the display device 200 can display multiple layers overlaid during the display of the user interface, and different layers have different display modes.

[0073] In some embodiments, the display device 200 can display images through a Video layer and an OSD layer. The Video layer can establish a connection with the media player in the image generation module and can be used to display the image content generated by the media player through playing media asset data. For example, when the display device 200 plays video media assets, the media player can parse the media asset data to form multiple frames of media asset images, and send these multiple frames to the Video layer to form a video playback image. The Video layer can display images based on the content, format, type, decoding specifications, and image quality parameters of the media asset data, thereby obtaining a better image display effect.

[0074] It should be noted that the Video layer can be used not only to display video media assets, but also other types of media assets. For example, the Video layer can also display image details, meaning that image-type media asset data can be displayed in the Video layer.

[0075] In some embodiments, the display device 200 can also perform image quality processing on the image content displayed on the Video layer, such as contrast adjustment, brightness adjustment, and color correction, to improve the image quality displayed on the Video layer. For example, the operating system of the display device 200 can preset multiple image quality mode options, including standard, soft, vivid, and eye-friendly modes. Users can select one of the image quality modes according to their viewing needs, and the display device 200 can then process the displayed image content according to the selected mode. For example, when the user selects the vivid mode, the display device 200 will enhance the color saturation and brightness of the image content through the Video layer, making the image content more vivid and bright, and then display the image frame with the adjusted image quality through the Video layer.

[0076] The OSD layer can refresh and display image-related information in real time based on the interactive operation process of the display device 200. This includes information such as graphics, text, and icons. Of course, the OSD layer can not only display image-type media content, but also other types of media content. For example, the OSD layer can also display video-type media content; that is, the media images obtained by parsing video media can be displayed in the OSD layer.

[0077] Understandably, the Video layer can adjust the image quality of media asset data to achieve image quality processing for the displayed image. The OSD layer, however, does not have the image quality processing capabilities of the Video layer and cannot directly perform image quality adjustments on media asset data.

[0078] To improve smoothness and high-quality display, the display device 200 achieves its display process through the cooperation of the Video layer and the OSD layer. The Video layer displays video media content, while the OSD layer displays various UI elements and information. For example, the Video layer displays video data, while the OSD layer displays various controls for managing the video data, such as pause buttons, progress bars, and volume controls. The OSD layer can be displayed above the Video layer, allowing graphics and other content displayed by the OSD layer to appear on the video playback screen, enabling users to perform interactive operations based on the content displayed by the OSD layer.

[0079] In some embodiments, to improve the user experience, the display device 200 can adjust parameters such as color saturation, contrast, and brightness to allow the displayed content to exhibit different filter effects. For example, color enhancement filters, black and white filters, retro filters, and soft filters can be set according to the user's preferences. For example, for users with color blindness or color weakness, red / green filters, green / red filters, blue / yellow filters, and grayscale modes can be set. For instance, for users with red blindness or red weakness, their ability to distinguish red is lost or weakened, and their sensitivity to the red end of the spectrum is reduced, thus perceiving red as a dark color. Therefore, a red / green filter can be set. For users with green blindness or green weakness, their ability to distinguish green is lost or weakened, and they perceive green as dark black or gray. Therefore, a green / red filter can be set. For users with blue blindness or blue weakness, their ability to distinguish blue and yellow is confused, but they can distinguish red and green. Therefore, a blue / yellow filter can be set. For users with total color blindness, their ability to distinguish colors at all is completely lost, and they only distinguish between light and dark black, gray, and white. They perceive red and green as dark, and yellow and blue as bright. Therefore, a grayscale mode can be set.

[0080] Based on the above display system structure, the image content presented by the display device 200 is based on the Video layer and the OSD layer. In order to improve the image display effect, the display device 200 can simultaneously set the filter effects of the Video layer and the OSD layer, so that the Video layer and the OSD layer ultimately present a unified image display effect.

[0081] In some embodiments, as shown in FIG5, FIG5 is an architecture diagram of filter mode settings provided according to some embodiments of the present application. The application layer of the display device 200 may include a settings application, which may encapsulate a filter settings menu for controlling filter effect settings, for user interaction, to adjust the display of different filter effects. The filter settings menu may include filter options for multiple filter modes. The display device 200 may control the display 260 to display the filter settings menu in response to a display command for displaying the filter settings menu. When the display 260 displays the filter settings menu, it may generate a setting command for the target filter mode corresponding to the selected target filter option in response to a selection command for the target filter option. In response to this setting command, the display parameters of the Video layer and OSD layer can be set accordingly based on the target filter mode, so that the Video layer and OSD layer present a unified filter effect.

[0082] For example, the user can open the settings menu for comfortable vision provided by the display device 200 through the control device 100, so that the display 260 displays the menu interface shown in Figure 6. The settings menu can include multiple visual settings such as light-sensitive brightness, light-sensitive color temperature, eye protection mode, and color vision optimization.

[0083] When the settings menu is displayed on monitor 260, the user can click the "Color Optimization" option in the settings menu through control device 100, so that display device 200 controls monitor 260 to display the color optimization menu, as shown in Figure 7. This color optimization menu can include filter options such as no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Users can select the appropriate filter effect mode based on their needs.

[0084] When a user clicks the "Red / Green Filter" option in the color optimization menu via control device 100, display device 200 can detect the confirmation key value input by control device 100 and generate a setting command for the red / green filter mode based on the current focus location of the filter option. In response to this setting command, the Video layer and OSD layer can be set simultaneously, so that the Video layer and OSD layer present the filter effect of the red / green filter mode.

[0085] In some embodiments, different display device 200 models support different functions. Therefore, the display device 200 can detect whether it supports filter adjustment functions. If the display device 200 supports filter adjustment functions, filter setting operations for the Video layer and OSD layer can be performed. If the display device 200 does not support filter adjustment functions, filter setting operations for the Video layer and OSD layer will not be performed.

[0086] In some embodiments, whether the display device 200 supports filter adjustment functionality can be determined based on the overall attribute list of the display device 200. The overall attribute list may include a series of inherent characteristics and functions of the display device 200, including but not limited to attribute information such as hardware configuration, software version, and technical specifications. Therefore, as shown in FIG8, the display device 200 can obtain the overall attribute list (S801), read the filter attribute value from the overall attribute list (S802), and the filter attribute value can be used to characterize whether the display device 200 supports filter adjustment functionality. Determine whether the filter attribute value is a first attribute value or a second attribute value (S803). If the filter attribute value is a first attribute value, it means that the display device 200 supports filter adjustment functionality, and the display 260 can be controlled to display the filter setting menu (S804). If the filter attribute value is a second attribute value, it means that the display device 200 does not support filter adjustment functionality, and the display 260 is controlled not to display the filter setting menu (S805).

[0087] For example, the first attribute value can be 1, indicating that the display device 200 supports the filter adjustment function, and the second attribute value can be 0, indicating that the display device 200 does not support the filter adjustment function.

[0088] In some embodiments, the display device 200 may support a power-on / off memory function for filter modes. When the display device 200 is powered off, it records the current filter mode settings. When the display device 200 is powered on again, it automatically loads and applies the corresponding filter mode based on the previously recorded settings. That is, in response to a power-off command, the display device 200 can record the current filter mode. In response to a power-on command, the display device 200 can retrieve the filter mode recorded during the last power-off and automatically set the corresponding filter parameters for the Video layer and OSD layer based on the recorded filter mode to ensure consistent display effects before and after power-on / off.

[0089] In some embodiments, the display device 200 may also change its current display mode from a filtered mode to an unfiltered mode in response to a setting command instructing it to restore factory settings. That is, when the display device 200 restores its factory settings, it can adjust the display mode to the factory default mode, i.e., the unfiltered mode, and the display device 200 will display the original image colors without any filtering.

[0090] In some embodiments, for setting filter effects in the Video layer and OSD layer, the display device 200 can pre-configure the image quality parameters and color matrix corresponding to different filter modes. When setting a filter mode, the image quality parameters and color matrix associated with that filter mode can be directly obtained, and the image quality parameters can be configured in the Video layer, while the color matrix can be configured in the OSD layer. By configuring the image quality parameters and color matrix associated with the filter mode for both the Video layer and the OSD layer simultaneously, a unified filter effect can be achieved for both the Video layer and the OSD layer.

[0091] In some embodiments, image quality parameters can be display gain parameters in the Video layer that determine the image display effect, including parameters related to image display such as color space, color depth, contrast, brightness, and saturation. The color matrix can be a transformation matrix that performs pixel value transformations on the image. It can perform linear transformations on the image pixels through matrix operations. For example, the color matrix can be a 4x5 floating-point matrix. By performing matrix multiplication between the ColorMatrix and the color value matrix of the image pixels, a new color value matrix is ​​obtained, thereby changing the image display effect.

[0092] In some embodiments, as shown in FIG9, the display device 200 can define filter type parameters of a filter mode (S901), and set image quality parameters and color matrix of the filter mode (S902). The filter type parameters can be used to characterize the type of filter mode. An association between the image quality parameters and the filter type parameters can be established (S903), and an association between the color matrix and the filter type parameters can be established (S904). The image quality parameters and color matrix can be stored (S905). When a target filter mode is set, the target filter type parameters of the target filter mode can be obtained, and the target image quality parameters and target color matrix associated with the target filter mode can be queried based on the target filter type parameters.

[0093] For example, taking the filter settings menu shown in Figure 7 as an example, the filter settings menu can include five filter modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Values ​​from 0 to 4 can be used as filter type parameters to represent the five filter modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode, respectively. Based on these filter type parameters, corresponding image quality parameters and color matrices are set for each filter mode.

[0094] In some embodiments, when the display device 200 sets the image quality parameters and color matrix of the filter mode, it can acquire a basic sample image and a target sample image, and set the image quality parameters and color matrix of the filter mode according to the basic sample image and the target sample image. The basic sample image can be an image without a filter effect, and the target sample image can be an image with a target filter effect.

[0095] For the color matrix, the display device 200 can obtain the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image, calculate the ratio between the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image, and use the ratio as the color matrix.

[0096] Regarding image quality parameters, the display device 200 can acquire the display parameters of the target sample image and the display parameters of the base sample image, calculate the difference between the display parameters of the target sample image and the base sample image, and use this difference as the image quality parameter. That is, the image quality parameter can include an offset parameter value, which can be the parameter value that is increased or decreased to achieve the target filter effect. When configuring the Video layer subsequently, the current image quality parameter of the Video layer can be modified based on the offset in this image quality parameter.

[0097] In other embodiments, the display device 200 can also acquire the display parameters of the target sample image and use these parameters as image quality parameters. That is, the image quality parameters can include specific display parameters, i.e., the display parameters corresponding to achieving the target filter effect. When configuring the Video layer subsequently, the current image quality parameters of the Video layer can be directly changed to these image quality parameters.

[0098] Understandably, by setting image quality parameters and color matrices simultaneously based on sample images with and without filter effects, and configuring them separately in the Video and OSD layers, the consistency of the filter effects ultimately presented in the Video and OSD layers can be improved.

[0099] In some embodiments, as shown in FIG10, for setting the filter effects of the Video layer and the OSD layer, the display device 200 can receive a setting instruction for the target filter mode (S1001), wherein the target filter mode is associated with the preset target image quality parameters and the target filter mode is associated with the preset target color matrix, and the target image quality parameters can be the display parameters of the image.

[0100] In response to the setting command, a first filter setting interface can be invoked (S1002) to configure the target image quality parameters to the Video layer (S1003), so that the Video layer can display the image based on the target image quality parameters. Simultaneously, a second filter setting interface can be invoked (S1004) to configure the target color matrix to the OSD layer (S1005), so that the OSD layer can display the image according to the target color matrix. In this application, by simultaneously configuring the image quality parameters and color matrix associated with the filter mode for both the Video layer and the OSD layer, a unified filter effect is ultimately achieved for both the Video layer and the OSD layer.

[0101] In some embodiments, the first filter setting interface may be a preset interface in the Video layer for configuring image quality parameters. The second filter setting interface may be a system-level interface in the display device 200 for configuring filter effect functions of the OSD layer.

[0102] In some embodiments, as shown in FIG11, for setting the filter effect of the Video layer, the display device 200 can obtain the target filter type parameter of the target filter mode (S1101), query the target image quality parameter associated with the target filter type parameter (S1102), transmit the image quality parameter to the Video layer through the first filter setting interface, and make the Video layer adjust its internal processing mechanism based on the image quality parameter, so that the Video layer displays the picture based on the target image quality parameter during subsequent playback and presents the target filter effect.

[0103] In some embodiments, the image quality parameters can be specific display parameter values ​​associated with the filter mode. That is, the display device 200 can call the first filter setting interface to change the current image quality parameters of the Video layer to the target image quality parameters through the first filter setting interface (S1103) so that the Video layer displays the image according to the target image quality parameters.

[0104] In other words, for the filter effect settings of the Video layer, the current image quality parameters of the Video layer can be directly replaced with the specific display parameter values ​​in the image quality parameters associated with the filter mode, so that the Video layer displays the image according to the image quality parameter values ​​associated with the filter mode.

[0105] In some embodiments, the image quality parameter can be the offset parameter value associated with the filter mode. That is, the display device 200 can call the first filter setting interface, read the current image quality parameter of the Video layer through the first filter setting interface, and modify the current image quality parameter of the Video layer based on the offset in the target image quality parameter (S1104) so ​​that the Video layer displays the image according to the modified image quality parameter.

[0106] In other words, the filter effect settings for the Video layer can be adjusted based on the offset parameter value associated with the filter mode, which is based on the current image quality parameters of the Video layer. This involves adding or subtracting from the current image quality parameters to modify them, so that the Video layer displays the image according to the modified image quality parameters.

[0107] Understandably, for the two configuration methods described above, directly adjusting the current image quality parameters of the Video layer to specific values ​​directly replaces the current image quality parameters of the Video layer with new, specific values. This means that all previous image quality parameter settings for the Video layer will be overwritten by the new values, resulting in the display device 200 only displaying one filter effect. On the other hand, adjusting parameter values ​​based on the current image quality parameters of the Video layer preserves the current image quality parameter settings and overlays new image quality parameter adjustments on top of them, allowing the display device 200 to display multiple filter overlay effects.

[0108] For example, if the current Video layer has already been configured with the image quality parameters for the eye protection mode, when setting the red / green filter mode, the image quality parameters of the red / green filter mode will be adjusted on top of the image quality parameters of the eye protection mode, so that the effect of the red / green filter and the effect of the eye protection mode are superimposed together.

[0109] The following uses the five filter modes shown in Figure 7 as examples to explain the filter effect settings for the Video layer.

[0110] To implement the five filter modes shown in Figure 7, the display device 200 can set a first filter setting interface in the Video layer, and define a process named hsTVSetColorVisionOptimization in the first filter setting interface to set the filter effects. This process can include an identifier (key): s32OptMode. The s32OptMode parameter can be used to specify the type of filter effect, and can also include parameter values ​​associated with the key that represent different filter effect types. For example, the value can be a number from 0 to 4, where 0 to 4 represent no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode, respectively, corresponding to the filter options of no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode in the interface shown in Figure 7.

[0111] This process can receive s32OptMode as an input parameter and load and apply the corresponding image quality parameters required for the filter effects based on the value of this parameter. In the Video layer, when the hsTVSetColorVisionOptimization process is called, it can read the s32OptMode parameter, load the image quality parameters corresponding to the s32OptMode parameter, and thus display the image according to those image quality parameters.

[0112] To implement the above five filter modes, the display device 200 can pre-associate a set of fixed image quality parameters with each filter mode. The optimization principle for the red / green filter mode is to reduce green; the optimization principle for the green / red filter mode is to increase red; the optimization principle for the blue / yellow filter mode is to increase blue; and the optimization principle for the grayscale mode is to set the saturation to 0. The preset image quality parameters may include the offset of white balance parameters and color correction parameters, and the current image quality parameters of the Video layer are adjusted by the offset.

[0113] The table below shows detailed information on image quality parameters.

[0114] Table 1: Detailed Overview of Image Quality Parameters

[0115] Taking setting a red / green filter as an example:

[0116] When the user selects the red / green filter option in the interface shown in Figure 7, the settings application calls the first filter setting interface and sets the value of the s32OptMode parameter to 1. In the Video layer, this interface loads the image quality parameters corresponding to the red / green filter effect based on the received s32OptMode parameter, and adjusts the current image quality parameters of the Video layer based on these parameters. By adjusting the current image quality parameters of the Video layer through offset adjustment, the relative intensity of red and green in the image can be changed, thus presenting the red / green filter effect.

[0117] The table below shows the offsets for white balance and color correction parameters corresponding to different filter effects. " / " indicates no adjustment is needed, "+" indicates an increase, and "-" indicates a decrease. For example, for a red / green filter, you can increase R by A1, decrease G by B1, and increase B by C1 in the current white balance parameters. Similarly, you can increase the saturation of red by E1, decrease the hue of yellow by G1, increase the saturation of purple by H1, and increase the hue of skin tone by I1 in the current color correction parameters.

[0118] Table 2. A list of offsets for white balance and color correction parameters corresponding to different filter effects.

[0119] In some embodiments, for OSD layer filter effect settings, the display of the OSD layer is implemented by calling the native interface of the operating system of the display device 200. Therefore, the display device 200 can enable and configure filter effect functions based on the native interface (settings.secure) in the operating system. That is, the filter setting item identifier (accessibility_display_daltonizer_enabled) and filter type item identifier (accessibility_display_daltonizer) in the operating system can be set through the settings.secure interface. The two identifiers (keys) accessibility_display_daltonizer_enabled and accessibility_display_daltonizer can be used to control the enabling and type of filter effect functions of the display device 200.

[0120] In this application, the filter setting item identifier can be used to control the operating status of the filter effect function, indicating whether the filter effect function of the OSD layer is enabled. When the filter setting item identifier is set to the first parameter, it indicates that the filter effect function of the OSD layer is enabled; when the filter setting item identifier is set to the second parameter, it indicates that the filter effect function of the OSD layer is disabled.

[0121] Therefore, the display device 200 detects the current display mode, which can be either a filter-enabled mode or a filter-free mode. If the current display mode is not a filter-free mode, the second filter setting interface, namely the settings.secure interface, can be called. Through the second filter setting interface, the filter setting item identifier is set to the first parameter to enable the OSD layer filter effect function. If the current display mode is a filter-free mode, the filter setting item identifier can be set to the second parameter through the second filter setting interface to disable the OSD layer filter effect function.

[0122] For example, consider the five filter modes shown in Figure 7: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. When setting the no filter mode, the filter setting item can be set to 0, indicating that the OSD layer filter effect function is turned off. When setting the other four filter modes, the filter setting item can be set to 1, indicating that the OSD layer filter effect function is turned on.

[0123] In this application, the filter type item identifier can be used to set the type of filter mode, representing the type of filter mode of the OSD layer. This filter type item identifier can use different parameter values ​​to represent different filter modes. In some embodiments, the filter type item identifier can be synchronized with the filter type parameters representing the filter mode defined by the display device 200. That is, the display device 200 can obtain the target filter type parameters of the target filter mode and set the filter type item identifier to the target filter type parameters through the second filter setting interface.

[0124] For example, consider the five filter modes shown in Figure 7: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Values ​​from 0 to 4 can be used as filter type parameters to represent these five modes: no filter, red / green filter, green / red filter, blue / yellow filter, and grayscale mode. Correspondingly, the filter type identifier can be set to values ​​from 1 to 4 to represent different filter modes, indicating that when the OSD layer's filter effects are enabled, the OSD layer's filter mode is one of four: red / green filter, green / red filter, and blue / yellow filter.

[0125] Based on the aforementioned second filter setting interface, when setting the target filter mode, as shown in Figure 11, the display device 200 can obtain the filter type item identifier as the target filter type parameter (S1101), query the target color matrix associated with the target filter type parameter (S1105), and map it to the Framework layer of the display device 200. The current color matrix set in the Framework layer is then changed to the target color matrix (S1106), thus configuring the target color matrix in the OSD layer. When a display is required, the original color value matrix of the pixels in the image to be displayed can be obtained. Based on the target color matrix set in the Framework layer, the target color value matrix is ​​calculated, and the image to be displayed is displayed in the OSD layer according to the target color value matrix. The target color value matrix can be obtained by performing matrix multiplication between the target color matrix and the original color value matrix.

[0126] In other words, by calling the settings.secure interface to modify the system settings in the Framework layer of the operating system, the color matrix configured in the Framework layer is changed, so that the Framework layer can apply the target color matrix associated with the target filter mode to the graphics rendering process, so as to process the image to be displayed through the target color matrix and display the processed image data through the OSD layer, thereby presenting the target filter effect.

[0127] The following uses the five filter modes shown in Figure 7 as examples to illustrate the filter effect settings for the OSD layer.

[0128] To implement the five filter modes shown in Figure 7, the display device 200 can enable and configure the filter effects through the settings.secure interface. In the Android system, the two identifiers (keys) accessibility_display_daltonizer_enabled and accessibility_display_daltonizer can be used to control the enabling and type of filter effects.

[0129] When `accessibility_display_daltonizer_enabled` is 0, the filter effect is turned off. When `accessibility_display_daltonizer_enabled` is 1, the filter effect is turned on. `accessibility_display_daltonizer` can have values ​​from 1 to 4, representing four filter modes: red / green, green / red, blue / yellow, and grayscale, respectively. Adjusting these two parameters allows you to achieve different filter effects.

[0130] Taking setting a red / green filter as an example:

[0131] In the interface shown in Figure 7, the user selects the filter option corresponding to the red / green filter. The settings application calls the `settings.secure` interface, setting `accessibility_display_daltonizer_enabled` to 1 and `accessibility_display_daltonizer` to 1. At the Framework layer, when a change in the settings in `Settings.Secure` is detected, the color matrix `ColorMatrix` corresponding to the red / green filter effect is loaded based on the value of `accessibility_display_daltonizer`. The modified `ColorMatrix` is then applied to the image rendering process at the Framework layer, and all image data processed by the Framework layer has its color values ​​adjusted according to this `ColorMatrix`. Finally, the processed image data is displayed through the OSD layer.

[0132] Images and videos are composed of pixel arrays and color values. A pixel array is a matrix containing pixels, and color values ​​can include RGBA values, where A is the transparency, R is the red channel component, G is the green channel component, and B is the blue channel component. ColorMatrix can change the color values ​​of image pixels based on matrix multiplication operations.

[0133] For example, the color matrix ColorMatrix can be a 4x5 matrix A, and the pixel value matrix of the pixels in the image to be displayed is C. The color value of the pixels can be changed according to the following formula:

[0134] In this matrix, A is the ColorMatrix. The first row determines the red channel component of the new color, the second row determines the green channel component, the third row determines the blue channel component, and the fourth row determines the transparency. The values ​​in the fifth column determine the offset of each component. Matrix C is the original pixel value matrix of the image to be displayed, and matrix R is the final pixel value matrix of the image. Filter effects can be adjusted by changing the color offset or the corresponding RGBA coefficients.

[0135] In some embodiments of this application, filter effects can be set simultaneously for both the Video layer and the OSD layer, allowing both layers to present a unified filter effect. The Video layer uses an interface to configure image quality parameters; adjusting these parameters achieves the corresponding filter effect. The OSD layer modifies system settings in the Framework layer of the operating system by calling native interfaces, changing the color matrix configured in the Framework layer, and then implementing the corresponding filter effect based on the color matrix.

[0136] Furthermore, it should be understood that the specific order in which the operations in Figures 9, 10, and 11 are described is merely illustrative and not intended to indicate that the order is the only possible order in which these operations can be performed. Those skilled in the art will readily conceive of various ways to reorder the operations described herein.

[0137] Based on the aforementioned display device 200, some embodiments of this application also provide a processing method for the display device, particularly relating to filter effect display. The display device 200 may include a display 260, a memory, and at least one processor 250. The display 260 may be configured to display a user interface. The screen content in the user interface is presented based on a video layer and a graphics layer. The memory may be configured to store computer programs. At least one processor 250 may be connected to the display 260 and the memory, and may be configured to execute the computer program to cause the display device 200 to perform the aforementioned method.

[0138] In some embodiments, the method may include, but is not limited to, the following steps: receiving a setting instruction for a target filter mode, wherein the target filter mode is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters may be display parameters of the image; the color matrix may be a transformation matrix that performs pixel value transformation on the image; responding to the setting instruction, calling a first filter setting interface, wherein the first filter setting interface may be a preset interface in the video layer for configuring image quality parameters; configuring the target image quality parameters to the video layer through the first filter setting interface so that the video layer displays the image based on the target image quality parameters; calling a second filter setting interface, wherein the second filter setting interface may be a system-level interface in the display device for configuring filter effect functions of the graphics layer; configuring the target color matrix to the graphics layer through the second filter setting interface so that the graphics layer displays the image based on the target color matrix.

[0139] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0140] As can be seen from the above solutions, the display device and processing method provided in the above embodiments can receive a setting instruction for a target filter mode. The target filter mode is associated with preset target image quality parameters and a preset target color matrix. In response to the setting instruction, a first filter setting interface is invoked, and the target image quality parameters are configured to the video layer through the first filter setting interface. A second filter setting interface is also invoked, and the target color matrix is ​​configured to the graphics layer through the second filter setting interface. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters, and the second filter setting interface is a system-level interface in the display device for configuring filter effects in the graphics layer. The method can simultaneously set filter effects for both the video layer and the graphics layer, resulting in a unified filter effect for both layers.

[0141] Based on the color vision optimization function of the aforementioned display device, the colors of media assets, such as the colors of images in a video, are adjusted to help users with color vision impairments better distinguish and identify colors. Taking the Android operating system as an example, Figure 12 is a schematic diagram of a scenario using Android's native color correction method according to some embodiments of this application. As shown in Figure 12, in some embodiments, the initial image is in RGB space. After conversion using a transformation matrix (such as a U matrix), the image can be mapped to LMS space. Then, the image is corrected using a correction matrix (i.e., the aforementioned color matrix) (such as a T matrix). Finally, the image is corrected using the inverse transformation of the transformation matrix (such as a U matrix). -1 The correction matrix is ​​used to convert the image in LMS space back to RGB space. The corrected image after conversion is the image output by the display device 200 after color correction. The correction matrix mentioned above is fixed.

[0142] To improve user experience, in some embodiments of this application, the display device 200 runs an application to obtain the selected correction type when triggering color correction (color correction) of an initial image in RGB space, and obtains a correction level based on the correction type input. The correction type may include correction types for color blindness and / or color weakness, such as the aforementioned red / green filter, green / red filter, and blue / yellow filter types. The correction level can be used to characterize the degree of correction for the correction type. An adjustable matrix for performing correction based on the correction level is then generated. Based on the adjustable matrix and the analog matrix corresponding to the initial image in RGB space, the correction matrix of the initial image is obtained. Then, the initial color matrix of the initial image in RGB space is obtained. A first product operation is performed on the initial color matrix and the correction matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space. Finally, the corrected image is output according to the output matrix.

[0143] The display device 200 in some embodiments of this application adds a dynamically adjustable matrix to the native color correction method of Android. Different correction matrices can be generated for different user-input correction levels; that is, a dynamically adjustable matrix. The higher the user-input correction level, the greater the correction to the image; the lower the user-input correction level, the less the correction to the image. This allows for targeted correction based on the different degrees of color weakness of users with color vision impairment, moving beyond the fixed and singular conversion effect of the Android color correction method. This application can generate different correction matrices according to different degrees of color vision impairment of users, dynamically correcting image colors, maximizing the retention of the number of colors that the user can recognize, and reducing image color distortion rate.

[0144] Figure 13 is a schematic flowchart of another processing method for a display device according to some embodiments of this application, particularly relating to image color correction. As shown in Figure 13, in some embodiments, when the display device 200 executes this method, it may perform steps including but not limited to the following:

[0145] Step S1301: Obtain the correction type selected when triggering color correction of the initial image in RGB space, and obtain the correction level based on the correction type input.

[0146] In some embodiments, different users may see different media effects through a display device. For example, users without color vision impairment (such as those without color weakness and / or color blindness) see a true image without color loss, i.e., an undistorted image, while users with color vision impairment see a distorted image with missing colors. Color vision impairment can be broadly categorized into color blindness and color weakness. Color blindness refers to the loss of color discrimination ability, while color weakness refers to a reduced ability to recognize colors.

[0147] The causes of color blindness or color weakness are as follows: In the human eye, there are three types of cone cells, each with different spectral sensitivities, resulting in trichromatic vision. Figure 14 is a schematic diagram illustrating the wavelength distribution of the three types of cone cells according to some embodiments of this application. As shown in Figure 14, in some embodiments, the three types of cone cells are referred to as short (S), medium (M), and long (L) cone cells, respectively, according to the order of their peak spectral sensitivity wavelengths. The causes of color blindness and color weakness are related to the absence or functional defects of these three types of cone cells. For example, the absence of L cone cells leads to red-green color blindness, while functional defects in M ​​cone cells lead to green-green color weakness. Different degrees of absence result in different degrees of color weakness; complete absence leads to color blindness.

[0148] Let's continue using Android as an example of the display device's operating system. In the aforementioned native Android color correction process, the correction matrix is ​​fixed. Taking a patient with partial loss of L-cone cells as an example, partial loss of L-cone cells causes red-light weakness; complete loss of L-cone cells results in red-light blindness. Because Android's native color correction method uses a fixed correction matrix (which will be explained in more detail later), if the correction matrix is ​​set too large, it actually disperses the reds that the red-light-weak patient could originally recognize, leading to overcorrection. Although Android's native color correction method can accommodate most people with color vision deficiencies, the corrected image differs significantly from the original image, altering most of the color information in the original image. For example, for some color-weak patients, the colors they can normally recognize will also be converted, resulting in a high degree of color distortion in the image.

[0149] Based on this, in some embodiments, before acquiring the correction type selected when triggering color correction for the initial image in RGB space, the display device 200 may, in response to a color correction instruction for the initial image in the user interface, control the display to display a color correction page (such as the aforementioned filter settings menu). The color correction page may include a correction type setting item for performing correction on the initial image. In response to a selection instruction for the correction type setting item (such as the aforementioned setting instruction), the display may be controlled to display the correction level corresponding to the correction type. In response to a determination instruction for the correction level, the step of acquiring the correction type selected when triggering color correction for the initial image in RGB space can be performed. The correction type may include correction types for color blindness and / or color weakness, such as the aforementioned red / green filter, green / red filter, and blue / yellow filter types. The correction level can be used to characterize the degree of correction for the correction type.

[0150] In one possible implementation, when a user wants to adjust the color of the initial image displayed on the display device, they can issue a color correction command through the user interface. After receiving the color correction command, the display device 200 can open the color correction page shown in Figure 15, allowing the user to make further color adjustments. The color correction page may include correction type settings for performing corrections on the initial image, such as red-blindness / color weakness correction type (i.e., the aforementioned red / green filter type), green-blindness / color weakness correction type (i.e., the aforementioned green / red filter type), blue-blindness / color weakness correction type (i.e., the aforementioned blue / yellow filter type), etc.

[0151] When a user selects a correction type setting, the display device 200 can present a page containing correction levels, as shown in Figure 16. That is, the display device 200 can provide the user with the correction levels for the selected correction type. The user can choose a suitable correction level on the page based on their actual situation. After the user determines the specific correction level, the display device 200 can apply the corresponding color correction algorithm or parameters to perform color correction on the initial image in the RGB color space according to the user's selection. In other words, in some embodiments of this application, the display device 200 can present a correction page for performing image color correction on the user, enabling the user to perform image color correction based on this correction page, thus providing a data basis for the user's personalized correction.

[0152] In some embodiments, based on the aforementioned color correction page, the display device 200 can obtain the correction type selected by the user when triggering color correction of the initial image in RGB space, and the correction level input based on that correction type. The correction level can be customized, for example, it can include levels 0-9 or 0-99, etc., and the correction level can be used to characterize the degree of color correction. A lower correction level indicates a lower degree of correction, and a higher correction level indicates a higher degree of correction. In this way, by allowing users to independently select the correction type and correction level, personalized correction needs for different colorblind and color-weak users can be met, improving the accuracy and practicality of the correction.

[0153] Compared to the native Android color correction method, the native Android method does not have correction levels, only correction types. For the correction type (i.e., filter type) selected by the user, only one level of correction is applied, i.e., single-mode correction. For example, when the display device 200 stores the parameter of the correction type selected by the user, i.e., the filter type parameter, it can store it in the form of a two-digit number including one and ten digits. The ones digit can represent the color weakness type, for example, 1 represents red weakness, 2 represents green weakness, and 3 represents blue weakness. The tens digit represents whether color correction is performed. For example, 0 represents no correction (simulation only), and 1 represents correction. So when the stored value is 11, it means color correction is performed for red weakness; when the stored value is 12, it means color correction is performed for green weakness; and when the stored value is 13, it means color correction is performed for blue weakness.

[0154] In this application, a new correction level for the initial image is added. After responding to the user-selected correction type and level, the display device 200 can store the correction as a three-digit number (including hundreds, tens, and units digits) or a four-digit number (including thousands, hundreds, tens, and units digits), or more. Therefore, this application's solution adds a parameter for the user-input correction level, and this parameter is variable, allowing for customized selection based on the user's different levels of color weakness. Subsequent color correction is then performed based on this parameter (described in detail later), moving beyond a single correction method and thus improving the accuracy of color correction.

[0155] In this application, after step S1301 is completed, step S1302 can be performed, including but not limited to the following.

[0156] Step S1302: Convert the correction level into a floating-point parameter, and generate an adjustable matrix based on the floating-point parameter to perform correction on the correction type.

[0157] In some embodiments, the native color correction method in Android uses a fixed adjustment matrix to correct colors. The following is a detailed description of the fixed color correction method in Android.

[0158] Figure 17 is a schematic diagram of the logical flow of the native Android image correction method according to some embodiments of this application. As shown in Figure 17, the display device 200 can perform matrix transformation on the initial image in RGB space (such as transforming the initial image to LMS space to form a simulated image) to obtain a simulated matrix, such as simulation. Simulation is the matrix corresponding to the image colors actually seen by colorblind and / or color-weak users. Based on this, the matrix corresponding to the image colors that colorblind and / or color-weak users cannot see (such as the missing matrix) can be denoted as the EP matrix, then EP = 1 (normal people can distinguish all colors, so it can be represented by 1) - simulation.

[0159] In Android's native color correction method, for colorblind and / or color-weak users who cannot see the matrix corresponding to image colors, other colors can be used for compensation. For example, color areas that color-weak or red-blind users cannot see can be compensated with green and blue. The matrix corresponding to the compensated color can be denoted as SEP, and the matrix compensated with other colors can be denoted as ErrSpread (fixed adjustment matrix). By using the fixed ErrSpread matrix to transform EP, colors that color-impaired users cannot see can be mapped to the color gamut (color channels) that users can see, resulting in the compensated EP. The compensation matrix SEP = ErrSpread * EP = ErrSpread * (1 - simulation). For colorblind and / or color-weak users, the simulated image is superimposed with the compensation color corresponding to the compensation matrix SEP to obtain the image corrected for the user (image in LMS space). If the matrix corresponding to the superimposed, i.e., the corrected image is denoted as T, then T = simulation + SEP = simulation + ErrSpread * EP = simulation + ErrSpread * (1 - simulation).

[0160] In the above formula, simulation is fixed, so the correction effect depends on the ErrSpread matrix. However, in Android's native color correction method, ErrSpread is fixed; for example, the ErrSpread for red-blindness... Therefore, the correction matrix T will also be fixed, resulting in the same correction effect for patients with color weakness of any degree. Afterward, the image in the LMS space is converted back to the RGB space, so the corrected image presented by the display device 200 to colorblind and / or color-weak users is also fixed, i.e., an image with a single correction effect.

[0161] In other words, Android's native color correction method uses a fixed ErrSpread matrix to transform the EP, so the resulting SEP is also fixed, and therefore the correction matrix is ​​also fixed. Understandably, correcting the colors of the initial image based on a fixed correction matrix results in a fixed and singular correction effect. Therefore, for patients with only mild color weakness, even if the corrected RGB image can accurately distinguish different colors, it has already resulted in overcorrection, leading to a high rate of color distortion in the image.

[0162] Therefore, this application aims to add a dynamically adjustable correction level to the Android native color correction method. It dynamically controls the adjustment matrix based on the user-input correction level (e.g., `level`), transforming the fixed adjustment matrix `ErrSpread` in the native Android correction method into an adjustable matrix `ErrSpread`. In this application, `ErrSpread` is generated based on the correction level set by the user according to the correction type, thus affecting the SEP matrix, the correction matrix T, and the final output corrected image. This provides a targeted correction method for different users' actual situations. That is, this application can generate different correction matrices for different user-input correction levels, and then apply the correction matrix to the output image to obtain the corrected image. Thus, for users with mild color weakness, the user-set optimization level is low, so the value of the adjustable matrix `ErrSpread` is small, preserving as much of the color gamut as possible that the user cannot see, reducing the distortion rate.

[0163] Since the maximum value in the native Android ErrSpread matrix is ​​1, while the correction levels are typically integers, such as any level from 1 to 9, the correction levels need to be converted to floating-point parameters for compatibility with the ErrSpread matrix format. Therefore, the display device 200 can convert the correction levels to floating-point parameters and generate an adjustable matrix based on these floating-point parameters to perform corrections on the correction type. In this way, by converting the correction levels to floating-point parameters, an adjustable matrix can be generated based on these parameters to perform corrections on the correction type, thereby achieving finer color correction.

[0164] In some embodiments, when the display device 200 converts the correction level into a floating-point parameter, it can first identify the digits where the correction level is located, including at least the hundreds digit, and determine the conversion value that can be used to convert the floating-point parameter based on the highest digit of the digits. Then, it performs a first division operation on the correction level and the conversion value to obtain the floating-point parameter.

[0165] In some embodiments, the display device 200 can obtain floating-point parameters in the following manner: First, the display device 200 can obtain the digit where the correction level is located. When the highest digit is the hundreds place, the converted value can be set as a first value, and a first division operation can be performed on the correction level and the first value to obtain the floating-point parameter; wherein, the first value can be a two-digit value. When the highest digit is the thousands place, the converted value can be set as a second value, and a first division operation can be performed on the correction level and the second value to obtain the floating-point parameter, wherein, the second value can be a three-digit value.

[0166] In one possible implementation, when converting the correction level into a floating-point parameter, the display device 200 first obtains the parameters stored by the display device 200 based on the correction type and correction level input by the user. The native Android storage method is a two-digit number (ones digit plus tens digit), such as 11 (representing color correction for weak red). In this application, it can be stored as a three-digit number, such as 511, where 5 is the correction level input by the user. The display device 200 supports a correction level range of 1-9, with the hundreds digit carrying the correction level value. Therefore, the highest digit is the hundreds place. To convert 5 to a floating-point number, the conversion value can be set to 10, and then a division operation can be performed between 5 and 10 to obtain the floating-point parameter 0.5. Similarly, if the identified correction level is 9, and the highest digit is also in the hundreds place, the conversion value can also be set to 10, and the floating-point parameter obtained based on this correction level can be 0.9.

[0167] For example, suppose the display device 200 stores a four-digit number (thousands, hundreds, tens, and units), such as 2111. Here, 21 represents the user-input correction level, meaning the display device 200 supports a correction level range of 1-99. The thousands and hundreds digits carry the correction level value, with the highest digit being the thousands place. To convert 21 to a floating-point number, the conversion value can be set to 100. Then, a division operation is performed between 21 and 100 to obtain the floating-point parameter 0.21. After calculating the floating-point parameter, an adjustable matrix ErrSpread is generated based on the obtained floating-point parameter to perform correction for the correction type (e.g., weak red). (The generation method of the adjustable matrix will be further described later.)

[0168] In other words, the display device 200 can select different conversion values ​​for calculation based on the number of digits in the correction level to obtain floating-point parameters. By selecting an appropriate conversion value, the correction level can be converted into floating-point parameters suitable for color correction, providing a data basis for generating an adjustable matrix. It should be noted that the 10 and 100 above are only examples; in actual applications, the conversion values ​​can also be other values, and this application does not specifically limit them.

[0169] In some embodiments, when the display device 200 generates an adjustable matrix for performing correction on the correction type based on floating-point parameters, it can first obtain a fixed adjustment matrix corresponding to the correction type, wherein the fixed adjustment matrix can be the adjustment matrix corresponding to the correction type in the native color correction method of Android. Then, it finds the parameter position of the fixed correction parameter used to correct the initial image in the fixed adjustment matrix, and then replaces the fixed correction parameter with a floating-point parameter based on the parameter position to obtain the adjustable matrix.

[0170] In one possible implementation, the display device 200 can first determine an initial adjustment matrix (a matrix already present in the native Android correction method) that matches the selected correction type. This fixed adjustment matrix contains some predefined parameters for basic image correction, such as the matrix used for red-blindness mentioned above. After obtaining the fixed adjustment matrix, the positions of the parameters used for specific correction operations can be identified (such as the positions corresponding to the two 0.7 values). These parameter positions correspond to the elements in the matrix and determine the correction method and degree. Once the parameter positions are determined, the fixed correction parameters at these positions can be replaced with calculated floating-point parameters. In this way, the originally fixed adjustment matrix becomes an adjustable matrix that can be adjusted according to the correction level, thereby achieving more flexible and precise color correction.

[0171] In some embodiments, the value of the correction level (level) after floating-point conversion, i.e., the value of the floating-point parameter, can be denoted as mCorrectSpread. Taking red-blindness as an example, in the native color correction method of Android, the matrix used for red-blindness is... If the parameter is located at the position of 0.7, then after replacing 0.7 with the floating-point parameter mCorrectSpread in this application based on the parameter position, the adjustable matrix ErrSpread_p(red-blind) corresponding to the red-blindness is = Specifically, when level = 5, if display device 200 sets the conversion value to 10, then mCorrectSpread = 0.5, corresponding to... When level = 9, mCorrectSpread = 0.9, corresponding to...

[0172] In other embodiments, taking green-blindness as an example, its adjustable matrix When level=5 When level = 9

[0173] Similarly, in some other embodiments, taking blue-yellow blindness as an example, its adjustable matrix ErrSpread_t(blue-yellow blindness) = When level=5 When level = 9

[0174] Therefore, the adjustable matrix ErrSpread differs for different correction levels. In other words, the adjustable matrix ErrSpread is dynamically generated based on the user-input correction level, and its value changes according to the user's input. By converting the correction level into floating-point parameters, the display device 200 can generate different adjustable matrices based on these floating-point parameters to achieve more precise color correction tailored to the user's needs. This allows the final image to adapt to the requirements of different correction types and levels.

[0175] In some embodiments, after step S1302 is completed, step S1303 may be performed, including but not limited to the following step S1303.

[0176] Step S1303: Perform matrix transformation on the initial image in RGB space to obtain the simulation matrix.

[0177] In some embodiments, the RGB color space is a color model based on human visual perception, based on the three primary colors of light: red, green, and blue. It is commonly used in display devices such as monitors, televisions, and projectors. Various colors can be produced by increasing the intensity of red, green, and blue light using these devices. The LMS color space is defined based on the light response of three types of cone cells in the human eye: L represents long-wavelength sensitive cone cells, corresponding to red; M represents medium-wavelength sensitive cone cells, corresponding to green; and S represents short-wavelength sensitive cone cells, corresponding to blue. The LMS color space is closer to human color perception. The XYZ color space is a model based on human color perception. It is a broader color space that covers all colors visible to the human eye, and therefore is often used as a bridge for conversion between other color spaces. The XYZ color space can be used for color space conversion.

[0178] Based on this, before the display device 200 performs matrix transformation on the initial image in RGB space to obtain the analog matrix, it can obtain a first matrix that transforms the initial image from RGB space to XYZ space, and then obtain a second matrix that transforms the initial image from XYZ space to LMS space. Afterwards, a first product operation is performed on the first and second matrices to transform the initial image to LMS space, and a transformation matrix corresponding to the transformed image is obtained. This transformation matrix can be used to transform the initial image in RGB format to LMS space. In other words, this process involves transforming the initial image from RGB space to XYZ space, and then from XYZ space to LMS space.

[0179] For example, taking sRGB (a standard RGB color space currently used by Android) in the RGB color space as an example, mapping from the sRGB color space to the LMS color space requires an intermediate step using the XZY color space. The first matrix for the sRGB to XYZ space conversion is known to be:

[0180] This matrix can be used to convert data in the sRGB color space to data in the XYZ color space;

[0181] The second matrix for the XYZ to LMS space transformation is given as:

[0182] This matrix can be used to further convert data in the XYZ color space into data in the LMS color space.

[0183] Therefore, the transformation matrix (such as the U matrix) for converting sRGB space to LMS space is:

[0184] By multiplying the two matrices above, we can obtain the transformation matrix U, which directly converts the RGB color space to the LMS color space. The RGB image can then be represented in the LMS space through the transformation matrix U, providing a basis for subsequent image color correction.

[0185] In some embodiments, the display device 200 performs a matrix transformation on the initial image in RGB space to obtain a simulation matrix. This simulation matrix represents the matrix corresponding to the image colors actually seen by colorblind and / or color-weak users after the matrix transformation to LMS space. LMS space is closer to the color perception method of the human visual system, which helps to more accurately simulate the visual experience of colorblind and color-weak users. That is, simulation represents the representation of the initial image in LMS space and simulates the image colors actually seen by colorblind and / or color-weak users. Through the LMS space transformation, the display device 200 can more accurately simulate the image colors actually seen by colorblind and / or color-weak users, providing a basis for subsequent color compensation.

[0186] In some embodiments, the display device 200 can obtain the analog matrix in the following manner: First, it can obtain the missing color corresponding to the correction type selected for the initial image in RGB space, and determine the first and second substitute colors of the missing color in LMS space, as well as the first coordinates corresponding to the first substitute color and the second coordinates corresponding to the second substitute color; then, it can perform a first product operation on the first and second coordinates to obtain the analog vector corresponding to the missing color, and then perform a projection operation along the analog vector to obtain the analog matrix.

[0187] In one possible implementation, to simulate the lack of color perception in specific types of color blindness (such as red-green, green-green, or blue-yellow color blindness), the missing color corresponding to the selected correction type of the initial image in RGB space can be obtained. In the LMS color space, a first and second substitute color for the missing color are found. These substitute colors are colors that color-blind and / or color-weak users can distinguish, replacing colors they cannot perceive. Simultaneously, the coordinates of these substitute colors in LMS space are determined, namely the first coordinate corresponding to the first substitute color and the second coordinate corresponding to the second substitute color. By multiplying the first and second coordinates, a simulation vector is obtained, representing the simulated direction of the missing color in LMS space. Then, a projection operation is performed along the simulation vector to obtain a simulation matrix. This matrix is ​​used to transform the original image into a color-blind simulation image, i.e., simulating the image seen by a color-blind patient.

[0188] According to existing research on color blindness, users without color vision impairment see a spatial range as shown in Figure 18, while users with color vision impairment (such as colorblind and / or color-weak users) can only see the color of one face. In Figure 18, points O (black) and W (white) are colors that all colorblind patients can see. Therefore, in the Android color correction method, for protanopia, in the LMS color space, projection along the L axis onto the OWB plane can simulate red-blindness caused by the absence of L cone cells; for deuteranopia, in the LMS color space, projection along the M axis onto the OWB plane can simulate green-blindness caused by the absence of M cone cells; and for tritanopia, in the LMS color space, projection along the S axis onto the OWR plane can simulate tritanopia caused by the absence of S cone cells.

[0189] Taking red-blindness as an example, the coordinates of the blue point in the LMS space are lms_b = U[2].rgb, that is, in the LMS space, blue can be obtained by mapping the blue in the RGB color space through the transformation matrix U, where U[2] represents the row number of the transformation matrix U (such as the third row of the transformation matrix U). The coordinates of the white point in the LMS space are lms_w = (U*vec[1]).rgb, in the LMS space, white can be obtained by mapping the white in the RGB color space through the transformation matrix U, where vec[1] is a vector representing white in the RGB space, and U*vec[1] means that this vector is transformed into the LMS space through the matrix U. Multiplying lms_b and lms_w, we can get the vector p0 = cross(lms_b, lms_w) perpendicular to the OWB plane. In the LMS space, point O represents black, point W represents white, and point B represents blue. The OWB plane is a plane defined by these three points and is used to simulate the color perception of colorblind patients in the LMS space. Vector p0 is a vector perpendicular to the OWB plane and is used to define the projection direction from the original image matrix (the matrix of the initial image) onto the OWB plane. This vector determines how the original image matrix is ​​projected onto the OWB plane in LMS space, thereby simulating the color effect seen by a colorblind person. Projecting the original image matrix along the L-axis onto the OWB plane yields the red-blindness simulation matrix. Therefore, the red-blindness simulation matrix is:

[0190] Where p0.x, p0.y, and p0.z correspond to the cross products (also known as vector products) of vector p0 along the L-axis, M-axis, and S-axis, respectively.

[0191] In this way, an original RGB image is converted into an image in LMS space using the transformation matrix U. Then, after transformation using the simulation matrix, it can simulate the image seen by someone with a complete absence of L-axis cone cells. For example, in red-blindness, due to the complete absence of L-axis cone cells, colors along the L-axis cannot be distinguished. Therefore, colors along the M and S axes can be added to the EP color values, thus mapping colors that a colorblind person cannot distinguish to colors that can be distinguished. By performing color transformation and simulation in LMS space, the color perception of colorblind patients can be simulated more accurately, providing a basis for users to obtain corrected images. After step S3 is completed, step S4 can be executed.

[0192] Step S1304: Perform a first difference operation on the preset value and the simulation matrix to obtain the missing matrix, and perform a first product operation on the adjustable matrix and the missing matrix to obtain the compensation matrix.

[0193] Figure 19 is a schematic diagram of the logical flow of an image correction method based on Android native optimization according to some embodiments of this application. As shown in Figure 19, in some embodiments, the preset value can represent the color distribution under normal vision. For example, the preset value can be 1. The display device 200 performs a first difference operation on the preset value and the simulation matrix to obtain a missing matrix (such as the EP matrix), i.e., EP = 1 - simulation. EP reflects the matrix corresponding to the color information that color-blind and / or color-weak users cannot see. Then, the display device 200 performs a first product operation on the adjustable matrix ErrSpread and the missing matrix EP to obtain the compensation matrix SEP, i.e., SEP = ErrSpread * EP = ErrSpread * (1 - simulation). The compensation matrix represents the matrix corresponding to the color seen after color compensation for colors that color-blind and / or color-weak users cannot see. Through the compensation matrix, colors that color-impaired users cannot distinguish can be mapped to colors that they can distinguish. That is, the compensation matrix can be used to supplement the missing color information, making the corrected image closer to the color performance under normal vision, thereby achieving the effect of color vision optimization.

[0194] It should be noted that in this formula, ErrSpread is an adjustable matrix (Android natively uses a fixed matrix), which can change according to the correction level input by the user. Therefore, the compensation matrix SEP is also dynamic and variable.

[0195] In some embodiments, after step S1304 is completed, step S1305 may be performed, including but not limited to the following step S1305.

[0196] Step S1305: Perform a first summation operation on the simulation matrix and the compensation matrix to obtain the correction matrix of the initial image.

[0197] After obtaining the dynamic compensation matrix SEP, the display device 200 can perform a first summation operation between the simulation matrix and the compensation matrix to obtain the correction matrix of the initial image. This correction matrix contains the color information of the color-corrected image and can be used to convert the initial image into a color-corrected image. If the correction matrix is ​​denoted as T, then T = simulation + SEP = simulation + ErrSpread * EP = simulation + ErrSpread * (1 - simulation), where ErrSpread is adjustable and dynamic. Therefore, the correction matrix T is also dynamic. It can be understood that using the adjustable correction matrix T to correct the image results in a dynamically changing correction effect, no longer the single correction effect native to Android.

[0198] Referring to Figure 19, the generation process of the correction matrix T can be divided into the following steps: First, a colorblindness simulation matrix (simulation) is generated. This matrix transformation converts the initial image into a colorblindness simulation image (i.e., the image seen by a colorblind person). Next, an EP matrix is ​​generated, representing the colors that a colorblind person cannot distinguish. Therefore, EP = 1 - simulation (normal people can distinguish all colors, so it can be represented by 1). Then, a SEP matrix is ​​generated. An ErrSpread matrix is ​​used to transform EP, replacing the colors that a colorblind person cannot distinguish with colors that the user can distinguish, resulting in the compensated EP, i.e., the compensation matrix SEP. Finally, the final correction matrix T is generated. The colorblindness simulation image is superimposed with the transformed compensation matrix SEP to obtain the final corrected image. Therefore, SEP needs to be superimposed on the simulation matrix, i.e., T = simulation + SEP. Compared to the native Android image correction method in Figure 17, the part with the thick border in Figure 19 is the different part. It is easy to see that since the adjustable matrix ErrSpread is dynamic and is adjusted according to the correction level input by the user, the compensation matrix SEP and the correction matrix T obtained based on the ErrSpread matrix are also dynamic. Therefore, the corrected image color displayed by the display device 200 is also dynamic and will present different effects according to the correction level input by the user, thus avoiding high image color distortion rate.

[0199] In some embodiments, after step S1305 is completed, step S1306 may be performed, including but not limited to the following step S1306.

[0200] Step S1306: Obtain the initial color matrix of the initial image in RGB space, perform a first product operation on the initial color matrix and the correction matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space, and output the corrected image according to the output matrix.

[0201] After obtaining the correction matrix, the display device 200 can acquire the initial color matrix of the initial image in the RGB space, and perform a first product operation on this initial color matrix and the correction matrix T. This operation can apply the correction matrix to the initial image to obtain the corrected image.

[0202] Referring back to Figure 12, it can be seen that the image after transformation by the correction matrix T is still in LMS space, while the image output by the display device 200 should be in RGB space. Therefore, the image after correction by the correction matrix T needs to undergo an inverse operation (such as U...). -1 Therefore, the process by which the display device 200 performs a first product operation on the initial color matrix and the correction matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space should include, but is not limited to, the following: the display device 200 calculates the inverse matrix of the transformation matrix based on the transformation matrix, performs a first product operation on the initial color matrix, the transformation matrix, the correction matrix, and the inverse matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space.

[0203] In some embodiments, the last RGB image in Figure 12 is obtained after color correction, which can be denoted as R'G'B'. The output matrix corresponding to the corrected image should be: R'G'B' = U -1 *T*U*RGB =U -1 *(simulation+ErrSpread*(1-simulation))*U*RGB;

[0204] After obtaining the output matrix, the display device 200 can output the corrected image according to the output matrix R'G'B'.

[0205] In some embodiments of this application, the adjustable matrix ErrSpread is generated based on the correction level set by the correction type. Since ErrSpread is dynamic, it affects the SEP matrix, the correction matrix T, and the final output corrected image. Therefore, the output matrix corresponding to the corrected image is also dynamic. Thus, the image correction method of this application can present different display effects for different users with color weakness.

[0206] Figure 20 is a schematic diagram of the color correction effect according to some embodiments of this application. As shown in Figure 20, taking the athletes' clothing in Figure 20 as an example, the initial RGB image contains five main athletes from left to right. The athlete on the left is wearing a bright green sports shirt and white sports shorts; the second and third athletes on the left are wearing bright red sports shirts and blue sports shorts; the fourth athlete on the left is wearing a bright green sports shirt, white sports shorts, and red knee-high socks; and the fifth athlete on the left is wearing a bright red sports shirt and blue sports shorts. In the simulated image, the red and green clothing of the five athletes are distorted to the same color—gray. It can be seen that the simulated image of the initial RGB image is greatly distorted. However, after correction, and after compensation from other color gamuts, as shown in Figure 20, the red clothing in the corrected image appears as a darker red and green, and the distortion rate is reduced. Moreover, the effect displayed by the display device 200 can also be different depending on the different correction levels input by the user.

[0207] In some embodiments, the higher the correction level input by the user, the greater the degree of image correction; the lower the correction level input by the user, the smaller the degree of image correction.

[0208] Figure 21 is a schematic diagram of the effect of the initial image without correction according to some embodiments of this application; Figure 22 is a schematic diagram of the effect when the correction level is 3 according to some embodiments of this application; Figure 23 is a schematic diagram of the effect when the correction level is 5 according to some embodiments of this application; and Figure 24 is a schematic diagram of the effect when the correction level is 7 according to some embodiments of this application. Combining Figures 21-24, taking athletes' clothing as an example, the initial RGB image contains 5 main athletes from left to right. The athlete on the left is wearing a bright green sports shirt and white sports shorts; the second and third athletes on the left are wearing bright red sports shirts and blue sports shorts; the fourth athlete on the left is wearing a bright green sports shirt, white sports shorts, and red knee-high socks; and the fifth athlete on the left is wearing a bright red sports shirt and blue sports shorts. Comparing the corrected images at different correction levels with the initial RGB image, the higher the correction level, the greater the degree of image correction; the lower the correction level, the less the degree of image correction. Thus, targeted correction can be performed according to the different color weakness levels of users with color vision impairment, rather than the fixed and single conversion effect in Android color correction methods. In this way, if the user has mild color blindness and sets a low optimization level, the value of the adjustable matrix ErrSpread will be small, and the color gamut that the user cannot see can be preserved as much as possible. That is, the number of colors that the user can recognize is preserved to the greatest extent, and the color distortion rate of the image is reduced.

[0209] In some embodiments, before generating an adjustable matrix to perform correction on the correction type based on floating-point parameters, the display device 200 may also set a default correction level. When it is detected that no correction level is input based on the correction type, a default adjustment matrix can be generated according to the default correction level. Then, a first product operation can be performed on the default adjustment matrix and the missing matrix to obtain a default compensation matrix. Then, a first sum operation can be performed on the analog matrix and the default compensation matrix to obtain the default correction matrix of the initial image. Finally, a first product operation can be performed on the initial color matrix and the default correction matrix to obtain the default output matrix corresponding to the image after correction of the initial image in RGB space. And, the corrected image can be output according to the default output matrix.

[0210] In some use cases, to ensure that a preset standard can be used for color calibration even without a specific calibration level input, the display device 200 can set a default calibration level. If the user does not provide a calibration level for the calibration type, the display device 200 can use the default calibration level for subsequent operations. For example, if the default calibration level set by the display device 200 is 3, and the user makes a custom selection, such as selecting a calibration level of 1 if the user has a mild color weakness, the display device 200 will generate an adjustable matrix and subsequent compensation and calibration matrices based on calibration level 1. If the user does not make a custom selection, such as after selecting the calibration type, the system-set default calibration level will be used, and a confirmation command can be directly triggered, such as pressing the confirmation button on a remote control. In this way, the display device 200 will perform subsequent calculations based on the default calibration level. The calculation method has been described in the previous embodiments and will not be repeated here. In this way, by providing a default calibration level for the user, the display device 200 can save the user from the process of manual selection, improving the convenience of user operation. At the same time, by setting a default calibration level, it can prevent the user from being unable to execute subsequent processes when no calibration level is input, avoiding user misoperation.

[0211] As can be seen from the above solutions, the display device 200 provided in some embodiments of this application, including at least one processor, can also be configured to execute a computer program stored in memory to cause the display device to perform: obtaining a selected correction type when triggering color correction of an initial image in RGB space, and obtaining a correction level based on the correction type input, wherein the correction type may include a correction type for color blindness and / or color weakness, and the correction level can be used to characterize the degree of correction of the correction type; converting the correction level into a floating-point parameter, and generating an adjustable matrix for performing correction on the correction type based on the floating-point parameter; performing a matrix transformation on the initial image in RGB space to obtain an analog matrix, wherein the analog matrix can characterize the image actually seen by color-blind and / or color-weak users after matrix transformation to LMS space. The system includes a matrix corresponding to colors; a missing matrix is ​​obtained by performing a first difference operation on a preset value and the simulation matrix, the missing matrix representing the matrix corresponding to colors that color-blind and / or color-weak users cannot see in the correction type; and a compensation matrix is ​​obtained by performing a first product operation on the adjustable matrix and the missing matrix, the compensation matrix representing the matrix corresponding to colors that color-blind and / or color-weak users can see after color compensation; a correction matrix for the initial image is obtained by performing a first summation operation on the simulation matrix and the compensation matrix; an initial color matrix of the initial image in RGB space is obtained, and a first product operation is performed on the initial color matrix and the correction matrix to obtain an output matrix corresponding to the image after correction of the initial image in RGB space; and the corrected image is output according to the output matrix.

[0212] In this application, the display device can generate different correction matrices according to the different degrees of color vision impairment of users, so as to dynamically correct the image colors, retain the number of colors that users can recognize to the greatest extent, and reduce the image color distortion rate.

[0213] In some embodiments, when the at least one processor performs the conversion of the correction level into a floating-point parameter, it may be further configured to execute the computer program to cause the display device to perform: identifying the digit where the correction level is located, the digit including at least the hundreds digit; determining the conversion value for converting the floating-point parameter based on the highest digit of the digit; and performing a first division operation on the correction level and the conversion value to obtain the floating-point parameter.

[0214] In some embodiments, when the at least one processor executes the generation of an adjustable matrix to perform correction on the correction type based on the floating-point parameters, it may be further configured to execute the computer program to cause the display device to perform: obtaining a fixed adjustment matrix corresponding to the correction type; the fixed adjustment matrix may be an adjustment matrix corresponding to the correction type in the native color correction method of Android; finding the parameter position of the fixed correction parameter used to correct the initial image in the fixed adjustment matrix; and replacing the fixed correction parameter with the floating-point parameter based on the parameter position to obtain the adjustable matrix.

[0215] In some embodiments, when the at least one processor performs the first division operation on the correction level and the converted value to obtain the floating-point parameter, it may be further configured to execute the computer program to cause the display device to perform: obtaining the digit where the correction level is located; setting the converted value to a first value when the highest digit of the digit is the hundreds place; and performing a first division operation on the correction level and the first value to obtain the floating-point parameter; the first value may be a two-digit value; when the highest digit of the digit is the thousands place, setting the converted value to a second value; and performing a first division operation on the correction level and the second value to obtain the floating-point parameter; the second value may be a three-digit value.

[0216] In some embodiments, before the at least one processor performs the step of performing matrix transformation on the initial image in RGB space to obtain an analog matrix, it may also be configured to execute the computer program to cause the display device to perform: obtaining a first matrix to transform the initial image from RGB space to XYZ space; obtaining a second matrix to transform the initial image from XYZ space to LMS space; performing a first product operation on the first matrix and the second matrix to transform the initial image to the LMS space; and obtaining a transformation matrix corresponding to the transformed image, wherein the transformation matrix can be used to transform the initial image in RGB format to LMS space.

[0217] In some embodiments, after the at least one processor performs the step of obtaining the output matrix corresponding to the image after correction of the initial image in RGB space, it may also be configured to execute the computer program to cause the display device to perform: calculating the inverse matrix of the transformation matrix based on the transformation matrix; and performing a first product operation on the initial color matrix, the transformation matrix, the correction matrix, and the inverse matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space.

[0218] In some embodiments, when the at least one processor performs a matrix transformation on the initial image in RGB space to obtain an analog matrix, it may be further configured to execute the computer program to cause the display device to perform: obtaining the missing color corresponding to the correction type selected for the initial image in RGB space; determining a first substitute color and a second substitute color for the missing color in LMS space, and a first coordinate corresponding to the first substitute color and a second coordinate corresponding to the second substitute color; performing a first product operation on the first coordinate and the second coordinate to obtain an analog vector corresponding to the missing color; and performing a projection operation along the analog vector to obtain an analog matrix.

[0219] In some embodiments, when the at least one processor executes the step of acquiring the selected correction type when performing color correction on an initial image in RGB space, it may be further configured to execute the computer program to cause the display device to perform: in response to a color correction instruction for the initial image in the user interface, control the display to display a color correction page; the color correction page includes a correction type setting for performing correction on the initial image; in response to a selection instruction for the correction type setting, control the display to display a correction level corresponding to the correction type; and in response to a determination instruction for the correction level, execute the step of acquiring the selected correction type when performing color correction on an initial image in RGB space.

[0220] In some embodiments, after the step of acquiring the selected correction type when triggering color correction of an initial image in RGB space, the at least one processor may further be configured to execute the computer program to cause the display device to perform: setting a default correction level; generating a default adjustment matrix based on the default correction level when detecting that the correction level is not input based on the correction type; performing a first product operation on the default adjustment matrix and the missing matrix to obtain a default compensation matrix; performing a first summation operation on the analog matrix and the default compensation matrix to obtain a default correction matrix for the initial image; performing a first product operation on the initial color matrix and the default correction matrix to obtain a default output matrix corresponding to the image after correction of the initial image in RGB space; and outputting the corrected image according to the default output matrix.

[0221] Those skilled in the art will clearly understand that the techniques in some embodiments of this application can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the solutions in this application, or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a readable non-volatile storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of this application.

[0222] Finally, it should be noted that the above embodiments are only used to illustrate the solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding solutions to deviate from the scope of the solutions of the embodiments of this application.

[0223] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion of the various embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, comprising: The display is configured to show a user interface, the screen content of which is presented based on a video layer and a graphics layer. Memory, configured to store computer programs; At least one processor, connected to the display and the memory, is configured to execute the computer program to cause the display device to perform: The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are display gain parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image. In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters. The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters; Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer; The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

2. The display device of claim 1, wherein the at least one processor is further configured to execute the computer program to cause the display device to perform: Define the filter type parameter for the filter mode, which is used to characterize the type of filter mode; Obtain a basic sample image and a target sample image, wherein the basic sample image is an image without any filter effect, and the target sample image is an image with the target filter effect; The image quality parameters of the filter mode are set according to the basic sample image and the target sample image. The image quality parameters are the difference between the display parameters of the target sample image and the display parameters of the basic sample image, or the image quality parameters are the display parameters of the target sample image. A color matrix is ​​set based on the basic sample image and the target sample image, wherein the color matrix is ​​the ratio between the color value matrix of the pixels in the target sample image and the color value matrix of the pixels in the basic sample image; Establish the association between the image quality parameters and the filter type parameters, and establish the association between the color matrix and the filter type parameters; Store the image quality parameters and the color matrix.

3. The display device according to claim 2, wherein the at least one processor performs the function of configuring the target image quality parameters to the video layer through the first filter setting interface, and is further configured to execute the computer program to cause the display device to perform: Obtain the target filter type parameter of the target filter mode; Query the target image quality parameters associated with the target filter type parameter; The target image quality parameters are configured to the video layer through the first filter setting interface.

4. The display device according to claim 3, wherein the at least one processor configures the target image quality parameters to the video layer through the first filter setting interface, and is further configured to execute the computer program to cause the display device to perform: The current image quality parameters of the video layer are changed to the target image quality parameters through the first filter setting interface, so that the video layer displays the image according to the target image quality parameters.

5. The display device according to claim 3, wherein the at least one processor performs the function of configuring the target image quality parameters to the video layer through the first filter setting interface, and is further configured to execute the computer program to cause the display device to perform: The current image quality parameters of the video layer are read through the first filter setting interface; The current image quality parameters of the video layer are modified based on the offset in the target image quality parameters so that the video layer displays the image according to the modified image quality parameters.

6. The display device of claim 1, wherein the at least one processor is further configured to execute the computer program to cause the display device to perform: Detect the current display mode, which is either a filter mode or a no-filter mode; If the current display mode is not the no-filter mode, the filter setting item identifier is set to the first parameter through the second filter setting interface. The first parameter is used to indicate that the filter effect function of the graphics layer is enabled. If the current display mode is no filter mode, the filter setting item identifier is set to the second parameter through the second filter setting interface. The second parameter is used to indicate that the filter effect function of the graphics layer is turned off.

7. The display device of claim 2, wherein the at least one processor performs the function of configuring the target color matrix to the graphics layer via the second filter setting interface, and is further configured to execute the computer program to cause the display device to perform: Obtain the target filter type parameter of the target filter mode; The filter type item identifier is set to the target filter type parameter through the second filter setting interface. The filter type item identifier is used to characterize the type of filter mode of the graphics layer. Query the target color matrix associated with the target filter type parameter; The current color matrix set in the display device frame layer is changed to the target color matrix to configure the target color matrix into the graphics layer.

8. The display device of claim 7, wherein the at least one processor is further configured to execute the computer program to cause the display device to perform: Obtain the original color value matrix of pixels in the image to be displayed; The target color value matrix is ​​calculated based on the target color matrix set in the framework layer. The target color value matrix is ​​obtained by performing matrix multiplication between the target color matrix and the original color value matrix. The image to be displayed is shown in the graphics layer according to the target color value matrix.

9. The display device of claim 1, wherein the at least one processor is further configured to execute the computer program to cause the display device to perform: Get the list of system properties; Read the filter attribute value from the overall device attribute list; If the filter attribute value is the first attribute value, then the filter settings menu is displayed. The filter settings menu includes filter options for multiple filter modes. The first attribute value is used to indicate that the display device supports filter adjustment functions. If the filter attribute value is the second attribute value, the filter settings menu will not be displayed. The second attribute value is used to indicate that the display device does not support the filter adjustment function.

10. The display device of claim 1, wherein the at least one processor is further configured to execute the computer program to cause the display device to perform: The system obtains the correction type selected when triggering color correction of an initial image in RGB space, and obtains the correction level based on the correction type input, wherein the correction type includes correction types for color blindness and / or color weakness, and the correction level is used to characterize the degree of correction of the correction type; The correction level is converted into a floating-point parameter, and an adjustable matrix is ​​generated based on the floating-point parameter to perform correction on the correction type; A matrix transformation is performed on the initial image in RGB space to obtain an analog matrix, wherein the analog matrix represents the matrix corresponding to the actual image colors seen by colorblind and / or color-weak users after the matrix is ​​transformed to LMS space; A first difference operation is performed between the preset value and the simulation matrix to obtain a missing matrix, the missing matrix representing the matrix corresponding to colors that color-blind and / or color-weak users cannot see in the correction type; and a first product operation is performed between the adjustable matrix and the missing matrix to obtain a compensation matrix; the compensation matrix representing the matrix corresponding to colors that color-blind and / or color-weak users can see after color compensation for colors that they cannot see. The simulation matrix and the compensation matrix are added together to obtain the correction matrix of the initial image. Obtain the initial color matrix of the initial image in RGB space, perform a first product operation on the initial color matrix and the correction matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space, and output the corrected image according to the output matrix.

11. The display device of claim 10, wherein the at least one processor converts the correction level into a floating-point parameter, specifically configured to execute the computer program to cause the display device to perform: Identify the digit where the correction level is located, wherein the digit includes at least the hundreds place; The conversion value used to convert the floating-point parameter is determined based on the highest bit of the number. The first division operation is performed on the correction level and the conversion value to obtain the floating-point parameter.

12. The display device of claim 10, wherein the at least one processor generates an adjustable matrix for performing correction on the correction type based on the floating-point parameters, and is specifically configured to execute the computer program to cause the display device to perform: Obtain the fixed adjustment matrix corresponding to the correction type; the fixed adjustment matrix is ​​the adjustment matrix corresponding to the correction type in the native Android color correction method; Locate the positions of the fixed correction parameters used to correct the initial image in the fixed adjustment matrix; The fixed correction parameter is replaced with the floating-point parameter based on the parameter position to obtain the adjustable matrix.

13. The display device according to claim 11, wherein the at least one processor performs a first division operation on the correction level and the conversion value to obtain the floating-point parameter, and is specifically configured to execute the computer program to cause the display device to perform: Obtain the digits corresponding to the correction level; When the highest digit of the number is the hundreds digit, the converted value is set to the first value, and a first division operation is performed on the correction level and the first value to obtain the floating-point parameter; the first value is a two-digit number. When the highest digit of the number is thousands, the converted value is set to the second value, and a first division operation is performed on the correction level and the second value to obtain the floating-point parameter; the second value is a three-digit number.

14. The display device according to claim 10, wherein before the step of the at least one processor performing matrix transformation on the initial image in RGB space to obtain an analog matrix, it is further configured to execute the computer program to cause the display device to perform: Obtain the first matrix that converts the initial image from RGB space to XYZ space; Obtain the second matrix that transforms the initial image from XYZ space to LMS space; A first product operation is performed on the first matrix and the second matrix to convert the initial image to the LMS space, and a conversion matrix corresponding to the converted image is obtained, the conversion matrix being used to convert the initial image in RGB format to the LMS space.

15. The display device according to claim 14, wherein after the at least one processor obtains the output matrix corresponding to the image after performing correction on the initial image in RGB space, it is further configured to execute the computer program to cause the display device to perform: Calculate the inverse matrix of the transformation matrix based on the transformation matrix; A first product operation is performed on the initial color matrix, the transformation matrix, the correction matrix, and the inverse matrix to obtain the output matrix corresponding to the image after correction of the initial image in RGB space.

16. The display device according to claim 10, wherein the at least one processor performs a matrix transformation on the initial image in RGB space to obtain an analog matrix, specifically configured to execute the computer program to cause the display device to perform: Obtain the missing color corresponding to the selected correction type for the initial image in RGB space; Determine the first and second substitute colors of the missing color in the LMS space, and the first coordinates corresponding to the first substitute color and the second coordinates corresponding to the second substitute color; Perform a first product operation on the first coordinate and the second coordinate to obtain the simulated vector corresponding to the missing color; A projection operation is performed along the simulated vector to obtain the simulated matrix.

17. The display device of claim 10, wherein the at least one processor acquires the correction type selected when triggering color correction of an initial image in RGB space, specifically configured to execute the computer program to cause the display device to perform: In response to a color correction instruction for the initial image in the user interface, the display is controlled to show a color correction page; the color correction page includes a correction type setting for performing correction on the initial image; In response to a selection instruction for the correction type setting, the display is controlled to show the correction level corresponding to the correction type; In response to the instruction to determine the correction level, the step of obtaining the correction type selected when triggering color correction of the initial image in RGB space is performed.

18. The display device of claim 10, wherein after acquiring the step of selecting the correction type when triggering color correction of an initial image in RGB space, the at least one processor is further configured to execute the computer program to cause the display device to perform: Set the default calibration level; When it is detected that the correction level is not input based on the correction type, a default adjustment matrix is ​​generated according to the default correction level; Perform a first product operation on the default adjustment matrix and the missing matrix to obtain the default compensation matrix; The simulation matrix and the default compensation matrix are added together to obtain the default correction matrix of the initial image. Perform a first product operation on the initial color matrix and the default correction matrix to obtain the default output matrix corresponding to the image after correction of the initial image in RGB space, and output the corrected image according to the default output matrix.

19. A processing method for a display device, the method comprising: The system receives a setting instruction for a target filter mode, which is associated with preset target image quality parameters and a preset target color matrix; the target image quality parameters are display gain parameters of the image; and the color matrix is ​​a transformation matrix that performs pixel value transformation on the image. In response to the setting command, the first filter setting interface is invoked. The first filter setting interface is a preset interface in the video layer for configuring image quality parameters. The target image quality parameters are configured to the video layer through the first filter setting interface, so that the video layer displays the image based on the target image quality parameters; Call the second filter setting interface, which is a system-level interface in the display device used to configure filter effects for the graphics layer; The target color matrix is ​​configured to the graphics layer through the second filter setting interface, so that the graphics layer displays the image based on the target color matrix.

Images