Display devices, image processing methods and apparatus
By acquiring the RGB grayscale value information of the edge pixels of the LCD device and dynamically adjusting the overdrive value, the problem of color dragging in moving images of the LCD device is solved, thus improving the image quality.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-21
- Publication Date
- 2026-03-10
AI Technical Summary
LCD displays are prone to color dragging when displaying moving images, especially in fast-moving scenes, and existing overdrive algorithms cannot effectively solve this problem.
By acquiring the RGB grayscale values of the edge pixels of each of the N frames, the motion level is determined, and the overdrive value is dynamically adjusted according to a preset overdrive table to avoid color dragging.
It effectively avoids color dragging in LCD display devices under different motion scenarios, thus improving image quality.
Smart Images

Figure CN116528068B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of image processing. More particularly, it relates to a display device, an image processing method and apparatus. BACKGROUND
[0002] When displaying a moving image, a display device, including a liquid crystal display device, usually has a trailing color phenomenon. Because the deflection of the liquid crystal of the liquid crystal display device requires time, when the liquid crystal deflection time exceeds the time of one frame of image, the human eye will refer to the residual image of the previous frame, causing the trailing color phenomenon. At the same time, because an image is composed of Red Green Blue (RGB) grayscale values, the RGB ratios of different images are different, and when the liquid crystal display device displays a moving image, the response times of R, G and B pixels in the RGB pixels can be different, and if the response time of one of the pixels is longer, the trailing color phenomenon will occur.
[0003] At present, an OverDrive (OD) algorithm is usually used to improve the trailing color phenomenon of the liquid crystal display device. Specifically, the OD algorithm outputs an OD value from a previous grayscale (Pre Gray) to a target grayscale (Target Gray) to reduce the liquid crystal response time, that is, to reach the target grayscale within the time of one frame of image, so as to improve the trailing color phenomenon of the liquid crystal display device. However, the above OD method can alleviate the trailing color phenomenon in a slow scene, but the trailing color phenomenon still occurs in a fast moving scene. SUMMARY
[0004] The exemplary embodiments of the present application provide a display device, an image processing method and apparatus, which can effectively avoid the trailing color phenomenon of the display device and improve the image quality performance of the display device.
[0005] In a first aspect, the embodiments of the present application provide a display device, comprising:
[0006] a display;
[0007] a processor connected to the display, the processor being configured to:
[0008] obtain RGB grayscale value information of an edge pixel of each frame of image in N frames of image;
[0009] determine a corresponding motion level according to the RGB grayscale value information;
[0010] determine a target OD table according to the motion level and a preset OD table, the preset OD table being used to represent the OD value corresponding to the conversion of the RGB grayscale values of adjacent two frames of image under different motion levels;
[0011] display a next group of N frames of image of the N frames of image according to the target OD table.
[0012] In some possible implementation manners, the processor is specifically configured to: determine, according to the RGB grayscale value information, a target grayscale value with a maximum difference value in the RGB grayscale values of the edge pixels; obtain an average value of the difference values of the target grayscale values of the edge pixels of the adjacent two frames of images in the N frames of images; and determine the corresponding motion level according to the average value.
[0013] In some possible implementation manners, the processor is specifically configured to: if the average values are all preset values, determine that the corresponding motion level is a first motion level; or, if the average values are not all preset values, determine the corresponding motion level according to a number of the average values that are preset values.
[0014] In some possible implementation manners, the processor is specifically configured to: obtain the RGB grayscale value information of each pixel of each frame of image in the N frames of images; and obtain the RGB grayscale value information of the edge pixels of each frame of image in the N frames of images based on a preset edge detection algorithm and the RGB grayscale value information of the pixels.
[0015] In some possible implementation manners, the processor is further configured to: obtain the preset overdrive table by: obtaining an image of a preset video displayed by the display device and an original image of the preset video under different motion levels, the preset video containing two different grayscale value combinations, and the original image having no color dragging phenomenon; obtaining an average value of the difference values of the grayscale values of the corresponding pixels in the image of the preset video and the original image displayed by the display device; and if the average value of the difference values of the grayscale values is greater than a difference value threshold, adjusting an overdrive value of the preset video until the average value of the difference values of the grayscale values is less than or equal to the difference value threshold, to obtain the preset overdrive table of the corresponding motion level.
[0016] In a second aspect, an image processing method is provided, which is applied to a display device and includes the following steps.
[0017] Obtaining the RGB grayscale value information of the edge pixels of each frame of image in the N frames of images;
[0018] Determining a corresponding motion level according to the RGB grayscale value information;
[0019] Determining a target overdrive table according to the motion level and a preset overdrive table, the preset overdrive table being used to represent a corresponding overdrive value of the conversion of the RGB grayscale values of the adjacent two frames of images under different motion levels;
[0020] Displaying a next group of N frames of images of the N frames of images according to the target overdrive table.
[0021] In some possible implementation manners, determining the corresponding motion level according to the RGB grayscale value information includes: determining a target grayscale value with the largest difference in RGB grayscale values of the edge pixels according to the RGB grayscale value information; obtaining an average value of differences in the target grayscale values of the edge pixels of the adjacent two frames of images in the N frames of images; and determining the corresponding motion level according to the average value.
[0022] In some possible implementation manners, determining the corresponding motion level according to the average value includes: determining that the corresponding motion level is a first motion level if the average values are all preset values; or determining the corresponding motion level according to a number of average values that are preset values if the average values are not all preset values.
[0023] In some possible implementation manners, obtaining the RGB grayscale value information of the edge pixels of each frame of image in the N frames of images includes: obtaining the RGB grayscale value information of the pixels of each frame of image in the N frames of images; and obtaining the RGB grayscale value information of the edge pixels of each frame of image in the N frames of images based on a preset edge detection algorithm and the RGB grayscale value information of the pixels.
[0024] In some possible implementation manners, the preset overdrive table is obtained in the following manner: obtaining an image of a preset video displayed by the display device and an original image of the preset video under different motion levels, the preset video containing two different grayscale value combinations, and the original image having no color dragging phenomenon; obtaining an average value of differences in grayscale values of corresponding pixels in the image of the preset video and the original image displayed by the display device; and adjusting an overdrive value of the preset video until the average value of the differences in the grayscale values is less than or equal to a difference threshold value, to obtain the preset overdrive table of the corresponding motion level, if the average value of the differences in the grayscale values is greater than the difference threshold value.
[0025] In a third aspect, an embodiment of the present application provides an image processing apparatus applied to a display device, and the image processing apparatus includes:
[0026] A first obtaining module, configured to obtain RGB grayscale value information of edge pixels of each frame of image in N frames of images;
[0027] A first determining module, configured to determine a corresponding motion level according to the RGB grayscale value information;
[0028] A second determining module, configured to determine a target overdrive table according to the motion level and a preset overdrive table, the preset overdrive table being used to represent a corresponding overdrive value of conversion of RGB grayscale values of adjacent two frames of images under different motion levels.
[0029] A display module, configured to display a next group of N frames of images of the N frames of images according to the target overdrive table.
[0030] In some possible implementations, the first determining module is specifically used to: determine the target gray value with the largest difference among the RGB gray values of the edge pixels based on the RGB gray value information; obtain the average value of the difference between the target gray values of the edge pixels of two adjacent frames in N frames; and determine the corresponding motion level based on the average value.
[0031] In some possible implementations, when the first determining module is used to determine the corresponding exercise level based on the average value, it is specifically used to: if all the average values are preset values, then determine the corresponding exercise level as the first exercise level; or, if not all the average values are preset values, then determine the corresponding exercise level based on the number of average values that are preset values.
[0032] In some possible implementations, the first acquisition module is specifically used to: acquire the RGB grayscale value information of the pixels in each of the N frames of images; and acquire the RGB grayscale value information of the edge pixels in each of the N frames of images based on a preset edge detection algorithm and the RGB grayscale value information of the pixels.
[0033] In some possible implementations, the image processing device further includes a second acquisition module, configured to obtain a preset overdrive table by: acquiring images of a preset video displayed on a display device at different motion levels and the original image of the preset video, wherein the preset video contains two different combinations of grayscale values and the original image has no color dragging; acquiring the average value of the grayscale value difference between the corresponding pixels in the preset video image displayed on the display device and the original image; if the average value of the grayscale value difference is greater than a difference threshold, adjusting the overdrive value of the preset video until the average value of the grayscale value difference is less than or equal to the difference threshold, thereby obtaining a preset overdrive table for the corresponding motion level.
[0034] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer program instructions, which, when executed, implement the image processing method as described in the second aspect of this application.
[0035] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the image processing method as described in the second aspect of this application.
[0036] The display device, image processing method, and apparatus provided in this application acquire the RGB grayscale value information of the edge pixels of each frame in N frames of images; determine the corresponding motion level based on the RGB grayscale value information; determine a target overdrive table based on the motion level and a preset overdrive table; and display the next set of N frames of images based on the target overdrive table. Since this application determines the corresponding motion level based on the RGB grayscale value information of the edge pixels in the image, and then uses the corresponding preset overdrive table to display the image, it can dynamically adjust the overdrive value. Therefore, it can effectively avoid color dragging in the display device and improve the image quality performance of the display device.
[0037] These and other aspects of this application will become more apparent in the description of the following embodiments(s). Attached Figure Description
[0038] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.
[0039] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a user, provided in an embodiment of this application.
[0040] Figure 2 This is a hardware configuration block diagram of a display device provided in an embodiment of this application;
[0041] Figure 3 This is a schematic diagram illustrating grayscale value conversion between adjacent frame images according to an embodiment of this application;
[0042] Figure 4 A schematic diagram illustrating a color dragging phenomenon provided in an embodiment of this application;
[0043] Figure 5 A flowchart illustrating an image processing method provided in an embodiment of this application;
[0044] Figure 6 A schematic diagram illustrating an image of a preset video captured by a camera according to an embodiment of this application;
[0045] Figure 7 A flowchart of an image processing method provided in another embodiment of this application;
[0046] Figure 8 This is a schematic diagram of the structure of an image processing apparatus provided in an embodiment of this application. Detailed Implementation
[0047] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.
[0048] Based on the exemplary embodiments described in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the appended claims. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete implementation on its own.
[0049] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0050] In this application, the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings are used to distinguish similar or related objects or entities and do not necessarily imply a specific order or sequence, unless otherwise indicated. It should be understood that such terms can be used interchangeably where appropriate, for example, in situations where implementation is possible in a sequence other than those given in the embodiments illustrated or described in this application.
[0051] Furthermore, the terms “including” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0052] As used in this application, the term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.
[0053] As used in this application, the term "remote control" refers to a component of an electronic device (such as the display device disclosed in this application) that typically allows for wireless control of the electronic device over a short distance. It generally uses infrared and / or radio frequency (RF) signals and / or Bluetooth to connect to the electronic device, and may also include functional modules such as Wi-Fi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard buttons in a typical remote control device with a user interface on a touchscreen.
[0054] As used in this application, the term "gesture" refers to user behavior that uses a change in hand shape or hand movement to express an expected idea, action, purpose, and / or result.
[0055] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a user, provided in an embodiment of this application. Figure 1 As shown, when a user turns on display device 200 to watch a video, display device 200 displays the image corresponding to the video.
[0056] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactive features to the display device 200. The server 400 can be a cluster or multiple clusters, and may include one or more types of servers. Other network services, such as video-on-demand and advertising services, are provided through the server 400.
[0057] Display device 200 can be a liquid crystal display, an OLED display, or a projection display device. The specific type, size, and resolution of the display device are not limited. Those skilled in the art will understand that display device 200 can be modified in terms of performance and configuration as needed. In addition to providing broadcast television reception functions, display device 200 can also be equipped with intelligent network television functions that provide computer support, including but not limited to internet television, smart television, and Internet Protocol television (IPTV).
[0058] Figure 2 This is a hardware configuration block diagram of a display device provided in one embodiment of this application. Figure 2 As shown, in some embodiments, the display device 200 includes at least one of a controller 250, a communicator 220, a detector 230, an input / output interface 255, a display 275, a memory 260, a power supply 290, and a user interface 265.
[0059] In some embodiments, the display 275 is a component for receiving image signals output from a first processor and for displaying video content and images as well as a menu control interface.
[0060] In some embodiments, the display 275 includes a display screen assembly for presenting an image and a driving assembly for driving the image display.
[0061] In some embodiments, the display 275 is used to present a user-controlled UI interface generated in the display device 200 and used to control the display device 200.
[0062] In some embodiments, depending on the type of display 275, a driving component for driving the display may also be included.
[0063] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.
[0064] In some embodiments, the communicator 220 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communicator 220 may include at least one of the following: a Wi-Fi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, or other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The Wi-Fi chip corresponds to the Wi-Fi module 221, which may also be called a wireless module; the Bluetooth communication protocol chip corresponds to the Bluetooth module 222; and the wired Ethernet communication protocol chip corresponds to the wired Ethernet module 223.
[0065] In some embodiments, the display device 200 can establish a communication with an external control device or content providing device to send and receive control signals and data signals.
[0066] In some embodiments, the user interface 265 can be used to receive infrared control signals from a control device (such as an infrared remote controller).
[0067] In some embodiments, the detector 230 is used by the display device 200 to collect signals from the external environment or to interact with the outside world.
[0068] In some embodiments, the detector 230 includes a light receiver and a sensor for collecting ambient light intensity, which can adaptively display parameter changes by collecting ambient light.
[0069] In some embodiments, the detector 230 may also include an image acquisition device 232, such as a camera or webcam, which can be used to acquire external environmental scenes and to acquire user attributes or user interaction gestures. It can adaptively change display parameters and recognize user gestures to achieve the function of interaction with the user.
[0070] In some embodiments, the detector 230 may also include a sound acquisition device 231, such as a microphone, which can be used to receive the user's voice.
[0071] In some embodiments, such as Figure 2 As shown, the input / output interface 255 is configured to enable data transmission between the controller 250 and other external devices or other controllers 250.
[0072] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 275, the controller 250 can perform operations related to the object selected by the user command.
[0073] like Figure 2 As shown, the controller 250 includes at least one of the following: Random Access Memory 251 (RAM), Read-Only Memory 252 (ROM), Video Processor 270, Audio Processor 280, Other Processors 253 (e.g., Graphics Processing Unit (GPU), Central Processing Unit (CPU)), Communication Interface, and Communication Bus 256. The Communication Bus connects the various components.
[0074] In some embodiments, RAM 251 is used to store temporary data of the operating system or other running programs.
[0075] In some embodiments, ROM 252 is used to store various system startup instructions.
[0076] In some embodiments, ROM 252 is used to store a basic input / output system, referred to as the Basic Input / Output System (BIOS). It is used to perform power-on self-test (POST), initialization of various functional modules within the system, drivers for the system's basic inputs / outputs, and to boot the operating system.
[0077] In some embodiments, upon receiving a power-on signal, the display device 200 starts up, the CPU executes the system startup instructions in ROM 252, and copies temporary data of the operating system stored in memory to RAM 251 to facilitate the startup or operation of the operating system. After the operating system has started up, the CPU copies temporary data of various applications from memory to RAM 251 to facilitate the startup or operation of various applications.
[0078] In some embodiments, the CPU processor 254 is configured to execute operating system and application instructions stored in memory, and to execute various applications, data, and content based on various interactive instructions received from external input, so as to ultimately display and play various audio and video content.
[0079] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in a pre-power-on mode, and / or to display a screen in normal mode. The one or more sub-processors are used for one operation in a standby mode or other state.
[0080] In some embodiments, the graphics processor 253 is configured to generate various graphical objects, including an arithmetic logic unit (ALU) that performs calculations based on various interactive instructions received from the user and displays the objects according to display attributes. It also includes a renderer that renders the various objects obtained from the ALU, the rendered objects being displayed on a monitor.
[0081] In some embodiments, the video processor 270 is configured to receive external video signals and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, so as to obtain a signal that can be directly displayed or played on the display device 200.
[0082] In some embodiments, the graphics processor 253 can be integrated with the video processor or configured separately. When integrated, it can perform the processing of graphics signals output to the display. When configured separately, they can perform different functions, such as a GPU+FRC (Frame Rate Conversion) architecture.
[0083] In some embodiments, the audio processor 280 is configured to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signals, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
[0084] In some embodiments, the video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.
[0085] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or integrated into one or more chips together with the controller.
[0086] In some embodiments, the audio output receives sound signals output by the audio processor 280 under the control of the controller 250, and can output to the external audio output terminal of the generating device of an external device in addition to the speaker carried by the display device 200 itself, and may also include a short-range communication module block in the communication interface.
[0087] The power supply 290, under the control of the controller 250, provides power to the display device 200 from an external power source. The power supply 290 may include a built-in power circuit installed inside the display device 200, or it may be an external power source installed in the display device 200, providing an external power interface within the display device 200.
[0088] User interface 265 is used to receive user input signals and then send the received user input signals to controller 250. The user input signals can be remote control signals received via an infrared receiver, or various user control signals received via a network communication module.
[0089] The memory 260 includes various software modules for driving the display device 200.
[0090] The basic module is a low-level software module used for signal communication between various hardware components in the display device 200 and for sending processing and control signals to higher-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage the data.
[0091] Display devices, including LCD displays, often exhibit color trailing when displaying moving images. Taking LCD TVs as an example, color trailing has been a persistent problem due to the optical principles of LCD TVs. The deflection of liquid crystals takes time; when this deflection time exceeds the duration of one frame, the human eye references the residual image from the previous frame, causing color trailing. Furthermore, since images are composed of RGB grayscale values, and different images have different RGB ratios, the response times of the R, G, and B pixels in the RGB pixels may differ when an LCD TV displays moving images. If one type of pixel has a longer response time, color trailing will occur.
[0092] Currently, overdrive is commonly used to improve color dragging in liquid crystal displays. For example, Figure 3 This is a schematic diagram illustrating grayscale value conversion between adjacent frame images according to an embodiment of this application, as shown below. Figure 3 As shown, line 301 represents the liquid crystal deflection process from the grayscale value of the Mth frame (i.e., the initial grayscale) to the grayscale value of the (M+1)th frame (i.e., the target grayscale). It can be understood that without an overdrive algorithm (i.e., no overdrive value), the liquid crystal deflection time is longer than the time of one frame, resulting in the liquid crystal not being fully deflected when one frame is reached. The overdrive algorithm adds a grayscale value higher than the target grayscale, called the overdrive value. Its purpose is to reach the target grayscale from the initial grayscale within one frame, thereby solving the color dragging problem. For example... Figure 3Line 302 corresponds to the optimal overdrive value. However, if the overdrive value is too high, for example... Figure 3 Line 303 in the image will cause the grayscale value of the next frame to exceed the target grayscale value, resulting in color dragging. Current overdrive algorithms only have a fixed overdrive lookup table. This table cannot ensure that all grayscale conversions reach the target grayscale value within one frame. In the same grayscale conversion scenario, using a fixed overdrive value can mitigate color dragging in slow scenes, but it will still occur in fast-moving scenes, causing the human eye to perceive color dragging and resulting in a poor user experience. For example, when playing moving images, color dragging occurs at motion edges, especially at the boundaries of bright and dark scenes, where the dragging is more noticeable. Figure 4 This is a schematic diagram illustrating a color dragging phenomenon provided in an embodiment of this application, as shown below. Figure 4 As shown, in Scene 1, within white box 401, values a and b correspond to the boundaries of bright and dark scenes, respectively. The RGB grayscale values and grayscale differences corresponding to a and b are, for example, the data for Scene 1 in Table 1. In Scene 2, within white box 402, values c and d correspond to the boundaries of bright and dark scenes, respectively. The RGB grayscale values and grayscale differences corresponding to c and d are, for example, the data for Scene 2 in Table 1. It can be understood that the RGB values at the boundaries of bright and dark scenes differ significantly, and the RGB differences are also different. When the image moves, the response times of the RGB grayscale values are different. A larger grayscale difference (such as the R grayscale difference in Scene 1) results in a longer response time, causing color dragging at the moving edges. In Scene 1, this manifests as red dragging, and in Scene 2, it manifests as green dragging.
[0093] Table 1
[0094]
[0095] To address the aforementioned issues, this application provides a display device, image processing method, and apparatus. By increasing motion vector calculations for different motion scenarios and dynamically adjusting the overdrive value, the display device can effectively avoid color dragging and improve its image quality.
[0096] The following detailed embodiments illustrate how this application performs image processing.
[0097] Figure 5 This is a flowchart illustrating an image processing method provided in one embodiment of the present application, applied to a display device, which includes a display and a processor connected to the display. Figure 5 As shown, the processor in the display device is configured to perform the following steps:
[0098] In S501, the RGB grayscale value information of the edge pixels of each frame in N frames of images is obtained.
[0099] In this embodiment of the application, for example, N frames of images are, for example, 5 frames of images. Five frames of images can be captured consecutively and stored in the image memory of the display device. (See reference...) Figure 4 Taking scene 1 as an example, within the white frame 401, pixels a and b correspond to the boundaries of bright and dark scenes, respectively. Accordingly, the corresponding edge pixels and their RGB grayscale values can be determined. The RGB grayscale values include R, G, and B grayscale values. For example, the RGB grayscale values are the R, G, and B grayscale values corresponding to pixel a in Table 1. For details on how to obtain the RGB grayscale values of the edge pixels in each of the N frames, please refer to subsequent embodiments; they will not be elaborated here.
[0100] In S502, the corresponding motion level is determined based on the RGB grayscale value information.
[0101] For example, there are five motion levels: motion level 0, motion level 1, motion level 2, motion level 3, and motion level 4. It can be understood that different motion levels correspond to different movement speeds of edge pixels in the image. In this step, after obtaining the RGB grayscale value information of the edge pixels in each of the N frames of images, the corresponding motion level can be determined based on the RGB grayscale value information. For details on how to determine the corresponding motion level based on the RGB grayscale value information, please refer to subsequent embodiments; they will not be repeated here.
[0102] In S503, the target overdrive table is determined based on the motion level and the preset overdrive table.
[0103] The preset overdrive table is used to characterize the overdrive value corresponding to the RGB grayscale value conversion of two adjacent frames under different motion levels.
[0104] In this step, the preset overdrive table is pre-stored in the display device, and different motion levels correspond to different preset overdrive tables. For example, if there are 5 motion levels, there will be 5 sets of preset overdrive tables: overdrive table 0, overdrive table 1, overdrive table 2, overdrive table 3, and overdrive table 4. Overdrive table 0 can be understood as the default overdrive table of the display device. For details on how to obtain the preset overdrive table, please refer to subsequent embodiments; it will not be repeated here. It can be understood that after determining the motion level, the corresponding preset overdrive table can be obtained based on the motion level, i.e., the target overdrive table is obtained. For example, if the motion level is determined to be motion level 3, the target overdrive table can be determined to be overdrive table 3; if the motion level is determined to be motion level 0, the target overdrive table can be determined to be overdrive table 0, i.e., the default overdrive table of the display device.
[0105] In S504, based on the target overdrive table, the next set of N frames of images is displayed.
[0106] For example, if the N frames are 5 frames, and the target overdrive table determined based on the 5 frames is overdrive table 3, then the next set of 5 frames, i.e., frames 6 to 10, is displayed according to the overdrive value in overdrive table 3. Similarly, steps S501 to S504 are repeated to display the next set of N frames based on the target overdrive table determined by the N frames.
[0107] The image processing method provided in this application embodiment obtains the RGB grayscale value information of the edge pixels of each frame in N frames of images; determines the corresponding motion level based on the RGB grayscale value information; determines a target overdrive table based on the motion level and a preset overdrive table; and displays the next set of N frames of images based on the target overdrive table. Since this application embodiment determines the corresponding motion level based on the RGB grayscale value information of the edge pixels in the image, and then uses the corresponding preset overdrive table to display the image, it can dynamically adjust the overdrive value. Therefore, it can effectively avoid color dragging on the display device and improve the image quality performance of the display device.
[0108] Based on the above embodiments, optionally, the processor of the display device is further configured to: obtain the preset overdrive table by: acquiring images of a preset video displayed by the display device at different motion levels and the original image of the preset video, wherein the preset video contains two different combinations of grayscale values and the original image has no color dragging; acquiring the average value of the grayscale value difference between the image of the preset video displayed by the display device and the original image; if the average value of the grayscale value difference is greater than a difference threshold, adjusting the overdrive value of the preset video until the average value of the grayscale value difference is less than or equal to the difference threshold, thereby obtaining a preset overdrive table for the corresponding motion level.
[0109] For example, Figure 6 This is a schematic diagram illustrating an image of a preset video captured by a camera according to an embodiment of this application. Figure 6As shown, the background 601 of the preset video is a grayscale value (the grayscale value can be divided into n levels, n = 8, 16, 32...255), and the vertical frame 602 in the middle is a grayscale value (the grayscale value can be divided into n levels, n = 8, 16, 32...255). The vertical frame 602 moves from left to right at different speeds, and there are 5 motion levels according to the speed. Taking n = 8 as an example, the camera can capture 8 * 8 * 5 images (where the background 601 corresponds to 8 grayscale values, the vertical frame 602 corresponds to 8 grayscale values and 5 motion levels). The image captured by the camera is denoted as E. This image can exhibit color drag. At the same time as the camera captures the image, the television saves the current image, denoted as F. This image has not been displayed on the monitor and is the original image, therefore it does not have color drag. Image E is compared with image F. A subtraction operation is performed between the two images (subtraction is performed on pixels at the same position, since R=G=B for grayscale images, any RGB grayscale value can be calculated). The difference in grayscale value for each pixel is denoted as Xi. The average grayscale value difference of the image is then: Y = (X1 + X2 + ... + Xi + ... + Xn) / n. A threshold of grayscale value difference is defined as α. If Y is greater than α, it indicates that color dragging occurs at the grayscale boundary of that motion level. For cases where Y is greater than α, the OD value under that grayscale value difference is automatically adjusted until color dragging no longer occurs.
[0110] By adjusting the OD value to eliminate color dragging in the image under different motion levels and grayscale value differences, multiple sets of OD tables can be obtained. If there are, for example, 5 motion levels, 5 sets of OD tables will be generated. These 5 sets of OD tables are stored in the display device, thus the display device obtains a preset overdrive table. For example, Table 2 is OD Table 0 corresponding to motion level 0, where the first column is the grayscale value corresponding to the previous frame image, and the first row is the grayscale value corresponding to the current frame image. For example, 64 in the first column is the grayscale value corresponding to the previous frame image, and 128 in the first row is the grayscale value corresponding to the current frame image. From the previous frame image to the current frame image, the corresponding grayscale value needs to be converted from 64 to 128, so the corresponding OD value is B3. Table 3 is OD Table 4 corresponding to motion level 4, where Gain1 to Gain25 represent the OD compensation coefficients of motion level 4 relative to motion level 0.
[0111] Table 2
[0112] OD Table 0 0 64 128 192 255 0 A1 A2 A3 A4 A5 64 B1 B2 B3 B4 B5 128 C1 C2 C3 C4 C5 192 D1 D2 D3 D4 D5 255 E1 E2 E3 E4 E5
[0113] Table 3
[0114] OD Table 4 0 64 128 192 255 0 A1 * Gain1 A2 * Gain2 A3 * Gain3 A4 * Gain4 A5 * Gain5 64 B1 * Gain6 B2 * Gain7 B3 * Gain8 B4 * Gain9 B5 * Gain10 128 C1 * Gain11 C2 * Gain12 C3 * Gain13 C4 * Gain14 C5 * Gain15 192 D1 * Gain16 D2 * Gain17 D3 * Gain18 D4 * Gain19 D5 * Gain20 255 E1 * Gain21 E2 * Gain22 E3 * Gain23 E4 * Gain24 E5 * Gain25
[0115] The image processing method provided in the embodiments of this application will be described in detail below with reference to specific steps.
[0116] Figure 7 A flowchart illustrating an image processing method provided in another embodiment of this application. (See attached flowchart.) Figure 7 As shown, the processor in the display device is configured to perform the following steps:
[0117] In the embodiments of this application, Figure 5 Step S501 can further include the following two steps, S701 and S702:
[0118] In S701, the RGB grayscale value information of the pixels in each of the N frames of images is obtained.
[0119] In this step, the processor obtains the RGB grayscale values of pixels in each of the N frames of images according to a preset statistical method. For the preset statistical method used, relevant technologies can be referenced, and this application does not impose any limitations.
[0120] In S702, based on a preset edge detection algorithm and the RGB grayscale value information of pixels, the RGB grayscale value information of edge pixels in each of the N frames of images is obtained.
[0121] For example, after obtaining the RGB grayscale values of pixels in each of the N frames of images, a preset edge detection algorithm is used. For each pixel in the image, taking the current pixel as the center pixel, the maximum grayscale value among the RGB grayscale values of the center pixel is first obtained, for example, the maximum grayscale value is R. Then, the R grayscale value of the center pixel is subtracted from the R grayscale values of the four adjacent pixels above, below, left, and right of the center pixel, respectively. This yields four corresponding differences. The adjacent pixel corresponding to the largest difference among the four differences is determined to be the edge pixel. For example, refer to... Figure 4 In scenario 1, for example, we can obtain the edge pixel corresponding to 'a' (the RGB grayscale values of this pixel are denoted as R_A, G_A, and B_A, respectively) and the edge pixel corresponding to 'b' (the RGB grayscale values of this pixel are denoted as R_B, G_B, and B_B, respectively). The grayscale value difference between the edge pixels corresponding to 'a' and 'b' is in the range of [0, 255]. The grayscale value difference threshold of the edge pixels is defined as T, for example, 50. The value of T can be adjusted according to the display of different display devices, and this application does not limit it. According to experiments, color dragging may occur if the grayscale value difference between any of R_A and R_B, G_A and G_B, and B_A and B_B is greater than 50.
[0122] In the embodiments of this application, Figure 5 Step S502 can further include the following three steps S703 to S705:
[0123] In S703, based on the RGB grayscale value information, the target grayscale value with the largest difference among the RGB grayscale values of the edge pixels is determined.
[0124] In this step, after obtaining the RGB grayscale value information of the edge pixels in each of the N frames of images, the target grayscale value with the largest difference among the RGB grayscale values of the edge pixels can be determined based on this RGB grayscale value information. For example, referring to the data corresponding to Scene 1 in Table 1, the largest difference in grayscale values is the R grayscale value difference, so the target grayscale value is determined to be the R grayscale value.
[0125] In S704, the average value of the difference in target grayscale values of edge pixels between two adjacent frames in N frames is obtained.
[0126] For example, if N frames are 5 frames, and the target grayscale value of the edge pixels is R grayscale value, then the R grayscale value of the edge pixels in the first frame of the 5 frames is defined as R_An. The R grayscale values of the edge pixels at the same positions as the edge pixels in the first frame in the second to fifth frames are R_An+1, R_An+2, R_An+3, and R_An+4, respectively. By calculating the average of the differences in the R grayscale values of the edge pixels in two adjacent frames, four average values can be obtained.
[0127] In S705, the corresponding exercise level is determined based on the average value.
[0128] In this step, after obtaining the average difference of the target grayscale values of the edge pixels of two adjacent frames in N frames, the corresponding motion level can be determined based on the average value.
[0129] Furthermore, the processor is specifically configured to: if all average values are preset values, then determine the corresponding motion level as the first motion level; or, if not all average values are preset values, then determine the corresponding motion level based on the number of average values that are preset values.
[0130] For example, the preset value is 0, and there are five exercise levels: exercise level 0, exercise level 1, exercise level 2, exercise level 3, and exercise level 4. Based on the example in step S704, four average values can be obtained. If all four average values are zero, the corresponding exercise level is determined to be exercise level 0; if three average values are zero, the corresponding exercise level is determined to be exercise level 1; if two average values are zero, the corresponding exercise level is determined to be exercise level 2; if one average value is zero, the corresponding exercise level is determined to be exercise level 3; and if all four average values are not zero, the corresponding exercise level is determined to be exercise level 4.
[0131] In S706, the target overdrive table is determined based on the motion level and the preset overdrive table.
[0132] The preset overdrive table is used to characterize the overdrive value corresponding to the RGB grayscale value conversion of two adjacent frames under different motion levels.
[0133] The specific implementation process of this step can be found in the relevant description of S503, and will not be repeated here.
[0134] In S707, the next set of N frames is displayed based on the target overdrive table.
[0135] The specific implementation process of this step can be found in the relevant description of S504, and will not be repeated here.
[0136] The image processing method provided in this application embodiment obtains the RGB grayscale value information of pixels in each frame of N frames of images. Based on a preset edge detection algorithm and the RGB grayscale value information of pixels, it obtains the RGB grayscale value information of edge pixels in each frame of N frames of images. According to the RGB grayscale value information, it determines the target grayscale value with the largest difference among the RGB grayscale values of edge pixels. It obtains the average value of the difference between the target grayscale values of edge pixels in two adjacent frames of N frames of images. Based on the average value, it determines the corresponding motion level. Based on the motion level and a preset overdrive table, it determines a target overdrive table. Based on the target overdrive table, it displays the next set of N frames of images. Because this application embodiment determines the corresponding motion level based on the RGB grayscale value information of edge pixels in the image, and then uses the corresponding preset overdrive table to display the image, it can dynamically adjust the overdrive value. Therefore, it can effectively avoid color dragging on the display device and improve the image quality performance of the display device.
[0137] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.
[0138] Figure 8 This is a schematic diagram of an image processing apparatus provided according to an embodiment of this application. This image processing apparatus is applied to a display device. Figure 8 As shown, the image processing apparatus 800 provided in this application embodiment includes: a first acquisition module 801, a first determination module 802, a second determination module 803, and a display module 804. Wherein:
[0139] The first acquisition module 801 is used to acquire the RGB grayscale value information of the edge pixels of each frame in N frames of images.
[0140] The first determining module 802 is used to determine the corresponding motion level based on the RGB grayscale value information.
[0141] The second determining module 803 is used to determine the target overdrive table based on the motion level and the preset overdrive table. The preset overdrive table is used to characterize the overdrive value corresponding to the RGB grayscale value conversion of two adjacent frames under different motion levels.
[0142] Display module 804 is used to display the next set of N frames of images based on the target overdrive table.
[0143] In some embodiments, the first determining module 802 may be specifically used to: determine the target gray value with the largest difference among the RGB gray values of the edge pixels according to the RGB gray value information; obtain the average value of the difference between the target gray values of the edge pixels of two adjacent frames in N frames; and determine the corresponding motion level according to the average value.
[0144] In some embodiments, when the first determining module 802 determines the corresponding exercise level based on the average value, it may specifically be used to: if all the average values are preset values, then determine the corresponding exercise level as the first exercise level; or, if not all the average values are preset values, then determine the corresponding exercise level based on the number of average values that are preset values.
[0145] In some embodiments, the first acquisition module 801 may be specifically used to: acquire the RGB grayscale value information of the pixels in each frame of N frames; and acquire the RGB grayscale value information of the edge pixels in each frame of N frames based on a preset edge detection algorithm and the RGB grayscale value information of the pixels.
[0146] In some embodiments, the image processing apparatus further includes a second acquisition module 805, configured to obtain a preset overdrive table by: acquiring images of a preset video displayed by a display device at different motion levels and the original image of the preset video, wherein the preset video contains two different combinations of grayscale values and the original image has no color dragging; acquiring the average value of the grayscale value difference between the corresponding pixels in the image of the preset video displayed by the display device and the original image; if the average value of the grayscale value difference is greater than a difference threshold, adjusting the overdrive value of the preset video until the average value of the grayscale value difference is less than or equal to the difference threshold, thereby obtaining a preset overdrive table for the corresponding motion level.
[0147] It should be noted that the device provided in this embodiment can be used to perform the above-described image processing method, and its implementation and technical effects are similar, so it will not be described again here.
[0148] It should be noted that the division of the various modules in the above device is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing element calls; they can be fully implemented in hardware; or some modules can be implemented by processing element calls to software, while others are implemented in hardware. For example, a processing module can be a separate processing element, or it can be integrated into a chip within the device. Alternatively, it can be stored as program code in the device's memory, and its functions can be called and executed by a processing element. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. During implementation, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.
[0149] For example, these modules can be one or more integrated circuits configured to implement the above methods, such as one or more ASICs (Application Specific Integrated Circuits), one or more DSPs (Digital Signal Processors), or one or more FPGAs (Field Programmable Gate Arrays). As another example, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a CPU or other processor capable of calling program code. Furthermore, these modules can be integrated together as a System-on-a-Chip (SoC).
[0150] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer programs. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another. For example, a computer program can be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).
[0151] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the image processing method described in any of the above method embodiments.
[0152] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium. When the at least one processor executes the computer program, it can implement the image processing method as described in any of the above method embodiments.
[0153] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0154] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of embodiments suitable for specific application considerations.
Claims
1. A display device, characterized by comprising: The display device comprises: a display device; a processor connected to the display device, the processor being configured to: obtain RGB grayscale value information of edge pixels in each frame of image in N frames of image, the edge pixels being determined based on a preset edge detection algorithm, for each pixel in the image, taking the current pixel as a center pixel, obtaining a maximum grayscale value in the RGB grayscale value of the center pixel, and determining a neighboring pixel corresponding to a maximum difference value among four difference values obtained by respectively subtracting corresponding grayscale values of the four neighboring pixels of the center pixel from the maximum grayscale value of the center pixel; determine a target grayscale value with the maximum difference among the RGB grayscale values of the edge pixels according to the RGB grayscale value information, obtain an average value of differences in the target grayscale values of the edge pixels in adjacent two frames of image in the N frames of image, and determine a corresponding motion level as a first motion level if the average value is a preset value, or determine the corresponding motion level according to a number of the average values being the preset value if the average values are not all the preset value; determine a target overdrive table according to the motion level and a preset overdrive table, the preset overdrive table being used to represent corresponding overdrive values of the RGB grayscale value conversion of adjacent two frames of image under different motion levels; display a next group of N frames of image of the N frames of image according to the target overdrive table.
2. The display device of claim 1, wherein, The processor is specifically configured to: obtain RGB grayscale value information of pixels in each frame of image in the N frames of image; obtain RGB grayscale value information of edge pixels in each frame of image in the N frames of image based on a preset edge detection algorithm and the RGB grayscale value information of the pixels.
3. The display device of claim 1, wherein, The processor is further configured to: obtain the preset overdrive table by: obtaining images of a preset video displayed by the display device and an original image of the preset video under different motion levels, the preset video containing two different grayscale value combinations, and the original image having no color dragging phenomenon; obtaining an average value of grayscale value differences of corresponding pixels in the images of the preset video displayed by the display device and the original image; if the average value of the grayscale value differences is greater than a difference threshold value, adjusting an overdrive value of the preset video until the average value of the grayscale value differences is less than or equal to the difference threshold value, and obtaining a preset overdrive table of a corresponding motion level.
4. An image processing method characterized by, The image processing method is applied to a display device, and the image processing method comprises: obtaining RGB grayscale value information of edge pixels in each frame of image in N frames of image, the edge pixels being determined based on a preset edge detection algorithm, for each pixel in the image, taking the current pixel as a center pixel, obtaining a maximum grayscale value in the RGB grayscale value of the center pixel, and determining a neighboring pixel corresponding to a maximum difference value among four difference values obtained by respectively subtracting corresponding grayscale values of the four neighboring pixels of the center pixel from the maximum grayscale value of the center pixel; According to the RGB gray value information, a target gray value with a maximum difference value in the RGB gray value of the edge pixel is determined; an average value of differences of the target gray values of the edge pixels of two adjacent images in the N images is obtained; if the average values are all preset values, it is determined that a corresponding motion level is a first motion level; or, if the average values are not all preset values, according to a number of the average values being preset values, a corresponding motion level is determined; According to the motion level and a preset overdrive table, a target overdrive table is determined, the preset overdrive table being used to represent that the RGB gray value of two adjacent images is converted into a corresponding overdrive value under different motion levels; According to the target overdrive table, a next group of N images of the N images is displayed.
5. The image processing method of claim 4, wherein, The RGB gray value information of the edge pixel of each image in the N images is obtained, including: The RGB gray value information of the pixel of each image in the N images is obtained; The RGB gray value information of the edge pixel of each image in the N images is obtained based on a preset edge detection algorithm and the RGB gray value information of the pixel.
6. The image processing method of claim 4, wherein, The preset overdrive table is obtained by the following way: An image of a preset video displayed by the display device and an original image of the preset video under different motion levels are obtained, the preset video containing two different gray value combinations, the original image having no color dragging phenomenon; An average value of gray value differences of corresponding pixels in the image of the preset video displayed by the display device and the original image is obtained; if the average value of the gray value differences is greater than a difference threshold value, an overdrive value of the preset video is adjusted until the average value of the gray value differences is less than or equal to the difference threshold value, and a preset overdrive table of a corresponding motion level is obtained.
7. An image processing apparatus characterized by comprising: The image processing device is applied to a display device, and includes: A first obtaining module is configured to obtain the RGB gray value information of the edge pixel of each image in the N images, the edge pixel being determined based on a preset edge detection algorithm, for each pixel in an image, taking a current pixel as a center pixel, obtaining a maximum gray value in the center pixel RGB gray value, and determining a neighboring pixel corresponding to a maximum difference value from the maximum gray value of the center pixel and corresponding gray values of four neighboring pixels above, below, left and right of the center pixel; A first determining module is configured to determine a target gray value with a maximum difference value in the RGB gray value of the edge pixel according to the RGB gray value information, and obtain an average value of differences of the target gray values of the edge pixels of two adjacent images in the N images; if the average values are all preset values, it is determined that a corresponding motion level is a first motion level; or, if the average values are not all preset values, according to a number of the average values being preset values, a corresponding motion level is determined; A second determining module is configured to determine a target overdrive table according to the motion level and a preset overdrive table, the preset overdrive table being used to represent that the RGB gray value of two adjacent images is converted into a corresponding overdrive value under different motion levels; a display module configured to display a next group of N frames of images of the N frames of images according to the target overdrive table.
8. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer program instructions, and the computer program instructions are executed to implement the image processing method in any one of claims 4 to 6.
9. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the image processing method in any one of claims 4 to 6.
Citation Information
Patent Citations
Source electrode driving circuit, source electrode driving method and display device
CN105931612A
Overdrive device and its method
CN1828713A