Image processing method and device, display device and storage medium
Patent Information
- Application Number
- CN202411095159.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-11-15
AI Technical Summary
[0004]然而,上述处理得到的显示图像帧存在周期性规律,导致对伪像的优化效果不佳,影响用户体验
[0029] It can be understood that the beneficial effects of the second to sixth aspects can be referred to the relevant descriptions in the above-mentioned first aspect, and will not be described again here.
Smart Images

Figure CN118968901A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of display technology, and in particular to an image processing method, apparatus, display device and storage medium. Background Art
[0002] With the continuous development of technology and the improvement of people's expectations for display effects, the demand for grayscale brightness display accuracy is getting higher and higher. In many application scenarios (for example, high dynamic range (HDR) display, virtual shooting, etc.), accurate grayscale brightness display can bring more excellent visual experience and more accurate information communication.
[0003] When the grayscale accuracy of the display is insufficient, it is easy to generate or amplify image artifacts, which are specifically manifested as image distortion, abnormal texture, color deviation or uneven brightness. In the image processing process, by pre-storing multiple rotation jitter matrices (i.e., rotating the basic jitter matrix to obtain multiple different matrices), the image frame to be processed with high bit depth is periodically processed, and the display information in the image frame to be processed that is higher than the display bit depth of the display device is allocated to adjacent spatial areas to obtain a display image frame to achieve spatial jitter (Pixel Dithering); so that the display image frame corresponding to the image frame to be processed can be displayed in a display device with a low display bit depth.
[0004] However, the display image frames obtained by the above processing have a periodic pattern, which leads to poor optimization effect on artifacts and affects user experience. Summary of the invention
[0005] The present application provides an image processing method, an apparatus, a display device and a storage medium, which can reduce the artifact phenomenon in the display image frame obtained after upscaling processing and improve the user experience.
[0006] In a first aspect, an image processing method is provided, which is applied to a display device, and includes: obtaining a preset basic jitter matrix and an image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, and the image frame to be processed includes multiple initial image blocks; for each initial image block, based on the basic jitter matrix and a random noise matrix, generating a target jitter matrix corresponding to the initial image block; based on the target jitter matrix, performing bit-up processing on the candidate image blocks to obtain target image blocks corresponding to the initial image blocks, the candidate image blocks are determined by the initial image blocks according to the display bit depth shift; based on each target image block, determining the display image frame corresponding to the image frame to be processed.
[0007] In this method, a predicted basic jitter matrix is adjusted by a random noise matrix to obtain a target jitter matrix corresponding to each initial image block, thereby improving the optimization effect of the target jitter matrix on artifacts. Furthermore, dynamic upscaling processing is performed based on each target jitter matrix to reduce artifacts in the displayed image frame obtained after the upscaling processing, thereby improving user experience.
[0008] In a possible implementation, a target jitter matrix corresponding to an initial image block is generated based on a basic jitter matrix and a random noise matrix, including: determining a random noise matrix, wherein the size of the random noise matrix is determined by the bit depth of the image frame to be processed and the display bit depth; superimposing the basic jitter matrix and the random noise matrix to obtain an alternative matrix; and shifting the alternative matrix based on a preset shift strategy to obtain a target jitter matrix.
[0009] For a preset basic jitter matrix, multiple non-repetitive target jitter matrices can be determined by superimposing a random noise matrix and performing shift processing. That is to say, corresponding target jitter matrices can be determined for each initial image frame. Each target jitter matrix is independent of each other and diverse, so that the corresponding target jitter matrix can be adapted to the initial image block in the image frame to be processed.
[0010] In a possible implementation, obtaining an alternative matrix includes: if the size of the basic jitter matrix is smaller than the size of the random noise matrix, expanding the basic jitter matrix to obtain an alternative jitter matrix; and superimposing the alternative jitter matrix and the random noise matrix to obtain an alternative matrix.
[0011] In the process of generating the target jitter matrix, the basic jitter matrix is a directly obtained and determined matrix; there may be a situation where the size of the random noise matrix is different from the size of the basic jitter matrix. By adjusting the basic jitter matrix, the size of the adjusted basic jitter matrix is made the same as the size of the random noise matrix, which facilitates the superposition of the basic jitter matrix and the random noise matrix.
[0012] In a possible implementation, determining a random noise matrix includes: determining a first noise matrix, the random noise matrix including a first noise matrix, and a value range of each element in the first noise matrix is within a first preset range;
[0013] Obtaining the candidate matrix includes: normalizing the basic jitter matrix; superimposing the normalized basic jitter matrix and the first noise matrix to obtain the first matrix, and the candidate matrix includes the first matrix.
[0014] By limiting the value range of the elements in the random noise matrix by the first preset range and normalizing the basic jitter matrix, each element in each random noise matrix has a uniform range, and in the subsequent operations and comparisons with the basic jitter matrix, it is not affected by the differences in various quantities, thereby eliminating the data differences in processing different image frames through the same preset basic jitter matrix, and improving the accuracy of data processing.
[0015] In one possible implementation, based on a preset shift strategy, an alternative matrix is shifted to obtain a target jitter matrix, including: based on the preset shift strategy, determining, in the alternative matrix, a first position corresponding to the current largest first element; in the target jitter matrix, based on the size of the alternative matrix, determining the element value of the second position, and setting the first element to a first preset value, wherein the second position is a position in the target jitter matrix corresponding to the first position.
[0016] Through preset shift processing, the candidate matrix is converted into a target dither matrix, so that the order of magnitude of each corresponding target dither matrix is unified, so that the corresponding target dither matrix can better adapt to the initial image block in the image frame to be processed, and provide a standard and unified dither matrix for subsequent processing.
[0017] In a possible implementation, after acquiring the image frame to be processed, the method further includes: dividing the image frame to be processed into multiple sub-regions based on a preset partitioning strategy, each sub-region including multiple initial image blocks; and processing the initial image blocks in each sub-region respectively.
[0018] The number of initial image blocks in the image frame to be processed is relatively large. The image frame to be processed can be divided into multiple sub-areas by a preset partitioning strategy, and the initial image blocks in multiple sub-areas can be processed simultaneously to improve data processing efficiency.
[0019] In a possible implementation, the candidate image blocks are lifted based on the target dither matrix to obtain a target image block corresponding to the initial image block, and also include: comparing the target dither matrix and the remainder matrix to obtain a lifted matrix, wherein the remainder matrix is determined by the initial image block and the candidate image block; and determining the target image block based on the lifted matrix and the candidate image block.
[0020] The candidate image blocks are lifted by the lifting matrix to obtain the target image blocks after dithering, which can be equivalent to the brightness level of the initial image blocks, so that the display device can achieve the effect of high grayscale accuracy and make up for the missing high-bit display information in the candidate image blocks.
[0021] In a second aspect, an image processing device is provided, the device comprising an acquisition unit, a jitter processing unit and an image processing unit, wherein:
[0022] The acquisition unit is used to acquire a preset basic dither matrix and an image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, and the image frame to be processed includes a plurality of initial image blocks.
[0023] The dither processing unit is used to generate, for each initial image block, a target dither matrix corresponding to the initial image block based on a basic dither matrix and a random noise matrix.
[0024] The image processing unit is used to perform bit depth processing on the candidate image blocks based on the target dither matrix to obtain the target image blocks corresponding to the initial image blocks, and is also used to determine the display image frames corresponding to the image frames to be processed based on the target image blocks; the candidate image blocks are determined by the initial image blocks according to the display bit depth shift.
[0025] In a third aspect, a display device is provided, comprising a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the display device executes any one of the image processing methods in the first aspect.
[0026] In a fourth aspect, a chip is provided, comprising a processor. When the processor executes instructions, the processor executes any one of the image processing methods in the first aspect. The chip may be a chip in a display device.
[0027] In a fifth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by an image processing device, the processor executes any one of the image processing methods in the first aspect.
[0028] In a sixth aspect, a computer program product is provided, the computer program product comprising: a computer program, when the computer program is executed by an image processing device, the image processing device executes any one of the image processing methods in the first aspect.
[0029] It can be understood that the beneficial effects of the second to sixth aspects can be found in the relevant description of the first aspect above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] Figure 1 is a schematic diagram of the structure of a display device provided in an embodiment of the present application;
[0031] Figure 2 is a flowchart of an image processing method provided in an embodiment of the present application;
[0032] Figure 3 is a flow chart of determining a target jitter moment in an image processing method provided in an embodiment of the present application;
[0033] Figure 4 is a flow chart of shift processing in the image processing method provided in an embodiment of the present application;
[0034] Figure 5 is a flow chart of a superimposed matrix in an image processing method provided in an embodiment of the present application;
[0035] Figure 6 is a flowchart of the bit-up process in the image processing method provided in the embodiment of the present application;
[0036] Figure 7 is a flowchart of another image processing method provided in an embodiment of the present application;
[0037] Figure 8 is a schematic diagram of an image processing device provided in an embodiment of the present application;
[0038] Fig. 9 It is a structural schematic diagram of a display device control system provided by the present application;
[0039] Fig.10 A schematic diagram of an example of application of the image processing method. DETAILED DESCRIPTION
[0040] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0041] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.
[0042] For the purpose of illustration rather than limitation, specific details such as specific system structures, technologies, etc. are provided to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0043] For ease of understanding, some concepts involved in the embodiments of the present application are introduced and explained below:
[0044] (1) Pixel Dithering
[0045] Spatial dithering is a commonly used method in image processing and display technology. Its basic principle is to simulate more colors or grayscale levels by introducing slight changes at the pixel level, thereby improving the visual quality of the image under limited hardware conditions.
[0046] It should be understood that when pixels are small enough that the human eye cannot distinguish the color of a single pixel, spatial dithering takes advantage of this visual characteristic and cleverly arranges the color and distribution of pixels to allow the human eye to perceive more colors or grayscale levels than the actual physical pixels can represent.
[0047] (2) Artifact
[0048] In the field of image processing and display, artifacts refer to undesirable, abnormal visual phenomena or features that appear in images.
[0049] These phenomena are not inherent in the original images, but are caused by defects or imperfections in the image processing, compression, transmission, display, etc. Artifacts may appear as image blur, jagged edges, block effects, color distortion, noise, ghosting, moiré, etc.
[0050] (3) Display bit depth
[0051] Display bit depth refers to the number of colors that a display device can display, usually expressed in bits (Binary digit, BIT), also known as "bit", "bit". The display bit depth can be expressed in binary digits, such as the common 8 bits, 10 bits, 12 bits, etc. The higher the display bit depth, the more colors that can be represented and the smoother the color transition.
[0052] The display bit depth determines the number of gray levels. The higher the display bit depth, the more gray levels can be represented. For example, a display device with an 8-bit display bit depth can represent 256 gray levels, and a display device with a 10-bit display bit depth can represent 1024 gray levels.
[0053] (4) Grayscale
[0054] Grayscale level refers to the number of different gray levels that a display device can display. For example, for a display device with an 8-bit display depth, the grayscale level is 2. 8 =256 levels.
[0055] (5) Grayscale
[0056] Grayscale refers to the different brightness levels of an image or display, from the darkest to the brightest. For example, for a display device with an 8-bit display depth, the grayscale range is 0 to 255.
[0057] (6) Bit depth
[0058] Bit depth specifies the amount of color information available for each pixel in an image. The more bits of information used per pixel, the more colors available and the more realistic the color representation.
[0059] The bit depth determines the number of colors and color accuracy that an image can display. For example, a bit depth of 8 bits means that each pixel can represent 2 8 = 256 different brightness levels.
[0060] At present, display devices (for example, mini-LED, micro-LED, etc.) have the advantages of high color gamut, high brightness, large viewing angle, long life, etc., and their application scenarios are constantly enriched, especially in scenarios with high image quality requirements; in many application scenarios (for example, high dynamic range (HDR) display, virtual shooting, etc.), precise low grayscale brightness display can bring more excellent visual experience and more accurate information communication.
[0061] In the image processing process, a high-bit-depth image frame is periodically processed by pre-storing a plurality of rotational jitter matrices (i.e., rotating the basic jitter matrix to obtain a plurality of different matrices), and the display information in the image frame that is higher than the display bit depth of the display device is allocated to an adjacent spatial area to obtain a display frame to implement spatial jitter (Pixel Dithering); so that a display frame corresponding to the image frame can be displayed in a display device with a low display bit depth.
[0062] In order to optimize the image processing process, a preset dither matrix is added, that is, the preset dither matrix is a basic dither matrix that is rotated to obtain multiple different rotation dither matrices, so that different image frames correspond to different dither matrices. For example:
[0063]
[0064] If the bit depth of the image frame to be displayed is 10 bits, the current display requirement is 125 grayscales, but the display bit depth of the display device is 8 bits, then Among them, the integer part is 31, which means that the display device can realize it, and the remainder part is 0.25, which means that the display device cannot be directly realized and the grayscale needs to be generated by an algorithm.
[0065] At this time, different rotational jitter matrices can determine different bit-lifting matrices by comparing them with the remainder; elements less than the remainder indicate that the grayscale displayed is increased by one level, and elements greater than or equal to the remainder indicate that the grayscale remains unchanged during display; the process is as follows:
[0066] Transform rotation jitter matrix
[0067] Compare Rotational Jitter Matrices The matrix corresponding to the remainder Get the raised matrix
[0068] Get the corresponding multiple lifting matrices
[0069] Artifacts are easily generated in low grayscale brightness displays. Through the above-mentioned rotating jitter matrix, a different bit-lifting matrix is used for every four image frames. However, the image frames obtained by this image processing process have a periodic pattern, and the human eye is more sensitive to regular spatiotemporal changes, resulting in poor optimization effects on artifacts, affecting user experience.
[0070] In view of this, the embodiments of the present application provide an image processing method, apparatus, display device and storage medium, the method comprising: first, obtaining a preset basic jitter matrix and an image frame to be processed including multiple initial image blocks; for each initial image block, generating a target jitter matrix corresponding to the initial image block based on the basic jitter matrix and the random noise matrix; thereby, the candidate image blocks determined by the initial image block according to the display bit depth shift can be up-shifted based on the target jitter matrix to obtain the target image blocks corresponding to the initial image blocks, and the display image frames corresponding to the image frames to be processed. In this method, a predicted basic jitter matrix is adjusted by a random noise matrix to obtain the target jitter matrix corresponding to each initial image block, thereby improving the optimization effect of the target jitter matrix on artifacts, and then, dynamically performing up-shifting based on each target jitter matrix, reducing the artifact phenomenon in the display image frame obtained after the up-shifting, and improving the user experience.
[0071] The image processing method provided in the embodiment of the present application can be applied to display devices such as mini-LED, micro-LED, LCD (Liquid Crystal Display), etc. The embodiment of the present application does not impose any restrictions on the specific type of display device.
[0072] For example, Figure 1 1 is a schematic diagram of the structure of an example of a display device provided in an embodiment of the present application. The display device 100 may include a processor 110, a memory 120, a communication unit 130 and a display screen 140.
[0073] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the display device 100. In other embodiments of the present application, the display device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0074] The processor 110 may include one or more processing units, for example, the processor 110 may include a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0075] The processor 110 can be used to control the display device 100, execute software programs, and process data of software programs. The display device 100 can also include a communication unit 130 to implement signal input (reception) and output (transmission), such as a receiver that can receive image data through a network cable.
[0076] The controller may be the nerve center and command center of the display device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0077] For another example, the display device 100 may be a terminal device, and the communication unit 130 may be a transceiver of the terminal device, or the communication unit 130 may be a transceiver circuit of the terminal device.
[0078] The display device 100 may include one or more memories 120 on which a program 121 is stored. The program 121 can be executed by the processor 110 to generate instructions so that the processor 110 executes the image processing method described in the above method embodiment according to the instructions.
[0079] Optionally, data may be stored in the memory 120. Optionally, the processor 110 may read data stored in the memory 120. The data may be stored at the same storage address as the program 121, or may be stored at a different storage address than the program 121.
[0080] The processor 110 and the memory 120 may be provided separately or integrated together; for example, integrated on a system on chip (SOC) of a terminal device.
[0081] Exemplarily, the memory 120 can be used to store the relevant program 121 of the image processing method provided in the embodiment of the present application, and the processor 110 can be used to call the relevant program 121 of the image processing method stored in the memory 120 when performing image restoration on the terminal device, and execute the image processing method of the embodiment of the present application.
[0082] The memory 120 is used to store instructions and data. The memory 120 can store instructions or data that have just been used or are cyclically used by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0083] The display screen 140 is composed of an LED light panel.
[0084] For ease of understanding, the following examples of this application will be Figure 1 Taking the display device of the shown structure as an example, the image processing method provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.
[0085] Combine the following Figures 2 to 7 The image processing method provided in the embodiment of the present application is described in detail. It should be noted that if there are substantially the same results, the method of the present application is not used as Figures 2 to 7 The process sequence shown is limited.
[0086] Figure 2 is a flow chart of the image processing method provided in the embodiment of the present application, such as Figure 2 As shown, the image processing method comprises the following steps:
[0087] S210: Obtain a preset basic dithering matrix and an image frame to be processed.
[0088] The bit depth of the image frame to be processed is higher than the display bit depth of the display device.
[0089] It should be understood that the image frame to be processed is the basic unit that constitutes a dynamic image (such as a video). In a video, a series of image frames played continuously and quickly form a smooth dynamic visual effect. Among them, high-resolution image frames can present more details and make the image clearer. For example, an image frame with a 4K resolution (3840×2160 pixels) contains more pixels than an image frame with a 1080P resolution (1920×1080 pixels), showing a sharper and more realistic image.
[0090] It should also be understood that the embodiment of the present application performs image processing on the image frame to be processed so that the display device can increase the display grayscale to display the image frame to be processed, wherein the size of the basic jitter matrix is smaller than the size of the image frame to be processed, and therefore, the image frame to be processed can be divided into multiple area blocks, namely, initial image blocks, by region division. In other words, the image frame to be processed includes multiple initial image blocks.
[0091] In order to improve the efficiency of image processing, the size of the initial image block may correspond to the size of the basic dithering matrix. For example, the size of the initial image block is a multiple of the basic dithering matrix.
[0092] For example, the size of the basic jitter matrix is 4×4. If the image frame to be processed includes 3840×2160 pixels, the initial image block can be a 4×4 area. For another example, if the image frame to be processed includes 3840×2160 pixels, the initial image block can be an 8×8 area.
[0093] In the embodiment of the present application, only one basic dither matrix needs to be preset in the display device, which reduces the occupation of hardware storage resources and saves storage space. At the same time, since only one dither matrix needs to be loaded, the time for data reading and processing can be improved, thereby improving the operating efficiency of the system.
[0094] Among them, the preset basic jitter matrix is an important tool for realizing spatial jitter. When the image frame to be processed is subjected to spatial jitter processing, each pixel in the image frame to be processed will be operated with the corresponding element in the jitter matrix, thereby changing the value of the pixel in the image frame to be processed, realizing a slight adjustment of the pixel value, and achieving a jitter effect.
[0095] The basic dithering matrix is used to dither the image frame to be processed so that the display device can show the visual effect of the image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, for example, the display bit depth of the display device is 6 bits, and the bit depth of the image frame to be processed is 8 bits, 10 bits or 12 bits, etc.
[0096] It can be understood that the display bit depth of the display device is N, and the bit depth of the image frame to be processed is M, where M>N, and the bits to be increased are K=MN. In order to facilitate the processing of different image frames to be processed, if K is an integer multiple of 2, power(2, K / 2) can be used, that is, calculating 2 to the power of K / 2, to determine the size of the preset basic dither matrix: If K is not an integer multiple of 2, the size of the basic dither matrix may be set to L×L, where L may be a preset value. The dither matrix may be further processed to adapt to conversions of different lifting bits.
[0097] That is to say, there is no limitation on the size of the basic dither matrix, and it can be a 2×2 matrix, a 4×4 matrix, etc.
[0098] For example, the basic dither matrix is a 4×4 matrix. In the following step 220, the basic dither matrix can be further deformed (such as expanded) to make it meet the different improvement requirements between the display bit depth of the display device and the bit depth of the image frame to be processed.
[0099] The preset basic dither matrix can be generated by analyzing and converting using a Bayer matrix.
[0100] For example, a Bayer matrix is used to generate a 4×4 basic dither matrix.
[0101] In some embodiments, a matrix of a corresponding size may be randomly generated based on a preset generation strategy, or a matrix of a corresponding size may be spliced based on a splicing rule and a splicing basic matrix. For example, if the size of the basic jitter matrix to be generated is 4×4, data 0-15 may be randomly allocated to generate the basic jitter matrix.
[0102] In some embodiments, an empirical model may be used to establish a fixed model based on previous image processing experience and experimental data to generate a basic dither matrix.
[0103] S220 . For each initial image block, generate a target dithering matrix corresponding to the initial image block based on a basic dithering matrix and a random noise matrix.
[0104] For each initial image block in the image frame to be processed, a target jitter matrix corresponding to the initial image block can be generated through a basic jitter matrix and a random noise matrix. It should be understood that the target jitter matrix is used to perform image processing on the initial image block, so that the image frame to be processed composed of the initial image blocks can be displayed in a display device, thereby improving the display grayscale of the display device.
[0105] In one possible case, the basic jitter matrix and the random noise matrix may be superimposed to obtain an alternative matrix, so that the target jitter matrix may be obtained by shifting the alternative matrix, thereby improving the optimization effect of the target jitter matrix on artifacts. Figure 3 is a flow chart of determining a target jitter moment in an image processing method provided in an embodiment of the present application, such as Figure 3 As shown, determining the target jitter moment includes the following steps:
[0106] S310: Determine a random noise matrix.
[0107] The size of the random noise matrix is determined by the bit depth of the image frame to be processed and the display bit depth of the display device.
[0108] It can be understood that the difference between the bit depth of the image frame to be processed and the display bit depth is first determined, and then the size of the random noise matrix is determined based on the difference. That is, the display bit depth of the display device is N, the bit depth of the image frame to be processed is M, and the difference D=MN. It should be understood that the difference is also used to characterize the bits that need to be improved in the image to be processed displayed by the display device; then, the number of elements in the random noise matrix is determined by the D power of 2, and then the size of the random noise matrix is determined.
[0109] It should be understood that for displaying the image frame to be processed, the display device needs to dither to increase the brightness of D bits, and the corresponding brightness levels include The minimum brightness unit is
[0110] For example, if the display bit depth of the display device is 6 bits, and the bit depth of the image frame to be processed is 10 bits, for the 85 grayscale displayed on the display device with 10 bits, by calculating It can be determined that the integer part 5 is the part that can be realized by the display device, and the remainder Since it cannot be directly implemented by display devices, the grayscale corresponding to the remainder needs to be generated by an algorithm.
[0111] It should be understood that the size of the random noise matrix is determined by determining the number of elements in the random noise matrix. There may be random noise matrices of various sizes. The random noise matrix can be further determined by the size of the basic jitter matrix to improve the efficiency of data processing.
[0112] For example, the size of the basic jitter matrix is 4×4, and when the difference is 4, it corresponds to 2 4 =16, at this time, the size of the random noise matrix can be 4×4, or it can also be 2×8, etc. At this time, when the size of the random noise matrix is 4×4, the data processing efficiency is higher; when the difference is 5, corresponding to 2 5 =32, at this time, the size of the random noise matrix can be 8×4, or 4×8, or 2×16, etc. At this time, when the size of the random noise matrix is 8×4 or 4×8, the data processing efficiency is higher; when the difference is 6, corresponding to 2 6 =64, at this time, the size of the random noise matrix can be 8×8, or can also be 4×16, etc. At this time, when the size of the random noise matrix is 8×8, the data processing efficiency is higher.
[0113] In some embodiments, the random noise matrix can be determined by a corresponding algorithm. The embodiment of the present application does not limit the determination process. When the size of the random noise matrix is X×Y, the random noise matrix can satisfy the following formula: Mat_noise=Rand(X,Y), where Rand(X,Y) is used to generate a matrix of X×Y random numbers.
[0114] It should be understood that for different initial image blocks, the corresponding random operation matrices are different.
[0115] For example, if the size of the random noise matrix is 4×4, the random noise matrix
[0116] S320: Superimpose the basic jitter matrix and the random noise matrix to obtain an alternative matrix.
[0117] Among them, superposition refers to the addition operation of the matrix, and the basic jitter matrix and the random noise matrix are added. The result of the operation is an alternative matrix, that is, the alternative matrix Mat2=Mat1+Mat_noise, where Mat1 is the basic jitter matrix and Mat_noise is the random noise matrix.
[0118] For example, the basic dither matrix Random Noise Matrix Then the alternative matrix
[0119] It should be understood that in the process of generating the target jitter matrix, the basic jitter matrix is a directly obtained and determined matrix; there may be a situation where the size of the random noise matrix is different from the size of the basic jitter matrix. At this time, the basic jitter matrix needs to be adjusted so that the size of the adjusted basic jitter matrix is the same as the size of the random noise matrix, so as to facilitate the superposition of the basic jitter matrix and the random noise matrix.
[0120] Among them, if the size of the basic jitter matrix is smaller than the size of the random noise matrix, the basic jitter matrix can be expanded to obtain an alternative jitter matrix. It should be understood that the size of the alternative jitter matrix is the same as the size of the random noise matrix; the alternative jitter matrix and the random noise matrix are superimposed to obtain an alternative matrix.
[0121] It should be understood that if the size of the basic jitter matrix is larger than the size of the random noise matrix, the random noise matrix can be expanded to obtain an expanded random noise matrix, and the basic jitter matrix and the expanded random noise matrix can be superimposed to obtain an alternative matrix.
[0122] For example, the basic dither matrix Random Noise Matrix
[0123] In the example, the size of the basic jitter matrix is 4×4, and the size of the random noise matrix is 8×8. The sizes of the two are different. The basic jitter matrix can be expanded to 8×8 to facilitate the superposition of the basic jitter matrix and the random noise matrix.
[0124] The alternative jitter matrix corresponding to the base jitter matrix can be determined by tiling, for example, The alternative jitter matrix corresponding to the basic jitter matrix can also be determined by expansion methods such as copying, filling, and repeating. It should be understood that there are many expansion methods, which are not limited in the embodiments of the present application.
[0125] like Figure 3 As shown, the method further includes: S330, performing shift processing on the candidate matrix based on a preset shift strategy to obtain a target jitter matrix.
[0126] It should be understood that the preset shift strategy is to adjust each candidate matrix to a target jitter matrix of a uniform order of magnitude.
[0127] Furthermore, the target dither matrices corresponding to the initial image blocks obtained by the preset shift strategy can dynamically perform upscaling processing based on the target dither matrices, thereby reducing artifacts in the displayed image frame obtained after the upscaling processing.
[0128] It should also be understood that, through the preset shift processing, the candidate matrix is converted into a target dither matrix, so that the corresponding target dither matrix is better adapted to the initial image block in the image frame to be processed.
[0129] in, Figure 4 is a flow chart of the shift processing in the image processing method provided in the embodiment of the present application, such as Figure 4 As shown, based on the preset shift strategy, the candidate matrix is shifted, including the following process:
[0130] S331. Based on a preset shift strategy, determine the first position corresponding to the current largest first element in the candidate matrix.
[0131] It should be understood that in the alternative matrices, the values of each element are different. In order to ensure that each image frame to be processed in the same video can be up-scaled based on the same order of magnitude, it is necessary to obtain a target jitter matrix of the same order of magnitude. In order to eliminate the data differences between the alternative matrices, the alternative matrices need to be shifted.
[0132] Therefore, during the shift processing, it is necessary to traverse the candidate matrix based on the number of elements in the candidate matrix. During each traversal, it is necessary to determine the current largest first element and the position corresponding to the first element, so as to facilitate the shift processing of the first element.
[0133] S332. In the target jitter matrix, based on the size of the candidate matrix, determine the element value of the second position, and set the first element to a first preset value.
[0134] The second position is a position in the target jitter matrix corresponding to the first position.
[0135] It should be understood that the size of the target dither matrix is the same as the size of the candidate matrix. Therefore, the second position in the target dither matrix can be determined by the first position in the candidate matrix.
[0136] The element value at the second position in the target jitter matrix is determined based on the number of bits promoted. For example, if the number of bits promoted is 4 bits, the element value corresponding to the second position is set to 15, 14, ..., 0 in sequence.
[0137] In order to dynamically determine the target jitter matrix in the shifting process, it is necessary to set the first element corresponding to the determined first position in the alternative matrix to a first preset value, wherein the value of the first preset value needs to be smaller than the minimum element value in the alternative matrix. For example, if the minimum element value in the alternative matrix is 4.88, the first preset value can be set to 0, 1, 2, etc.
[0138] For example, the alternative matrix Perform shift processing, the specific processing process is as follows:
[0139] First, initialize a matrix with the same size as the candidate matrix Mat2, namely the target jitter matrix Mat3;
[0140] Secondly, in the candidate matrix Mat2, determine the first position Mat2[3][3] of the largest first element 27.68;
[0141] Next, at the second position Mat3[3][3] corresponding to the target jitter matrix, determine that the element value of the second position is 15, and set the first element of the first position Mat2[3][3] in the candidate matrix to the first preset value, which is 0;
[0142] Then, repeat the above process until every first position in the candidate matrix Mat2 is traversed;
[0143] Finally, the target jitter matrix is obtained
[0144] It should be understood that through the above process, the candidate matrix is transformed into
[0145] It should also be understood that, at this time, the determined target dithering matrix and the basic dithering matrix are different, and the target dithering matrix corresponding to each initial image block is different.
[0146] Furthermore, for the image frame to be processed, the bit-up process can be performed through each target dither matrix.
[0147] For the target jitter matrix, if its size is n×n, the value range of each element (i.e. jitter value) inside it is 0 to n×n-1, that is, different permutations and combinations can be obtained (n 2 )! There are various matrices, therefore, for each image frame to be processed in the video, the corresponding target jitter matrix is various and random, and then, the display image frame obtained after the jitter processing by the target jitter matrix has a better optimization effect on the artifacts.
[0148] The embodiment of the present application converts the candidate matrix into a target dither matrix through a preset shift process, so that the corresponding target dither matrix can be adapted to the initial image block in the image frame to be processed in a diverse and uniform order of magnitude.
[0149] In some embodiments, in order to make each element in each random noise matrix have a uniform range so that the subsequent operations and comparisons with the basic jitter matrix are not disturbed by the differences in quantities, the value range of the elements in the random noise matrix can be limited.
[0150] A first noise matrix is determined, and the value range of each element in the first noise matrix is within a first preset range. It should be understood that the random noise matrix includes the first noise matrix, that is, the first noise matrix is a random noise matrix with a limited value range.
[0151] For example, the first preset range may be a range between 0 and 1, and if the size of the random noise matrix is 4×4, the first noise matrix And, in this embodiment, the determined elements in each first noise matrix are all within a first preset range.
[0152] In some embodiments, the random noise matrix may be processed by normalization to obtain a first noise matrix, so that the value range of each element in the first noise matrix is within a first preset range. It should be understood that the embodiment of the present application does not limit the normalization method, and may be maximum value normalization, sum normalization, etc.
[0153] Through the first noise matrix determined as above, each element thereof has a uniform range, so that excessively large or small elements are prevented from having excessive impact on subsequent results, thereby improving the stability of the processing process.
[0154] In order to unify the quantitative differences of each matrix, the basic jitter matrix can be normalized. At this time, the random noise matrix is the first noise matrix. Then, for Figure 3 Step 320 in the above example superimposes the basic jitter matrix and the random noise matrix to obtain an alternative matrix, which can be obtained by Figure 5The flowchart shown is used to determine, Figure 5 is a flowchart of a superimposed matrix in an image processing method provided in an embodiment of the present application, such as Figure 5 As shown, the following steps are included:
[0155] S311. Determine a first noise matrix.
[0156] The first preset range corresponding to the first noise matrix may be a range between 0 and 1.
[0157] S321. Normalize the basic jitter matrix.
[0158] For example, the basic dither matrix The normalized basic jitter matrix is It should be understood that the embodiments of the present application do not limit the method of normalization processing.
[0159] S322: Superimpose the normalized basic jitter matrix and the first noise matrix to obtain a first matrix.
[0160] The candidate matrix includes the first matrix, that is, the first matrix is a candidate matrix, that is, the first matrix Mat2′=Mat1 nor +Mat_noise′, where Mat1 nor is the normalized basic jitter matrix, and Mat_noise′ is the first noise matrix.
[0161] For example, the first noise matrix Superimposing the normalized basic jitter matrix and the first noise matrix;
[0162] Get the first matrix
[0163] It can be known from step 320 that in some embodiments, if the size of the basic jitter matrix is smaller than the size of the random noise matrix, it is also necessary to expand the normalized basic jitter matrix to obtain an alternative jitter matrix, for example, Further, the candidate dither matrix and the random noise matrix are superimposed to obtain a first matrix.
[0164] It should be understood that in the embodiments of the present application, the order of expansion and normalization processing is not limited.
[0165] In some embodiments, the size of the initial image block is different from the size of the target dither matrix. In order to improve the image processing efficiency, the target dither matrix needs to be expanded.
[0166] For example, if the size of the basic dither matrix is 4×4, the size of the initial image block is 8×8, and the promoted bit is 5 bits, then when the size of the target dither matrix is 8×4, the requirement of the promoted bit processing can be met. At this time, if the obtained target dither matrix is used to perform the promoted bit processing on the initial image block, the target dither matrix needs to be expanded to be an 8×8 matrix.
[0167] In some embodiments, the size of the initial image block may also be limited by the hardware device. For example, the hardware device is limited to processing only image blocks of size 8×8. In this case, the initial image block can only be set to an 8×8 area and cannot be set to a 4×4 area. If the size of the corresponding target jitter matrix does not meet the size of 8×8, the target jitter matrix needs to be expanded.
[0168] like Figure 2 As shown, the image processing method further includes: S230, performing a bit-up process on the candidate image block based on the target dithering matrix to obtain a target image block corresponding to the initial image block.
[0169] The candidate image blocks are determined by shifting the initial image blocks according to the display bit depth.
[0170] It should be understood that the image frame to be processed corresponding to the initial image block cannot be displayed by the display device. Therefore, each initial image block needs to be shifted so that the image frame composed of the shifted initial image blocks (i.e., the alternative image blocks) meets the display bit depth of the display device.
[0171] The shift processing may be to convert the initial image block with a high bit depth into the candidate image block with a low bit depth by performing a negative shift on the initial image block.
[0172] In order to make up for the missing high-bit display information in the candidate image block, the candidate image block can be upgraded through the upgrade matrix, so that the target image block after dithering can be equivalent to the brightness level of the initial image block, so that the display device can achieve the effect of high grayscale accuracy. Figure 6 is a flowchart of the bit-up process in the image processing method provided in the embodiment of the present application, such as Figure 6 As shown, the following steps are included:
[0173] S410 , compare the target jitter matrix and the remainder matrix to obtain a raised matrix.
[0174] The remainder matrix is determined by the initial image block and the candidate image block.
[0175] The candidate image block is an image block of low bit depth, and the initial image block is an image block of high bit depth. In order to ensure that the operation corresponds to the same bit, the candidate image block of low bit depth is positively shifted to obtain the same bit depth as the initial image block. Then, the initial image block and the candidate image block after the positive shift are subjected to a remainder operation to obtain a remainder matrix.
[0176] A comparison operation is performed on the target jitter matrix and the remainder matrix to obtain a corresponding raised matrix.
[0177] S420: Determine a target image block based on the bit-lifting matrix and the candidate image blocks.
[0178] The raised bit matrix and the candidate image block are superimposed to obtain the jittered target image block, that is, the brightness level corresponding to the initial image block is equivalently achieved at the display bit depth of the display device, thereby increasing the grayscale accuracy.
[0179] like Figure 2 As shown, the image processing method further includes: S240, determining a display image frame corresponding to the image frame to be processed based on each target image block.
[0180] It should be understood that the image frame to be processed includes multiple initial image blocks. When the target image blocks corresponding to each initial image block are determined by traversing, the display image frame corresponding to the image frame to be processed can be determined. The display image frame can be displayed on a display device, with a brightness level equivalent to that of the initial image frame, and the display image frame reduces artifacts and optimizes the display effect.
[0181] Since the image frame to be processed includes multiple initial image blocks, in order to improve the efficiency of data processing, multiple initial image blocks can be processed simultaneously. In some embodiments, after the image frame to be processed is obtained in step 210, a preset partitioning strategy can be used to realize simultaneous processing of multiple initial image blocks. Figure 7 is a flowchart of another image processing method provided in an embodiment of the present application, such as Figure 7 As shown, after step 210, the following steps are also included:
[0182] S211 . Divide the image frame to be processed into a plurality of sub-regions based on a preset partitioning strategy.
[0183] Each sub-region includes a plurality of initial image blocks.
[0184] For example, the image frame to be processed is a 4K image, including 3840×2160 pixels. If the size of the initial image block is 8×8, the image frame to be processed includes 480×270 initial image blocks. The image frame to be processed can be divided into 6×3 sub-areas through a preset partitioning strategy, and each sub-area includes 80*90 initial image blocks.
[0185] S212: Process the initial image blocks in each sub-region respectively.
[0186] It should be understood that the processing of the initial image block here refers to the processing process corresponding to step 220, which will not be repeated here. It should be noted that the processing of the initial image blocks in each region is independent and performed simultaneously, so the efficiency of image processing can be improved by presetting the partition strategy.
[0187] It should be understood that as the spacing between LED points in display devices becomes smaller and smaller, due to multiple factors such as coupling, device characteristics, and low current drive, problems such as different linearity of RGB sub-pixels at low grayscales occur, especially the different graying brightness of RGB at low grayscales, resulting in obvious color flicker (noise), which affects the display effect of low grayscales.
[0188] The embodiment of the present application processes each image frame to be processed in sequence. By controlling, the image processing of each image frame to be processed follows the video frame, or the image processing of each image frame to be processed follows the refresh frame, which can reduce the visual flicker caused by the jitter processing.
[0189] The refresh frame refers to the number of times the display device updates the image frame within a unit time, and the frame rate of the refresh frame is higher than the frame rate of the video frame.
[0190] In order to achieve the synchronous processing mentioned above, the image processing method can be set in a receiving card or a driver IC in the display device.
[0191] The application scenarios of the embodiments of the present application are briefly described below.
[0192] The image processing method in the embodiment of the present application can be applied to the field of display technology. For example, the display bit depth of the display device is 8 bits, the size of the basic dither matrix is 4×4, and the size of the initial image block in the image frame to be processed is 8×8.
[0193] If the bit depth of the image frame to be processed in the video is 12 bits, the bits that need to be increased are 4 bits, that is, the corresponding target dither matrix needs to be flattened into a 4×4 matrix.
[0194] Among them, the basic jitter matrix can be normalized to obtain an alternative jitter matrix, and the alternative jitter matrix is superimposed with a 4×4 first noise matrix (the value range of each element in the first noise matrix is within a first preset range) to obtain a first matrix; the alternative matrix is shifted through a preset shift strategy, and then the shifted alternative matrix is expanded to obtain an 8×8 target jitter matrix, and then, the image stream is processed through the target jitter matrix to obtain a display image frame.
[0195] If the bit depth of the image frame to be processed in the video is 13 bits, the bit to be increased is 5 bits, that is, the corresponding target jitter matrix needs to be flattened into an 8×4 matrix.
[0196] Among them, the basic jitter matrix can be expanded into an 8×4 matrix and normalized to obtain an alternative jitter matrix, which is superimposed with an 8×4 first noise matrix (the value range of each element in the first noise matrix is within a first preset range) to obtain a first matrix; the alternative matrix is shifted through a preset shift strategy, and the shifted alternative matrix is expanded to obtain an 8×8 target jitter matrix, and then the image stream is processed through the target jitter matrix to obtain a display image frame.
[0197] If the bit depth of the image frame to be processed in the video is 14 bits, the bits that need to be increased are 6 bits, that is, the corresponding target jitter matrix needs to be flattened into an 8×8 matrix.
[0198] Among them, the basic jitter matrix can be expanded into an 8×8 matrix and normalized to obtain an alternative jitter matrix, which is superimposed with an 8×8 first noise matrix (the value range of each element in the first noise matrix is within a first preset range) to obtain a first matrix; the alternative matrix is shifted through a preset shift strategy to obtain an 8×8 target jitter matrix, and then the image stream is processed through the target jitter matrix to obtain a display image frame.
[0199] It should be understood that the above is an example of an application scenario and does not limit the application scenario of the present application.
[0200] It should be understood that the above examples are intended to help those skilled in the art understand the embodiments of the present application, rather than to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of the present application.
[0201] Combination of the above Figures 2 to 7 , describes in detail the image processing method of the embodiment of the present application, and will now be combined with Figure 8 It should be understood that the image processing device in the embodiment of the present application can execute various image processing methods in the aforementioned embodiment of the present application, that is, the specific working process of the following various products can refer to the corresponding process in the aforementioned method embodiment.
[0202] Figure 8 500 is a schematic diagram of an image processing device provided in an embodiment of the present application. It should be understood that the image processing device 500 can execute Figures 2 to 7 The image processing method shown; Figure 8 As shown, the image processing device 500 includes an acquisition unit 510, a jitter processing unit 520 and an image processing unit 530, wherein:
[0203] The acquisition unit 510 is used to acquire a preset basic dither matrix and an image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, and the image frame to be processed includes a plurality of initial image blocks.
[0204] The jitter processing unit 520 is used to generate a target jitter matrix corresponding to each initial image block based on a basic jitter matrix and a random noise matrix.
[0205] The image processing unit 530 is used to perform bit-up processing on the candidate image blocks based on the target dither matrix to obtain the target image blocks corresponding to the initial image blocks; the candidate image blocks are determined by the initial image blocks according to the display bit depth shift. The image processing unit 530 is also used to determine the display image frame corresponding to the image frame to be processed based on each target image block.
[0206] Each unit module of the image processing device 500 can respectively execute the corresponding steps in the above method embodiment, so each unit module will not be described in detail here. Please refer to the description of the above corresponding steps for details.
[0207] It should be noted that the above-mentioned image processing device 500 is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.
[0208] For example, a "unit" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.
[0209] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.
[0210] Fig. 9 Schematic diagram of a display device control system provided by the present application. The display device can be used to implement the image processing method described in the above method embodiment. Fig. 9 As shown, the control system of the display device includes a sending card, a receiving card, a driver IC and a light board, wherein the light boards are spliced together to form a display screen.
[0211] In the embodiment of the present application, the image processing method is set in a receiving card or a driver IC in a display device. If it is set in a receiving card, the receiving card can perform refresh frame processing and jitter processing. By controlling the synchronization of the image processing of each image frame to be processed with the frame refresh of each image frame to be processed, the visual flicker caused by the jitter processing can be reduced.
[0212] In some embodiments, the driver IC is disposed on the back side of the light board.
[0213] The present application also provides a chip, which includes a processor. When the processor executes instructions, the processor executes an image processing method that implements any method embodiment in the present application.
[0214] It should be understood that the chip can implement a receiving card and / or a driver IC. In some embodiments, the chip can also implement the function of a sending card.
[0215] The chip can be used as a component of a display device or a part of units in the display device. The chip has a communication interface and can realize communication with other units in the display device.
[0216] Fig.10 FIG. 1 is a schematic diagram of an example of the application of the image processing method, which is used to represent the changes of each data in each module process. Fig.10 As shown, the system input video stream of the display device is 10 bits, that is, the bit depth of the processed image frame to be displayed is 10 bits, and the display bit depth of the display device is 12 bits, wherein the data processing module needs to achieve a 4-bit display enhancement, that is, to achieve an overall 16-bit grayscale accuracy effect.
[0217] The present application also provides a computer program product, which, when executed by the processor 110, implements the image processing method of any method embodiment in the present application.
[0218] The computer program product may be stored in the memory 120 , for example, a program 121 , which is converted into an executable target file that can be executed by the processor 110 after preprocessing, compiling, assembling, linking and other processing processes.
[0219] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the image processing method of any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.
[0220] The computer-readable storage medium is, for example, a memory 120. The memory 120 may be a volatile memory or a nonvolatile memory, or the memory 120 may include both a volatile memory and a nonvolatile memory. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0221] In this application, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0222] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0223] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0224] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0225] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic; for example, the division of units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0226] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0227] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0228] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An image processing method, It is characterized in that Applied to display devices, including: Acquire a preset basic dither matrix and an image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, and the image frame to be processed includes a plurality of initial image blocks; For each of the initial image blocks, generating a target dithering matrix corresponding to the initial image block based on the basic dithering matrix and the random noise matrix; Performing bit depth lifting processing on the candidate image block based on the target dithering matrix to obtain a target image block corresponding to the initial image block, wherein the candidate image block is determined by shifting the initial image block according to the display bit depth; Based on each of the target image blocks, a display image frame corresponding to the image frame to be processed is determined.
2. The image processing method according to claim 1, It is characterized in that The step of generating a target dithering matrix corresponding to the initial image block based on the basic dithering matrix and the random noise matrix includes: Determine a random noise matrix, wherein the size of the random noise matrix is determined by the bit depth of the image frame to be processed and the display bit depth; Superimposing the basic jitter matrix and the random noise matrix to obtain an alternative matrix; Based on a preset shift strategy, the candidate matrix is shifted to obtain the target jitter matrix.
3. The image processing method according to claim 2, It is characterized in that The candidate matrix is obtained, including: If the size of the basic jitter matrix is smaller than the size of the random noise matrix, expanding the basic jitter matrix to obtain an alternative jitter matrix; The candidate jitter matrix and the random noise matrix are superimposed to obtain the candidate matrix.
4. The image processing method according to claim 2, It is characterized in that Determining the random noise matrix includes: Determine a first noise matrix, the random noise matrix includes the first noise matrix, and the value range of each element in the first noise matrix is within a first preset range; The candidate matrix is obtained, including: Normalizing the basic jitter matrix; The normalized basic jitter matrix and the first noise matrix are superimposed to obtain a first matrix, and the candidate matrix includes the first matrix.
5. The image processing method according to any one of claims 2 to 4, It is characterized in that The step of performing a shift process on the candidate matrix based on a preset shift strategy to obtain the target jitter matrix includes: Based on the preset shift strategy, determining, in the candidate matrix, a first position corresponding to the current largest first element; In the target jitter matrix, based on the size of the candidate matrix, an element value of a second position is determined, and the first element is set to a first preset value, wherein the second position is a position in the target jitter matrix corresponding to the first position.
6. The image processing method according to any one of claims 1 to 4, It is characterized in that The candidate image blocks are subjected to a bit-lifting process based on the target jitter matrix to obtain a target image block corresponding to the initial image block, and further comprising: Comparing the target jitter matrix and the remainder matrix to obtain a raised matrix, wherein the remainder matrix is determined by the initial image block and the candidate image block; The target image block is determined based on the bit-lifting matrix and the candidate image blocks.
7. An image processing device, It is characterized in that The image processing device comprises: an acquisition unit, configured to acquire a preset basic jitter matrix and an image frame to be processed, wherein the bit depth of the image frame to be processed is higher than the display bit depth of the display device, and the image frame to be processed includes a plurality of initial image blocks, A jitter processing unit, configured to generate, for each of the initial image blocks, a target jitter matrix corresponding to the initial image block based on the basic jitter matrix and the random noise matrix; An image processing unit is used to perform bit depth processing on candidate image blocks based on the target dither matrix to obtain target image blocks corresponding to the initial image blocks, and to determine, based on each of the target image blocks, a display image frame corresponding to the image frame to be processed; the candidate image blocks are determined by the initial image blocks according to the display bit depth shift.
8. A display device, It is characterized in that The display device comprises a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the display device executes the image processing method according to any one of claims 1 to 6.
9. A chip, It is characterized in that The method comprises a processor, and when the processor executes instructions, the processor performs the image processing method according to any one of claims 1 to 6.
10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the image processing method according to any one of claims 1 to 6.
