IMAGE PROCESSING APPARATUS, IMAGE DISPLAY SYSTEM, IMAGE PROCESSING METHOD, PROGRAM, AND STORAGE MEDIUM
The image processing device addresses flicker and false contours in HDR images by truncating bits and setting a high dither frequency, combined with spatial dithering, to enhance gradation and reduce artifacts on displays with fewer bits.
Patent Information
- Application Number
- JP2021004500
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-14
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2041-01-14
AI Technical Summary
Existing image processing methods for High Dynamic Range (HDR) images on displays with fewer bits cause flicker and false contours due to temporal dither processing, especially when the dither frequency is low relative to the frame rate.
An image processing device that performs temporal dither processing by truncating C bits from A bits and converting to B bits, setting the dither frequency to 25 or more frames per second, and using a dither pattern that pseudo-expresses the A-bit image with N frames as the minimum unit, combined with spatial dither processing to reflect truncated bits in effective bits.
Suppresses flicker and false contours in HDR images displayed on displays with fewer bits, maintaining smooth gradation and reducing noticeable artifacts.
Smart Images

Figure 0007579153000001 
Figure 0007579153000002 
Figure 0007579153000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for performing dither processing on image data. [Background technology]
[0002] Traditionally, video display devices such as televisions, monitors, and smartphones have used the Standard Dynamic Range (hereinafter referred to as SDR) as the dynamic range of brightness. However, in recent years, an increasing number of devices are capable of displaying images in a wider dynamic range of brightness, the High Dynamic Range (hereinafter referred to as HDR).
[0003] The SDR processing defined in the RECOMMENDATION ITU-R BT.709 (hereafter referred to as ITU-BT.709) standard is based on 8-bit quantization, while the HDR processing defined in the SMPTE STANDARD 2084 (hereafter referred to as SMPTE ST 2084) standard is based on multi-bit processing of at least 10 bits.
[0004] In this image display system premised on multi-bit processing, the image processing device has a multi-bit processing function of 10 bits or more, but the input section of the display device may be less than 10 bits. In this case, it is necessary to reduce the bits of the image when outputting the image to the display device, but this may result in coarse gradation of the image and the occurrence of false contours. To address this issue, a dither processing method is known as a method for eliminating false contours.
[0005] Patent Document 1 discloses a technology for suppressing pseudo contours by performing dither processing in the time direction (hereinafter referred to as temporal dither processing) and dither processing in the space direction (hereinafter referred to as spatial dither processing) using multiple dither matrices to express pseudo gradations.
[0006] Furthermore, Patent Document 2 discloses a technique for suppressing pseudo contours by dithering in the time direction and dithering in the space direction using random numbers. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2020-52097 A [Patent Document 2] Japanese Patent Application Publication No. 10-261080 Summary of the Invention [Problem to be solved by the invention]
[0008] However, because time dithering changes the luminance of an image at high speed, this change in luminance may be seen as screen flicker. In particular, when time dithering is performed on an HDR image, the flicker is more noticeable than in an SDR image. Furthermore, when time dithering is performed, the more frames are required and the lower the dither frequency (hereinafter, dither frequency) relative to the frame rate, the more noticeable the flicker becomes in the image display.
[0009] In the temporal dithering and spatial dithering processes described in Patent Document 1, there is a trade-off between increasing the area of the dither matrix and the number of required frames, so that it may be difficult to increase the dither frequency depending on the conditions.
[0010] Furthermore, in the time dithering process in Patent Document 2, a random number generator is used to perform random number addition in the time dithering process, making it difficult to uniquely determine the dithering frequency.
[0011] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide an image processing device that can suppress the occurrence of flicker and false contours when displaying an HDR image with a higher bit count on a display device that performs display with a smaller bit count. [Means for solving the problem]
[0012] The image processing device according to the present invention is an image processing device for truncating C bits (C is a positive integer) from an A-bit (A is a positive integer) image, and displaying the truncated B=(AC)-bit image on a display means at a frame rate of M frames / second (M is a positive real number), B= (AC) bit The value at the Kth step (K is a positive integer) and the value at the (K+1)th step The pixel value that is the intermediate value of B= (AC) bit The K-th step value and the (K+1)-th step value are Every N frames (N is a positive integer) By outputting only the first number of frames N1 and the second number of frames N2 (N=N1+N2) in a time dithering means for pseudo-expressing the A-bit image with a dithering pattern having the N frames as a minimum unit, the first frame number N1 and the second frame number N2 are set based on a ratio of the magnitude of the intermediate value to a difference between the K-th step value and the (K+1)-th step value; The time dither means sets the value of N so that M / N is 25 or more. Furthermore, the time dither means performs time dither processing on a start frame of a dither pattern of the N frames according to a value of the C bit obtained by truncating the A bit image, and performs time dither processing on frames other than the start frame of the N frames according to a value of the C bit obtained by truncating the A bit image to be subjected to the time dither processing as the start frame. It is characterized by: Effect of the Invention
[0013] According to the present invention, when an HDR image with a higher number of bits is displayed on a display device that performs display with a smaller number of bits, it is possible to suppress the occurrence of flicker and pseudo contours. [Brief description of the drawings]
[0014] [Figure 1] 1 is a block diagram showing an example of the arrangement of an image display system according to a first embodiment. [Diagram 2] FIG. 4 is a schematic diagram showing an example of a time dither process according to the first embodiment. [Diagram 3] FIG. 4 is a schematic diagram showing an example of a time dither process according to the first embodiment. [Figure 4] 5A and 5B are schematic diagrams illustrating an example of time dither processing for a certain pixel of moving image data according to the first embodiment. [Diagram 5] 5A and 5B are schematic diagrams illustrating an example of time dither processing for a certain pixel of moving image data according to the first embodiment. [Figure 6]FIG. 11 is a block diagram showing an example of the arrangement of an image display system according to a second embodiment. [Figure 7] 10A to 10C are schematic diagrams showing spatial dither processing and temporal dither processing in the second embodiment. [Figure 8] FIG. 11 is a schematic diagram illustrating an example of spatial dither processing according to the second embodiment. [Figure 9] FIG. 11 is a schematic diagram showing an example of a time dither process according to the second embodiment. [Figure 10] 10 is a flowchart showing spatial dither processing and temporal dither processing in the second embodiment. [Figure 11] FIG. 11 is a block diagram showing an example of the arrangement of an image display system according to a third embodiment. [Figure 12] FIG. 11 is a detailed block diagram of a light emission characteristic inverse converter according to the third embodiment. [Figure 13] 13A to 13C are diagrams showing an example of the processing contents of temporal dither processing and spatial dither processing according to the fourth embodiment. [Figure 14] FIG. 13 is a block diagram showing an example of the configuration of a time dither unit in the fifth embodiment. [Figure 15] FIG. 13 is a block diagram showing an example of the configuration of a time dither unit according to a sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0016] (First embodiment) FIG. 1 is a block diagram showing an example of the configuration of an image display system including an image processing device according to a first embodiment of the present invention.
[0017] 1, the image display system of this embodiment includes an image processing device 100, an external data transmission path 110, and a display device 120. Note that the image display system of this embodiment uses RGB image data as an input image, and a display unit (described later) is also configured with RGB pixels.
[0018] The image processing device 100 includes an OETF conversion unit 101, a time dither unit 102, a transmission unit 103, a control unit 104, and a memory 105. The OETF conversion unit 101, the time dither unit 102, and the transmission unit 103 may each be an independent circuit, or may be realized by the control unit 104 executing a program stored in the memory 105.
[0019] An OETF (Optical-Electronic Transfer Function) converter 101 converts digital image data input from the outside into OETF conforming to generalized standards such as ITU BT.709 and SMPTE ST 2084.
[0020] The time dither unit 102 performs time dither processing to change the image data according to the value of a predetermined bit in the acquired image data. Time dither processing is a technique for artificially increasing the gradation by switching data according to the value of the bit to be truncated. The time dither unit 102 changes the image data according to the display speed (frame rate) of the display device 120 and the color information for each pixel of the input image. The detailed processing will be described later.
[0021] The transmitting unit 103 transmits the image data to a receiving unit 121 of the display device 120 via an external data transmission path 110 .
[0022] The control unit 104 executes a program stored in the memory 105 to control the operation of each component of the image processing device 100 .
[0023] The external data transmission path 110 is a data transmission path dedicated to image data, and may be LVDS (Low Voltage Differential Signaling), HDMI (High-Definition Multimedia Interface), Display Port (registered trademark), SDI (Serial Digital Interface), MIPI (Mobile Industry Processor Interface), etc. In this embodiment, the external data transmission path 110 has 8-bit precision. Bit precision does not mean a physical bit width, but a substantial bit width. For example, when 8-bit data and the remaining 2 bits of 0 data are packed into a 10-bit width transmission path, the precision becomes 8 bits.
[0024] The display device 120 includes a receiving unit 121, a DA conversion unit 122, an EOTF conversion unit 123, a display unit 124, a control unit 125, and a memory 126. The receiving unit 121, the DA conversion unit 122, and the EOTF conversion unit 123 may each be an independent circuit, or may be realized by the control unit 125 executing a program stored in the memory 126.
[0025] The receiving unit 121 acquires image data from the image processing device 100 via the external data transmission path 110. The DA (Digital Analog) conversion unit 122 converts the digital image data acquired from the receiving unit 121 into an analog signal.
[0026] An EOTF (Electro-Optical Transfer Function) converter 123 performs EOTF conversion on the analog image signal acquired from the DA converter 122. The OETF conversion and the EOTF conversion have an inverse conversion (inverse characteristics) relationship. The EOTF converted image data is displayed on a display unit 124, which will be described later.
[0027] According to the above data flow, the same image data as the image data acquired by the image processing device 100 is displayed on the display unit 124 .
[0028] The display unit 124 is made of a cathode ray tube, liquid crystal, organic electroluminescence (EL), etc. The display unit 124 has its own light-emitting characteristics depending on the material and configuration. Display materials such as cathode ray tubes are said to have light-emitting characteristics close to the EOTF defined in ITU BT.709.
[0029] Meanwhile, the EOTF, which brings the display of the display material closer to human perception, is defined in SMPTE ST 2084. The EOTF converter 123 represents a conversion process that converts electrical input data into light-emitting characteristics that depend on the display material. When an image is displayed on the display unit, the EOTF conversion based on the display unit 124 is applied to the image. Therefore, the OETF converter 101 applies the OETF conversion, which is the inverse conversion of the EOTF, to the input image in advance.
[0030] The control unit 125 executes a program stored in the memory 126 to control the operation of each component of the display device 120 .
[0031] Next, a specific example will be described of the time dither unit 102. First, a case will be described in which the frame rate of the display device 120 is 120 Hz (M frames / second (M is a positive real number)) and 8-bit image data is generated from 10-bit RGB image data by time dither processing.
[0032] 2 is a schematic diagram showing an example of time dither processing in time dither section 102 when the frame rate is 120 Hz. Here, it is assumed that the G data in pixels 200 to 204 of the RGB image data are "0110010000", "0110010001", "0110010010", "0110010011", and "0110010100" in binary.
[0033] When outputting 10-bit (bit width A bits (A is a positive integer)) image data as 8 bits (bit width B=(AC) bits), the number of bits to be truncated is 2 bits (C bits (C is a positive integer)). When the lower 2 bits of the data of pixels 200 to 203 are truncated and output as 8 bits, all of them become "01100100" as shown in pixel 210. Similarly, the data of pixel 204 takes a value that is 1 bit larger than that of pixel 210 (the intermediate value of one step of 8 bits), and becomes "01100101" as shown in pixel 211. In this case, the value of the truncated bit is "00" for pixels 200 and 204, "01" for pixel 201, "10" for pixel 202, and "11" for pixel 203. In the time dithering process, the value of the output data is switched for each pixel according to the value of the truncated bit.
[0034] Pixel 200 outputs pixel 210-1-00 in the first frame, pixel 210-2-00 in the second frame, pixel 210-3-00 in the third frame, and pixel 210-4-00 in the fourth frame. Pixels 210-1-00, 210-2-00, 210-3-00, and 210-4-00 all have the same value as pixel 210, "01100100." That is, pixel 200 outputs the value of pixel 210 in all four frames.
[0035] The pixel 201 outputs pixel 210-1-01 in the first frame, pixel 211-2-01 in the second frame, pixel 210-3-01 in the third frame, and pixel 210-4-01 in the fourth frame. The pixels 210-1-01, 210-3-01, and 210-4-01 all have the same value "01100100" as the pixel 210. The pixel 211-2-01 also has the same value "01100101" as the pixel 211. That is, the pixel 201 outputs the value of the pixel 210 three times in four frames, and outputs the value of the pixel 211 once in four frames. That is, the pixel 201 selectively outputs the value of the pixel 210 or the value of the pixel 211 the number of times according to the ratio within one step of the intermediate value "01".
[0036] Pixel 202 outputs pixel 211-1-10 in the first frame, pixel 210-2-10 in the second frame, pixel 210-3-10 in the third frame, and pixel 211-4-10 in the fourth frame. Both pixels 210-2-10 and 210-3-10 have the same value "01100100" as pixel 210. Also, both pixels 211-1-10 and 211-4-10 have the same value "01100101" as pixel 211. That is, pixel 202 outputs the value of pixel 210 twice in four frames, and outputs the value of pixel 211 twice in four frames.
[0037] Pixel 203 outputs pixel 211-1-11 in the first frame, pixel 210-2-11 in the second frame, pixel 211-3-11 in the third frame, and pixel 211-4-11 in the fourth frame. Pixel 210-2-11 has the same value "01100100" as pixel 210. Also, pixels 211-1-11, 211-3-11, and 211-4-11 all have the same value "01100101" as pixel 211. That is, pixel 203 outputs the value of pixel 210 once every four frames, and outputs the value of pixel 211 three times every four frames.
[0038] Pixel 204, like pixel 200, outputs the value of pixel 211 in all four frames.
[0039] Here, when images of multiple luminances are displayed in quick succession, the luminance of the image recognized by the human eye is the average luminance of all the images displayed. Therefore, as shown in pixels 221-223, it is possible to express the gradation of the original pixels 201-203 in a pseudo manner, and the user perceives smoother gradation than when time dithering is not performed, and the visibility of pseudo contours is suppressed. Note that, although the above description is given of processing the G data, the same processing is also performed on the RB data.
[0040] In the time dithering process shown in Figure 2, 4 frames (N frames (N is a positive integer)) are treated as one period (minimum unit). In this case, the dither frequency is 30 Hz calculated from a frame rate of 120 Hz / 4 frames. When the dither frequency is 30 Hz or higher (M / N is 30 or higher), flicker is barely noticeable.
[0041] 3 is a schematic diagram showing another example of the time dithering process in the time dithering section 102 when the frame rate of the display device 120 is 60 Hz. Note that a description of the same parts as those in the time dithering process shown in FIG. 2 will be omitted.
[0042] The difference with the time dithering process shown in Figure 2 is that when the value of the bits to be truncated in the G data is "01", the output is the same as when the value of the bits to be truncated is "00", and when the value of the bits to be truncated is "11", the output is the same as when the value of the bits to be truncated is "10". In this case, the time dithering process in Figure 3 treats two frames as one period. In other words, the dither frequency is calculated at a frame rate of 60 Hz / 2 frames, resulting in 30 Hz.
[0043] In the process of Fig. 3, as shown by pixels 321 to 323, it is possible to express a gradation different from the pseudo gradation visually recognized from the output result of the time dither process of Fig. 2. Compared to the time dither process of Fig. 2, the effect of suppressing pseudo contours is weakened, but the effect of suppressing flicker that occurs as a by-product is strengthened.
[0044] 2 and 3, the frame number for outputting a pixel value 1 bit larger in the time dithering process is uniquely determined, but it may be determined freely as long as the number of frames in one cycle of the time dithering process is the same as the number of frames for outputting a pixel value 1 bit larger. For example, when the value of the lower 2 bits in FIG. 2 is "01", the frame for outputting the pixel 211 1 bit larger may be the first, third or fourth frame, rather than the second frame. Similarly, when the value of the bit to be discarded in FIG. 3 is "11", the frame for outputting the pixel 311 1 bit larger may be the first frame, rather than the second frame.
[0045] In this embodiment, the time dithering process for converting from 10 bits to 8 bits when the display frame rate of the display device 120 is 60 Hz or 120 Hz has been described as an example, but is not limited to this. The display frame rate of the display device 120, the processing bit precision of the input image and the image processing device 100, and the bit precision of the external data transmission path 110 are variable. Therefore, it is sufficient to apply the time dithering process that maintains the dither frequency of 30 Hz according to the above frame rate and bit precision.
[0046] As an example of a different bit width of the external data transmission path 110, a case where the frame rate is 60 Hz and conversion is performed from 10 bits to 6 bits will be described. In order to maintain the dither frequency of 30 Hz and suppress pseudo contours, the time dither processing shown in Fig. 3 can be applied and time dither processing that refers to the two bits, the fourth lowest bit and the third lowest bit, can be used.
[0047] Next, a case will be described in which the frame rate is 240 Hz and conversion is performed from 12 bits to 8 bits, as an example in which the display frame rate, the processing bit precision in the input image and image processing device 100, and the bit precision in the external data transmission path 110 are all different. In this case, in order to maintain a dither frequency of 30 Hz and to strengthen the suppression of false contours, it is advisable to use a time dither process that requires 8 frames and refers to the 3 bits from the 4th lowest bit to the 2nd lowest bit.
[0048] Depending on the video standard, it may be difficult to achieve a dither frequency of 30 Hz by time dither processing. In this case, time dither processing is applied to bring the dither frequency closer to 30 Hz. For example, when the display frame rate is 59.94 Hz, the frequency by time dither processing is set to 29.97 Hz by applying the time dither processing shown in FIG. 3. As another example, when the display frame rate is 50 Hz, the frequency by time dither processing is set to 25 Hz (M / N is 25 or more) by applying the time dither processing shown in FIG. 3.
[0049] Next, the time dither section 102 will be described for a case where image data differs for each frame, such as moving image data.
[0050] Fig. 4 is a diagram showing an example of a method for applying time dithering to a pixel of video data when the display frame rate is 60 Hz. In the time dithering shown in Fig. 4, the start frame of the time dithering cycle is subjected to time dithering according to the value of the lowest two bits of the input image. Meanwhile, for frames other than the start frame, time dithering is performed according to the value of the lowest two bits of the start frame of the time dithering cycle at that time, rather than the value of a specific bit of the input image.
[0051] As an example, a case will be described in which coordinates (x, y) in each of frames 401 to 404 in Fig. 4(a) are converted from 10 bits to 8 bits using the time dithering process described in Fig. 3. Also, the pixel value of the coordinates (x, y) is assumed to be "0110010000" for the first frame 401, "0110010010" for the second frame 402, "0110010011" for the third frame 403, and "0110010001" for the fourth frame 404.
[0052] The lower two bits of the pixel value at the coordinates (x, y) of the first frame 401 are "00". The first frame 401 is the start frame of the time dither cycle in FIG. 3. Therefore, for the coordinates (x, y) of the first frame 401, pixel 310-1-00 shown in FIG. 3 is output. That is, for the coordinates (x, y) of the first frame 401, the value of pixel 310, which is the upper eight bits of the input pixel, is output. The lower two bits of the pixel value at the coordinates (x, y) of the second frame 402 are "10". The second frame 402 is a frame other than the start frame of the time dither cycle in FIG. 3, and in this case, the lower two bits of the start frame of the time dither cycle are "00". Therefore, for the coordinates (x, y) of the second frame 402, pixel 310-2-00 shown in FIG. 3 is output. That is, for the coordinates (x, y) of the second frame 402, the value of pixel 310 is output. The lower two bits of the pixel value at the coordinates (x, y) of the third frame 403 are "11". The third frame 403 is a new start frame in the time dither cycle of FIG. 3. Therefore, for the coordinates (x, y) of the third frame 403, the pixel 310-1-11 shown in FIG. 3 is output. That is, for the coordinates (x, y) of the third frame 403, the value of the pixel 310 is output. For the coordinates (x, y) of the fourth frame 404, as in the case of the second frame, the time dither process is used with reference to the value of the lower two bits of the third frame, so the pixel 311-2-11 shown in FIG. 3 is output. That is, for the coordinates (x, y) of the fourth frame 404, the value of the pixel 311 is output. The pixel values output in each frame at the coordinates (x, y) by the above-mentioned time dither process are shown in FIG. 4(b). In this case, the pixel values output at coordinates (x, y) in the first frame 411, second frame 412, and third frame 413 are "01100100", and the pixel value output in the fourth frame 414 is "01100101".
[0053] 5 is a diagram showing a different example of a method of applying time dithering to a pixel of video image data. Note that a description of the same parts as those in the time dithering shown in FIG. 4 will be omitted.
[0054] The difference from the time dithering process shown in FIG. 4 is that, in the case of the second frame 502, the lower two bits in FIG. 3 are "10" and time dithering process of frame number 2 is applied at the coordinates (x, y). Also, in the case of the fourth frame 504, the lower two bits are "01" and time dithering process of frame number 2 is applied. Here, as shown in FIG. 5(a), the second frame 502 and the fourth frame 504 apply time dithering process according to the lower two bits of the pixel value of the frame at the coordinates (x, y). FIG. 5(b) shows the pixel values output in each frame at the coordinates (x, y) by the above time dithering process. In this case, the pixel values output in the first frame 511, the third frame 513, and the fourth frame 514 at the coordinates (x, y) are "01100100", and the pixel value output in the second frame 512 is "01100101".
[0055] Here, in the time dithering process shown in FIG. 5, the bits of each pixel are referenced for each frame, and time dithering according to the lowest two bits of the input pixel for each frame is applied to all frames.
[0056] As shown in frames 511 to 514, the process of Fig. 5 makes it possible to express gradations different from the pseudo gradations visually perceived by the method of applying the time dithering process of Fig. 4. Compared to the method of applying the time dithering process of Fig. 4, the number of times the lowest two bits of the pixel value of the frame are referenced increases, but the pixel output is closer to the original gradation.
[0057] As described above, in the first embodiment, the time dithering process is changed so as to maintain the dithering frequency at 30 Hz in accordance with the display frame rate. This makes it possible to suppress false contours while suppressing flicker that occurs when an image is displayed on the display unit 124. Similarly, when it is difficult to set the dithering frequency to 30 Hz, the time dithering process is changed so as to maintain a frequency close to 30 Hz, making it possible to suppress false contours while suppressing flicker that occurs when an image is displayed on the display unit 124.
[0058] Second embodiment In the time dithering process shown in Fig. 3 in the first embodiment, some pixels have the same output value, so the gradation expression capability is lower than that of the time dithering process shown in Fig. 2. In the second embodiment, a method for improving the gradation expression capability when applying the time dithering process shown in Fig. 3 will be described.
[0059] 6 is a block diagram showing an example of the configuration of an image display system according to a second embodiment of the present invention. Note that the same components as those in the image display system according to the first embodiment are given the same reference numerals and the description thereof will be omitted.
[0060] The image display system of the second embodiment includes an image processing device 600, an external data transmission path 110, and a display device 120.
[0061] The spatial dither unit 601 performs spatial dither processing to change image data according to the value of a predetermined bit in the acquired image data. The spatial dither processing is a technique for adding values of a target pixel and adjacent pixels outside the valid bits to be discarded in the image data, and changing the data of pixels that exceed a threshold value to increase the gradation in an artificial manner. The spatial dither unit 601 may be an independent circuit, or may be realized by the control unit 104 executing a program stored in the memory 105.
[0062] Next, a description will be given of specific processing of the spatial dither unit 601 and the temporal dither unit 102 in this embodiment. First, a description will be given of a case in which the frame rate of the display device 120 is 60 Hz, and spatial dither processing and temporal dither processing are performed on 10-bit RGB image data to generate 8-bit image data.
[0063] FIG. 7 is a schematic diagram showing the dithering process in the spatial dithering section 601 and the temporal dithering section 102 when the frame rate is 60 Hz.
[0064] First, 10-bit image data 700 is input to the spatial dither unit 601. The spatial dither unit 601 performs spatial dither processing on the least significant bit 710 of the 10-bit image data 700. This spatial dither processing results in output of 9-bit image data 701. At this time, the least significant bit 710 of the 10-bit input data 700 is reflected in the least significant bit 711 of the 9-bit image data 701 by the spatial dither processing. The 9-bit image data 701 output from the spatial dither unit 601 is input to the time dither unit 102. The time dither unit 102 performs time dither processing on the 9-bit image data 701. This time dither processing results in output of 8-bit image data 702. At this time, the least significant bit 711 of the 9-bit image data 701 is reflected in the least significant bit 712 of the 8-bit image data 702.
[0065] 7, 8-bit image data in which all values outside the effective bits are reflected in the effective bits is output from spatial dither unit 601 and time dither unit 102. In addition, since the time dither processing in this case requires two frames, the dither frequency is 30 Hz in a display device 120 with a frame rate of 60 Hz.
[0066] Next, a description will be given of the spatial dither section 601. First, a case will be described in which spatial dither processing is performed on 10-bit RGB image data to generate 9-bit image data.
[0067] 8 is a schematic diagram showing an example of spatial dither processing in spatial dither section 601. Here, it is assumed that the G data in pixels 800 to 807 of the RGB image data is "0110010100", "0110010011", "0110010011", "0110010010", "0110010010", "0110010010", "0110010001", "0110010001", "0110010000".
[0068] When the lowest bit of the data of pixel 800 is truncated and output as 9 bits, it becomes "011001010" as shown in pixel 810. Similarly, the data of pixels 801 to 804 becomes "011001001" as shown in pixels 811 to 814, and the data of pixels 805 to 807 becomes "011001000" as shown in pixels 815 to 817. In this case, the value of the truncated bit is "1" for pixels 801, 802, 805, and 806, and "0" for pixels 800, 803, 804, and 807.
[0069] In spatial dithering, the value of the discarded bit is added to the adjacent pixel to switch the value of the output data. For pixels 802 and 806, the value of the lowest bit added is 2. Since the significant digit of 1 bit is 1, pixels 802 and 806 overflow. Here, pixels 802 and 806 output a pixel that is 1 bit larger. In other words, pixel 802 outputs "011001010", and pixel 806 outputs "011001001".
[0070] By the spatial dithering process, the bits to be discarded are reflected in the effective bits of some pixels. Therefore, as shown in pixels 820 to 827, it is possible to express the original gradation throughout the entire horizontal direction, and pseudo contours are suppressed more than when spatial dithering is not performed. In this example, the process is performed on the G data, but the same process is also performed on the RB data.
[0071] Next, a description will be given of the time dither unit 102. First, a case will be described in which the frame rate of the display device 120 is set to 60 Hz, and time dither processing is performed on 9-bit RGB image data to generate 8-bit image data.
[0072] Fig. 9 is a schematic diagram showing an example of time dither processing in the time dither section 102. Here, it is assumed that the G data in pixels 900 to 902 are binary numbers "011001000", "011001001", and "011001010". Note that a description of the same parts as those in the time dither processing shown in Fig. 3 will be omitted.
[0073] The difference from the time dither shown in FIG. 3 is that only one bit is discarded. Here, when the value of the discarded bit is "0", the output is the same as when the value of the discarded bit in FIG. 3 is "00" or "01". Similarly, when the value of the discarded bit is "1", the output is the same as when the value of the discarded bit in FIG. 3 is "10" or "11". In this case, in the time dither process shown in FIG. 9, two frames are treated as one period. Here, the dither frequency is 30 Hz calculated at a frame rate of 60 Hz / 2 frames. In this example, the process is described as being performed on G data, but the same process is also performed on RB data.
[0074] 10 is a flowchart showing spatial dither processing and temporal dither processing in this embodiment. The operation of this flowchart is performed by the control unit 104 executing a program stored in the memory 105.
[0075] First, in step S1001, the control unit 104 starts this flow.
[0076] In step S1002, in response to a command from the control unit 104, the OETF conversion unit 101 detects the format of the input image.
[0077] In step S1003, the spatial dither unit 601 determines whether or not the input image is an HDR image in response to an instruction from the control unit 104. If the input image is not an HDR image, the process proceeds to step S1010, where the flow ends.
[0078] If the input image is an HDR image (step S1003: Yes), in step S1004, in response to an instruction from the control unit 104, the spatial dither unit 601 compares the output bit precision of the temporal dither unit 102 with the bit precision of the external data transmission path 110. If the output bit precision of the temporal dither unit 102 is equal to or lower than the bit precision of the external data transmission path 110, the process proceeds to step S1010, and this flow ends.
[0079] If the output bit precision of the time dither unit 102 is greater than the bit precision of the external data transmission path 110 (step S1004: Yes), in step S1005, the control unit 104 instructs the time dither unit 102 whether or not to perform time dither processing. In this embodiment, the control unit 104 determines to perform time dither processing when the frame rate is 60 Hz or higher. If the frame rate is less than 60 Hz, the process proceeds to step S1010 and ends this flow. Note that the time dither unit 102 and the spatial dither unit 601 exchange information used for control with each other via a data bus (not shown).
[0080] If the frame rate is 60 Hz or higher (step S1005: Yes), in step S1006, the control unit 104 instructs the time dither unit 102 to select a bit to be subjected to time dither processing (hereinafter, referred to as a time dither target bit). In this embodiment, the time dither target bit is the second lowest bit. The time dither target bit is then output to the spatial dither unit 601 via the data bus.
[0081] In step S1007, the control unit 104 instructs whether or not to perform spatial dither processing by referring to the bits to be subjected to time dithering acquired from the time dithering unit 102. Whether or not to perform spatial dither processing is determined based on whether or not there are bits other than the bits to be subjected to time dither processing among the bits other than the effective bits. If there are no bits other than the bits to be subjected to time dither processing, the process proceeds to step S1009.
[0082] If there are bits other than the bits to be subjected to the time dithering process (step S1007: Yes), the process proceeds to step S1008, where the spatial dithering section 601 performs spatial dithering process in response to an instruction from the control section 104.
[0083] In step S1009, in response to an instruction from the control unit 104, the time dither unit 102 performs time dither processing on the bit selected in step S1006, and the process proceeds to step S1010, where this flow ends.
[0084] In the above description, the display frame rate of the display device 120 is 60 Hz, and conversion from 10 bits to 8 bits is performed, but the present invention is not limited to this. For example, the following description will be given of a case where the display frame rate of the display device 120 is 120 Hz, the processing bit precision of the input image and the image processing device is 10 bits, and the bit precision of the external data transmission path is 6 bits.
[0085] In this case, temporal dithering is applied to two bits, bits 7 and 8. Spatial dithering is applied to bit 9 or to both bits 9 and 10. In this case, temporal dithering requires 4 frames and the dither frequency is 30 Hz.
[0086] Therefore, the bit width and range of bits to be applied in the time dithering process and the spatial dithering process are expressed by the following conditional expressions.
[0087] The number of frames in time dither unit 102 is N (N is an integer equal to or greater than 2), the bit width of the input image is A, and the bit width of the external data transmission path is B. In this case, the bit width of time dither processing is N / 2, and the range of bits for which time dither processing is performed can be expressed as the most significant bit being AB-1 and the least significant bit being AB-(N / 2).
[0088] Furthermore, spatial dithering is performed if the bit width, AB-(N / 2)-1, is equal to or greater than 0. In this case, the bit range for which spatial dithering is performed can be expressed as the most significant bit being AB-(N / 2)-1 and the least significant bit being 0.
[0089] In this embodiment, since N=2, A=10, and B=8, the bit width of the time dithering process is 1, and the bit range in which the time dithering process is performed is the second lowest bit. Also, the bit width of the spatial dithering process is 1, and the bit range in which the spatial dithering process is performed is the least significant bit.
[0090] Also, in FIG. 8, spatial dithering is applied to the horizontal direction, but it may be applied to the vertical direction, the diagonal direction, or all of the above directions.
[0091] In this embodiment, the time dithering process is applied after the spatial dithering process, but the present invention is not limited to this, and the spatial dithering process may be performed after the time dithering process. For example, in FIG. 7, the time dithering process is applied to 10-bit data, and 9-bit image data is output. Then, the spatial dithering process is applied to the 9-bit image data, and 8-bit image data is output.
[0092] 10, the branching condition in step S1005 is that the frame rate of the display device is 60 Hz or more, but the condition and process may be changed to conform to the video standard. For example, the branching condition in step S1005 is that the frame rate of the display device is 59.94 Hz or more, and time dithering is applied so as to maintain the dither frequency at 29.97 Hz. Similarly, the branching condition in step S1005 is that the frame rate of the display device is 50 Hz or more, and time dithering is applied so as to maintain the dither frequency at 25 Hz.
[0093] As described above, in the second embodiment, the time dithering process is changed so as to maintain the dithering frequency at 30 Hz according to the frame rate of the display device, and spatial dithering process is applied to any bit among the bits to be truncated that has not been applied with the time dithering process. By combining the time dithering process and the spatial dithering process, it is possible to suppress false contours while suppressing flicker that occurs when an image is displayed on the display unit 124 and reflecting any bit to be truncated in the display bits.
[0094] Similarly, if it is difficult to set the dither frequency to 30 Hz, the time dither processing is changed so as to maintain the dither frequency close to 30 Hz, and spatial dither processing is applied to any bits among the bits to be discarded that have not been subjected to the time dither processing. This makes it possible to suppress false contours while suppressing flicker that occurs when an image is displayed on the display unit 124 and reflecting any bits to be discarded in the display bits.
[0095] (Third embodiment) 11 is a block diagram showing an example of the configuration of an image display system according to a third embodiment of the present invention. Note that the same components as those in the image display systems according to the first and second embodiments of the present invention are denoted by the same reference numerals and will not be described.
[0096] The image display system of this embodiment comprises an image processing device 1100, an external data transmission line 110, and a display device 1110.
[0097] The light emission characteristic inverse conversion unit 1101 performs the inverse conversion process of the light emission characteristic conversion unit 1111 based on the display unit 124. Fig. 12 is a detailed block diagram of the light emission characteristic inverse conversion unit 1101. Note that the light emission characteristic inverse conversion unit 1101 may be an independent circuit, or may be realized by the control unit 104 executing a program stored in the memory 105. Similarly, the light emission characteristic conversion unit 1111 may be an independent circuit, or may be realized by the control unit 125 executing a program stored in the memory 126.
[0098] 12, since the RGB pixels constituting the display unit 124 each have individual light-emitting characteristics, the light-emitting characteristic inverse conversion unit 1101 has light-emitting characteristic inverse conversion units 1101-01, 1101-02, and 1101-03, one for each of the RGB. The RGB image data that has undergone the light-emitting characteristic inverse conversion is output after white balance adjustment by a white balance adjustment unit (hereinafter, WB adjustment unit) 1101-04. The order of the light-emitting characteristic inverse conversion and the white balance processing may be reversed, or may be performed simultaneously.
[0099] The light emission characteristic conversion unit 1111 converts the analog image signal acquired from the DA conversion unit 122 into light emission characteristics based on the RGB pixels that constitute the display unit 124. The image to be displayed on the display unit 124 needs to be subjected to inverse conversion of the light emission characteristics before DA conversion. When performing HDR display, which is prone to gradation breakdown, inverse conversion processing of light emission characteristics approximating the OETF of HDR is performed on the output data of the OETF conversion unit 101, which has a bit precision equal to or higher than that of the external data transmission line 110. This makes it possible to reduce quantization errors and calculation errors and minimize gradation breakdown of the displayed image.
[0100] In this embodiment, the spatial dither unit 601 is provided in the image processing device 1100, but this need not be provided depending on the situation.
[0101] The light emission characteristic inverse converter 1101 may be provided in the display device 1110. In that case, the light emission characteristic inverse converter 1101 is disposed between the receiving unit 121 and the DA conversion unit 122. In this case, the light emission characteristic inverse converter 1101 may be an independent circuit, or may be realized by the control unit 125 executing a program stored in the memory 126. While EOTF such as ITU BT.709 is standardized assuming the light emission characteristics of cathode ray tubes and the like, EOTF assuming the light emission characteristics of organic EL and the like is not standardized. Since the light emission characteristics change due to environmental differences such as the temperature of the display material and the voltage applied, and individual differences of the display material itself, it becomes necessary to correct these differences. The image processing device 1100 is connected to the display device 1110 via the external data transmission path 110. The image processing device 1100 and the display device 1110 are each independent, and it is assumed that a combination of a plurality of image processing devices 1100 and a plurality of display devices 1110 is selected and used. When this combination is taken into consideration, control becomes easier by correcting the light emission characteristics dependent on the display unit 124 within the same display device 1110. Therefore, the inverse conversion to the light emission characteristics is performed by the display device 1110, and the image data of the external data transmission path 110 is data that complies with a generalized standard. In this case, by using an HDR OETF that is close to the light emission characteristics of an organic EL or the like, it is possible to reduce quantization errors and calculation errors in the inverse conversion of the light emission characteristics of the display device 1110 and minimize gradation breakdown of the displayed image.
[0102] (Fourth embodiment) In the first, second and third embodiments, the frame rate of the display device is assumed to be 60 Hz or 50 Hz or more in order to perform time dither processing with a dither frequency of approximately 30 Hz maintained to suppress flicker. In the fourth embodiment, a control method for a case where the frame rate of the display device is less than 60 Hz or 50 Hz in the block configuration of Fig. 6 or Fig. 11 will be described.
[0103] 13A shows an example in which the number of frames N of the temporal dither unit 102 is "2." When the display frame rate M is changed to 15 Hz, 30 Hz, 60 Hz, 120 Hz, and 240 Hz, the temporal dither frequency M / N becomes 7.5 Hz, 15 Hz, 30 Hz, 60 Hz, and 120 Hz.
[0104] Flicker can only be suppressed when the time dither frequency is 30 Hz or higher, so time dithering is not performed at display frame rates of 15 Hz and 30 Hz, where the time dither frequency is less than 30 Hz. Instead, spatial dithering is performed at display frame rates of 15 Hz and 30 Hz to reduce false contours. At display frame rates of 60 Hz or higher, both time dithering and spatial dithering are used together to suppress flicker while increasing the false contour reduction effect.
[0105] FIG. 13(b) shows an example of changing the number of frames N of the time dither unit 102. When the display frame rate M is 15 Hz, 30 Hz, or 60 Hz, N is set to "2", when M is 120 Hz, N is set to "4", and when M is 240 Hz, N is set to "8". By increasing the number of frames N of the time dither process, the gradation expression capability is improved and the false contour reduction effect is enhanced. Also, as in FIG. 13(a), when the display frame rate is 15 Hz and 30 Hz, where the time dither frequency is less than 30 Hz, the time dither process is not performed. Instead, in order to reduce the false contour, the spatial dither process is performed at the display frame rates of 15 Hz and 30 Hz. Also, when the display frame rate is 60 Hz or more, the time dither process and the spatial dither process are used together to suppress flicker and enhance the false contour reduction effect.
[0106] FIG. 13(c) shows an example in which the image input to the image processing device 600, 1100 is a moving image. Since flicker is more noticeable in a moving image than in a still image, time dither processing is not performed when the time dither frequency is less than 60 Hz. When the display frame rate M is 15 Hz, 30 Hz, 60 Hz, or 120 Hz, N is set to "2", and when M is 240 Hz, N is set to "4". By increasing the number of frames N in the time dither processing, the gradation expression capability is improved and the false contour reduction effect is enhanced. In a moving image, time dither processing is not performed when the display frame rate is 60 Hz or less, which is the time dither frequency of 30 Hz or less. Instead, spatial dither processing is performed when the display frame rate is 60 Hz or less to reduce false contours. In addition, when the display frame rate is 120 Hz or more, the false contour reduction effect by time dithering is low when N is small, so the false contour reduction effect is enhanced while suppressing flicker by using time dither processing and spatial dither processing in combination.
[0107] Fifth embodiment In the fifth embodiment, a method of switching the time dither pattern depending on the hue of the input image data will be described.
[0108] The configuration of the image display system according to the fifth embodiment is the same as that of the image display system according to the first embodiment shown in the block diagram of Fig. 1. Note that the same parts as those of the image display system according to the first embodiment are denoted by the same reference numerals and will not be described.
[0109] 14 is a block diagram showing an example of the configuration of the time dither unit 102 in this embodiment. The time dither unit 102 includes a hue frequency acquisition unit 1400, a frequency acquisition setting unit 1401, a frequency threshold setting unit 1402, a hue determination unit 1403, a frame memory 1404, and a time dither processing unit 1405.
[0110] In this embodiment, the frame rate of the display device 120 is set to 60 Hz, and frequency information is obtained from 10-bit RGB image data, indicating how many pixels containing a large amount of green or red components exist in one frame of an image. This information is used to control the dither pattern used in the time dither process.
[0111] The hue frequency acquisition unit 1400 compares the R, G, and B values of each pixel of the input image data, and if the image contains a large amount of green components, it counts the frequency of the green components. Also, if the image contains a large amount of red components, it counts the frequency of the red components. The frequency of the green or red components is counted (the determination results are counted) as frequency information based on the conditions set in the frequency acquisition setting unit 1401. In this embodiment, if the following condition 1 is met, the image is deemed to contain a large amount of green components, and the green frequency information is counted. Also, if the following condition 2 is met, the image is deemed to contain a large amount of red components, and the red frequency information is counted.
[0112] G>R and G>B …(Condition 1) R>G and R>B …(Condition 2) The input image data is sequentially stored in the frame memory 1404 until hue frequency information of one frame of image data is acquired.
[0113] When acquisition of frequency information for one frame of image data is completed, a hue determination unit 1403 determines the hue of the input image using the obtained hue frequency information and the threshold value set by the frequency threshold setting unit 1402. In this embodiment, the green frequency threshold value=red frequency threshold value=half the number of pixels in one frame.
[0114] If the green frequency information is equal to or greater than half of the number of pixels in one frame, the image data is determined to be an image containing a large amount of green components. Since false contours are easily noticeable in images containing a large amount of green components (images containing a large amount of G components), a time dither pattern that is highly effective in suppressing false contours is applied. Specifically, one frame's worth of image is read from the frame memory 1404, and the time dither processing unit 1405 performs time dither processing that treats four frames as one cycle. The dither frequency in this case is 15 Hz, calculated based on a frame rate of 60 Hz / 4 frames.
[0115] If the frequency information for red is equal to or greater than half of the number of pixels in one frame, the image data is determined to be an image containing a large amount of red components. Since false contours are difficult to recognize in an image containing a large amount of red components (an image containing a large amount of R components), a time dither pattern is applied which has a weaker effect of suppressing false contours but is highly effective in suppressing secondary flicker. Specifically, one frame's worth of image is read from the frame memory 1404, and the time dither processing unit 1405 performs time dither processing which treats two frames as one cycle. In this case, the dither frequency is 30 Hz calculated based on a frame rate of 60 Hz / 2 frames.
[0116] In this embodiment, the dither pattern is switched for each frame by calculating the hue frequency of the image data for one frame, but it may be controlled for each pixel of the image data. Also, frequency information of the previous frame or cumulative frequency information of several frames may be used. In that case, the frame memory 1404 shown in FIG. 14 is not necessary.
[0117] Alternatively, the dither pattern used by the time dither unit 102 may be switched by the user directly specifying, in a mode setting or the like, that the image has a large amount of green or red components.
[0118] In the above description, the hue frequency information is detected by the hue frequency acquisition unit 1400, and the judgment is made by the hue judgment unit 1403. However, if hue information corresponding to pixels is added in advance to the input image data, the hue judgment unit 1403 may use this information to switch the dither pattern.
[0119] Sixth embodiment In the sixth embodiment, a method of switching the time dither pattern according to the brightness of the input image data will be described.
[0120] The configuration of the image display system according to the sixth embodiment is the same as that of the image display system according to the first embodiment shown in the block diagram of Fig. 1. Note that the same components as those of the image display system according to the first embodiment are denoted by the same reference numerals and will not be described.
[0121] 15 is a block diagram showing an example of the configuration of the time dither unit 102 in this embodiment. The time dither unit 102 includes a luminance detection unit 1500, a luminance frequency acquisition unit 1501, a frequency acquisition setting unit 1502, a frequency threshold setting unit 1503, a brightness determination unit 1504, a frame memory 1505, and a time dither processing unit 1506.
[0122] The luminance detection unit 1500 obtains the brightness (luminance) of the image from the R, G, and B values of each pixel of the input image data, and counts bright pixels as a luminance frequency. The conversion from the R, G, and B values to the brightness (luminance value) value Y (assumed to be 10 bits) is calculated by (Equation 1).
[0123] Y = (0.26270 x R) + (0.67800 x G) + (0.05930 x B) ... (Equation 1) The luminance frequency is counted based on the conditions set in the frequency acquisition setting unit 1502. In this embodiment, if the Y value calculated by the above formula 1 satisfies the following condition 3, the pixel is counted as a bright pixel. In this embodiment, Y has a precision of 10 bits, and 0≦Y≦1023.
[0124] Y>512 ...(Condition 3) The input image data is sequentially stored in the frame memory 1505 until luminance frequency information of one frame of image data is acquired.
[0125] When acquisition of frequency information for one frame of image data is completed, a brightness determination unit 1504 determines the brightness of the input image using the obtained luminance frequency information and the threshold value set by the frequency threshold setting unit 1503. In this embodiment, the luminance frequency threshold value is set to half the number of pixels for one frame.
[0126] When the luminance frequency information is equal to or greater than half the number of pixels for one frame, the brightness determination unit 1504 determines that the image data is a bright image. In a bright image, false contours are less noticeable, but flicker caused by dither processing tends to be more noticeable. Therefore, a time dither pattern is applied that has a weaker effect of suppressing false contours, but a high effect of suppressing secondary flicker. Specifically, one frame of image is read from the frame memory 1505, and the time dither processing unit 1506 performs time dither processing that treats two frames as one cycle. In this case, the dither frequency is 30 Hz calculated based on a frame rate of 60 Hz / 2 frames.
[0127] If the luminance frequency information is less than half the number of pixels for one frame, the brightness determination unit 1504 determines that the image data is a dark image. In dark images, false contours are easily noticeable, but flicker caused by dither processing tends to be difficult to notice. Therefore, a time dither pattern that is highly effective in suppressing false contours is applied. Specifically, one frame of image is read from the frame memory 1505, and the time dither processing unit 1506 performs time dither processing that treats four frames as one cycle. The dither frequency in this case is 15 Hz calculated at a frame rate of 60 Hz / 4 frames.
[0128] In this embodiment, the dither pattern is switched for each frame by calculating the brightness frequency of the image data for one frame, but it may be controlled for each pixel of the image data. Also, frequency information of the previous frame or cumulative frequency information of several frames may be used. In that case, the frame memory 1505 shown in FIG. 15 is not necessary.
[0129] The dither pattern used by the time dither processor 1506 may be switched by the user directly specifying whether the image is bright or dark in the mode settings or the like.
[0130] In the above description, the brightness of the image is detected by the brightness detection unit 1500, and the brightness frequency is detected by the brightness frequency acquisition unit 1501. However, if brightness information corresponding to each pixel or each image frame is added in advance to the input image data, the dither pattern used by the time dither processing unit 1506 may be switched using this brightness information.
[0131] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0132] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]
[0133] 100, 600, 1100: image processing device, 101: OETF conversion unit, 102: time dither unit, 103: transmission unit, 104, 125: control unit, 105, 126: memory, 110: external data transmission path, 120, 1110: display device, 121: reception unit, 122: DA conversion unit, 123: EOTF conversion unit, 124: display unit, 601: spatial dither unit, 1101: light emission characteristic inverse conversion unit, 1111: light emission characteristic conversion unit
Claims
1. 1. An image processing device for truncating C bits (C is a positive integer) from an A-bit (A is a positive integer) image, and displaying the truncated B=(A-C)-bit image on a display means at a frame rate of M frames / second (M is a positive real number), comprising: a time dither means for outputting a pixel value taking an intermediate value between a K-th step value (K is a positive integer) and a (K+1)-th step value in the B=(A-C) bits in the A-bit image for a first number N1 of frames and a second number N2 (N=N1+N2) of frames in N frames (N is a positive integer), respectively, thereby pseudo-expressing the A-bit image with a dither pattern having N frames as a minimum unit, the first frame number N1 and the second frame number N2 are set based on a ratio of the magnitude of the intermediate value to a difference between the K-th step value and the (K+1)-th step value; the time dither means sets the value of N so that M / N is 25 or more; The image processing device further comprises: a time dithering means for performing time dithering on a start frame of a dither pattern of the N frames in accordance with the value of the C bit obtained by truncating the A bit image; and for frames other than the start frame of the N frames, performing time dithering on the start frame in accordance with the value of the C bit obtained by truncating the A bit image to be subjected to the time dithering.
2. 2. The image processing apparatus according to claim 1, wherein said time dithering means sets the value of N so that M / N is 30 or more.
3. 3. The image processing apparatus according to claim 1, further comprising an OETF conversion means for converting an input image using a predetermined OETF (Optical-Electron Transfer Function) to obtain the A-bit image.
4. 4. The image processing device according to claim 1, further comprising a spatial dithering means for adding a pixel value having an intermediate value in one step in the (A-C) bits to an adjacent pixel value, wherein the spatial dithering means performs spatial dithering in accordance with a bit value not used in the temporal dithering process in the A-bit image.
5. 4. The image processing apparatus according to claim 3, wherein said time dithering means sets the value of N so that M / N is 25 or more when the bit width of the image output by said OETF conversion means is larger than the bit width of an external data transmission line.
6. The time dithering means comprises a hue frequency acquisition means for counting the frequency when the input image contains a large amount of green or red components, a frequency acquisition setting means for specifying a condition for counting the frequency by the hue frequency acquisition means, and a hue determination means for determining the hue of the image according to the frequency acquired by the hue frequency acquisition means, 6. The image processing apparatus according to claim 1, wherein a dither pattern to be used is set in accordance with the result of the determination by said hue determining means.
7. The time dither means comprises: a luminance detection means for detecting a luminance value from an input image; a luminance frequency acquisition means for counting a frequency from the luminance value detected by the luminance detection means; a frequency acquisition setting means for designating a range of luminance values to be counted by the luminance frequency acquisition means; and a brightness determination means for determining the brightness of image data in accordance with the frequency acquired by the luminance frequency acquisition means.
7. The image processing apparatus according to claim 1, wherein a dither pattern to be used is set in accordance with a result of the determination by said brightness determining means.
8. An image processing device according to any one of claims 1 to 7, A display device for displaying an image; an external data transmission path for transmitting an image from the image processing device to the display device; The display device is characterized in that it has an EOTF conversion means for converting an image acquired through the external data transmission path using an EOTF (Electro-Optical Transfer Function) that is an inverse characteristic of the OETF used in the OETF conversion means of the image processing device.
9. An image processing device according to any one of claims 1 to 7, A display device for displaying an image; an external data transmission path for transmitting an image from the image processing device to the display device; the image processing device has a light emission characteristic inverse conversion means for performing an inverse conversion of a light emission characteristic based on a display material of the display device with respect to an image acquired from an OETF (Optical-Electro Transfer Function) conversion means; The image display system according to the present invention, wherein the display device has a light emission characteristic conversion means for converting light emission characteristics of the image acquired from the external data transmission path based on a display material of the display device.
10. 1. An image processing method for truncating C bits (C is a positive integer) from an A-bit (A is a positive integer) image, and displaying the truncated B=(A-C)-bit image on a display means at a frame rate of M frames / second (M is a positive real number), comprising: a time dithering step of outputting a pixel value taking an intermediate value between a K-th step value (K is a positive integer) and a (K+1)-th step value in the B=(A-C) bits in the A-bit image for a first number N1 of frames and a second number N2 of frames (N=N1+N2) in N frames (N is a positive integer), respectively, thereby pseudo-expressing the A-bit image with a dither pattern having N frames as a minimum unit; the first frame number N1 and the second frame number N2 are set based on a ratio of the magnitude of the intermediate value to a difference between the K-th step value and the (K+1)-th step value; In the time dithering step, the value of N is set so that M / N is 25 or more; Furthermore, in the time dithering step, a time dithering process is performed on a start frame of a dither pattern of the N frames in accordance with the value of the C bit obtained by truncating the A bit image, and a time dithering process is performed on frames other than the start frame of the N frames in accordance with the value of the C bit obtained by truncating the A bit image to be subjected to the time dithering process as the start frame.
11. A program for causing a computer to execute each step of the image processing method according to claim 10.
Citation Information
Patent Citations
Multigradation display device
JP1993113767A
Picture emphasizing device
JP1997247483A
Method for decreasing contour generation of image
JP1998261080A
Image processing apparatus and method, program, and recording medium
JP2003304400A
Method and device for processing video data by combining error diffusion and another dithering
JP2006039556A
