Display device and display method

Abstract

The display device includes a receiving circuit, a luminance information generating circuit, a conversion curve generating circuit, a picture conversion circuit and an image display module. The receiving circuit is used to accept an input image signal. The luminance information generating circuit obtains original luminance information and setting luminance information of each original picture by analyzing each original picture in the input image signal. The conversion curve generating circuit generates an electro-optical conversion lookup table of each original picture according to the setting luminance information of each original picture and a conversion function. The picture conversion circuit performs electro-optical conversion lookup on the original pictures of the input image signal according to the electro-optical conversion lookup table corresponding to each original picture to generate a plurality of output pictures of an output image signal, so as to adjust the electro-optical conversion lookup table for each picture to optimize the display image effect.

Description

Technical Field

[0001] This invention relates to a display device and a display method, and more particularly to a display device and a display method capable of generating an electro-optical conversion lookup table frame by frame. Background Technology

[0002] High Dynamic Range (HDR) image processing technology is an imaging technology widely used in displays, designed to improve image contrast and color performance.

[0003] HDR-compliant video signals contain metadata that records multiple raw parameters of the video signal, such as brightness and color space information. When outputting images, HDR-enabled displays use the Electro-Optical Transfer Function (EOTF) and the information in the metadata as parameters to calculate the mapping curve between the input signal value and the brightness output on the display device—the EOTF curve—and store it in the form of an EOTF lookup table to ensure the display accurately reproduces image brightness and contrast. Currently, HDR technology can be divided into static HDR and dynamic HDR. Static HDR video signals have fixed metadata, so different frames use the same mapping curve, making it impossible to optimize the output image frame-by-frame or scene-by-scene. Dynamic HDR video signals contain multiple metadata corresponding to each frame or different scenes. The software in the display's user interface calculates the mapping curve frame-by-frame, providing optimized image presentation effects based on different frames or scenes. However, this method places a heavy computational burden on the display's processor, and calculating new mapping curves requires a long adjustment time, failing to meet the real-time requirements of frame-by-frame updates.

[0004] The "Background Art" paragraph is only used to help understand the content of this invention. Therefore, the content disclosed in the "Background Art" paragraph may include some known technologies that are not known to those skilled in the art. The content disclosed in the "Background Art" paragraph does not mean that the content or the problems to be solved by one or more embodiments of this invention were known or understood by those skilled in the art prior to this application. Summary of the Invention

[0005] In view of the limitations or defects of existing dynamic HDR display technology or static HDR display technology, the present invention proposes a display device, comprising a receiving circuit, a brightness information generation circuit, a conversion curve generation circuit, an image conversion circuit, and an image display module. A receiving circuit receives an input image signal, which includes multiple original frames, each containing multiple original pixels. A brightness information generation circuit is electrically connected to the receiving circuit and receives the input image signal from the receiving circuit. The brightness information generation circuit obtains the original brightness information of each original frame based on the input image signal and generates set brightness information corresponding to each original frame based on the original brightness information. A conversion curve generation circuit is electrically connected to the brightness information generation circuit and generates an electro-optical conversion lookup table based on the set brightness information and conversion function of each original frame. A screen conversion circuit is electrically connected to the receiving circuit and the conversion curve generation circuit. It receives the electro-optical conversion lookup table corresponding to each original frame from the conversion curve generation circuit and receives the input image signal from the receiving circuit and generates an output image signal. The screen conversion circuit performs an electro-optical conversion lookup on each original frame of the input image signal based on the electro-optical conversion lookup table corresponding to each original frame to generate multiple output frames of the output image signal, each of which includes multiple output pixels. An image display module is electrically connected to the screen conversion circuit to receive the output image signal and display the output image based on the output image signal.

[0006] The present invention also proposes a display method executed by a display device. This display device includes a receiving circuit, a brightness information generation circuit, a conversion curve generation circuit, and a screen conversion circuit. The display method includes the following steps: receiving an input image signal via the receiving circuit, wherein the input image signal includes multiple original images, each of which includes multiple original pixels; receiving the input image signal from the receiving circuit via the brightness information generation circuit, obtaining original brightness information of each of the original images based on the input image signal, and generating set brightness information corresponding to each of the original images based on the original brightness information; generating an electro-optical conversion lookup table via the conversion curve generation circuit based on the set brightness information and conversion function of each of the original images; receiving the electro-optical conversion lookup table corresponding to each of the original images from the conversion curve generation circuit via the screen conversion circuit, receiving the input image signal from the receiving circuit, and generating an output image signal; and displaying the output image via an image display module based on the output image signal; wherein the step of generating the output image signal involves the screen conversion circuit performing an electro-optical conversion lookup on each of the original images of the input image signal according to the electro-optical conversion lookup table corresponding to each of the original images to generate multiple output images of the output image signal, wherein each output image includes multiple output pixels.

[0007] Compared to known technologies that rely on software within the user interface of the display device to generate electro-optical conversion lookup tables based on metadata, the present invention achieves higher efficiency in generating electro-optical conversion lookup tables. It can generate electro-optical conversion lookup tables frame-by-frame, allowing for effective adaptive adjustments for each output frame. This invention addresses the problem of known static HDR technologies being unable to adjust electro-optical conversion curves based on the image or scene, and also solves the problem of dynamic HDR requiring different electro-optical conversion lookup tables based on different metadata, and being unable to optimize frame-by-frame due to software computational limitations.

[0008] To make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings. Attached Figure Description

[0009] Figure 1 This is a block diagram of the display device according to the first embodiment of the present invention.

[0010] Figure 2 This is a block diagram of a display device according to a second embodiment of the present invention.

[0011] Figure 3 This is a flowchart illustrating the calculation of set brightness information by the display device according to the second embodiment of the present invention.

[0012] Figure 4 This is a block diagram of a display device according to a third embodiment of the present invention.

[0013] Figure 5 This is a block diagram of a display device according to the fourth embodiment of the present invention.

[0014] Figure 6 This is a block diagram of a display device according to the fifth embodiment of the present invention.

[0015] Figure 7 This is a block diagram of a display device according to another embodiment of the present invention.

[0016] Figure 8 This is a flowchart of the display method of the present invention.

[0017] Figure 9 This is a block diagram of the projection device of the present invention.

[0018] Explanation of reference numerals in the attached figures:

[0019] 100, 200, 400, 500, 600, 700: Display devices

[0020] 100IP, 200IP, 400IP, 500IP, 600IP, 700IP: Image Processors

[0021] 110: Receiving circuit

[0022] 120: Brightness Information Generation Circuit

[0023] 121: Image Analysis Module

[0024] 130: Conversion Curve Generation Circuit

[0025] 140: Image conversion circuit

[0026] 141: Storage Unit

[0027] 150: Image display module

[0028] 210: Raw brightness information

[0029] 220: Smoothing Calculation Module

[0030] 301~308, 310, 801~806: Step 410: Signal Processing Circuit

[0031] 420: Color Space Conversion Circuit

[0032] 430: Metadata

[0033] 510: Preprocessing circuit

[0034] BR_info: Sets brightness information

[0035] EOTF_LUT: Electro-optical conversion lookup table

[0036] img_in: Input image signal

[0037] img_out: Outputs the video signal

[0038] P: Projection device

[0039] P10: Lighting System

[0040] P20: Optomechanical System

[0041] P201: Light valve

[0042] P202: Controller

[0043] P30: Projection lens. Detailed Implementation

[0044] Some embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Component symbols used in the following description are considered identical or similar when they appear in different drawings. These embodiments are only a part of the present invention and do not disclose all possible implementations of the invention. More precisely, these embodiments are merely examples of systems and methods within the scope of the present invention's patent application.

[0045] The foregoing descriptions and other technical contents, features, and effects of this invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms used in the following embodiments, such as up, down, left, right, front, or back, are merely for reference to the accompanying drawings. Therefore, the directional terms used are for illustrative purposes and not for limiting the invention.

[0046] This invention proposes a display device and display method that can dynamically generate an electro-optical conversion lookup table for each screen.

[0047] Figure 1 This is a system block diagram of the display device according to the first embodiment. Please refer to... Figure 1 The display device 100 includes a receiving circuit 110, a brightness information generation circuit 120, a conversion curve generation circuit 130, a screen conversion circuit 140, and an image display module 150. The receiving circuit 110 is electrically connected to the brightness information generation circuit 120. The brightness information generation circuit 120 is electrically connected to the conversion curve generation circuit 130 and the screen conversion circuit 140. The screen conversion circuit 140 is also electrically connected to the conversion curve generation circuit 130. The image display module 150 is electrically connected to the screen conversion circuit 140. The display device 100 may include, for example, at least one image processor 100IP. In this embodiment, the at least one image processor 100IP is... The FPGA, wherein the at least one image processor 100IP includes the aforementioned receiving circuit 110, brightness information generation circuit 120, conversion curve generation circuit 130, and image conversion circuit 14. In other embodiments, the at least one image processor 100IP may be, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microcontroller unit (MCU), microprocessor, digital signal processor (DSP), programmable controller, application-specific integrated circuit (ASIC), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field-programmable gate array (FPGA), or other similar elements or combinations thereof.

[0048] The receiving circuit 110 can conform to any suitable transmission standard, including High Definition Multimedia Interface (HDMI), DisplayPort (DP), Universal Serial Bus type C (USB-C), Thunderbolt, wireless transmission module, etc., and the present invention is not limited thereto. The receiving circuit 110 is electrically connected to the connection port of the display device 100 to receive an input image signal img_in from an external signal source. This input image signal img_in contains multiple original frames, each original frame contains multiple original pixels, and each original pixel contains multiple color channels. These color channels include, for example, at least one of a red channel, a green channel, and a blue channel, and each color channel is represented by, for example, a grayscale value.

[0049] The brightness information generation circuit 120 receives the input image signal img_in from the receiving circuit 110, obtains the original brightness information of each original frame based on the input image signal img_in, and generates a set brightness information BR_info corresponding to each original frame based on the original brightness information of each original frame. This original brightness information can be obtained by analyzing all original pixels of each original frame. In some embodiments, the brightness information generation circuit 120 includes an image analysis module 121, which receives the input image signal img_in and calculates the maximum value among the grayscale values ​​of all color channels of all original pixels in each original frame of the input image signal img_in as the original brightness information. For example, in a first original frame of the input image signal img_in, the maximum value of all original pixels in the red channel is "250", the maximum value of all original pixels in the green channel is "220", and the maximum value of all original pixels in the blue channel is "225". The maximum value in these color channels is "250", and this value can be used as the original brightness information of the first frame. Here, the corresponding original brightness information is calculated for each original frame.

[0050] In other embodiments, the color channels of the original image can be converted to other color spaces, such as YUV, YCrCb, HSI, etc., and then the maximum brightness (e.g., Y in the YUV color space) can be obtained as the original brightness information. In some embodiments, these color channels can also be preprocessed (e.g., bright spot removal) first, and then the maximum value of all color channels can be taken as the original brightness information.

[0051] After calculating the original brightness information, the brightness information generation circuit 120 can generate a set brightness information BR_info corresponding to each original frame based on this original brightness information. In some embodiments, the brightness information generation circuit 120 uses the original brightness information of each original frame as the set brightness information BR_info. In other words, the set brightness information BR_info of each original frame is the same as the original brightness information. In other embodiments, the original brightness information of multiple sequentially consecutive original frames can be obtained, and then low-pass filtering can be performed on these original brightness information to generate the set brightness information BR_info for each original frame, thereby avoiding screen flicker caused by excessively high frequency of change in the set brightness information. In other embodiments, the set brightness information BR_info can also be generated by limiting the change between the original brightness information of two consecutive original frames to a preset range, thereby avoiding viewing discomfort caused by excessive changes in the set brightness information.

[0052] The conversion curve generation circuit 130 receives the set brightness information BR_info from the brightness information generation circuit 120, and generates an electro-optical conversion lookup table EOTF_LUT corresponding to each original frame based on the set brightness information BR_info for each original frame and a conversion function. The input value of the conversion function is a grayscale value, such as the grayscale value of a color channel of an input pixel in an input image signal, and the output value of the conversion function is the brightness value of the color channel of the corresponding output pixel in the output image. The conversion function can refer to the standards set by the Society of Motion Picture and Television Engineers (SMPTE) or other organizations. For example, this conversion function is shown in the following mathematical formula 1.

[0053] [Mathematical Expression 1]

[0054] F D =EOTF[E′]=10000Y

[0055]

[0056] Where E' is the normalized linear grayscale value, such as the grayscale value in the red, green, or blue channel, or it can be a color value in the LMS color space. F DY is the linear luminance value. Y is the normalized nit value, ranging from [0:1]. m1, m2, c1, c2, and c3 are preset parameters. For example, m1 = 2610 / 16384 = 0.1593017578125; m2 = 2523 / 4096*128 = 78.84375; c1 = 3424 / 4096 = 0.8359375 = c3 - c3 + 1; c2 = 2413 / 4096*32 = 18.8515625; c3 = 2392 / 4096*32 = 18.6875, but this invention does not limit the values ​​of these preset parameters.

[0057] Specifically, the conversion curve generation circuit 130 generates an electro-optical conversion lookup table (EOTF_LUT) corresponding to each original frame in the input image signal based on the set brightness information BR_info and the conversion function, as described below. First, a range is set based on the set brightness information BR_info of the original frame as an upper limit value B, and this range is represented as [0, B]. Next, each positive integer value from 0 to B within [0, B] is sequentially substituted into the grayscale value E' of the conversion function to generate the corresponding brightness value F. D and output brightness value F D The corresponding grayscale value is stored in the column of the electro-optical conversion lookup table EOTF_LUT, thus generating the electro-optical conversion lookup table EOTF_LUT.

[0058] The image conversion circuit 140 receives the electro-optical conversion lookup table (EOTF_LUT) for each original frame from the conversion curve generation circuit 130. The image conversion circuit 140 includes, for example, a storage unit 141 for storing the EOTF_LUT. Specifically, the image conversion circuit 140 can update the EOTF_LUT in the storage unit 141 each time it receives the EOTF_LUT for an original frame, thereby storing the EOTF_LUT for each original frame. Alternatively, the image conversion circuit 140 can store the EOTF_LUTs for all or a period of time for the original frames in the storage unit 141, and then read the corresponding EOTF_LUT for each original frame when an optical conversion lookup is required. On the other hand, the image conversion circuit 140 receives the input image signal img_in and generates an output image signal img_out. The image conversion circuit 140 performs an electro-optical conversion lookup on each of the multiple original frames of the input image signal img_in according to its corresponding electro-optical conversion lookup table EOTF_LUT to generate multiple output frames of the output image signal img_out. Each output frame includes multiple output pixels. Specifically, the image conversion circuit 140 performs an electro-optical conversion lookup on each original pixel in the original frame to generate each output pixel of each output frame of the output image signal img_out. More specifically, the image conversion circuit 140 looks up the corresponding luminance value in the electro-optical conversion lookup table EOTF_LUT based on the grayscale value of each color channel of the original pixel, and uses it as the luminance value of each color channel of the output pixel of the corresponding original pixel in the corresponding output frame.

[0059] The image display module 150 receives the output image signal from the image conversion circuit 140 and displays the output image according to the output image signal. The image display module 150 can be any display technology used to present images to the user. For example, if the display device 100 is a liquid crystal display device, then the image display module 150 is a liquid crystal display panel and a controller (or processor) for controlling the liquid crystal display panel; if the display device 100 is a projection device, the image display module 150 includes, for example, a light valve and a controller (or processor) for controlling the light valve.

[0060] In this invention, the brightness information generation circuit 120 and the conversion curve generation circuit 130 are independent circuit modules. The brightness information generation circuit 120 generates set brightness information for each original frame, and the conversion curve generation circuit 130 generates an electro-optical conversion lookup table for each original frame. In other words, in this invention, the electro-optical conversion lookup table does not need to be generated by the software of the user interface of the display device 100. Compared with the prior art, the method of this invention generates the electro-optical conversion lookup table more efficiently, and can actually generate the electro-optical conversion lookup table frame by frame, which can effectively and adaptively adjust for each output frame. This invention solves the problem that the prior art dynamic HDR must generate different electro-optical conversion lookup tables based on different metadata, and cannot be optimized frame by frame due to software computing limitations.

[0061] Figure 2 This is a system block diagram of the display device according to the second embodiment of the present invention. Please refer to... Figure 2 The display device 100 includes, for example, at least one image processor 200IP. The at least one image processor 200IP includes the aforementioned receiving circuit 110, the aforementioned brightness information generation circuit 120, the conversion curve generation circuit 130, and the image conversion circuit 140. For a detailed description of the implementation of the image processor 200IP, please refer to the description of the image processor 100P; it will not be repeated here. The difference between the second embodiment and the first embodiment is that the brightness information generation circuit 120 of the image processor 200IP of the display device 200 further includes a smoothing calculation module 220, which is electrically connected to the image analysis module 121. The image analysis module 121 calculates the original brightness information 210 corresponding to each original frame, and the smoothing calculation module 220 receives the original brightness information 210 and generates set brightness information BR_info based on the original brightness information 210. Figure 3 This is a flowchart of the smoothing calculation module 220 generating the set brightness information BR_info, including steps 301 to 308. In step 301, the original brightness information is received. In step 302, it is determined whether the original brightness information is lower than a brightness threshold. If the result of step 302 is yes, in step 303, the brightness threshold is set to a target brightness value. If the result of step 302 is no, in step 304, the original brightness information is set to the target brightness value. That is, the calculation of the target brightness value can be expressed as the following mathematical formula 2.

[0062] [Mathematical Expression 2]

[0063] TB = max(T1, OB)

[0064] Where OB represents the original brightness information, T1 represents the brightness threshold, and TB represents the target brightness value. In other words, the brightness threshold serves as the lower limit for the target brightness value. The reason for setting the brightness threshold will be explained below.

[0065] After determining the target brightness value, step 310 calculates the difference between this target brightness value and the set brightness information (previous set brightness information) of the previous original frame (previous original frame), and generates the set brightness information (current set brightness information) of the currently judged original frame (current original frame) based on this difference. For example, a brightness adjustment value is set, and if the difference between the target brightness value of the judged original frame and the previous set brightness information is too large (e.g., greater than the brightness adjustment value), the target brightness value is increased or decreased in units of the brightness adjustment value to generate the set brightness information. In this way, flickering of the output image can be avoided when the difference between the set brightness information and the previous set brightness information is too large.

[0066] Specifically, step 310 includes steps 305 to 307. In step 305, it is determined whether the difference between the target brightness value and the previously set brightness information exceeds the brightness adjustment value. If the result of step 305 is yes, in step 306, the brightness adjustment value is added to or subtracted from the previously set brightness information to obtain the set brightness information. Specifically, if the target brightness value is greater than the previously set brightness information, the brightness adjustment value is added to the previously set brightness information to obtain the set brightness information of the currently judged original image. If the target brightness value is less than the previously set brightness information, the brightness adjustment value is subtracted from the previously set brightness information to obtain the set brightness information of the currently judged original image. If the result of step 305 is no, this means that the difference between the target brightness value and the previously set brightness information is less than or equal to the brightness adjustment value. Next, in step 307, the target brightness value is set as the set brightness information. Finally, in step 308, the set brightness information is output.

[0067] The purpose of the brightness threshold is explained here. As described in steps 301 to 310 above, the brightness threshold is the target brightness value or the lower limit of the set brightness information. When the original brightness information is low, it indicates that the overall brightness of the original image is too low. Therefore, the brightness threshold is used as the lower limit of the set brightness value to avoid the overall brightness of the output image being too low. On the other hand, since the adjustment is performed in units of brightness adjustment value in step 306, when switching between different scenes (including multiple consecutive images with similar brightness information), if the set brightness information of the previous scene differs too much from that of the next scene, it will take many images (frames) to reach the set brightness value of the next scene. The adjustment speed of brightness when switching between scenes will be too slow, resulting in poor viewing effect. Therefore, using the brightness threshold as the lower limit of the set brightness value can limit the range of difference in set brightness values ​​between two scenes.

[0068] Please refer to the following: Figure 2In the second embodiment, the operating principle of the conversion curve generation circuit 130 and the image conversion circuit 140 is the same as that of the first embodiment, so it will not be described again here.

[0069] Figure 4 This is a system block diagram of a display device according to a third embodiment of the present invention. The display device 400 includes, for example, at least one image processor 400IP. For a detailed description of the image processor 400IP, please refer to the description of the image processor 100P, which will not be repeated here. The difference between the third embodiment and the first or second embodiment is that the display device 400 further includes a signal processing circuit 410 and a color space conversion circuit 420. The at least one image processor 400IP includes a receiving circuit 110, a luminance information generation circuit 120, a conversion curve generation circuit 130, a screen conversion circuit 140, a signal processing circuit 410, and a color space conversion circuit 420. The signal processing circuit 410 is electrically connected to the receiving circuit 110 and the color space conversion circuit 420. The color space conversion circuit 420 is electrically connected between the luminance information generation circuit 120 and the screen conversion circuit 140. In this embodiment, the receiving circuit 110 obtains metadata from the input image signal img_in. The signal processing circuit 410 receives metadata 430 from the receiving circuit 110 and determines whether the input image signal img_in conforms to the High Dynamic Range (HDR) format based on the metadata 430. For example, the metadata 430 may contain one or more fields indicating whether a HDR format is supported, such as HDR10, HDR10+, or Dolby Vision. Alternatively, if the input image signal img_in conforms to the HDR format, the metadata 430 may contain information such as the original color space of the video, the maximum luminance value in the video, and the definition of white. The original color space information may include, for example, the coordinates of the red, green, and blue channels in the CIE-1931 chromaticity diagram.

[0070] On the other hand, the color space conversion circuit 420 stores the display color space information corresponding to the display device 400, such as the coordinates of the red, green, and blue channels in the CIE-1931 chromaticity diagram. When the signal processing circuit 410 determines that the input image signal img_in conforms to the high dynamic range format, the color space conversion circuit 420 converts the original pixels of each original image from the original color space to the display color space based on the original color space information and display color space information contained in the metadata. For example, the color space conversion circuit 420 can establish a 3*3 matrix based on the original color space information and display color space information. Multiplying this matrix by the grayscale values ​​of the three color channels of the original pixel (forming a vector) yields the grayscale values ​​of the three color channels in the display color space. It is worth noting that the operation of the color space conversion circuit 420 is parallel to the operation of the conversion curve generation circuit 130, which increases the overall processing speed.

[0071] The image conversion circuit 140 receives the converted original image and performs an electro-optical conversion lookup table (EOTF_LUT) on the converted original image to generate multiple output images, and provides an output image signal (img_out) with multiple output images to the image display module 150. Therefore, the display device 400 in this embodiment can also be used to process image signals conforming to the HDR format. Since the brightness information generation circuit 120 and the conversion curve generation circuit 130 generate a corresponding electro-optical conversion lookup table (EOTF_LUT) for each original image, the output image can be optimized based on the brightness information of each original image, regardless of whether the input image signal is static HDR or dynamic HDR. On the other hand, this disclosure enables even static HDR image signals to produce frame-by-frame optimized video display effects on the display.

[0072] It is worth mentioning that the display device 400 of the third embodiment can also be used for image signals that do not conform to the HDR format. When the signal processing circuit 410 determines that the input image signal img_in does not conform to the high dynamic range format, the color space conversion circuit 420 does not perform color space conversion, and the original image in the input image signal img_in is directly transmitted to the image conversion circuit 140 through the color space conversion circuit 420.

[0073] In the third embodiment, the operating principle of the brightness information generation circuit 120, the conversion curve generation circuit 130, and the image conversion circuit 140 is the same as that of the second embodiment, so it will not be described again here.

[0074] Figure 5This is a system block diagram of a display device according to a fourth embodiment of the present invention. The display device 500 includes, for example, at least one image processor 500IP. The at least one image processor 500IP includes a receiving circuit 110, a brightness information generation circuit 120, a conversion curve generation circuit 130, an image conversion circuit 140, and a preprocessing circuit 510. For a detailed description of the image processor 500IP, please refer to the description of the image processor 100P, which will not be repeated here. The difference between the fourth embodiment and the third embodiment is that the display device 500 also includes a preprocessing circuit 510. The preprocessing circuit 510 is electrically connected between the brightness information generation circuit 120 and the color space conversion circuit 420. The preprocessing circuit 510 is used to receive the input image signal img_in and perform one or more preprocessing operations on the original pixels of the original image. These preprocessing operations include, for example, noise reduction, color space conversion, brightness adjustment, contrast adjustment, sharpness adjustment, color temperature adjustment, etc., and the present invention is not limited thereto. In this embodiment, the color space conversion circuit 420 receives the pre-processed original image and performs color space conversion on the pre-processed original image to generate the converted original image.

[0075] In the fourth embodiment, the operating principle of the brightness information generation circuit 120, the conversion curve generation circuit 130, and the image conversion circuit 140 is the same as that of the second embodiment, so it will not be described again here.

[0076] Figure 6 This is a system block diagram of a display device according to a fifth embodiment of the present invention. The display device 600 includes, for example, at least one image processor 600IP. In this embodiment, the at least one image processor 600IP includes a receiving circuit 110, a brightness information generation circuit 120, a conversion curve generation circuit 130, and a screen conversion circuit 140. For a detailed description of the image processor 600IP, please refer to the description of the image processor 100P; it will not be repeated here. In the display device 600 of the fifth embodiment, the screen conversion circuit 140 is directly connected to the receiving circuit 110 to receive the input image signal img_in, and the brightness information generation circuit 120 is directly connected to the receiving circuit 110 to receive the input image signal img_in. The main difference between the fifth embodiment and the first to fourth embodiments is that the screen conversion circuit 140 is not electrically connected to the receiving circuit 110 through the brightness information generation circuit 120. In this embodiment, the operations performed by the brightness information generation circuit 120 and the conversion curve generation circuit 130 are the same as in the first embodiment, and therefore will not be described again here.

[0077] Furthermore, the architecture of the fifth embodiment can also be combined with other embodiments. For example, in Figure 7In some embodiments, the display device 700 includes, for example, at least one image processor 700IP. The at least one image processor 700IP includes a receiving circuit 110, a brightness information generation circuit 120, a conversion curve generation circuit 130, and a screen conversion circuit 140. The brightness information generation circuit 120 of the image processor 700IP further includes a smoothing calculation module 220. For a detailed description of the image processor 700IP, please refer to the description of the image processor 100P, which will not be repeated here. For example, the screen conversion circuit 140 and the receiving circuit 110 may further include the color space conversion circuit 420 of the third embodiment and the preprocessing circuit 510 of the fourth embodiment.

[0078] In other words, in the fifth embodiment, after the input image signal img_in is transmitted to the display device 600, it is divided into two paths. The path formed by the receiving circuit 110 to the brightness information generation circuit 120 and the conversion curve generation circuit 130 is used to analyze the brightness information in the input image information to generate an electro-optic conversion lookup table. The path formed by the receiving circuit 110 to the screen conversion circuit 140 is used to transmit the input image information to be processed.

[0079] Figure 8 This is a flowchart of the display method of the present invention. Please refer to it. Figure 8 In step 801, an input image signal is received by a receiving circuit, wherein the input image signal includes multiple original frames, each of which contains multiple original pixels. In step 802, a brightness information generation circuit receives the input image signal from the receiving circuit, obtains the original brightness information of the original frames based on the input image signal, and generates set brightness information for the corresponding original frames based on the original brightness information. In step 803, a conversion curve generation circuit generates an electro-optical conversion lookup table based on the set brightness information of the original frames and a conversion function. In step 804, an image conversion circuit receives the electro-optical conversion lookup table from the conversion curve generation circuit. In step 805, the image conversion circuit performs an electro-optical conversion lookup on the original frames of the input image signal according to the electro-optical conversion lookup table to generate multiple output frames for the output image signal, thereby generating the output image signal. Each output frame includes multiple output pixels. And in step 806, an image display module displays the output image based on the output image signal. Figure 8 For detailed descriptions of each step, please refer to the detailed description of display devices 100 to 700 in this invention, which will not be repeated here.

[0080] In this invention, Figure 8 Each step is implemented, for example, by the circuits 110 to 150 in the first to fifth embodiments described above.

[0081] Figure 9This is a block diagram of the projection device of the present invention. If display devices 100, 200, 400, 500, 600, and 700 are projection devices P, then projection device P includes an illumination system P10, an optical-mechanical system P20, and a projection lens P30. The illumination system P10 includes, for example, a light source device and at least one optical element (not labeled) to provide an illumination beam L1 to the optical-mechanical system P20. The optical-mechanical system P20 includes, for example, at least one image processor 100IP, 200IP, 400IP, 500IP, 600IP, or 700IP as described in the above embodiments, and an image display module 150. The image display module 150 includes at least one light valve P201 and a controller for controlling the at least one light valve P201. A controller (or processor) P202 is used to control at least one light valve P201. The controller (or processor) P202 receives the output image signal img_out from at least one image processor 100IP, 200IP, 400IP, 500IP, 600IP, 700IP. At least one light valve P201 is disposed on the transmission path of the image beam L2. The controller (or processor) P202 controls at least one light valve P201 to convert the illumination beam L1 into the image beam L2 according to the output image signal img_out. The projection lens P30 is disposed on the transmission path of the image beam L2 to project the image beam L2 out of the projection device P.

[0082] In another embodiment, at least one image processor may not be part of the optical engine system, i.e., the projection device includes an illumination system, at least one image processor in the above embodiments, the optical engine system, and a projection lens.

[0083] In the aforementioned display device and display method, since the brightness information generation circuit 120 and the conversion curve generation circuit 130 are each independent circuit modules, they can generate corresponding set brightness information and electro-optical conversion lookup tables for each original image (frame) at a higher frequency. Even if the input image signal does not conform to the HDR image format or belongs to the static HDR image format, an electro-optical conversion lookup table can be generated for each image. Compared with existing dynamic HDR technology, it can actually generate an electro-optical conversion lookup table for each frame, thereby truly optimizing each output image. On the other hand, the smoothing calculation module 220 can make the switching between scenes with different brightness levels smoother, avoiding flickering or viewing discomfort.

[0084] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Any simple equivalent changes and modifications made in accordance with the claims and description of the invention are still within the scope of this patent. Furthermore, no embodiment or claim of the present invention needs to achieve all the objectives, advantages, or features disclosed in the invention. In addition, the abstract and title (invention title) are only used to assist in patent document retrieval and are not intended to limit the scope of the invention. Moreover, the terms "first," "second," etc., mentioned in this specification or claims are only used to name elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of elements.

Claims

1. A display device, characterized in that, The display device includes a receiving circuit, a brightness information generation circuit, a conversion curve generation circuit, an image conversion circuit, and an image display module, wherein: The receiving circuit is used to receive an input image signal, wherein the input image signal includes a plurality of original frames, each of the plurality of original frames containing a plurality of original pixels; The brightness information generating circuit is electrically connected to the receiving circuit to receive the input image signal from the receiving circuit. The brightness information generating circuit obtains the original brightness information of each of the plurality of original images according to the input image signal, and generates set brightness information corresponding to each of the plurality of original images according to the original brightness information. The conversion curve generation circuit is electrically connected to the brightness information generation circuit, and is used to generate an electro-optic conversion lookup table based on the set brightness information and conversion function of each of the plurality of original images. The image conversion circuit is electrically connected to the receiving circuit and the conversion curve generation circuit, and is used to receive the electro-optical conversion lookup table corresponding to each of the plurality of original images from the conversion curve generation circuit, and to receive the input image signal from the receiving circuit and generate an output image signal; wherein the image conversion circuit performs electro-optical conversion lookup on each of the plurality of original images of the input image signal according to the electro-optical conversion lookup table corresponding to each of the plurality of original images, so as to generate a plurality of output images of the output image signal, wherein each of the plurality of output images includes a plurality of output pixels; The image display module is electrically connected to the image conversion circuit to receive the output image signal and display the output image according to the output image signal.

2. The display device according to claim 1, characterized in that, The brightness information generation circuit includes an image analysis module, which receives the input image signal, and each of the multiple original pixels of the multiple original images includes multiple color channels. The image analysis module is used to calculate the maximum value in the multiple color channels of each of the multiple original pixels of the multiple original images as the original brightness information.

3. The display device according to claim 2, characterized in that, The brightness information generation circuit uses the original brightness information of each of the plurality of original images as the set brightness information corresponding to each of the plurality of original images.

4. The display device according to claim 2, characterized in that, The brightness information generation circuit also includes a smoothing calculation module, which is electrically connected to the image analysis module to receive the original brightness information corresponding to each of the plurality of original images, and the smoothing calculation module is used to determine whether the original brightness information of each of the plurality of original images is lower than a brightness threshold. If the original brightness information of the original image is determined to be lower than the brightness threshold, the smoothing calculation module sets the brightness threshold to a target brightness value; If the original brightness information of the original image is greater than or equal to the brightness threshold, the smoothing calculation module sets the original brightness information as the target brightness value; as well as The smoothing calculation module generates the set brightness information of the original image to be judged based on the difference between the target brightness value and the previous set brightness information of the original image preceding the original image to be judged.

5. The display device according to claim 4, characterized in that, If the difference between the target brightness value and the previously set brightness information exceeds the brightness adjustment value, and the target brightness value is greater than the previously set brightness information, the smoothing calculation module adds a brightness adjustment value to the previously set brightness information to obtain the set brightness information of the original image judged among the multiple original images; If the difference between the target brightness value and the previously set brightness information exceeds the brightness adjustment value, and the target brightness value is less than the previously set brightness information, the smoothing calculation module subtracts the brightness adjustment value from the previously set brightness information to obtain the set brightness information of the original image being judged. as well as If the difference between the target brightness value and the previously set brightness information is less than or equal to the brightness adjustment value, the smoothing calculation module sets the target brightness value to the set brightness information of the original image being judged.

6. The display device according to claim 1, characterized in that, The display device further includes a signal processing circuit and a color space conversion circuit, wherein The receiving circuit is also used to obtain metadata of the input image signal from the input image signal; The signal processing circuit is electrically connected to the receiving circuit, receives the metadata from the receiving circuit, and determines whether the input image signal conforms to the high dynamic range format based on the metadata. as well as The color space conversion circuit is electrically connected to the signal processing circuit to receive the metadata and store the display color space information corresponding to the display device; wherein, If the signal processing circuit determines that the input image signal conforms to the high dynamic range format, the color space conversion circuit is used to convert the plurality of original pixels of each of the plurality of original images from the original color space to the display color space according to the original color space information contained in the metadata and the display color space information; wherein, The image conversion circuit is electrically connected to the color space conversion circuit to receive the plurality of converted original images, and performs electro-optical conversion search on each of the plurality of converted original images to generate the plurality of output images.

7. The display device according to claim 1, characterized in that, The image conversion circuit performs an electro-optic conversion lookup on the plurality of original pixels of the plurality of original images of the input image signal according to the electro-optic conversion lookup table corresponding to each of the plurality of original images, so as to generate the plurality of output pixels of each of the plurality of output images of the output image signal.

8. The display device according to claim 1, characterized in that, The brightness information generating circuit is electrically connected between the image conversion circuit and the receiving circuit, so that the receiving circuit is electrically connected to the image conversion circuit through the brightness information generating circuit, and the image conversion circuit receives the input image signal from the receiving circuit through the brightness information generating circuit.

9. The display device according to claim 1, characterized in that, The image conversion circuit is directly connected to the receiving circuit so that the receiving circuit can receive the input image signal.

10. A display method, characterized in that, The display method is executed by a display device, which includes a receiving circuit, a brightness information generation circuit, a conversion curve generation circuit, an image conversion circuit, and an image display module. The display method includes the following steps: The receiving circuit receives an input image signal, wherein the input image signal includes a plurality of original frames, each of the plurality of original frames containing a plurality of original pixels; The brightness information generating circuit receives the input image signal from the receiving circuit, obtains the original brightness information of each of the plurality of original images based on the input image signal, and generates set brightness information corresponding to each of the plurality of original images based on the original brightness information. The conversion curve generation circuit generates an electro-optic conversion lookup table based on the set brightness information and conversion function of each of the plurality of original images; The image conversion circuit receives the electro-optic conversion lookup table corresponding to each of the plurality of original images from the conversion curve generation circuit, receives the input image signal from the receiving circuit, and generates an output image signal. as well as The image display module displays the output image based on the output image signal; wherein The step of generating the output image signal is to use the image conversion circuit to perform an electro-optic conversion lookup on each of the plurality of original images of the input image signal according to the electro-optic conversion lookup table corresponding to each of the plurality of original images, so as to generate a plurality of output images of the output image signal respectively, wherein each of the plurality of output images includes a plurality of output pixels.

11. The display method according to claim 10, characterized in that, The brightness information generation circuit includes an image analysis circuit, and each of the multiple original pixels of the original image includes multiple color channels; the display method further includes the following steps: The image analysis circuit calculates the maximum value in the multiple color channels of each of the multiple original pixels of the multiple original images as the original brightness information.

12. The display method according to claim 11, characterized in that, In the step of generating set brightness information based on the original brightness information, the original brightness information of each of the plurality of original images is used as the set brightness information of each of the plurality of original images.

13. The display method according to claim 11, characterized in that, The brightness information generation circuit further includes a smoothing calculation module, and the step of generating set brightness information based on the original brightness information includes the following steps: The smoothing calculation module determines whether the original brightness information corresponding to each of the plurality of original images is lower than a brightness threshold. If the original brightness information of the original image is determined to be lower than the brightness threshold, the smoothing calculation module sets the brightness threshold to a target brightness value. If the original brightness information of the original image is greater than or equal to the brightness threshold, the smoothing calculation module sets the original brightness information as the target brightness value. as well as The smoothing calculation module generates the set brightness information of the original image to be judged based on the difference between the target brightness value and the previous set brightness information of the original image preceding the original image to be judged.

14. The display method according to claim 13, characterized in that, The step of generating the set brightness information of the original image to be judged by the smoothing calculation module based on the difference between the target brightness value and the previous set brightness information of the previous original image corresponding to the original image to be judged includes the following steps: If the difference between the target brightness value and the previously set brightness information exceeds the brightness adjustment value, and the target brightness value is greater than the previously set brightness information, the smoothing calculation module adds a brightness adjustment value to the previously set brightness information to obtain the set brightness information of the original image being judged. If the difference between the target brightness value and the previously set brightness information exceeds the brightness adjustment value, and the target brightness value is less than the previously set brightness information, the smoothing calculation module subtracts the brightness adjustment value from the previously set brightness information to obtain the set brightness information of the original image being judged. as well as If the difference between the target brightness value and the previously set brightness information is less than or equal to the brightness adjustment value, the smoothing calculation module sets the target brightness value to the set brightness information of the original image being judged.

15. The display method according to claim 10, characterized in that, The display device further includes a signal processing circuit and a color space conversion circuit, and the display method includes: The receiving circuit obtains the metadata of the input image signal from the input image signal. The signal processing circuit determines whether the input image signal conforms to the high dynamic range format based on the metadata. The color space conversion circuit receives the metadata and stores the display color space information corresponding to the display device; and If the signal processing circuit determines that the input image signal conforms to a high dynamic range format, the color space conversion circuit, based on the original color space information contained in the metadata and the display color space information, converts the plurality of original pixels of each of the plurality of original images from the original color space to the display color space; wherein, The image conversion circuit performs electro-optical conversion on the multiple converted original images to generate the multiple output images respectively.

16. The display method according to claim 10, characterized in that, The step of generating the multiple output images of the output image signal by performing electro-optic conversion lookup on the multiple original images according to the electro-optic conversion lookup table corresponding to each of the multiple original images by the image conversion circuit includes: The image conversion circuit performs electro-optic conversion search on each of the plurality of original pixels of the plurality of original frames of the input image signal to generate the plurality of output pixels of each of the plurality of output frames of the output image signal.

Images