Signal processing device and image display apparatus including the same

Abstract

The present invention relates to a signal processing device and an image display device equipped with the same. An image display device according to one embodiment of the present invention comprises a display, an image receiving device for receiving an input image, and a signal processing device for performing signal processing on an input image from an image receiving device and outputting image data to a display. The signal processing device controls the brightness adjustment change rate of the first input image to be smaller than the brightness adjustment change rate of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same. By doing so, the contrast of the image displayed on the display can be improved.

Description

Technology Field

[0001] The present invention relates to a signal processing device and an image display device equipped with the same, and more specifically, to a signal processing device capable of improving the contrast of an image displayed on a display and an image display device equipped with the same. Background Technology

[0002] A signal processing device is a device that performs signal processing on an input image so that the image can be displayed.

[0003] For example, a signal processing device may receive a broadcast signal or an HDMI signal, perform signal processing based on the received broadcast signal or HDMI signal, and output a signal-processed video signal.

[0004] Meanwhile, with the advancement of camera and broadcasting technology, the resolution and vertical synchronization frequency of input video are increasing. Specifically, there is a growing need for image quality processing for video with resolutions such as 4K and 8K.

[0005] A signal processing device can handle the image quality processing of such input images. Accordingly, research is being conducted to improve image quality processing in a signal processing device. Meanwhile, Korean Patent Publication No. 10-2010-0028247 relates to a contrast correction device and method for an image display device, and discloses that the perceived contrast ratio is improved by analyzing and processing the brightness signal of an image signal input to an image display device. The problem to be solved

[0006] The objective of the present invention is to provide a signal processing device capable of improving the contrast of an image displayed on a display, and an image display device equipped with the same.

[0007] Meanwhile, another objective of the present invention is to provide a signal processing device capable of enhancing contrast for an object in an image and an image display device equipped with the same. means of solving the problem

[0008] An image display device according to an embodiment of the present invention for achieving the above objective comprises a display, an image receiving device for receiving an input image, and a signal processing device for performing signal processing on an input image from the image receiving device and outputting image data to the display, wherein the signal processing device controls the brightness adjustment change rate of the first input image to be smaller than the brightness adjustment change rate of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image.

[0009] Meanwhile, the signal processing device can control the brightness adjustment change rate of the first input image to be greater than the brightness adjustment change rate of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is smaller than the brightness deviation of the second input image.

[0010] Meanwhile, in a state where the average luminance levels of the first input image and the second input image are the same, if the luminance deviation of the first input image is greater than the luminance deviation of the second input image, the luminance adjustment level at the average luminance level of the first input image and the luminance adjustment level at the average luminance level of the second input image may be the same.

[0011] Meanwhile, the signal processing device can control the change rate of brightness adjustment at a brightness level smaller than the average brightness level of the first input image to be smaller than the change rate of brightness adjustment at a brightness level smaller than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same.

[0012] Meanwhile, the signal processing device can control the brightness adjustment level at a brightness level smaller than the average brightness level of the first input image and the second input image to be greater than the brightness adjustment level at a brightness level smaller than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image when the average brightness levels of the first input image and the second input image are the same.

[0013] Meanwhile, the signal processing device can control the change rate of brightness adjustment at a brightness level greater than the average brightness level of the first input image and the second input image to be smaller than the change rate of brightness adjustment at a brightness level greater than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same.

[0014] Meanwhile, the signal processing device can control the brightness adjustment level at a brightness level greater than the average brightness level of the first input image and the second input image to be smaller than the brightness adjustment level at a brightness level greater than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same.

[0015] Meanwhile, the signal processing device adjusts the brightness of the input image based on the brightness distribution of the input image, and can control the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases.

[0016] Meanwhile, the signal processing device can extract an object of the input image and control the amount of change in the luminance of the extracted object to increase in correspondence with the luminance of the extracted object.

[0017] Meanwhile, the signal processing device can control the amount of change in the luminance of the extracted object to increase as the peak of the luminance distribution of the extracted object becomes larger.

[0018] Meanwhile, the signal processing device can control the amount of change in the luminance of the extracted object to increase as the deviation of the luminance distribution of the extracted object becomes smaller.

[0019] Meanwhile, the signal processing device can extract the background of the input image and control the amount of change in the brightness of the extracted object to increase in correspondence with the brightness of the extracted background.

[0020] Meanwhile, the signal processing device includes an image analysis unit that analyzes an input image and a luminance mapping unit that performs luminance mapping based on luminance information of the input image from the image analysis unit, and the luminance mapping unit can control the luminance adjustment change rate of the first input image to be smaller than the luminance adjustment change rate of the second input image when the average luminance level of the first input image and the second input image are the same and the luminance deviation of the first input image is greater than the luminance deviation of the second input image.

[0021] Meanwhile, an image display device according to another embodiment of the present invention includes a display, an image receiving device for receiving an input image, and a signal processing device for performing signal processing on an input image from an image receiving device and outputting image data to a display. The signal processing device adjusts the brightness of an input image based on the brightness distribution of the input image, and controls the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases.

[0022] Meanwhile, the signal processing device can extract an object from an input image and control the amount of change in the luminance of the extracted object so that the larger the peak of the luminance distribution of the extracted object, the greater the change in luminance of the extracted object.

[0023] Meanwhile, the signal processing device can extract an object from an input image and control the amount of change in the luminance of the extracted object so that the smaller the deviation of the luminance distribution of the extracted object, the greater the change in luminance of the extracted object.

[0024] Meanwhile, a signal processing device according to an embodiment of the present invention includes an image analysis unit that analyzes an input image and a luminance mapping unit that performs luminance mapping based on luminance information of an input image from the image analysis unit, and the luminance mapping unit can control the luminance adjustment change rate of the first input image to be smaller than the luminance adjustment change rate of the second input image when the luminance deviation of the first input image is greater than the luminance deviation of the second input image.

[0025] Meanwhile, the luminance mapping unit controls the luminance adjustment change rate at a luminance level smaller than the average luminance level of the first input image to be smaller than the luminance adjustment change rate at a luminance level smaller than the average luminance level of the second input image when the average luminance levels of the first input image and the second input image are the same and the luminance adjustment level at a luminance level smaller than the average luminance level of the first input image can be controlled to be larger than the luminance adjustment level at a luminance level smaller than the average luminance level of the second input image.

[0026] Meanwhile, the luminance mapping unit controls the luminance adjustment change rate at a luminance level greater than the average luminance level of the first input image and the second input image to be smaller than the luminance adjustment change rate at a luminance level greater than the average luminance level of the second input image when the average luminance levels of the first input image and the second input image are the same and the luminance adjustment level at a luminance level greater than the average luminance level of the first input image is smaller than the luminance adjustment level at a luminance level greater than the average luminance level of the second input image. Effects of the invention

[0027] An image display device according to one embodiment of the present invention comprises a display, an image receiving device for receiving an input image, and a signal processing device for performing signal processing on an input image from the image receiving device and outputting image data to the display. The signal processing device controls the brightness adjustment change rate of the first input image to be smaller than the brightness adjustment change rate of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved. In particular, the contrast of a main object within the image can be improved. Additionally, the contrast of the background within the image can be improved.

[0028] Meanwhile, the signal processing device can control the brightness adjustment change rate of the first input image to be greater than the brightness adjustment change rate of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is smaller than the brightness deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0029] Meanwhile, in a state where the average luminance levels of the first input image and the second input image are the same, if the luminance deviation of the first input image is greater than the luminance deviation of the second input image, the luminance adjustment level at the average luminance level of the first input image and the luminance adjustment level at the average luminance level of the second input image may be the same. Accordingly, the contrast of the image displayed on the display can be improved.

[0030] Meanwhile, the signal processing device can control the change rate of brightness adjustment at a brightness level smaller than the average brightness level of the first input image to be smaller than the change rate of brightness adjustment at a brightness level smaller than the average brightness level of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is greater than the brightness deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0031] Meanwhile, the signal processing device can control the brightness adjustment level at a brightness level smaller than the average brightness level of the first input image to be greater than the brightness adjustment level at a brightness level smaller than the average brightness level of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is greater than the brightness adjustment level at a brightness level smaller than the average brightness level of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0032] Meanwhile, the signal processing device can control the change rate of brightness adjustment at a brightness level greater than the average brightness level of the first input image to be smaller than the change rate of brightness adjustment at a brightness level greater than the average brightness level of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is greater than the brightness deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0033] Meanwhile, the signal processing device can control the brightness adjustment level at a brightness level greater than the average brightness level of the first input image and the second input image to be smaller than the brightness adjustment level at a brightness level greater than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same. Accordingly, the contrast of the image displayed on the display can be improved.

[0034] Meanwhile, the signal processing device adjusts the brightness of the input image based on the brightness distribution of the input image, and can control the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases. Accordingly, the contrast of the image displayed on the display can be improved.

[0035] Meanwhile, the signal processing device can extract objects from the input image and control the amount of change in the luminance of the extracted objects to increase in correspondence with the luminance of the extracted objects. Accordingly, the contrast of the image displayed on the display can be improved.

[0036] Meanwhile, the signal processing device can control the amount of change in luminance of the extracted object so that the larger the peak of the luminance distribution of the extracted object, the greater the change in luminance of the extracted object. Accordingly, the contrast of the image displayed on the display can be improved.

[0037] Meanwhile, the signal processing device can control the amount of change in the luminance of the extracted object to increase as the deviation in the luminance distribution of the extracted object becomes smaller. Accordingly, the contrast of the image displayed on the display can be improved.

[0038] Meanwhile, the signal processing device can extract the background of the input image and control the amount of change in the brightness of the extracted object to increase in correspondence with the brightness of the extracted background. Accordingly, the contrast of the image displayed on the display can be improved.

[0039] Meanwhile, the signal processing device includes an image analysis unit that analyzes an input image and a luminance mapping unit that performs luminance mapping based on luminance information of the input image from the image analysis unit. The luminance mapping unit can control the luminance adjustment change rate of the first input image to be smaller than the luminance adjustment change rate of the second input image when the average luminance levels of the first input image and the second input image are the same and the luminance deviation of the first input image is greater than the luminance deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0040] Meanwhile, an image display device according to another embodiment of the present invention includes a display, an image receiving device for receiving an input image, and a signal processing device for performing signal processing on an input image from an image receiving device and outputting image data to a display. The signal processing device adjusts the brightness of an input image based on the brightness distribution of the input image, and controls the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases. Accordingly, the contrast of the image displayed on the display can be improved. In particular, the contrast of a main object within the image can be improved. Additionally, the contrast of the background within the image can be improved. Accordingly, the contrast of the image displayed on the display can be improved.

[0041] Meanwhile, the signal processing device can extract objects from the input image and control the amount of change in luminance of the extracted object so that the larger the peak of the luminance distribution of the extracted object, the greater the change in luminance of the extracted object. Accordingly, the contrast of the image displayed on the display can be improved.

[0042] Meanwhile, the signal processing device can extract objects from the input image and control the amount of change in the luminance of the extracted objects so that the smaller the deviation in the luminance distribution of the extracted objects, the greater the change in luminance of the extracted objects. Accordingly, the contrast of the image displayed on the display can be improved.

[0043] Meanwhile, a signal processing device according to an embodiment of the present invention includes an image analysis unit that analyzes an input image and a luminance mapping unit that performs luminance mapping based on luminance information of the input image from the image analysis unit. The luminance mapping unit can control the luminance adjustment change rate of the first input image to be smaller than the luminance adjustment change rate of the second input image when the luminance deviation of the first input image is greater than the luminance deviation of the second input image. Accordingly, the contrast of the image displayed on the display can be improved. In particular, the contrast of the main object within the image can be improved. Additionally, the contrast of the background within the image can be improved. Accordingly, the contrast of the image displayed on the display can be improved. In particular, the contrast of the main object within the image can be improved. Additionally, the contrast of the background within the image can be improved.

[0044] Meanwhile, the luminance mapping unit controls the luminance adjustment change rate at a luminance level smaller than the average luminance level of the first input image to be smaller than the luminance adjustment change rate at a luminance level smaller than the average luminance level of the second input image when the average luminance levels of the first input image and the second input image are the same and the luminance adjustment level at a luminance level smaller than the average luminance level of the first input image is controlled to be larger than the luminance adjustment level at a luminance level smaller than the average luminance level of the second input image. Accordingly, the contrast of the image displayed on the display can be improved.

[0045] Meanwhile, the luminance mapping unit controls the luminance adjustment change rate at a luminance level greater than the average luminance level of the first input image and the second input image to be smaller than the luminance adjustment change rate at a luminance level greater than the average luminance level of the second input image when the average luminance levels of the first input image and the second input image are the same and the luminance adjustment level at a luminance level greater than the average luminance level of the first input image is smaller than the luminance adjustment level at a luminance level greater than the average luminance level of the second input image. Accordingly, the contrast of the image displayed on the display can be improved. Brief explanation of the drawing

[0046] FIG. 1 is a drawing illustrating an image display device according to one embodiment of the present invention. Figure 2 is an example of an internal block diagram of the image display device of Figure 1. Figure 3 is an example of an internal block diagram of the signal processing device of Figure 2. FIG. 4a is a diagram illustrating a control method of the remote control device of FIG. 2. Figure 4b is an internal block diagram of the remote control device of Figure 2. Figure 5 is an internal block diagram of the display of Figure 2. FIGS. 6a and 6b are drawings referenced in the description of the organic light-emitting panel of FIG. 5. Figure 7 is another example of an internal block diagram of the signal processing device of Figure 2. FIGS. 8a to 8d are drawings referenced in the description of a signal processing device related to the present invention. FIG. 9 is an example of an internal block diagram of a signal processing device according to an embodiment of the present invention. FIG. 10 is a flowchart illustrating the operation method of a signal processing device according to an embodiment of the present invention. FIGS. 11a to 13 are drawings referenced in the description of the operation of the signal processing device of FIG. 10. FIG. 14 is a flowchart illustrating the operation method of a signal processing device according to another embodiment of the present invention. FIGS. 15 to 16 are drawings referenced in the description of the operation of the signal processing device of FIG. 14. Specific details for implementing the invention

[0047] The present invention will be described in more detail below with reference to the drawings.

[0048] The suffixes "module" and "part" for components used in the following description are assigned solely for the ease of drafting this specification and do not inherently confer any particularly significant meaning or role. Accordingly, the terms "module" and "part" may be used interchangeably.

[0049] FIG. 1 is a drawing illustrating an image display device according to one embodiment of the present invention.

[0050] Referring to the drawing, the image display device (100) may include a display (180).

[0051] An image display device (100) according to one embodiment of the present invention includes a display (180), an image receiving device (105 of FIG. 2) for receiving an input image, and a signal processing device (170 of FIG. 2) for performing signal processing on an input image from the image receiving device (105) and outputting image data to the display (180). The signal processing device (170) controls the brightness adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be smaller than the brightness adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) when the brightness deviation of the first input image (1510) is greater than the brightness deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved. In particular, the contrast of the main object within the image can be improved. In addition, it becomes possible to enhance the contrast of the background within the video.

[0052] Meanwhile, the signal processing device (170) can control the brightness adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be greater than the brightness adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) when the average brightness levels of the first input image (1510) and the second input image (1610) are the same and the brightness deviation of the first input image (1510) is smaller than the brightness deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0053] Meanwhile, an image display device (100) according to another embodiment of the present invention includes a display (180), an image receiving device (105 of FIG. 2) that receives an input image, and a signal processing device (170 of FIG. 2) that performs signal processing on an input image from the image receiving device (105) and outputs image data to the display (180). The signal processing device (170) adjusts the brightness of the input image based on the brightness distribution of the input image, and controls the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0054] Meanwhile, the display (180) can be implemented as any one of various panels. For example, the display (180) can be any one of a liquid crystal display panel (LCD panel), an organic light-emitting panel (OLED panel), an inorganic light-emitting panel (LED panel), etc.

[0055] Meanwhile, organic light-emitting panels (OLED panels) have the advantage of faster panel response speed and superior color reproduction compared to liquid crystal display panels.

[0056] Meanwhile, the image display device (100) according to an embodiment of the present invention controls the brightness adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be smaller than the brightness adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) when the brightness deviation of the first input image (1510) is greater than the brightness deviation of the second input image (1610), even if the display (180) is equipped with any one of a liquid crystal display panel (LCD panel), an organic light-emitting panel (OLED panel), an inorganic light-emitting panel (LED panel), etc. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0057] Meanwhile, an image display device (100) according to another embodiment of the present invention adjusts the brightness of an input image based on the brightness distribution of the input image, and controls the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0058] Meanwhile, the image display device (100) of FIG. 1 can be a TV, monitor, tablet PC, mobile terminal, vehicle display device, etc.

[0059] Figure 2 is an example of an internal block diagram of the image display device of Figure 1.

[0060] Referring to FIG. 2, an image display device (100) according to an embodiment of the present invention may include an image receiving device (105), an external device interface unit (130), a storage unit (140), a user input interface unit (150), a sensor unit (not shown), a signal processing device (170), a display (180), and an audio output unit (185).

[0061] The video receiving device (105) can receive input video. For example, the video receiving device (105) can receive external input video such as broadcast video, HDMI video, or streaming video.

[0062] The video receiving device (105) may include a tuner unit (110), a demodulator unit (120), a network interface unit (130), and an external device interface unit (130).

[0063] Meanwhile, the video receiving device (105) may include only a tuner unit (110), a demodulator unit (120), and an external device interface unit (130), unlike the drawing. That is, it may not include a network interface unit (130).

[0064] The tuner unit (110) selects an RF (Radio Frequency) broadcast signal corresponding to a channel selected by the user or all previously stored channels among the RF broadcast signals received through an antenna (not shown). Additionally, it converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0065] For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband video or audio signal (CVBS / SIF). That is, the tuner unit (110) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (110) can be directly input to a signal processing device (170).

[0066] Meanwhile, the tuner unit (110) may be equipped with multiple tuners to receive multiple channels of broadcast signals. Alternatively, a single tuner that simultaneously receives multiple channels of broadcast signals is also possible.

[0067] The demodulator (120) receives the digital IF signal (DIF) converted by the tuner (110) and performs a demodulation operation.

[0068] The demodulation unit (120) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0069] The stream signal output from the demodulation unit (120) can be input to the signal processing unit (170). The signal processing unit (170) performs demultiplexing, video / audio signal processing, etc., then outputs video to the display (180) and outputs audio to the audio output unit (185).

[0070] The external device interface unit (130) can transmit or receive data with a connected external device (not shown), for example, a set-top box (50). To this end, the external device interface unit (130) may include an A / V input / output unit (not shown).

[0071] The external device interface section (130) can be connected wirelessly or via wired connection to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game console, camera, camcorder, computer (laptop), set-top box, etc., and can also perform input / output operations with the external devices.

[0072] The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit (not shown) can perform short-range wireless communication with other electronic devices.

[0073] Through such a wireless communication unit (not shown), the external device interface unit (130) can exchange data with an adjacent mobile terminal (600). In particular, the external device interface unit (130) can receive device information, information on an application being executed, an application image, etc. from the mobile terminal (600) in mirroring mode.

[0074] The network interface unit (135) provides an interface for connecting the video display device (100) to a wired / wireless network including the Internet network. For example, the network interface unit (135) can receive content or data provided by the Internet or a content provider or network operator through the network.

[0075] Meanwhile, the network interface section (135) may include a wireless communication section (not shown).

[0076] The storage unit (140) may store a program for each signal processing and control within the signal processing device (170), and may also store a signal-processed image, voice, or data signal.

[0077] Additionally, the storage unit (140) may perform the function of temporarily storing video, audio, or data signals input to the external device interface unit (130). Additionally, the storage unit (140) may store information regarding a predetermined broadcast channel through a channel memory function such as a channel map.

[0078] Although the storage unit (140) of FIG. 2 is illustrated in an embodiment in which it is provided separately from the signal processing device (170), the scope of the present invention is not limited thereto. The storage unit (140) may be included within the signal processing device (170).

[0079] The user input interface unit (150) transmits a signal input by the user to the signal processing device (170) or transmits a signal from the signal processing device (170) to the user.

[0080] For example, user input signals such as power on / off, channel selection, and screen settings can be transmitted / received from a remote control device (200), user input signals input from local keys (not shown) such as a power key, channel key, volume key, and setting value can be transmitted to a signal processing device (170), user input signals input from a sensor unit (not shown) that senses a user's gesture can be transmitted to a signal processing device (170), or signals from the signal processing device (170) can be transmitted to a sensor unit (not shown).

[0081] The signal processing device (170) can demultiplex a stream input through the tuner unit (110), the demodulator unit (120), the network interface unit (135), or the external device interface unit (130), or process the demultiplexed signals to generate and output a signal for video or audio output.

[0082] For example, the signal processing device (170) can receive a broadcast signal or an HDMI signal, etc., received from the video receiving device (105), perform signal processing based on the received broadcast signal or HDMI signal, and output a signal-processed video signal.

[0083] The image signal processed by the signal processing device (170) can be input to the display (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the signal processing device (170) can be input to an external output device through the external device interface unit (130).

[0084] The voice signal processed by the signal processing device (170) can be sound-outputted to the audio output unit (185). Additionally, the voice signal processed by the signal processing device (170) can be input to an external output device through the external device interface unit (130).

[0085] Although not illustrated in FIG. 2, the signal processing device (170) may include a demultiplexer, an image processing unit, etc. That is, the signal processing device (170) can perform various signal processing and, accordingly, can be implemented in the form of a System On Chip (SOC). This will be described later with reference to FIG. 3.

[0086] In addition, the signal processing device (170) can control the overall operation within the image display device (100). For example, the signal processing device (170) can control the tuner unit (110) to control the selection (tuning) of an RF broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0087] Additionally, the signal processing device (170) can control the image display device (100) by means of a user command or internal program input through the user input interface unit (150).

[0088] Meanwhile, the signal processing device (170) can control the display (180) to display an image. At this time, the image displayed on the display (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0089] Meanwhile, the signal processing device (170) can cause a predetermined object to be displayed within the image displayed on the display (180). For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0090] Meanwhile, the signal processing device (170) can recognize the user's location based on an image captured by a shooting unit (not shown). For example, it can determine the distance (z-axis coordinate) between the user and the image display device (100). In addition, it can determine the x-axis coordinate and y-axis coordinate within the display (180) corresponding to the user's location.

[0091] The display (180) generates a driving signal by converting a video signal, data signal, OSD signal, control signal processed by a signal processing device (170) or a video signal, data signal, control signal, etc. received from an external device interface unit (130).

[0092] Meanwhile, the display (180) can be configured as a touch screen and used as an input device in addition to an output device.

[0093] The audio output unit (185) receives a voice-processed signal from the signal processing unit (170) and outputs it as voice.

[0094] The shooting unit (not shown) photographs the user. The shooting unit (not shown) can be implemented with one camera, but is not limited thereto, and can also be implemented with multiple cameras. The image information captured by the shooting unit (not shown) can be input to the signal processing device (170).

[0095] The signal processing device (170) can detect a user's gesture based on each or a combination of an image captured from a shooting unit (not shown) or a signal detected from a sensor unit (not shown).

[0096] Meanwhile, the signal processing device (170) can be implemented in the form of a System On Chip (SOC).

[0097] The power supply unit (190) supplies power throughout the image display device (100). In particular, the power supply unit (190) can supply power to a signal processing device (170) implemented in the form of a System On Chip (SOC), a display (180) for image display, and an audio output unit (185) for audio output.

[0098] Specifically, the power supply unit (190) may be equipped with a converter that converts AC power into DC power and a DC / DC converter that converts the level of DC power.

[0099] The remote control device (200) transmits user input to the user input interface unit (150). To this end, the remote control device (200) may use Bluetooth, RF (Radio Frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, etc. Additionally, the remote control device (200) may receive video, audio, or data signals output from the user input interface unit (150) and display or output audio from the remote control device (200).

[0100] Meanwhile, the above-described video display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0101] Meanwhile, the block diagram of the image display device (100) illustrated in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display device (100) actually implemented. That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. Furthermore, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the rights of the present invention.

[0102] Figure 3 is an example of an internal block diagram of the signal processing device of Figure 2.

[0103] Referring to the drawings, a signal processing device (170) according to one embodiment of the present invention may include a demultiplexer (310), an image processing unit (320), a processor (330), and an audio processing unit (370). In addition, it may further include a data processing unit (not shown).

[0104] The demultiplexer (310) demultiplexes the input stream. For example, if an MPEG-2 TS is input, it can be demultiplexed to separate it into video, audio, and data signals. Here, the stream signal input to the demultiplexer (310) may be a stream signal output from the tuner (110), the demodulator (120), or the external device interface (130).

[0105] The image processing unit (320) can perform signal processing on the input image. For example, the image processing unit (320) can perform image processing on the image signal demultiplexed from the demultiplexing unit (310).

[0106] To this end, the image processing unit (320) may include an image decoder (325), a scaler (335), an image quality processing unit (635), an image encoder (not shown), an OSD processing unit (340), a frame rate conversion unit (350), and a formatter (360), etc.

[0107] The video decoder (325) decodes the demultiplexed video signal, and the scaler (335) performs scaling so that the resolution of the decoded video signal can be output on the display (180).

[0108] The image decoder (325) may be equipped with decoders of various specifications. For example, it may be equipped with MPEG-2, H,264 decoders, 3D image decoders for color images and depth images, decoders for multiple viewpoint images, etc.

[0109] The scaler (335) can scale the input video signal, which has been decoded in the video decoder (325), etc.

[0110] For example, the scaler (335) can upscale when the size or resolution of the input video signal is small, and downscale when the size or resolution of the input video signal is large.

[0111] The image quality processing unit (635) can perform image quality processing on the input image signal, which has been decoded in the image decoder (325), etc.

[0112] For example, the image processing unit (635) can perform noise removal processing of the input image signal, expand the resolution of the grayscale of the input image signal, perform image resolution enhancement, perform high dynamic range (HDR) based signal processing, vary the frame rate, and perform image processing corresponding to panel characteristics, particularly organic light-emitting panels.

[0113] The OSD processing unit (340) generates an OSD signal based on user input or independently. For example, based on a user input signal, it can generate a signal to display various information as graphics or text on the screen of the display (180). The generated OSD signal may include various data such as user interface screens, various menu screens, widgets, and icons of the image display device (100). Additionally, the generated OSD signal may include 2D objects or 3D objects.

[0114] Additionally, the OSD processing unit (340) can generate a pointer that can be displayed on a display based on a pointing signal input from the remote control device (200). In particular, such a pointer can be generated by a pointing signal processing device, and the OSD processing unit (240) may include such a pointing signal processing device (not shown). Of course, it is also possible for the pointing signal processing device (not shown) to be provided separately rather than being provided within the OSD processing unit (240).

[0115] The frame rate converter (FRC) (350) can convert the frame rate of the input video. Meanwhile, the frame rate converter (350) can also output the video as is without separate frame rate conversion.

[0116] Meanwhile, the formatter (360) can convert the format of the input video signal into a video signal for display on a display and output it.

[0117] In particular, the formatter (360) can change the format of the video signal to correspond to the display panel.

[0118] Meanwhile, the formatter (360) may change the format of the video signal. For example, the format of the 3D video signal may be changed to any one of various 3D formats such as Side by Side format, Top / Down format, Frame Sequential format, Interlaced format, Checker Box format.

[0119] The processor (330) can control the overall operation within the image display device (100) or the signal processing device (170).

[0120] For example, the processor (330) can control the tuner (110) to select (Tuning) an RF broadcast corresponding to a channel selected by the user or a pre-stored channel.

[0121] Additionally, the processor (330) can control the image display device (100) by means of a user command or an internal program input through the user input interface unit (150).

[0122] Additionally, the processor (330) can perform data transmission control with the network interface unit (135) or the external device interface unit (130).

[0123] Additionally, the processor (330) can control the operation of the demultiplexer (310), image processing unit (320), etc., within the signal processing device (170).

[0124] Meanwhile, the audio processing unit (370) within the signal processing device (170) can perform voice processing of the demultiplexed voice signal. To this end, the audio processing unit (370) may be equipped with various decoders.

[0125] Additionally, the audio processing unit (370) within the signal processing device (170) can process bass, treble, volume control, etc.

[0126] A data processing unit (not shown) within a signal processing device (170) can perform data processing of a demultiplexed data signal. For example, if the demultiplexed data signal is an encoded data signal, it can be decoded. The encoded data signal may be Electronic Program Guide information containing broadcast information such as the start time and end time of a broadcast program aired on each channel.

[0127] Meanwhile, the block diagram of the signal processing device (170) illustrated in FIG. 3 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the signal processing device (170) actually implemented.

[0128] In particular, the frame rate converter (350) and the formatter (360) may be provided separately from the image processing unit (320).

[0129] FIG. 4a is a diagram illustrating a control method of the remote control device of FIG. 2.

[0130] As illustrated in (a) of FIG. 4a, a pointer (205) corresponding to the remote control device (200) is displayed on the display (180).

[0131] The user can move or rotate the remote control device (200) up and down, left and right ((b) of FIG. 4a), and forward and backward ((c) of FIG. 4a). The pointer (205) displayed on the display (180) of the image display device corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control or a 3D pointing device.

[0132] Figure 4a (b) illustrates that when the user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the image display device also moves to the left in response.

[0133] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the image display device. The image display device can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The image display device can display the pointer (205) to correspond to the calculated coordinates.

[0134] Figure 4a (c) illustrates a case where, while pressing a specific button within the remote control device (200), the user moves the remote control device (200) away from the display (180). By doing so, the selected area within the display (180) corresponding to the pointer (205) can be zoomed in and enlarged. Conversely, when the user moves the remote control device (200) closer to the display (180), the selected area within the display (180) corresponding to the pointer (205) can be zoomed out and reduced. Meanwhile, when the remote control device (200) moves away from the display (180), the selected area is zoomed out, and when the remote control device (200) moves closer to the display (180), the selected area may be zoomed in.

[0135] Meanwhile, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).

[0136] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0137] Figure 4b is an internal block diagram of the remote control device of Figure 2.

[0138] Referring to the drawing, the remote control device (200) may include a wireless communication unit (425), a user input unit (435), a sensor unit (440), an output unit (450), a power supply unit (460), a storage unit (470), and a control unit (480).

[0139] The wireless communication unit (425) transmits and receives signals with any one of the image display devices according to the embodiments of the present invention described above. Among the image display devices according to the embodiments of the present invention, one image display device (100) will be described as an example.

[0140] In this embodiment, the remote control device (200) may be equipped with an RF module (421) capable of transmitting and receiving signals to and from the image display device (100) according to RF communication standards. Additionally, the remote control device (200) may be equipped with an IR module (423) capable of transmitting and receiving signals to and from the image display device (100) according to IR communication standards.

[0141] In this embodiment, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the video display device (100) through the RF module (421).

[0142] Additionally, the remote control device (200) can receive a signal transmitted by the video display device (100) through the RF module (421). Additionally, the remote control device (200) can transmit commands regarding power on / off, channel change, volume change, etc. to the video display device (100) through the IR module (423) as needed.

[0143] The user input unit (435) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the image display device (100) to the remote control device (200) by operating the user input unit (435). If the user input unit (435) is equipped with a hard key button, the user can input commands related to the image display device (100) to the remote control device (200) through a push operation of the hard key button. If the user input unit (435) is equipped with a touch screen, the user can input commands related to the image display device (100) to the remote control device (200) by touching the soft keys of the touch screen. Additionally, the user input unit (435) may be equipped with various types of input means that the user can operate, such as a scroll key or a jog key, and this embodiment does not limit the scope of the rights of the present invention.

[0144] The sensor unit (440) may be equipped with a gyroscope sensor (441) or an accelerometer sensor (443). The gyroscope sensor (441) can sense information regarding the movement of the remote control device (200).

[0145] For example, the gyroscope sensor (441) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes. The accelerometer sensor (443) can sense information regarding the movement speed of the remote control device (200), etc. Meanwhile, a distance measuring sensor may be further provided, thereby allowing the distance to be sensed from the display (180).

[0146] The output unit (450) can output a video or audio signal corresponding to the operation of the user input unit (435) or a signal transmitted from the video display device (100). Through the output unit (450), the user can recognize whether the user input unit (435) is operated or whether the video display device (100) is controlled.

[0147] For example, the output unit (450) may be equipped with an LED module (451) that lights up when the user input unit (435) is operated or when a signal is transmitted and received with the image display device (100) through the wireless communication unit (425), a vibration module (453) that generates vibration, a sound output module (455) that outputs sound, or a display module (457) that outputs image.

[0148] The power supply unit (460) supplies power to the remote control device (200). The power supply unit (460) can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time. The power supply unit (460) can resume the power supply when a predetermined key provided in the remote control device (200) is operated.

[0149] The storage unit (470) may store various types of programs, application data, etc., necessary for the control or operation of the remote control device (200). If the remote control device (200) transmits and receives signals wirelessly through the video display device (100) and the RF module (421), the remote control device (200) and the video display device (100) transmit and receive signals through a predetermined frequency band. The control unit (480) of the remote control device (200) may store and refer to information regarding the frequency band, etc., for wirelessly transmitting and receiving signals with the video display device (100) paired with the remote control device (200) in the storage unit (470).

[0150] The control unit (480) controls all matters related to the control of the remote control device (200). The control unit (480) can transmit a signal corresponding to a predetermined key operation of the user input unit (435) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor unit (440) to the image display device (100) through the wireless communication unit (425).

[0151] The user input interface unit (150) of the image display device (100) may be equipped with a wireless communication unit (151) capable of wirelessly transmitting and receiving signals with a remote control device (200), and a coordinate value calculation unit (415) capable of calculating coordinate values ​​of a pointer corresponding to the operation of the remote control device (200).

[0152] The user input interface unit (150) can wirelessly transmit and receive signals to and from the remote control device (200) through the RF module (412). It can also receive signals transmitted by the remote control device (200) according to the IR communication standard through the IR module (413).

[0153] The coordinate value calculation unit (415) can calculate the coordinate values ​​(x,y) of the pointer (205) to be displayed on the display (170) by correcting for hand tremor or error from the signal corresponding to the operation of the remote control device (200) received through the wireless communication unit (151).

[0154] The transmission signal of the remote control device (200) input to the video display device (100) through the user input interface unit (150) is transmitted to the signal processing unit (170) of the video display device (100). The signal processing unit (170) can determine information regarding the operation and key operation of the remote control device (200) from the signal transmitted from the remote control device (200), and control the video display device (100) accordingly.

[0155] As another example, the remote control device (200) can calculate a pointer coordinate value corresponding to the operation and output it to the user input interface unit (150) of the image display device (100). In this case, the user input interface unit (150) of the image display device (100) can transmit information regarding the received pointer coordinate value to the signal processing device (170) without a separate hand tremor or error correction process.

[0156] In addition, as another example, the coordinate value calculation unit (415) may be provided inside the signal processing unit (170) rather than the user input interface unit (150), unlike in the drawing.

[0157] Figure 5 is an internal block diagram of the display of Figure 2.

[0158] Referring to the drawing, the organic light-emitting panel-based display (180) may include an organic light-emitting panel (210), a first interface unit (230), a second interface unit (231), a timing controller (232), a gate driver (234), a data driver (236), a memory (240), a processor (270), a power supply unit (290), a current detection unit (510), etc.

[0159] The display (180) receives a video signal (Vd), a first DC power supply (V1), and a second DC power supply (V2), and can display a predetermined image based on the video signal (Vd).

[0160] Meanwhile, the first interface unit (230) within the display (180) can receive a video signal (Vd) and a first DC power supply (V1) from the signal processing device (170).

[0161] Here, the first DC power supply (V1) can be used for the operation of the power supply unit (290) and the timing controller (232) within the display (180).

[0162] Next, the second interface unit (231) can receive a second DC power supply (V2) from an external power supply unit (190). Meanwhile, the second DC power supply (V2) can be input to a data driving unit (236) within the display (180).

[0163] The timing controller (232) can output a data driving signal (Sda) and a gate driving signal (Sga) based on the video signal (Vd).

[0164] For example, when the first interface unit (230) converts an input video signal (Vd) and outputs a converted video signal (va1), the timing controller (232) can output a data driving signal (Sda) and a gate driving signal (Sga) based on the converted video signal (va1).

[0165] The timing controller (232) can receive additional signals, such as a control signal and a vertical synchronization signal (Vsync), in addition to the video signal (Vd) from the signal processing device (170).

[0166] In addition, the timing controller (232) can output a gate driving signal (Sga) for the operation of the gate driving unit (234) and a data driving signal (Sda) for the operation of the data driving unit (236) based on a control signal, a vertical synchronization signal (Vsync), etc., in addition to the video signal (Vd).

[0167] The data driving signal (Sda) at this time may be a data driving signal for driving RGBW subpixels when the panel (210) has RGBW subpixels.

[0168] Meanwhile, the timing controller (232) can further output a control signal (Cs) to the gate driver (234).

[0169] The gate driver (234) and the data driver (236) supply a scanning signal and an image signal to the organic light-emitting panel (210) through the gate line (GL) and the data line (DL), respectively, according to the gate driving signal (Sga) and the data driving signal (Sda) from the timing controller (232). Accordingly, the organic light-emitting panel (210) displays a predetermined image.

[0170] Meanwhile, the organic light-emitting panel (210) may include an organic light-emitting layer, and to display an image, a plurality of gate lines (GL) and data lines (DL) may be arranged in an intersecting matrix form at each pixel corresponding to the organic light-emitting layer.

[0171] Meanwhile, the data driving unit (236) can output a data signal to the organic light-emitting panel (210) based on the second DC power supply (V2) from the second interface unit (231).

[0172] The power supply unit (290) can supply various power sources to the gate driving unit (234), the data driving unit (236), the timing controller (232), etc.

[0173] The current detection unit (510) can detect the current flowing through the subpixel of the organic light-emitting panel (210). The detected current can be input to a processor (270), etc., for the purpose of calculating the accumulated current.

[0174] The processor (270) can perform various controls within the display (180). For example, it can control the gate driver (234), the data driver (236), the timing controller (232), etc.

[0175] Meanwhile, the processor (270) can receive current information flowing to a subpixel of the organic light-emitting panel (210) from the current detection unit (510).

[0176] And, the processor (270) can calculate the accumulated current of each subpixel of the organic light-emitting panel (210) based on the current information flowing through the subpixel of the organic light-emitting panel (210). The calculated accumulated current can be stored in the memory (240).

[0177] Meanwhile, the processor (270) can determine that there is burn-in if the accumulated current of a subpixel of each organic light-emitting panel (210) is greater than the allowable limit.

[0178] For example, the processor (270) can determine that a subpixel is burned in if the accumulated current of each organic light-emitting panel (210) is 300,000 A or more.

[0179] Meanwhile, the processor (270) can determine that a subpixel is a subpixel where burn-in is predicted if the accumulated current of some subpixels among the subpixels of each organic light-emitting panel (210) approaches an allowable value.

[0180] Meanwhile, the processor (270) can determine the subpixel with the largest accumulated current as the burn-in prediction subpixel based on the current detected by the current detection unit (510).

[0181] FIGS. 6a and 6b are drawings referenced in the description of the organic light-emitting panel of FIG. 5.

[0182] First, FIG. 6a is a drawing showing a pixel within an organic light-emitting panel (210).

[0183] Referring to the drawing, the organic light-emitting panel (210) may have a plurality of scan lines (Scan 1 to Scan n) and a plurality of data lines (R1, G1, B1, W1 to Rm, Gm, Bm, Wm) that intersect therewith.

[0184] Meanwhile, a pixel (subpixel) is defined in the intersection area of ​​the scan line and the data line within the organic light-emitting panel (210). In the drawing, a pixel having RGBW subpixels (SR1, SG1, SB1, SW1) is shown.

[0185] FIG. 6b illustrates a circuit of a subpixel within a pixel of the organic light-emitting panel of FIG. 6a.

[0186] Referring to the drawing, the organic light-emitting subpixel circuit (CRTm) may be an active type and may include a scan switching element (SW1), a storage capacitor (Cst), a driving switching element (SW2), and an organic light-emitting layer (OLED).

[0187] A scan switching element (SW1) has a scan line connected to its gate terminal and turns on according to an input scan signal (Vdscan). When turned on, it transmits an input data signal (Vdata) to the gate terminal of a driving switching element (SW2) or to one end of a storage capacitor (Cst).

[0188] A storage capacitor (Cst) is formed between the gate terminal and the source terminal of a driving switching element (SW2) and stores a predetermined difference between a data signal level transmitted to one end of the storage capacitor (Cst) and a DC power supply (VDD) level transmitted to the other end of the storage capacitor (Cst).

[0189] For example, if the data signal has different levels according to the PAM (Pulse Amplitude Modulation) method, the power level stored in the storage capacitor (Cst) changes depending on the level difference of the data signal (Vdata).

[0190] As another example, when the data signal has different pulse widths according to the PWM (Pulse Width Modulation) method, the power level stored in the storage capacitor (Cst) changes depending on the difference in the pulse width of the data signal (Vdata).

[0191] [The simultaneous sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim sim

[0192] The organic light-emitting layer (OLED) includes an RGBW light-emitting layer (EML) corresponding to a subpixel, and may include at least one of a hole injection layer (HIL), a hole transport layer (HTL), an electron transport layer (ETL), and an electron injection layer (EIL), and may also include a hole blocking layer, etc.

[0193] Meanwhile, although all subpixels in the organic light-emitting layer (OLED) emit white light, separate color filters are provided for green, red, and blue subpixels to enable color implementation. That is, green, red, and blue subpixels are each provided with additional green, red, and blue color filters, respectively. On the other hand, since the white subpixel emits white light, a separate color filter is not required.

[0194] Meanwhile, in the drawing, the scan switching element (SW1) and the driving switching element (SW2) are exemplified as p-type MOSFETs, but it is also possible to use n-type MOSFETs or other switching elements such as JFETs, IGBTs, or SICs.

[0195] Meanwhile, a pixel is a hold-type device that continues to emit light from an organic light-emitting layer (OLED) after a scan signal is applied during a unit display period, specifically during a unit frame.

[0196] Meanwhile, with the advancement of camera and broadcasting technologies, the resolution and vertical synchronization frequency of input video signals are increasing. In particular, there is a need for image quality processing for video signals with 4K resolution and a vertical resolution of 120Hz. Accordingly, a method for improving the image quality processing of input video signals is proposed. This is described with reference to Figure 7 and below.

[0197] Figure 7 is another example of an internal block diagram of the signal processing device of Figure 2.

[0198] Referring to the drawings, a signal processing device (170) according to an embodiment of the present invention may include an image analysis unit (610) and an image quality processing unit (635).

[0199] The image analysis unit (610) can analyze the input image signal and output information related to the analyzed input image signal.

[0200] Meanwhile, the image analysis unit (610) can distinguish between the object area and the background area of ​​the first input image signal. Alternatively, the image analysis unit (610) can calculate the probability or ratio of the object area and the background area of ​​the first input image signal.

[0201] The input video signal may be an input video signal from a video receiving device (105) or a video decoded by a video decoder (320) of FIG. 3.

[0202] In particular, the video analysis unit (610) can analyze the input video signal using artificial intelligence (AI) and output the analyzed input video signal information.

[0203] Specifically, the image analysis unit (610) can analyze the resolution, grayscale, noise level, pattern, etc. of the input image signal and output information related to the analyzed input image signal, particularly image quality setting information, to the image quality processing unit (635).

[0204] The image quality processing unit (635) may include an HDR processing unit (705), a first reduction unit (710), an enhancement unit (750), and a second reduction unit (790).

[0205] The HDR processing unit (705) receives a video signal and can perform High Dynamic Range (HDR) processing on the input video signal.

[0206] For example, the HDR processing unit (705) can convert a Standard Dynamic Range (SDR) video signal into an HDR video signal.

[0207] As another example, the HDR processing unit (705) receives a video signal and can perform gradation processing for high dynamic range on the input video signal.

[0208] Meanwhile, the HDR processing unit (705) can bypass grayscale conversion when the input video signal is an SDR video signal, and perform grayscale conversion when the input video signal is an HDR video signal. Accordingly, the contrast of the image displayed on the display can be improved.

[0209] Meanwhile, the HDR processing unit (705) can perform a gradation conversion process based on a first gradation conversion mode that emphasizes the low gradation and saturates the high gradation among the low gradation and high gradation, or a second gradation conversion mode that converts somewhat uniformly across the low gradation and high gradation.

[0210] The HDR processing unit (705) can perform grayscale conversion processing based on the first grayscale conversion curve or the second grayscale conversion curve.

[0211] For example, the HDR processing unit (705) can perform grayscale conversion processing based on data in a lookup table corresponding to a first grayscale conversion curve or data in a lookup table corresponding to a second grayscale conversion curve.

[0212] Specifically, the HDR processing unit (705) can perform a grayscale conversion process based on data corresponding to the first grayscale conversion mode in the lookup table when the first grayscale conversion mode is performed.

[0213] More specifically, the HDR processing unit (705) can perform a grayscale conversion process based on an operation formula regarding input data and data corresponding to the first grayscale conversion mode in a lookup table determined according to said operation formula when the first grayscale conversion mode is performed. Here, the input data may include video data and metadata.

[0214] Meanwhile, the HDR processing unit (705) can perform a grayscale conversion process based on data corresponding to the second grayscale conversion mode in the lookup table when the second grayscale conversion mode is performed.

[0215] More specifically, when a second grayscale conversion mode is performed, the HDR processing unit (705) can perform grayscale conversion processing based on an operation formula regarding input data and data corresponding to the second grayscale conversion mode in a lookup table determined according to said operation formula. Here, the input data may include video data and metadata.

[0216] Meanwhile, the HDR processing unit (705) may select a first gradation conversion mode or a second gradation conversion mode depending on the third gradation conversion mode or the fourth gradation conversion mode in the high gradation amplification unit (851) in the second reduction unit (790).

[0217] For example, the high-gradation amplification unit (851) in the second reduction unit (790) can perform gradation conversion processing based on data corresponding to the third gradation conversion mode in the lookup table when the third gradation conversion mode is performed.

[0218] Specifically, the high-gradation amplification unit (851) within the second reduction unit (790) can perform gradation conversion processing based on an operation formula regarding input data and data corresponding to the third gradation conversion mode in a lookup table determined according to said operation formula when the third gradation conversion mode is performed. Here, the input data may include video data and metadata.

[0219] Meanwhile, the high-gradation amplification unit (851) in the second reduction unit (790) can perform gradation conversion processing based on data corresponding to the fourth gradation conversion mode in the lookup table when the fourth gradation conversion mode is performed.

[0220] Specifically, the high-gradation amplification unit (851) within the second reduction unit (790) can perform gradation conversion processing based on an operation formula regarding input data and data corresponding to the fourth gradation conversion mode in a lookup table determined according to said operation formula when the fourth gradation conversion mode is performed. Here, the input data may include video data and metadata.

[0221] For example, the HDR processing unit (705) can perform the second gradation conversion mode when the fourth gradation conversion mode is performed in the high gradation amplification unit (851) within the second reduction unit (790).

[0222] As another example, the HDR processing unit (705) can perform the first gradation conversion mode when the third gradation conversion mode is performed in the high gradation amplification unit (851) within the second reduction unit (790).

[0223] Alternatively, the high-gradation amplification unit (851) in the second reduction unit (790) may vary the gradation conversion mode performed according to the gradation conversion mode in the HDR processing unit (705).

[0224] For example, the high-gradation amplification unit (851) within the second reduction unit (790) can perform a fourth gradation conversion mode when the second gradation conversion mode is performed in the HDR processing unit (705).

[0225] As another example, the high-gradation amplification unit (851) in the second reduction unit (790) can perform a third gradation conversion mode when the first gradation conversion mode is performed in the HDR processing unit (705).

[0226] Meanwhile, the HDR processing unit (705) according to one embodiment of the present invention can perform a gradation conversion mode so that low gradation and high gradation are uniformly converted.

[0227] That is, the HDR processing unit (705) can perform grayscale conversion processing based on the second grayscale conversion curve rather than the first grayscale conversion curve.

[0228] Meanwhile, the second reduction unit (790) performs a fourth grayscale conversion mode according to the second grayscale conversion mode in the HDR processing unit (705) and can amplify the upper limit level of the grayscale of the video signal input thereto. Accordingly, the contrast of the image displayed on the display can be improved.

[0229] Next, the first reduction unit (710) can perform noise removal on the input video signal or the video signal processed by the HDR processing unit (705).

[0230] Specifically, the first reduction unit (710) can perform the multi-stage noise removal processing and the first-stage grayscale expansion processing on the input video signal or the HDR video from the HDR processing unit (705).

[0231] To this end, the first reduction unit (710) may be equipped with a plurality of noise removal units (715, 720) for removing noise in multiple stages and a gradation extension unit (725) for extending the gradation.

[0232] Next, the enhancement unit (750) can perform multi-stage image resolution enhancement processing on the image from the first reduction unit (710).

[0233] Additionally, the enhance unit (750) can perform processing to enhance the three-dimensionality of the object. Additionally, the enhance unit (750) can perform processing to enhance color or contrast.

[0234] To this end, the enhance unit (750) may be equipped with a plurality of resolution enhancement units (735, 738, 742) for enhancing image resolution in multiple stages, an object depth enhancement unit (745) for enhancing the depth of an object, and a color contrast enhancement unit (749) for enhancing color or contrast.

[0235] Next, the second reduction unit (790) can perform a second stage grayscale expansion process based on the noise-removed image signal input from the first reduction unit (710).

[0236] Meanwhile, the second reduction unit (790) can amplify the upper limit level of the grayscale of the input signal and expand the resolution of the grayscale of the input signal. Accordingly, the contrast of the image displayed on the display can be improved.

[0237] For example, uniform grayscale expansion can be performed across the entire grayscale range of the input signal. Accordingly, as uniform grayscale expansion is performed across the area of ​​the input image, high-grayscale expressiveness can be enhanced.

[0238] Meanwhile, the second reduction unit (790) can perform grayscale amplification and expansion based on the input signal from the first grayscale expansion unit (725). Accordingly, the contrast of the image displayed on the display can be improved.

[0239] Meanwhile, the second reduction unit (790) can vary the degree of amplification based on the user input signal when the input video signal is an SDR video signal. Accordingly, high-gradation expression capability can be increased in response to user settings.

[0240] Meanwhile, the second reduction unit (790) can perform amplification according to a set value when the input video signal is an HDR video signal. Accordingly, the contrast of the video displayed on the display can be improved.

[0241] Meanwhile, the second reduction unit (790) can vary the degree of amplification based on the user input signal when the input video signal is an HDR video signal. Accordingly, high-gradation expression capability can be increased in response to user settings.

[0242] Meanwhile, the second reduction unit (790) can vary the degree of grayscale expansion when expanding the grayscale based on the user input signal. Accordingly, high grayscale expression capability can be increased in response to user settings.

[0243] Meanwhile, the second reduction unit (790) can amplify the upper limit level of the gradation according to the gradation conversion mode in the HDR processing unit (705). Accordingly, the contrast of the image displayed on the display can be improved.

[0244] The signal processing device (170) includes an HDR processing unit (705) that receives a video signal and adjusts the brightness of the input video signal, and a reduction unit (790) that amplifies the brightness of the video signal from the HDR processing unit (705) and increases the grayscale resolution of the video signal to generate an enhanced video signal, and the enhanced video signal provides increased brightness and grayscale resolution of the video signal while maintaining the high dynamic range within the displayed HDR image.

[0245] Meanwhile, the brightness range of the video signal is adjusted according to a control signal received by the signal processing device (170).

[0246] Meanwhile, the system further includes a video analysis unit that determines whether the input video signal is an HDR signal or an SDR signal and generates a control signal to be provided to the HDR processing unit (705), and the control signal is adjusted only when it indicates that the input video signal is an HDR signal.

[0247] Meanwhile, the control signal is received from the control unit of the image display device associated with signal processing and corresponds to the settings of the image display device.

[0248] Meanwhile, the resolution of the grayscale is increased based on the amplification of the adjusted luminance of the video signal.

[0249] Meanwhile, the resolution of the grayscale is increased based on a control signal input to the signal processing device (170).

[0250] Meanwhile, the control signal is received from the control unit of the image display device associated with signal processing and corresponds to the settings of the image display device.

[0251] Meanwhile, the reduction unit (790) may include a high-gradation amplification unit (851) that amplifies the upper limit level of the gradation of the input signal, and a decontour unit (842, 844) that expands the resolution of the amplified gradation from the high-gradation amplification unit (851).

[0252] The second reduction unit (790) may be equipped with a second gradation extension unit (729) for second-stage gradation extension.

[0253] Meanwhile, the image quality processing unit (635) within the signal processing device (170) of the present invention is characterized by performing four stages of reduction processing and four stages of image enhancement processing, as shown in FIG. 7.

[0254] Here, the 4-stage reduction process may include 2-stage noise removal processing and 2-stage gradation extension processing.

[0255] Here, the second stage noise removal processing is performed by the first and second noise removal units (715, 720) within the first reduction unit (710), and the second stage grayscale expansion processing can be performed by the first grayscale expansion unit (725) within the first reduction unit (710) and the second grayscale expansion unit (729) within the second reduction unit (790).

[0256] Meanwhile, the 4-stage image enhancement processing may include the 3-stage image resolution enhancement processing (bit resolution enhancement) and object depth enhancement processing.

[0257] Here, the three-stage image resolution enhancement processing is performed by the first to third resolution enhancement units (735, 738, 742), and the object depth enhancement processing can be performed by the object depth enhancement unit (745).

[0258] Meanwhile, the first feature of the signal processing device (170) of the present invention is to gradually improve image quality by applying the same or similar algorithms multiple times as a multi-stage image quality processing.

[0259] To this end, the image quality processing unit (635) within the signal processing device (170) of the present invention performs image quality processing by applying the same or similar algorithm two or more times.

[0260] Meanwhile, the same or similar algorithms performed in the image processing unit (635) have different goals to be achieved at each stage, and by performing multi-stage image processing gradually, compared to processing all image quality in one stage, there is an advantage of fewer image artifacts and a more natural and clearer image processing result.

[0261] Meanwhile, by applying the same or similar algorithms in combination with other image quality processing algorithms, it becomes possible to achieve effects beyond simple continuous processing.

[0262] Meanwhile, another feature of the signal processing device (170) of the present invention is that it performs noise removal processing in multiple stages. The noise removal processing in each stage may include temporal processing and spatial processing.

[0263] Meanwhile, High Dynamic Range (HDR) techniques can express richer contrast by using a much wider range of luminance (unit nit) than conventional methods such as Standard Dynamic Range (SDR).

[0264] Recently, high dynamic range images can be generated using high-spec cameras with a wide dynamic range.

[0265] Meanwhile, standard dynamic range video, etc., is a general dynamic range level, and in broadcast standards, it is expressed up to approximately 100 nits or less.

[0266] However, high dynamic range techniques currently in use allow for a wide range of up to approximately 10,000 nits.

[0267] Accordingly, when applying the high dynamic range technique, the image characteristics change significantly compared to the existing general dynamic range, so changes to the entire system, such as the image format, related metadata, compression method, interface between devices, and display (180), are required to express it.

[0268] Meanwhile, in a video display device (100) that is developing to a wider dynamic range, when playing a conventional general dynamic range video or when playing a high dynamic range video, it is desirable to perform tone mapping to maintain the quality of the source video.

[0269] In particular, since the dynamic range of the image is often different from the dynamic range of the display (180), it is necessary to map the dynamic range of the image to be suitable for the dynamic range of the display (180).

[0270] Meanwhile, it is necessary to represent the luminance (brightness) within the expressible range as is, while performing image processing that minimizes quality degradation compared to the source video for brightness components in the unexpressible range. Additionally, a conversion function that reflects the user's intended purpose is required.

[0271] FIGS. 8a to 8d are drawings referenced in the description of a signal processing device related to the present invention.

[0272] First, Fig. 8a is a diagram illustrating an example of luminance mapping of an input image.

[0273] Referring to the drawing, luminance mapping of the input image can be performed based on the first curve (CVo).

[0274] According to the first curve (CVo), the luminance of the input image can be bypassed and output as the output luminance.

[0275] In this case, the luminance of the input image can be referred to as the luminance level of the input image, and the output luminance can be referred to as the luminance adjustment level or the luminance mapping level.

[0276] Next, Fig. 8b is a diagram illustrating another example of luminance mapping of an input image.

[0277] Referring to the drawing, luminance mapping of the input image can be performed based on the second curve (CVy).

[0278] According to the second curve (CVo), when the luminance (input) of the input image is smaller than Ly1, it becomes smaller than the output luminance (output) of the first curve (CVo), and when the luminance (input) of the input image is between Ly1 and Ly2, it becomes larger than the output luminance (output) of the first curve (CVo), and when the luminance (input) of the input image is larger than Ly2, it becomes smaller than the output luminance (output) of the first curve (CVo).

[0279] That is, according to the second curve (CVy) of FIG. 8b, the level of the output luminance can be varied depending on the luminance level or gradation of the input luminance of the input image.

[0280] According to the second curve (CVy) of Fig. 8b, luminance mapping of the input image is performed, and when the luminance-mapped image is displayed on the display (180), dynamic contrast is made possible.

[0281] FIG. 8c illustrates a first input image (810) and a first luminance histgram (Hsa) representing the luminance distribution of the first input image (810).

[0282] In the drawing, the luminance histgram (Hsa) represents the frequency according to the luminance of the first input image (810).

[0283] Referring to the drawing, the first input image (810) is an image including a face object region, and the face object region (Arm) may have a luminance level between the Iz1 luminance level and the Iz2 luminance level in the first luminance histgram (Hsa).

[0284] Referring to the drawing, the luminance levels of the first input image (810) are mostly from the 0 luminance level to the Iz2 luminance level, and there is almost no distribution between the Iz2 luminance level and the maximum luminance level.

[0285] Accordingly, when performing luminance mapping according to the second curve (CVy) of FIG. 8b, if the luminance level of the first input image (810) is from the 0 luminance level to the Iz2 luminance level, the luminance adjustment level according to the luminance mapping may not be sufficient, and if the luminance level of the first input image (810) is from the z2 luminance level to the maximum luminance level, there may be a disadvantage that the luminance adjustment level during luminance mapping is excessively changed.

[0286] FIG. 8d illustrates a second input image (860) and a second luminance histgram (Hsb) representing the luminance distribution of the second input image (860).

[0287] In the drawing, the luminance histgram (Hsa) represents the frequency according to the luminance of the second input image (860).

[0288] Referring to the drawing, the second input image (860) is an image including a flower object area (Ara) and a background area (Aub), wherein the flower object area (Ara) may have a luminance level between the Iz2 luminance level and the maximum luminance level (WHa) in the second luminance histgram (Hsb), and the background area (Aub) may have a luminance level between the 0 luminance level and the Iz1 luminance level (WHb) in the second luminance histgram (Hsb).

[0289] Referring to the drawing, the luminance levels of the second input image (860) are mostly between the 0 luminance level and the Iz1 luminance level or between the Iz2 luminance level and the maximum luminance level, and are almost non-distributed between the Iz1 luminance level and the Iz2 luminance level.

[0290] Accordingly, when performing luminance mapping according to the second curve (CVy) of FIG. 8b, if the luminance level of the second input image (860) is between the 0 luminance level and the Iz1 luminance level or between the Iz2 luminance level and the maximum luminance level, the luminance adjustment level according to the luminance mapping may not be sufficient, and if the luminance level of the second input image (860) is between the Iz1 luminance level and the Iz2 luminance level, there may be a disadvantage that the luminance adjustment level during luminance mapping is excessively changed.

[0291] Meanwhile, when the average luminance level of the first input image (810) of FIG. 8c and the average luminance level of the second input image (860) are the same, luminance mapping can be performed based on the same second curve (CVy), and as described above, there is a disadvantage that accurate luminance mapping cannot be performed for each object area.

[0292] Accordingly, the present invention provides a method for improving the contrast of an image displayed on a display (180) by adaptively performing luminance mapping according to the luminance distribution of an input image. In particular, the invention provides a method for improving the contrast of a main object within an image.

[0293] This will be described with reference to Fig. 9 and below.

[0294] FIG. 9 is an example of an internal block diagram of a signal processing device according to an embodiment of the present invention.

[0295] Referring to the drawings, a signal processing device (170) according to an embodiment of the present invention may include an image analysis unit (610) that analyzes an input image and a luminance mapping unit (820) that performs luminance mapping based on luminance information of the input image from the image analysis unit (610).

[0296] A luminance mapping unit (820) in a signal processing device (170) according to an embodiment of the present invention controls the luminance adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be smaller than the luminance adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved. In particular, the contrast of the main object in the image can be improved. In addition, the contrast of the background in the image can be improved.

[0297] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can control the luminance adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be greater than the luminance adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same and the luminance deviation of the first input image (1510) is smaller than the luminance deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0298] Meanwhile, in the luminance mapping unit (820) within the signal processing device (170) according to an embodiment of the present invention, when the average luminance levels of the first input image (1510) and the second input image (1610) are the same, and the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610), the luminance adjustment level (LV1) at the average luminance level (IPTa) of the first input image (1510) and the luminance adjustment level (LV1) at the average luminance level (IPTb) of the second input image (1610) may be the same. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0299] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can control the luminance adjustment change rate (ΔV2a) at a luminance level (IH2a) smaller than the average luminance level of the first input image (1510) and the second input image (1610) to be smaller than the luminance adjustment change rate (ΔV2b) at a luminance level (IH2b) smaller than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610) while the average luminance levels of the first input image (1510) are the same. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0300] Meanwhile, in a state where the average luminance levels of the first input image (1510) and the second input image (1610) are the same, the luminance mapping unit (820) in the signal processing device (170) can control the luminance adjustment level (LV2a) at a luminance level (IH2a) that is smaller than the average luminance level of the first input image (1510) to be greater than the luminance adjustment level (LV2b) at a luminance level (IH2b) that is smaller than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0301] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can control the luminance adjustment change rate (ΔV3a) at a luminance level (IH3a) greater than the average luminance level of the first input image (1510) and the second input image (1610) to be smaller than the luminance adjustment change rate (ΔV3b) at a luminance level (IH3b) greater than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0302] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can control the luminance adjustment level (LV3a) at a luminance level (IH2b) greater than the average luminance level of the first input image (1510) and the second input image (1610) to be smaller than the luminance adjustment level (LV3b) at a luminance level (IH3b) greater than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0303] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention adjusts the luminance of the input image based on the luminance distribution of the input image, and can control the amount of change in the luminance adjusted so that the higher the degree of the luminance distribution of the input image, the greater the change in the luminance adjusted. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0304] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can extract an object of an input image (810 or 860) and control the amount of change in luminance of the extracted object (Arm or Ara) to increase in correspondence with the luminance of the extracted object (Arm or Ara). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0305] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can control the amount of change in luminance of the extracted object (Arm or Ara) so that the larger the peak of the luminance distribution of the extracted object (Arm or Ara), the greater the luminance change amount of the extracted object (Arm or Ara). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0306] Meanwhile, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can be controlled so that the amount of change in luminance of the extracted object (Arm or Ara) increases as the deviation of the luminance distribution of the extracted object (Arm or Ara) becomes smaller. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0307] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) according to an embodiment of the present invention can extract the background of an input image and control the amount of change in luminance of the extracted object (Arm or Ara) to increase in correspondence with the luminance of the extracted background. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0308] FIG. 10 is a flowchart showing a method of operation of a signal processing device according to an embodiment of the present invention, and FIG. 11a to 13 are drawings referenced in the description of the operation of the signal processing device of FIG. 10.

[0309] Referring to the drawings, an image receiving device (105) in a signal processing device (170) according to an embodiment of the present invention receives an input image.

[0310] And, the image analysis unit (610) within the signal processing device (170) can acquire luminance information of the input image (S1010).

[0311] Next, the image analysis unit (610) within the signal processing unit (170) can calculate the luminance histogram of the input image (S1020).

[0312] For example, if the input image is a first input image (810) such as FIG. 12, the first luminance histogram (HSa) of the first input image (810) can be calculated.

[0313] As another example, if the input image is a second input image (860) such as FIG. 13, the second luminance histogram (HSb) of the second input image (860) can be calculated.

[0314] As another example, if the input image is a third input image (not shown), the third luminance histogram (HSm) of the third input image can be calculated.

[0315] FIG. 11a illustrates a third luminance histogram (HSm) representing the luminance distribution and degrees of a third input image.

[0316] Referring to the drawing, the third luminance histogram (HSm) exemplifies that the low luminance level has a peak, the medium luminance level is close to zero, and the high luminance level has some.

[0317] Next, the luminance mapping unit (820) within the signal processing unit (170) can calculate a gain based on the luminance histogram of the input image (S1030).

[0318] The luminance mapping unit (820) within the signal processing unit (170) can calculate a curve according to the degrees of the luminance histogram.

[0319] Next, the luminance mapping unit (820) within the signal processing device (170) can map the luminance of the input image based on the calculated gain and output a luminance-adjusted luminance level (S1040). That is, the luminance mapping unit (820) within the signal processing device (170) can perform luminance mapping based on the calculated gain.

[0320] The GRa curve of FIG. 11b may be a gain curve corresponding to the luminance histogram (HSm) of FIG. 11a.

[0321] On the other hand, when the luminance level is at its peak, it is desirable to set the gain to the highest level; however, assigning too much gain can make the entire image look unnatural.

[0322] Accordingly, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can perform gain adjustment processing to relax the gain in stages when the degree of the luminance level is at a peak.

[0323] Accordingly, the luminance mapping unit (820) within the signal processing device (170) can perform GRa curve calculation, GRb curve calculation, GRc curve calculation, GRd curve calculation, etc. of FIG. 11b in stages. Finally, the luminance mapping unit (820) within the signal processing device (170) can perform luminance mapping based on the GRd curve.

[0324] That is, the luminance mapping unit (820) within the signal processing device (170) can perform luminance mapping based on the degrees of the luminance histogram, and perform filtering on the peaks of the degrees step by step, so that luminance mapping can be performed based on the finally calculated luminance mapping curve or luminance mapping table.

[0325] Accordingly, ultimately, object-based contrast enhancement becomes possible, and the ability to render low-gradation tones in the background can be improved.

[0326] FIG. 11c illustrates a luminance mapping curve (CVa) based on the GRd curve of FIG. 11b.

[0327] Referring to the drawing, the luminance mapping curve (CVa) of FIG. 11c, compared to the bypass curve (CVo) of FIG. 8a, has a smaller luminance conversion level in the low-gradation region and a larger luminance conversion level in the medium-gradation region where the degree is peak.

[0328] Therefore, since the luminance expression power in the area where the object is placed is increased and the low-gradation expression power in the area where the background is placed is increased, the contrast of the image displayed on the display (180) can be improved.

[0329] FIG. 12 illustrates a first input image (810), a first luminance histgram (Hsa) representing the luminance distribution of the first input image (810), and a first luminance mapping curve (CVb1) calculated.

[0330] In the drawing, the luminance histgram (Hsa) represents the frequency according to the luminance of the first input image (810).

[0331] Referring to the drawing, the first input image (810) is an image including a face object region, and the face object region (Arm) may have a luminance level between the Iz1 luminance level and the Iz2 luminance level in the first luminance histgram (Hsa).

[0332] Referring to the drawing, the luminance levels of the first input image (810) are mostly from the 0 luminance level to the Iz2 luminance level, and there is almost no distribution between the Iz2 luminance level and the maximum luminance level.

[0333] Accordingly, when performing luminance mapping according to the second curve (CVy) of FIG. 8b, if the luminance level of the first input image (810) is from the 0 luminance level to the Iz2 luminance level, the luminance adjustment level according to the luminance mapping may not be sufficient, and if the luminance level of the first input image (810) is from the z2 luminance level to the maximum luminance level, there may be a disadvantage that the luminance adjustment level during luminance mapping is excessively changed.

[0334] Accordingly, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can calculate a first luminance mapping curve (CVb1) based on a first luminance histgram (Hsa) and perform luminance mapping based on the calculated first luminance mapping curve (CVb1).

[0335] According to the first luminance mapping curve (CVb1), the luminance adjustment level of the first luminance mapping curve (CVb1), i.e., the output level, can always be greater than the luminance adjustment level of the bypass curve (CVo).

[0336] That is, the luminance adjustment level of the first luminance mapping curve (CVb1) between the 0 luminance level and the maximum luminance level can always be greater than the luminance adjustment level of the bypass curve (CVo).

[0337] Next, when comparing the first luminance mapping curve (CVb1) with the second curve (CVy) of FIG. 8b, the luminance adjustment level from the 0 luminance level to the Iz2 luminance level is approximately larger than the luminance adjustment level of the second curve (CVy) of FIG. 8b, and the luminance adjustment level from the Iz2 luminance level to the maximum luminance level is approximately smaller than the luminance adjustment level of the second curve (CVy) of FIG. 8b.

[0338] Accordingly, compared to the second curve (CVy) of FIG. 8b, the luminance adjustment level between the Iz1 luminance level and the Iz2 luminance level, which has a large luminance distribution, is larger, so luminance adjustment or luminance mapping corresponding to the object of the input image becomes possible.

[0339] Ultimately, the contrast of the image displayed on the display (180) can be improved. In particular, the contrast of the main object area (Arm) within the image can be improved.

[0340] FIG. 13 illustrates a second input image (860), a second luminance histgram (Hsb) representing the luminance distribution of the second input image (860), and a second luminance mapping curve (CVb2) calculated.

[0341] In the drawing, the luminance histgram (Hsa) represents the frequency according to the luminance of the second input image (860).

[0342] Referring to the drawing, the second input image (860) is an image including a flower object area (Ara) and a background area (Aub), wherein the flower object area (Ara) may have a luminance level between the Iz2 luminance level and the maximum luminance level (WHa) in the second luminance histgram (Hsb), and the background area (Aub) may have a luminance level between the 0 luminance level and the Iz1 luminance level (WHb) in the second luminance histgram (Hsb).

[0343] Referring to the drawing, the luminance levels of the second input image (860) are mostly between the 0 luminance level and the Iz1 luminance level or between the Iz2 luminance level and the maximum luminance level, and are almost non-distributed between the Iz1 luminance level and the Iz2 luminance level.

[0344] Accordingly, when performing luminance mapping according to the second curve (CVy) of FIG. 8b, if the luminance level of the second input image (860) is between the 0 luminance level and the Iz1 luminance level or between the Iz2 luminance level and the maximum luminance level, the luminance adjustment level according to the luminance mapping may not be sufficient, and if the luminance level of the second input image (860) is between the Iz1 luminance level and the Iz2 luminance level, there may be a disadvantage that the luminance adjustment level during luminance mapping is excessively changed.

[0345] Meanwhile, when the average luminance level of the first input image (810) of FIG. 12 and the average luminance level of the second input image (860) are the same, luminance mapping can be performed based on the same second curve (CVy), and as described above, there is a disadvantage that accurate luminance mapping cannot be performed for each object area.

[0346] Accordingly, the luminance mapping unit (820) in the signal processing device (170) according to an embodiment of the present invention can calculate a second luminance mapping curve (CVb2) based on a second luminance histgram (Hsb) and perform luminance mapping based on the calculated second luminance mapping curve (CVb2).

[0347] According to the second luminance mapping curve (CVb2), the luminance adjustment level of the second luminance mapping curve (CVb2), i.e., the output level, can always be greater than the luminance adjustment level of the bypass curve (CVo).

[0348] That is, the luminance adjustment level of the second luminance mapping curve (CVb2) between the 0 luminance level and the maximum luminance level can always be greater than the luminance adjustment level of the bypass curve (CVo).

[0349] Next, when comparing the second luminance mapping curve (CVb2) with the second curve (CVy) of FIG. 8b, the luminance adjustment level between the 0 luminance level and the Iz1 luminance level is approximately larger than the luminance adjustment level of the second curve (CVy) of FIG. 8b, and the luminance adjustment level between the Iz1 luminance level and the Iz2 luminance level is approximately smaller.

[0350] Therefore, the luminance representation capability in the low-gradation region (WHb) between the luminance level and the Iz1 luminance level can be enhanced. Accordingly, the contrast of the background region (Arb) within the image can be improved.

[0351] Meanwhile, when comparing the second luminance mapping curve (CVb2) with the second curve (CVy) of FIG. 8b, the luminance adjustment level between the Iz2 luminance level and the maximum level can be approximately smaller than the luminance adjustment level of the second curve (CVy) of FIG. 8b.

[0352] However, the luminance adjustment level between the maximum level and the Iz2 luminance level of the second luminance mapping curve (CVb2) is larger than that of the bypass curve (CVo), so that the contrast of the main object area (Ara) in the image can be improved.

[0353] Meanwhile, the average luminance level of the first input image (810) of FIG. 12 and the average luminance level of the second input image (860) of FIG. 13 may be the same, and even if the average luminance levels are the same, in the embodiment of the present invention, luminance mapping based on different luminance mapping curves can be performed according to the luminance distribution of each input image. Therefore, adaptive luminance mapping to the input image is possible, and ultimately, dynamic contrast per object can be implemented.

[0354] FIG. 14 is a flowchart illustrating a method of operation of a signal processing device according to another embodiment of the present invention, and FIG. 15 to 16 are drawings referenced in the description of the operation of the signal processing device of FIG. 14.

[0355] Referring to the drawings, an image receiving device (105) in a signal processing device (170) according to an embodiment of the present invention receives an input image.

[0356] In particular, the image receiving device (105) in the signal processing device (170) according to an embodiment of the invention can receive a first input image (1510) and a second input image (1610) at different timings (S1410).

[0357] And, the image analysis unit (610) within the signal processing unit (170) can acquire luminance information of the input image.

[0358] Next, the image analysis unit (610) in the signal processing device (170) determines whether the average picture level (APL) of the first input image (1510) and the second input image (1610) is the same (S1420), and if so, determines whether the brightness deviation of the first input image (1510) is greater than the brightness deviation of the second input image (1610) (S1420).

[0359] And, in the case where applicable, the luminance mapping unit (820) in the signal processing device (170) controls the luminance adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) of FIG. 15 to be smaller than the luminance adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) of FIG. 16 (S1430).

[0360] Meanwhile, in step 1420 (S1420), if the luminance deviation of the first input image (1510) is smaller than the luminance deviation of the second input image (1610), the luminance mapping unit (820) in the signal processing device (170) can control the luminance adjustment change rate (ΔV2a, ΔV3a) of the first input image (1510) to be larger than the luminance adjustment change rate (ΔV2b, ΔV3b) of the second input image (1610) (S1440). That is, it can be set in the opposite way to the case of FIG. 15 and FIG. 16.

[0361] When comparing FIG. 15 and FIG. 16, the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610).

[0362] The luminance distribution of the first input image (1510) of FIG. 15 is distributed from approximately 20 levels to 35 levels, and the luminance distribution of the second input image (1610) of FIG. 16 is distributed from approximately 90 levels to 165 levels.

[0363] At this time, the average luminance level of the first input image (1510) and the average luminance level of the second input image (1610) may both be the same at level 127.

[0364] The luminance mapping unit (820) within the signal processing device (170) can perform luminance mapping based on the first luminance mapping curve (CVc1) of FIG. 15.

[0365] Specifically, the luminance mapping unit (820) within the signal processing device (170) can calculate a luminance histogram for the first input image (1510), calculate a first luminance mapping curve (CVc1) based on the luminance histogram, and perform luminance mapping based on the calculated first luminance mapping curve (CVc1).

[0366] The luminance mapping unit (820) within the signal processing device (170) can perform luminance mapping based on the second luminance mapping curve (CVc2).

[0367] Specifically, the luminance mapping unit (820) within the signal processing device (170) can calculate a luminance histogram for the second input image (1610), calculate a second luminance mapping curve (CVc2) based on the luminance histogram, and perform luminance mapping based on the calculated second luminance mapping curve (CVc2).

[0368] When comparing FIG. 15 and FIG. 16, the luminance deviation of the first input image (1510) is distributed from approximately 20 levels to 35 levels, so the luminance deviation is greater than that of the second input image (1610), which has a luminance distributed from approximately 90 levels to 165 levels.

[0369] Accordingly, the luminance mapping unit (820) within the signal processing device (170) can be set so that the first luminance mapping curve (CVc1) has a smaller rate of change, that is, is closer to the bypass curve (CVo), and the second luminance mapping curve (CVc2) has a larger rate of change, that is, is more different from the bypass curve (CVo).

[0370] That is, the first luminance mapping curve (CVc1) can be formed more gently than the second luminance mapping curve (CVc2).

[0371] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can be set so that for a luminance level smaller than the average luminance level (IPTa), the luminance adjustment level of the first luminance mapping curve (CVc1) or the second luminance mapping curve (CVc2) is smaller than the luminance adjustment level in the bypass curve (CVo).

[0372] For example, for the luminance level of the WH2 section of FIG. 15 and FIG. 16 which is smaller than the average luminance level (IPTa), the luminance adjustment level of the first luminance mapping curve (CVc1) or the second luminance mapping curve (CVc2) can be set to be smaller than the luminance adjustment level in the bypass curve (CVo).

[0373] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can be set such that for a luminance level greater than the average luminance level (IPTa), the luminance adjustment level of the first luminance mapping curve (CVc1) or the second luminance mapping curve (CVc2) is greater than the luminance adjustment level in the bypass curve (CVo).

[0374] For example, for the luminance level of the WH3 section of FIG. 15 and FIG. 16 which is greater than the average luminance level (IPTa), the luminance adjustment level of the first luminance mapping curve (CVc1) or the second luminance mapping curve (CVc2) can be set to be greater than the luminance adjustment level in the bypass curve (CVo).

[0375] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can be set so that, for the average luminance level (IPTa), the luminance adjustment level of the first luminance mapping curve (CVc1) or the second luminance mapping curve (CVc2) becomes LV1, which is the same as the luminance adjustment level in the bypass curve (CVo).

[0376] The pattern (PTa) in the first input image (1510) of FIG. 15 may be a pattern having an average luminance level (IPTa), and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV1.

[0377] Meanwhile, the pattern (PTb) in the second input image (1610) of FIG. 16 may be a pattern having an average luminance level (IPTb), and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV1.

[0378] Meanwhile, in the signal processing device (170), the luminance mapping unit (820) may have the same luminance adjustment level (LV1) at the average luminance level (IPTa) of the first input image (1510) and the luminance adjustment level (LV1) at the average luminance level (IPTb) of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0379] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can control the luminance adjustment change rate (ΔV2a) at a luminance level (IH2a) smaller than the average luminance level of the first input image (1510) and the second input image (1610) when the average luminance level of the first input image (1510) and the luminance deviation of the first input image (1510) are greater than the luminance deviation of the second input image (1610) so that the luminance adjustment change rate (ΔV2b) at a luminance level (IH2b) smaller than the average luminance level of the first input image (1510) is smaller than the luminance adjustment change rate (ΔV2b) at a luminance level (IH2b) smaller than the average luminance level of the second input image (1610) when the average luminance level of the first input image (1510) is the same.

[0380] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can control the luminance adjustment level (LV2a) at a luminance level (IH2a) that is smaller than the average luminance level of the first input image (1510) and the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same, such that when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610), the luminance adjustment level (LV2a) at a luminance level (IH2a) that is smaller than the average luminance level of the first input image (1510) is greater than the luminance adjustment level (LV2b) at a luminance level (IH2b) that is smaller than the average luminance level of the second input image (1610).

[0381] For example, the 90 luminance level in the first input image (1510) of FIG. 15 may correspond to IH2a, and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV2a, which is greater than LV2b, and the luminance adjustment change rate may be ΔV2a, which is smaller than ΔV2b.

[0382] Meanwhile, the 90 luminance level in the second input image (1610) of FIG. 16 may correspond to IH2b, and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV2b, and the luminance adjustment change rate may be ΔV2b.

[0383] Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0384] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can control the luminance adjustment change rate (ΔV3a) at a luminance level (IH3a) greater than the average luminance level of the first input image (1510) and the second input image (1610) to be smaller than the luminance adjustment change rate (ΔV3b) at a luminance level (IH3b) greater than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same.

[0385] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can control the luminance adjustment level (LV3a) at a luminance level (IH2b) greater than the average luminance level of the first input image (1510) and the second input image (1610) to be smaller than the luminance adjustment level (LV3b) at a luminance level (IH3b) greater than the average luminance level of the second input image (1610) when the luminance deviation of the first input image (1510) is greater than the luminance deviation of the second input image (1610) when the average luminance levels of the first input image (1510) and the second input image (1610) are the same.

[0386] For example, the 165 luminance level in the first input image (1510) of FIG. 15 may correspond to IH3a, and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV2a, which is smaller than LV3b, and the luminance adjustment change rate may be ΔV3a, which is smaller than ΔV3b.

[0387] Meanwhile, the 165 luminance level in the second input image (1610) of FIG. 16 may correspond to IH3b, and according to the luminance mapping of the luminance mapping unit (820), the mapped luminance adjustment level may be LV3b, and the luminance adjustment change rate may be ΔV3b.

[0388] Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0389] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) adjusts the luminance of the input image based on the luminance distribution of the input image, and can control the amount of change in the luminance adjusted so that the higher the degree of the luminance distribution of the input image, the greater the change in the luminance adjusted. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0390] Meanwhile, the signal processing device (170) can extract an object of the input image (810 or 860) and control the amount of change in the brightness of the extracted object (Arm or Ara) to increase in correspondence with the brightness of the extracted object (Arm or Ara). Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0391] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can be controlled so that the amount of change in luminance of the extracted object (Arm or Ara) increases as the peak of the luminance distribution of the extracted object (Arm or Ara) increases. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0392] Meanwhile, the luminance mapping unit (820) within the signal processing device (170) can be controlled so that the amount of change in luminance of the extracted object (Arm or Ara) increases as the deviation in the luminance distribution of the extracted object (Arm or Ara) decreases. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0393] Meanwhile, the signal processing device (170) can extract the background of the input image and control the amount of change in the brightness of the extracted object (Arm or Ara) to increase in correspondence with the brightness of the extracted background. Accordingly, the contrast of the image displayed on the display (180) can be improved.

[0394] Ultimately, according to the signal processing device (170) and the image display device (100) equipped with the same according to various embodiments of the present invention, the contrast of the image displayed on the display (180) can be improved by adaptively performing luminance mapping according to the luminance distribution of the input image. In particular, the contrast of the main object within the image can be improved.

[0395] Furthermore, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above. Various modifications are possible by those skilled in the art without departing from the essence of the invention as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present invention.

Claims

Claim 1 The device includes: a display; an image receiving device for receiving an input image; and a signal processing device for performing signal processing on an input image from the image receiving device and outputting image data to the display. The signal processing device controls the brightness adjustment change rate of the first input image to be smaller than the brightness adjustment change rate of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image. Based on a first brightness mapping curve, brightness that is smaller than the average brightness level of the first input image is adjusted to be smaller than the bypass curve that outputs the brightness of the input image by bypassed. Brightness that is larger than the average brightness level of the first input image is adjusted to be larger than the bypass curve. Based on a second brightness mapping curve, brightness that is smaller than the average brightness level of the second input image is adjusted to be smaller than the bypass curve. Brightness that is larger than the average brightness level of the second input image is adjusted to be larger than the bypass curve. An image display device characterized by controlling the mapping curve to be closer to the bypass curve than to the second luminance mapping curve. Claim 2 An image display device according to claim 1, wherein the signal processing device controls the brightness adjustment change rate of the first input image to be greater than the brightness adjustment change rate of the second input image when the average brightness levels of the first input image and the second input image are the same and the brightness deviation of the first input image is smaller than the brightness deviation of the second input image. Claim 3 An image display device according to claim 1, wherein the signal processing device is characterized in that, when the average luminance level of the first input image and the second input image are the same, and the luminance deviation of the first input image is greater than the luminance deviation of the second input image, the luminance adjustment level at the average luminance level of the first input image and the luminance adjustment level at the average luminance level of the second input image are the same. Claim 4 An image display device according to claim 1, wherein the signal processing device controls the brightness adjustment change rate at a brightness level smaller than the average brightness level of the first input image to be smaller than the brightness adjustment change rate at a brightness level smaller than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image while the average brightness levels of the first input image and the second input image are the same. Claim 5 An image display device according to claim 1, wherein the signal processing device controls the brightness adjustment level at a brightness level smaller than the average brightness level of the first input image to be greater than the brightness adjustment level at a brightness level smaller than the average brightness level of the second input image when the average brightness levels of the first input image and the second input image are the same. Claim 6 An image display device according to claim 1, wherein the signal processing device controls the brightness adjustment change rate at a brightness level greater than the average brightness level of the first input image and the second input image such that, when the average brightness levels of the first input image and the second input image are the same, the brightness deviation of the first input image is greater than the brightness deviation of the second input image, and the brightness adjustment change rate at a brightness level greater than the average brightness level of the first input image is smaller than the brightness adjustment change rate at a brightness level greater than the average brightness level of the second input image. Claim 7 An image display device according to claim 1, wherein the signal processing device controls the brightness adjustment level at a brightness level greater than the average brightness level of the first input image to be smaller than the brightness adjustment level at a brightness level greater than the average brightness level of the second input image when the brightness deviation of the first input image is greater than the brightness deviation of the second input image, while the average brightness levels of the first input image and the second input image are the same. Claim 8 An image display device according to claim 1, wherein the signal processing device adjusts the brightness of the input image based on the brightness distribution of the input image, and controls the amount of change in the brightness-adjusted brightness to be greater as the degree of the brightness distribution of the input image increases. Claim 9 An image display device according to claim 1, wherein the signal processing device extracts an object of an input image and controls the amount of change in brightness of the extracted object to increase in correspondence with the brightness of the extracted object. Claim 10 In claim 9, the image display device is characterized by the signal processing device controlling the amount of change in brightness of the extracted object to increase as the peak of the brightness distribution of the extracted object becomes larger. Claim 11 delete Claim 12 delete Claim 13 delete Claim 14 delete Claim 15 delete Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete

Images