Display device and method for operating display device

Abstract

A display device according to an embodiment of the present invention may include a controller that uses information of local regions of an image to perform tone mapping that does not communicate with each other for each local region. A display device according to an embodiment of the present invention may include a controller that performs adaptive local tone mapping for each respective local region based on information of each local region of an image.

Description

Technical Field

[0001] The present invention relates to a display device and a method of operating the display device.

[0002] The present invention relates to a display device and a method of operating the display device, and relates to a tone mapping method and an image quality improvement method for an input image. Background Art

[0003] Digital images are usually composed of three RGB channels. Usually, each channel in an SDR (Standard Dynamic Range) image can present brightness in the range of 0 - 255 (8 bits). However, since the range of brightness that can be presented in each channel of an SDR image is narrow, in many cases, dark parts cannot be presented normally, or bright parts cannot be presented normally. For example, in the case of an image with a significant brightness difference between dark and bright parts, such as a photo taken under backlight, the light-dark balance is biased to one side. Therefore, there may be a large difference between the scene seen with the naked eye and the SDR image of the scene. Compared with such an SDR image, an image presented in 16 bits or 32 bits in each channel is called an HDR (High Dynamic Range) image. Since the HDR image has a wider brightness presentation ability, it has the advantage of being able to present images more realistically.

[0004] However, ordinary display devices cannot present 16-bit or 32-bit gray levels (gradation). Therefore, it is necessary to convert a 16-bit or 32-bit HDR image into a digital image with a limited dynamic range. Tone mapping can refer to a technique used in the process of converting an HDR image into an SDR image or an LDR (Low Dynamic Range) image, which compresses the brightness region of the HDR image into the brightness region of the SDR image or the LDR image while increasing the contrast ratio between light and dark.

[0005] The display device performs tone mapping on the input image data to generate output image data, and outputs the generated output image data to the display. In order to output an image that can improve the stereoscopic effect and user immersion of the video through such tone mapping on the display, various methods for improving the brightness and contrast ratio of the video are currently being studied. Summary of the Invention

[0006] Problems to be Solved by the Invention

[0007] The present invention provides a display device and a method of operating the same that can further improve the stereoscopic effect and user immersion of an image.

[0008] The present invention provides a display device and an operation method thereof that can improve the brightness and contrast ratio of an image.

[0009] The present invention provides a display device and an operation method thereof that can utilize local area information of an image to improve the brightness and contrast ratio of the image, and can increase the stereoscopic effect and user immersion of the image.

[0010] The present invention provides a display device and an operation method thereof. The display device performs adaptive local tone mapping for each corresponding local area based on information of each local area of an image, thereby being able to further improve the stereoscopic effect and user immersion of the image.

[0011] Technical solution for solving the problem

[0012] The display device according to an embodiment of the present invention may include a controller that performs different tone mappings for each local area based on information of local areas of an image.

[0013] The display device according to an embodiment of the present invention may include a controller that performs adaptive local tone mapping for each corresponding local area based on information of each local area of an image.

[0014] The display device according to an embodiment of the present invention may include: a controller that performs tone mapping for adjusting the brightness of input image data; and an OLED display that outputs an image based on the output image data whose brightness is adjusted by the tone mapping. The controller generates a basic mapping curve for the entire area based on the input image data. The controller extracts the brightness information of each local area of the entire area, and generates a local mapping curve reflecting the brightness information of each corresponding local area for each local area to perform the tone mapping.

[0015] According to the display device of an embodiment of the present invention, the basic mapping curve may include a dynamic contrast curve for the entire area and a dynamic tone mapping curve for the entire area.

[0016] According to the display device of an embodiment of the present invention, the controller may adaptively generate the local mapping curve for each corresponding local area based on the extracted brightness information of each local area and the basic mapping curve.

[0017] For a display device according to an embodiment of the present invention, the controller may set local dimming intensity for the corresponding local area based on the brightness information of each local area, and adaptively process local pixel compensation for the corresponding local area based on the set local dimming intensity, so as to generate the local mapping curve.

[0018] For a display device according to an embodiment of the present invention, if the brightness of the corresponding local area is less than a first reference value, the controller may set the local dimming intensity to be relatively weak; if the brightness of the corresponding local area is greater than a second reference value which is larger than the first reference value, the controller may set not to perform local dimming; if the brightness of the corresponding local area is between the first reference value and the second reference value, the controller may set the local dimming to be relatively strong.

[0019] For a display device according to an embodiment of the present invention, if the brightness of the corresponding local area is less than a first reference value, the controller may process the local pixel compensation to be relatively weak to generate the local mapping curve; if the brightness of the corresponding local area is greater than a second reference value which is larger than the first reference value, the controller may not perform local pixel compensation and maintain the basic mapping curve; if the brightness of the corresponding local area is between the first reference value and the second reference value, the controller may process the local pixel compensation to be relatively strong to generate the local mapping curve.

[0020] For a display device according to an embodiment of the present invention, if the brightness of the corresponding local area is less than the first reference value, the controller may process the local pixel compensation to be relatively weak to generate the local mapping curve; if the brightness of the corresponding local area is greater than the second reference value, the controller may not perform local pixel compensation and maintain the basic mapping curve; if the brightness of the corresponding local area is between the first reference value and the second reference value, the controller may process the local pixel compensation to be relatively strong to generate the local mapping curve.

[0021] For a display device according to an embodiment of the present invention, if the brightness of the corresponding local area is less than a first reference value, the controller may generate the local mapping curve to emphasize the contrast ratio between light and dark; if the brightness of the corresponding local area is greater than a second reference value which is larger than the first reference value, the controller may maintain the basic mapping curve; if the brightness of the corresponding local area is between the first reference value and the second reference value, the controller may generate the local mapping curve to increase the brightness.

[0022] The operation method of the display device according to an embodiment of the present invention can generate a basic mapping curve for the entire area based on input image data, extract the luminance information of each local area of the entire area, and generate local mapping curves reflecting the luminance information of the corresponding local areas for each local area to perform tone mapping on the input image data, and output the image based on the output image data whose luminance is adjusted through the tone mapping to an OLED display.

[0023] According to the operation method of the display device according to an embodiment of the present invention, the basic mapping curve may include a dynamic contrast curve for the entire area and a dynamic tone mapping curve for the entire area.

[0024] According to the operation method of the display device according to an embodiment of the present invention, local mapping curves can be adaptively generated for each of the corresponding local areas based on the extracted luminance information of each local area and the basic mapping curve.

[0025] According to the operation method of the display device according to an embodiment of the present invention, the local dimming intensity for the corresponding local area can be set based on the luminance information of each local area, and the local pixel compensation for the corresponding local area can be adaptively processed based on the set local dimming intensity, thereby generating the local mapping curve.

[0026] According to the operation method of the display device according to an embodiment of the present invention, if the luminance of the corresponding local area is less than a first reference value, the local dimming intensity can be set to be relatively weak; if the luminance of the corresponding local area is greater than a second reference value larger than the first reference value, it can be set not to perform local dimming; if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the local dimming can be set to be relatively strong.

[0027] According to the operation method of the display device according to an embodiment of the present invention, if the luminance of the corresponding local area is less than a first reference value, the local pixel compensation can be processed to be relatively weak to generate the local mapping curve; if the luminance of the corresponding local area is greater than a second reference value larger than the first reference value, the local pixel compensation can be not performed and the basic mapping curve can be maintained; if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the local pixel compensation can be processed to be relatively strong to generate the local mapping curve.

[0028] According to the operation method of the display device according to an embodiment of the present invention, if the brightness of the corresponding local area is less than the first reference value, the local mapping curve may be generated to emphasize the light-dark ratio. If the brightness of the corresponding local area is greater than the second reference value greater than the first reference value, the basic mapping curve may be maintained. If the brightness of the corresponding local area is equal to or greater than the first reference value and equal to or less than the second reference value, the local mapping curve may be generated to increase the brightness.

[0029] Advantageous Effects of the Invention

[0030] According to the display device and the operation method of the display device according to an embodiment of the present invention, the stereoscopic effect and user immersion of an image can be further improved.

[0031] According to the display device and the operation method of the display device according to an embodiment of the present invention, the brightness and light-dark ratio of an image can be increased.

[0032] According to the display device and the operation method of the display device according to an embodiment of the present invention, based on the local area information of an image, the brightness and light-dark ratio of the image can be increased, and the stereoscopic effect and user immersion of the image can be increased.

[0033] According to the display device and the operation method of the display device according to an embodiment of the present invention, based on the information of each local area of an image, adaptive local tone mapping is performed for each corresponding local area, thereby further improving the stereoscopic effect and user immersion of the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a block diagram showing a display device according to an embodiment of the present invention.

[0035] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention.

[0036] Figure 3 shows an actual configuration example of a remote control device according to an embodiment of the present invention.

[0037] Figure 4 shows an example of using a remote control device according to an embodiment of the present invention.

[0038] Figure 5 is a flowchart showing the operation method of a display device according to an embodiment of the present invention.

[0039] Figure 6 is a diagram illustrating a local dimming example of a general LED display device.

[0040] Figure 7 is a diagram illustrating an example of a dimming mapping of a general LED display device.

[0041] Figure 8 Shows an example of pixel compensation based on local dimming of a general LED display device.

[0042] Figure 9 Shows an example of local dimming and pixel compensation of the display device according to an embodiment of the present invention.

[0043] Figure 10 Shows an example of pixel compensation based on local dimming of the display device according to an embodiment of the present invention.

[0044] Figure 11 Shows the input image and output image of the display device according to an embodiment of the present invention.

[0045] Figure 12 Shows the application in the display device according to an embodiment of the present invention Figure 11 Example of local pixel compensation for low gray-level regions.

[0046] Figure 13 Shows the application in the display device according to an embodiment of the present invention Figure 11 Example of local pixel compensation for medium gray-level regions.

[0047] Figure 14 Shows the application in the display device according to an embodiment of the present invention Figure 11 Example of local pixel compensation for high gray-level regions. Detailed Description of the Invention

[0048] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the accompanying drawings. In the following description, the suffixes "interface", "module", and "unit" for components are given and mixed only for convenience of writing the specification, and they do not have distinct meanings or functions from each other.

[0049] The display device according to an embodiment of the present invention is, for example, a smart display device that has added computer support functions to the broadcast reception function, and has an Internet function etc. in addition to fully executing the broadcast reception function, so that it can have more user-friendly interfaces such as a handwriting input device or a touch screen or a spatial remote controller. In addition, by connecting to the Internet and a computer with the support of wired or wireless Internet functions, functions such as email or web browsing or banking or games can also be executed. In order to implement such various functions, a standardized general-purpose OS can be used.

[0050] Therefore, in the display device described in the present invention, for example, various applications can be freely added or deleted on a general OS kernel, so that various user-friendly functions can be executed. More specifically, the display device can be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and can also be applied to a smartphone according to circumstances.

[0051] Figure 1 FIG. is a block diagram showing the configuration of a display device according to an embodiment of the present invention.

[0052] Referring to Figure 1 , the display device 100 may include a broadcast receiving unit 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, a display 180, a speaker 185, and a power supply circuit 190.

[0053] The broadcast receiving unit 130 may include a tuner 131, a demodulator 132, and a network interface 133.

[0054] The tuner 131 may select a specific broadcast channel according to a channel selection instruction. The tuner 131 may receive a broadcast signal of the selected specific broadcast channel.

[0055] The demodulator 132 may separate the received broadcast signal into a video signal, an audio signal, and a data signal related to a broadcast program, and may restore the separated video signal, audio signal, and data signal into an outputtable form.

[0056] The external device interface 135 may receive an application or an application directory in an adjacent external device and transfer it to the controller 170 or the memory 140.

[0057] The external device interface 135 may provide a connection path between the display device 100 and an external device. The external device interface 135 may receive one or more of video and audio output from an external device connected to the display device 100 in a wireless or wired manner and transfer it to the controller 170. The external device interface 135 may include a plurality of external input terminals. The plurality of external input terminals may include RGB terminals, one or more HDMI (High Definition Multimedia Interface) terminals, and component terminals.

[0058] The video signal of the external device input through the external device interface 135 may be output through the display 180. The voice signal of the external device input through the external device interface 135 may be output through the speaker 185.

[0059] External devices that can be connected to the external device interface 135 can be, for example, any one of a set-top box, a Blu-ray player, a DVD player, a game console, a soundbar, a smartphone, a PC, a USB memory, and a home theater, but this is only an example.

[0060] The network interface 133 can provide an interface for connecting the display device 100 to a wired / wireless network including the Internet. The network interface 133 can send or receive data to / from other users or other electronic devices through the accessed network or other networks linked to the accessed network.

[0061] In addition, a part of the content data stored in the display device 100 can be sent to other users or selected users or selected electronic devices pre-registered in the display device 100.

[0062] The network interface 133 can access a specified web page through the accessed network or other networks linked to the accessed network. That is, by accessing a specified web page through the network, data can be sent or received with the corresponding server.

[0063] In addition, the network interface 133 can receive content or data provided by a content provider or a network operator. That is, the network interface 133 can receive content such as movies, advertisements, games, VOD, broadcast signals, etc. and related information provided by a content provider or a network provider through the network.

[0064] In addition, the network interface 133 can receive update information and update files of firmware provided by a network operator, and can send data to the Internet or a content provider or a network operator.

[0065] The network interface 133 can select and receive application programs required from application programs publicly available (open) to the public through the network.

[0066] The memory 140 can store programs for processing and controlling various signals in the controller 170, and can also store images, voices, or data signals after signal processing.

[0067] In addition, the memory 140 can also perform the function of temporarily storing images, voices, or data signals input from the external device interface 135 or the network interface 133, and can also store information related to a specified image through a channel memory function.

[0068] The memory 140 can store application programs or application program directories input from the external device interface 135 or the network interface 133.

[0069] The display device 100 can play content files (video files, still image files, music files, text files, application files, etc.) stored in the memory 140 and provide them to the user.

[0070] The user input interface 150 can transmit the signals input by the user to the controller 170, or transmit the signals from the controller 170 to the user. For example, the user input interface 150 can receive control signals such as power on / off, channel selection, and screen setting from the remote control device 200 based on various communication methods such as Bluetooth, UWB (Ultra-Wideband), ZigBee, RF (Radio Frequency) communication method, or infrared (IR) communication method, and process them, or can process the control signals from the controller 170 for transmission to the remote control device 200.

[0071] In addition, the user input interface 150 can transmit the control signals input from local keys (not shown) such as power keys, channel keys, volume keys, and setting values to the controller 170.

[0072] The video signal processed by the controller 170 can be input to the display 180 and displayed as an image corresponding to the corresponding video signal. In addition, the video signal processed by the controller 170 can be input to an external output device through the external device interface 135.

[0073] The voice signal processed by the controller 170 can be output as audio to the speaker 185. In addition, the voice signal processed by the controller 170 can be input to an external output device through the external device interface 135.

[0074] In addition, the controller 170 can control the overall operation within the display device 100.

[0075] In addition, the controller 170 can control the display device 100 using the user instructions input through the user input interface 150 or internal programs, and can be connected to a network for the user to download the required application programs or application program directories into the display device 100.

[0076] The controller 170 enables the channel information selected by the user, etc., to be output through the display 180 or the speaker 185 together with the processed video or voice signal.

[0077] In addition, the controller 170 enables the video signal or voice signal from an external device, such as a camera or a video camera, input through the external device interface 135 to be output through the display 180 or the speaker 185 according to the external device video playback instruction received through the user input interface 150.

[0078] On the other hand, the controller 170 may control the display 180 to display images. For example, the broadcast images input through the tuner 131, or the external input images input through the external device interface 135, or the images input through the network interface unit, or the images stored in the memory 140 may be controlled to be displayed on the display 180. In this case, the images displayed on the display 180 may be still images or videos, and may be 2D images or 3D images.

[0079] In addition, the controller 170 may control the playback of the content stored in the display device 100, or the received broadcast content, or the external input content input from the outside. The content may be in various forms such as broadcast images, external input images, audio files, still images, accessed web page screens, and text files.

[0080] The wireless communication interface 173 may perform communication with an external device through wired or wireless communication. The wireless communication interface 173 may perform short-range communication with an external device. To this end, the wireless communication interface 173 may utilize at least one of Bluetooth TM ), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus technologies to support short-range communication. Such a wireless communication interface 173 may support wireless communication between the display device 100 and a wireless communication system, or between the display device 100 and other display devices 100, or between the display device 100 and the network where the display device 100 (or an external server) is located through a short-range wireless communication network. The short-range wireless communication network may be a short-range wireless personal area network.

[0081] Here, the other display device 100 may be a wearable device (e.g., a smartwatch, smart glasses, HMD (head mounted display)), a mobile terminal such as a smartphone, etc. that can exchange data (or be linked) with the display device 100 of the present invention. The wireless communication interface 173 may detect (or identify) communicable wearable devices around the display device 100.

[0082] Furthermore, in the case where the detected wearable device is verified as a device that communicates with the display device 100 of the present invention, the controller 170 may transmit at least a part of the data processed in the display device 100 to the wearable device through the wireless communication interface 173. Therefore, the user of the wearable device can utilize the data processed in the display device 100 through the wearable device.

[0083] The display 180 may convert the video signal, data signal, OSD signal processed in the controller 170 or the video signal, data signal, etc. received from the external device interface 135 into R, G, B signals respectively to generate a driving signal.

[0084] On the other hand, Figure 1 The illustrated display device 100 is only one embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted according to the specifications of the actually implemented display device 100.

[0085] That is, two or more components may be combined into one component as needed, or one component may be subdivided into two or more components. In addition, the functions performed in each block are intended to illustrate embodiments of the present invention, and the specific actions or devices do not limit the scope of the rights of the present invention.

[0086] According to another embodiment of the present invention, different from Figure 1 that shown, the display device 100 may also not have a tuner 131 and a demodulator 132, and receive and play video through the network interface 133 or the external device interface 135.

[0087] For example, the display device 100 may be divided into an image processing device such as a set-top box for receiving content, etc. according to a broadcast signal or various network services, and a content playback device for playing the content input from the image processing device.

[0088] In this case, the operation method of the display device according to the embodiment of the present invention described below can be performed not only by referring to Figure 1It can be executed by the display device 100 for explanation, or can also be executed by either an image processing device such as the set-top box or a content playback device having a display 180 and an audio output unit 185.

[0089] Next, with reference to Figures 2 to 3 , a remote control device according to an embodiment of the present invention will be described.

[0090] Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention, Figure 3 showing an actual configuration example of the remote control device 200 according to an embodiment of the present invention.

[0091] First, with reference to Figure 2 , the remote control device 200 may include a fingerprint recognizer 210, a wireless communication circuit 220, a user input interface 230, a sensor 240, an output interface 250, a power supply circuit 260, a memory 270, a controller 280, and a microphone 290.

[0092] With reference to Figure 2 , the wireless communication circuit 220 transceives signals with any one of the display devices according to the foregoing embodiments of the present invention.

[0093] The remote control device 200 may have an RF circuit 221 capable of transceiving signals with the display device 100 according to the RF communication standard, and may have an IR circuit 223 capable of transceiving signals with the display device 100 according to the IR communication standard. In addition, the remote control device 200 may have a Bluetooth circuit 225 capable of transceiving signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 may have an NFC circuit 227 capable of transceiving signals with the display device 100 according to the NFC (Near Field Communication) communication standard, and may have a WLAN circuit 229 capable of transceiving signals with the display device 100 according to the WLAN (Wireless LAN) communication standard.

[0094] In addition, the remote control device 200 transmits a signal including information related to the movement of the remote control device 200 to the display device 100 through the wireless communication circuit 220.

[0095] On the other hand, the remote control device 200 may receive the signal transmitted by the display device 100 through the RF circuit 221, and may, as needed, transmit instructions regarding power on / off, channel change, volume change, etc. to the display device 100 through the IR circuit 223.

[0096] The user input interface 230 can be composed of a keyboard, keys, a touchpad, a touch screen, etc. The user can operate the user input interface 230 to input instructions related to the display device 100 to the remote control device 200. When the user input interface 230 has hard keys, the user can input instructions related to the display device 100 to the remote control device 200 by pressing the hard keys. In this regard, reference is made to Figure 3 for description.

[0097] Reference is made to Figure 3 , the remote control device 200 may include a plurality of keys. The plurality of keys may include a fingerprint recognition key 212, a power key 231, a home key 232, a live broadcast key 233, an external input key 234, a volume adjustment key 235, a voice recognition key 236, a channel change key 237, an OK key 238, and a back key 239.

[0098] The fingerprint recognition key 212 can be a key for recognizing the fingerprint of the user. As an embodiment, the fingerprint recognition key 212 can perform a pressing action, so it can receive the pressing action and the fingerprint recognition action.

[0099] The power key 231 can be a key for turning on / off the power of the display device 100.

[0100] The home key 232 can be a key for moving to the home screen of the display device 100.

[0101] The live broadcast key 233 is a key for displaying a live broadcast program.

[0102] The external input key 234 can be a key for receiving an external input connected to the display device 100.

[0103] The volume adjustment key 235 can be a key for adjusting the volume output by the display device 100.

[0104] The voice recognition key 236 can be a key for receiving the voice of the user and recognizing the received voice.

[0105] The channel change key 237 can be a key for receiving the broadcast signal of a specific broadcast channel.

[0106] The OK key 238 can be a key for selecting a specific function, and the back key 239 can be a key for returning to the previous screen.

[0107] To explain again Figure 2 .

[0108] When the user input interface 230 is provided with a touch screen, the user can input instructions related to the display device 100 to the remote control device 200 by touching the soft keys on the touch screen. Additionally, the user input interface 230 can have various input devices that the user can operate, such as scroll keys or jog keys. The scope of the rights of the present invention is not limited in this embodiment.

[0109] The sensor 240 can have a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 can sense information related to the movement of the remote control device 200.

[0110] For example, the gyro sensor 241 can sense information related to the movement of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 can sense information related to the moving speed of the remote control device 200. On the other hand, the remote control device 200 can also have a distance measurement sensor, so that the distance between the remote control device 200 and the display 180 of the display device 100 can be sensed.

[0111] The output interface 250 can output a video signal or an audio signal corresponding to the operation of the user input interface 230 or corresponding to the signal transmitted from the display device 100.

[0112] The user can identify whether the user input interface 230 is operated or whether the display device 100 is controlled through the output interface 250.

[0113] For example, the output interface 250 can have an LED 251, a vibrator 253, a speaker 255, or a display 257. If the user input interface 230 is operated or signals are transmitted and received with the display device 100 through the wireless communication unit 225, the LED 251 is lit, the vibrator 253 generates vibration, the speaker 255 outputs sound, and the display 257 outputs an image.

[0114] In addition, the power supply circuit 260 supplies power to the remote control device 200, and can stop the power supply when the remote control device 200 does not operate for a specified time, thereby reducing power waste.

[0115] The power supply circuit 260 can restore the power supply when a specified key provided on the remote control device 200 is operated.

[0116] The memory 270 can store various programs, application program data, etc. required for the control or operation of the remote control device 200.

[0117] When the remote control device 200 wirelessly transmits and receives signals with the display device 100 through the RF circuit 221, the remote control device 200 and the display device 100 transmit and receive signals through a specified frequency band.

[0118] The controller 280 of the remote control device 200 can store information such as the frequency band capable of wirelessly transmitting and receiving signals with the display device 100 paired with the remote control device 200 in the memory 270 and refer to this information.

[0119] The controller 280 controls various matters related to the control of the remote control device 200. The controller 280 can transmit a signal corresponding to a specified key operation of the user input interface 230 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor 240 to the display device 100 through the wireless communication unit 225.

[0120] In addition, the microphone 290 of the remote control device 200 can acquire voice.

[0121] A plurality of microphones 290 can be provided.

[0122] Next, an explanation will be given of Figure 4 this.

[0123] Figure 4 An example of using a remote control device according to an embodiment of the present invention is shown.

[0124] Figure 4 In example (a) of, the cursor 205 corresponding to the remote control device 200 is displayed on the display 180.

[0125] The user can move the remote control device 200 up and down, left and right, or rotate it. The cursor 205 displayed on the display 180 of the display device 100 corresponds to the movement of the remote control device 200. As shown in the figure, since this remote control device 200 moves the corresponding cursor 205 and displays it as it moves in the 3D space, it can be named a spatial remote controller.

[0126] Figure 4 In example (b) of, when the user moves the remote control device 200 to the left, the cursor 205 displayed on the display 180 of the display device 100 also moves to the left correspondingly.

[0127] Information about the movement of the remote control device 200 detected by the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 can calculate the coordinates of the cursor 205 from the information about the movement of the remote control device 200. The display device 100 can display the cursor 205 corresponding to the calculated coordinates.

[0128] Figure 4Example (c) illustrates a situation where, while a specific button within the remote control device 200 is pressed, the user moves the remote control device 200 away from the display 180. As a result, the selection area within the display 180 corresponding to the cursor 205 can be pulled closer and enlarged for display.

[0129] Conversely, when the user moves the remote control device 200 closer to the display 180, the selection area within the display 180 corresponding to the cursor 205 can be pulled farther away and reduced in size for display.

[0130] On the other hand, it is also possible that when the remote control device 200 is away from the display 180, the selection area is pulled farther away, and when the remote control device 200 is closer to the display 180, the selection area is pulled closer.

[0131] In addition, in a state where a specific button within the remote control device 200 is pressed, the recognition of up / down and left / right movements can be excluded. That is, when the remote control device 200 is moved closer to or farther away from the display 180, only the forward / backward movement can be recognized, and the up / down and left / right movements are not recognized. In a state where the specific button within the remote control device 200 is not pressed, the cursor 205 is moved only according to the up / down, left / right movement of the remote control device 200.

[0132] On the other hand, the movement speed or movement direction of the cursor 205 can correspond to the movement speed or movement direction of the remote control device 200.

[0133] On the other hand, the cursor representation in this specification is an object that is displayed on the display 180 corresponding to the operation of the remote control device 200. Therefore, the cursor 205 can be an object of various shapes other than the arrow shape shown in the drawings. For example, it can be a concept including a point, a pointer, a prompt, a thick outline, etc. And the cursor 205 can be displayed not only corresponding to any point on the horizontal and vertical axes on the display 180, but also corresponding to a plurality of points such as a line or a surface.

[0134] The display device 100 of the embodiment can include a controller 170 that performs tone mapping for adjusting the brightness of the input image data.

[0135] The display device 100 can include a display 180 that outputs an image based on the output image data whose brightness is adjusted by the tone mapping executed in the controller 170.

[0136] Hereinafter, with reference to Figure 5 , the process of performing tone mapping in the display device of the embodiment of the present invention will be described.

[0137] Figure 5It is a flowchart showing the operation method of the display device according to an embodiment of the present invention.

[0138] The controller 170 of the display device 100 according to the embodiment may generate a base mapping curve for the entire area (S501).

[0139] According to the operation method of the display device 100 according to the embodiment, the controller 170 may generate a base mapping curve for the entire area based on the input image data.

[0140] As an example, the base mapping curve may be generated by HDR (High Dynamic Range) processing of the input image data.

[0141] The base mapping curve generated in the controller 170 may include a base dynamic tone mapping (DTM; Dynamic Tone Mapping) curve for the entire area of the input image data. The base mapping curve may include a base dynamic contrast (DC; Dynamic Contrast) curve for the entire area of the input image data.

[0142] The base mapping curve may include at least one of a base dynamic tone mapping curve for the input image data or a base dynamic contrast curve for the input image data.

[0143] The controller 170 may receive metadata together with the image data. The input image data may be an HDR video. The metadata may include information about the input image data. The metadata may include at least one of the brightness information of the HDR video, the maximum brightness information of each scene, and the information for identifying the HDR video.

[0144] In addition, the controller 170 may calculate a luminance distribution histogram from the input image data. The luminance distribution histogram of the HDR video may refer to the distribution information of the luminance values of each pixel among a plurality of pixels of the HDR video. The controller 170 may calculate a luminance distribution histogram, and the luminance distribution histogram is a distribution diagram of the signal levels (for example, 0 to 1023) of each pixel among a plurality of pixels of the HDR video.

[0145] The base mapping curve may be generated based on video information including histogram information and APL (Average Picture Level) information of the input image data.

[0146] The controller 170 may generate a basic DTM (Dynamic Tone Mapping) curve based on the luminance distribution histogram information of the input image data. The basic DTM curve may refer to a mapping curve in the RGB domain. In the RGB domain, mapping may be performed from the input image data to the output image data according to the generated basic DTM curve.

[0147] The controller 170 may generate a basic DC (Dynamic Contrast) curve. The basic DC curve may refer to a mapping curve in the luminance Y domain. In the luminance Y domain, mapping may be performed from the input image data to the output image data according to the generated basic DC curve.

[0148] On the other hand, since the scheme of generating the basic DTM curve or the basic DC curve in the controller 170 to generate output image data suitable for the characteristics of the display 180 for the input image data is already known, the detailed description thereof is omitted herein.

[0149] The controller 170 of the display device 100 according to the embodiment may extract the luminance information of each local area of the entire area and generate a local mapping curve reflecting the luminance information of each corresponding local area for each local area (S503).

[0150] The controller 170 may adaptively generate a local mapping curve for each corresponding local area based on the extracted luminance information of each local area and the basic mapping curve.

[0151] The controller 170 may set the local dimming intensity for the corresponding local area based on the luminance information of each local area, and adaptively process the local pixel compensation for the corresponding local area based on the set local dimming intensity, thereby generating a local mapping curve.

[0152] The controller 170 of the display device 100 according to the embodiment may perform tone mapping based on the generated local mapping curve and output the image of the output image data adjusted based on the luminance to the display 180 (S505).

[0153] The display device 100 according to the embodiment proposes a scheme for solving the drawback that in the case of performing tone mapping based on the basic DTM curve and the basic DC curve mainly based on the image histogram information, there is a region with insufficient perceived light-dark ratio in the output image.

[0154] The display device 100 of the embodiment proposes a solution: setting local dimming values in a dimming LUT (Look Up Table) based on local block information in an image (such as maximum R, G, B), and processing local pixel compensation for brightness compensation based on the local dimming amount.

[0155] The controller 170 of the embodiment may include a dimming processor for setting local dimming values and a pixel compensation processor for performing local pixel compensation.

[0156] Referring to Figures 6 to 8 , local dimming and local pixel compensation of a display device including an LED display will be described.

[0157] Figure 6 is a diagram illustrating a local dimming example of a general LED display device, Figure 7 is a diagram illustrating an example of a dimming map of a general LED display device, Figure 8 shows an example of pixel compensation based on local dimming of a general LED display device.

[0158] The concept of the dimming LUT in the display device including an LED display of the embodiment is that, as in the example of the dimming LUT in the LED display device shown in Figure 6 , the dimming intensity of darker areas can be made stronger to make them darker, while brighter areas maintain their brightness levels. As shown in Figure 6 and Figure 7 , the controller 170 can perform an enhancement process on the dimming intensity of the dark area R1 and a weakening process on the dimming intensity of the bright area R2.

[0159] The controller 170 can, as in the example of the pixel compensation LUT in the LED display device shown in Figure 8 , if the local dimming intensity for a local block is strong, correspondingly enhance the local pixel compensation intensity to compensate for the brightness of the corresponding local block.

[0160] As described above, the controller 170 can output output image data with an increased contrast ratio to the display 180 by adjusting the local dimming intensity and local pixel compensation intensity of the corresponding local areas based on the brightness information of each local area of the input image data.

[0161] A major difference between a display device including an LED display and a display device including an OLED display lies in whether there is a backlight that provides light for displaying an image.

[0162] Since each pixel of an OLED display is made of self-luminous materials, there is no need for a backlight. This may be the biggest advantage of OLED displays when displaying black. The disadvantage of LED displays is that due to the backlight, black can also appear hazy. In order to improve this disadvantage, LED displays apply local dimming technology to turn off the backlight in the corresponding local area where black needs to be displayed to improve the expression of black. For the parts that cannot be displayed after turning off the backlight, LED displays use the pixel compensation function to increase the signal brightness to compensate.

[0163] Compared with LED displays, OLED displays can set the number of blocks for local dimming to be larger, and the size of the blocks for local dimming can be set to be smaller. For example, the OLED display can set the number of blocks for local dimming to 20,736 (192*108). Therefore, compared with the case of processing local dimming in LED displays, OLED displays can design picture quality more locally and finely.

[0164] Below, refer to Figure 9 and Figure 10 , describing a process of processing pixel compensation for a local area in a display device including an OLED display according to an embodiment of the present invention.

[0165] Figure 9 An example of local dimming and pixel compensation of a display device according to an embodiment of the present invention is shown. Figure 10 An example of pixel compensation based on local dimming of a display device according to an embodiment of the present invention is shown.

[0166] According to a display device including an OLED display of an embodiment, Figure 9 As shown in the first line 901, the controller 170 can set and process the local dimming intensity differently according to the brightness of each local area. The first line 901 shows an example of a dimming LUT, showing the change tendency of the local dimming intensity based on the brightness of each local area.

[0167] The controller 170 may set the local dimming intensity to be weaker and process the darker local area, considering that black may appear to be floating or sinking visually and is easily affected by noise.

[0168] For a local area with relatively medium brightness, the controller 170 may set the local dimming intensity to the highest level and perform processing in order to maximize the brightness-to-darkness ratio of the image.

[0169] The controller 170 may not apply additional local dimming to the brighter local area, taking into account the situation where the resolution is reduced and the brightness is reduced, so that the brighter local area is not affected by the local dimming and remains the same.

[0170] For example, if the luminance of a corresponding local area is less than a first reference value, the controller 170 may set the local dimming intensity to be relatively weak. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales. Additionally, setting the local dimming intensity to be relatively weak may mean that if the output luminance value is displayed in 1024 grayscales, the output luminance is set to 512 to 768 grayscales.

[0171] If the luminance of a corresponding local area is greater than a second reference value that is greater than the first reference value, the controller 170 may be set not to perform local dimming. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales, and the second reference value may be 640 grayscales. Additionally, being set not to perform local dimming may mean that if the output luminance value is displayed in 1024 grayscales, the output luminance is set to 1024 grayscales.

[0172] If the luminance of a corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller 170 may set the local dimming intensity to be relatively strong. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales, and the second reference value may be 640 grayscales. Additionally, setting the local dimming intensity to be relatively strong may mean that if the output luminance value is displayed in 1024 grayscales, the output luminance is set to 0 to 512 grayscales. For example, if the input luminance value is 256 to 512 grayscales, the local dimming intensity may be set to maximum, and the output luminance may be set to 0 grayscales.

[0173] In a display device including an OLED display according to an embodiment, the controller 170 may refer to the local dimming intensity set for a local area, as Figure 9 and Figure 10 shown, and set and process local pixel compensation for the corresponding local area.

[0174] According to a display device including an OLED display according to an embodiment, as Figure 9 shown by the second line 903, the controller 170 may differently set and process the local pixel compensation intensity based on the luminance of each local area. The second line 903 shows the variation tendency of the local pixel compensation intensity based on the luminance of each local area, Figure 10 showing an example of a pixel compensation LUT.

[0175] As Figure 10 shown by the pixel compensation LUT shown, in order to overall improve the contrast ratio of an image, the controller 170 may set and process pixel compensation with a tendency to reduce the luminance of areas with relatively low luminance and increase the luminance of the remaining areas.

[0176] For example, if the luminance of a corresponding local area is less than a first reference value, the controller 170 may generate and process a local mapping curve by treating local pixel compensation as relatively weak. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales. To improve the contrast ratio of the image in the corresponding local area, the controller 170 may set and process local pixel compensation to further reduce the luminance of the area with lower luminance.

[0177] If the luminance of the corresponding local area is greater than a second reference value that is larger than the first reference value, the controller 170 may maintain the basic mapping curve without performing local pixel compensation. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales and the second reference value may be 640 grayscales. Additionally, setting not to perform local pixel compensation may mean setting that the area with relatively high luminance maintains the input luminance without additional pixel compensation.

[0178] If the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller 170 may generate a local mapping curve by treating the intensity of local pixel compensation as relatively strong. For example, if the input luminance value is displayed in 1024 grayscales, the first reference value may be 128 grayscales and the second reference value may be 640 grayscales. Additionally, setting the intensity of local pixel compensation to be relatively strong may mean, for example, as shown in the pixel compensation LUT of Figure 10 to increase the luminance of the corresponding local area to improve the contrast ratio of the image.

[0179] In the display device according to an embodiment, if the luminance of a corresponding local area is less than the first reference value, the controller 170 may generate a local mapping curve to emphasize the contrast ratio; if the luminance of the corresponding local area is greater than a second reference value that is larger than the first reference value, the controller 170 may maintain the basic mapping curve; and if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller 170 may generate a local mapping curve to increase the luminance.

[0180] Figure 11 The input image and the output image of the display device according to an embodiment of the present invention are shown.

[0181] Figure 11 (a) of Figure 11 shows an example of applying the basic mapping curve to the entire area based on the input image data,

[0182] As Figure 11 shown, it can be seen that the luminance and the contrast ratio of the output image with local pixel compensation added to the local area are improved as a whole.

[0183] In Figure 11 it, the first region 1101 illustrates a relatively low gray-scale region, the second region 1103 illustrates a relatively medium gray-scale region, and the third region 1105 illustrates a relatively high gray-scale region.

[0184] The controller 170 of the embodiment applies different local pixel compensations to the first region 1101, the second region 1103, and the third region 1105 respectively. The controller 170 adaptively applies different local dimming intensities and local pixel compensation intensities to the corresponding local regions based on the brightness information of each local region.

[0185] Figure 12 Illustrates the local pixel compensation applied to the Figure 11 low gray-scale region 1101 in the OLED display device of the embodiment of the present invention.

[0186] The controller 170 of the embodiment sets a weaker local dimming and a weaker local pixel compensation for the low gray-scale region 1101 to emphasize the light-dark ratio, thereby performing local pixel compensation for further reducing the brightness of the relatively low-brightness region and further increasing the brightness of the remaining brightness regions.

[0187] Figure 13 Illustrates the local pixel compensation applied to the Figure 11 medium gray-scale region 1103 in the OLED display device of the embodiment of the present invention.

[0188] The controller 170 of the embodiment sets a stronger local dimming and a stronger local pixel compensation for the medium gray-scale region 1103 to maximize the light-dark ratio, thereby performing local pixel compensation for significantly reducing the brightness of the relatively low-brightness region and significantly increasing the brightness of the remaining brightness regions.

[0189] Figure 14 Illustrates the local pixel compensation applied to the Figure 11 high gray-scale region 1105 in the OLED display device of the embodiment of the present invention.

[0190] The controller 170 of the embodiment sets and processes the high gray-scale region 1105 not to perform local dimming and local pixel compensation to maintain the presentation power of the image applied based on the basic mapping curve.

[0191] As described above, according to the OLED display device of the embodiment, local pixel compensation is adaptively performed based on the local region information of the image, so that the brightness and light-dark ratio of the image can be improved, and the three-dimensional sense and user immersion of the image can be increased.

[0192] In the OLED display device according to the embodiment, the brightness of the middle gray level region of the image is increased, and the brightness of the low gray level region is decreased, so that the brightness and contrast ratio of the image can be improved according to the stretch effect.

[0193] According to an embodiment of the present invention, the foregoing method can be implemented as processor-readable code in a medium recording a program. Examples of the processor-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0194] In the display device as described above, the configurations and methods of the above embodiments are not limitedly used, but the embodiments can also be configured by selectively combining all or a part of each embodiment to enable various deformations.

Claims

1. A display device, wherein, Comprising: A controller that performs tone mapping for adjusting the brightness of input image data; And An OLED display that outputs an image based on the output image data whose brightness is adjusted by the tone mapping; The controller generates a basic mapping curve for the entire area based on the input image data; The controller extracts the brightness information of each local area of the entire area, and generates a local mapping curve that reflects the brightness information of each corresponding local area for each local area to perform the tone mapping.

2. The display device according to claim 1, wherein The basic mapping curve includes a dynamic contrast curve for the entire area and a dynamic tone mapping curve for the entire area.

3. The display device according to claim 1, wherein The controller adaptively generates the local mapping curve for each corresponding local area based on the extracted brightness information of each local area and the basic mapping curve.

4. The display device according to claim 1, wherein The controller sets the local dimming intensity for the corresponding local area based on the brightness information of each local area, and adaptively processes the local pixel compensation for the corresponding local area based on the set local dimming intensity, thereby generating the local mapping curve.

5. The display device according to claim 4, wherein If the brightness of the corresponding local area is less than a first reference value, the controller sets the local dimming intensity to be relatively weak; If the brightness of the corresponding local area is greater than a second reference value that is larger than the first reference value, the controller sets not to perform the local dimming; If the brightness of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller sets the local dimming to be relatively strong.

6. The display device according to claim 4, wherein If the brightness of the corresponding local area is less than a first reference value, the controller processes the local pixel compensation to be relatively weak to generate the local mapping curve; If the brightness of the corresponding local area is greater than a second reference value that is larger than the first reference value, the controller does not perform the local pixel compensation and maintains the basic mapping curve; If the brightness of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller processes the local pixel compensation to be relatively strong to generate the local mapping curve.

7. The display device according to claim 5, wherein If the brightness of the corresponding local area is less than the first reference value, the controller processes the local pixel compensation to be relatively weak to generate the local mapping curve; If the brightness of the corresponding local area is greater than the second reference value, the controller does not perform the local pixel compensation and maintains the basic mapping curve; If the brightness of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller processes the local pixel compensation to be relatively strong to generate the local mapping curve.

8. The display device according to claim 4, wherein, if the luminance of the corresponding local area is less than a first reference value, the controller generates the local mapping curve to emphasize the light-dark ratio; if the luminance of the corresponding local area is greater than a second reference value that is greater than the first reference value, the controller maintains the basic mapping curve; if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the controller generates the local mapping curve to increase the luminance.

9. A method of operating a display device, wherein, a basic mapping curve for the entire area is generated based on input image data; luminance information of each local area of the entire area is extracted, and a local mapping curve reflecting the luminance information of each corresponding local area is generated for each local area to perform tone mapping on the input image data; an image based on the output image data whose luminance is adjusted by the tone mapping is output to an OLED display.

10. The method of operating a display device according to claim 9, wherein, the basic mapping curve includes a dynamic contrast curve for the entire area and a dynamic tone mapping curve for the entire area.

11. The method of operating a display device according to claim 9, wherein, based on the extracted luminance information of each local area and the basic mapping curve, the local mapping curve is adaptively generated for each corresponding local area.

12. The method of operating a display device according to claim 9, wherein, based on the luminance information of each local area, a local dimming intensity for the corresponding local area is set, and local pixel compensation for the corresponding local area is adaptively processed based on the set local dimming intensity, thereby generating the local mapping curve.

13. The method of operating a display device according to claim 12, wherein, if the luminance of the corresponding local area is less than a first reference value, the local dimming intensity is set to be relatively weak; if the luminance of the corresponding local area is greater than a second reference value that is greater than the first reference value, it is set not to perform the local dimming; if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the local dimming is set to be relatively strong.

14. The method of operating a display device according to claim 12, wherein, if the luminance of the corresponding local area is less than a first reference value, the local pixel compensation is processed to be relatively weak to generate the local mapping curve; if the luminance of the corresponding local area is greater than a second reference value that is greater than the first reference value, the local pixel compensation is not performed and the basic mapping curve is maintained; if the luminance of the corresponding local area is equal to or greater than the first reference value and less than the second reference value, the local pixel compensation is processed to be relatively strong to generate the local mapping curve.

15. The method of operating a display device according to claim 12, wherein, If the brightness of the corresponding local area is less than the first reference value, generate the local mapping curve to emphasize the light-dark ratio; If the brightness of the corresponding local area is greater than the second reference value which is greater than the first reference value, maintain the basic mapping curve; If the brightness of the corresponding local area is greater than or equal to the first reference value and less than the second reference value, generate the local mapping curve to increase the brightness.

Images