Display device and operation method thereof

Abstract

In a display device according to an embodiment disclosed herein, at least one processor individually or collectively executes a plurality of instructions to detect information on the ratio at which graphics are displayed in an image on the basis of graphics data, and, on the basis of the information on the ratio at which the graphics are displayed, control a video image quality processing unit so that the video image quality processing unit processes the graphics when the ratio at which the graphics are displayed is greater than or equal to a first threshold, and control a graphics image quality processing unit and the video image quality processing unit so that the graphics image quality processing unit processes the graphics and the video image quality processing unit processes a video when the ratio at which the graphics are displayed is lower than the first threshold.

Description

Display device and method of operation thereof

[0001] Various embodiments relate to a display device and a method of operating the same, and more particularly, to a display device capable of processing and displaying video and graphics and a method of operating the same.

[0002] With the recent advancement of electronic technology, various types of display devices are being developed and distributed, and display devices that provide ultra-high resolutions such as 4K resolution and 8K resolution are also increasing.

[0003] In this regard, graphics displayed through display devices can also have varying resolutions. If the resolution of the original graphics displayed on a display device is lower than that of the display device, the graphics appear blurry, resulting in poor image quality and discomfort for the user. As display devices offering ultra-high resolutions have increased in recent years, the importance of processing the image quality of the original graphics has increased.

[0004] A display device according to one embodiment of the present disclosure can detect information about a ratio at which graphics are displayed in an image based on graphic data by having at least one processor individually or collectively execute the plurality of instructions.

[0005] A display device according to one embodiment of the present disclosure can control a video quality processing unit to process graphics based on information about a ratio at which graphics are displayed, when the ratio at which graphics are displayed is greater than or equal to a first threshold value, by having the at least one processor individually or collectively execute the plurality of instructions.

[0006] A display device according to one embodiment of the present disclosure can control a graphic quality processing unit and a video quality processing unit so that a graphic quality processing unit processes graphics and a video quality processing unit processes video when a ratio at which graphics are displayed is lower than a first threshold value by having the at least one processor individually or collectively execute the plurality of instructions.

[0007] A method for processing an image in a display device according to one embodiment of the present disclosure may include an operation of detecting information regarding a ratio at which graphics are displayed in an image based on graphic data.

[0008] A method for processing an image in a display device according to one embodiment of the present disclosure may include an operation of controlling a video quality processing unit to process a graphic when the graphic display ratio is greater than or equal to a first threshold value based on information about the graphic display ratio.

[0009] A method for processing an image in a display device according to one embodiment of the present disclosure may include an operation of controlling a graphic quality processing unit and a video quality processing unit so that a graphic quality processing unit processes a graphic and a video quality processing unit processes a video when a graphic display ratio is lower than a first threshold based on information about a graphic display ratio.

[0010] In one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing a method of operating a display device on a computer may be provided.

[0011] The present disclosure can be readily understood by the combination of the following detailed description and the accompanying drawings, wherein reference numerals refer to structural elements.

[0012] FIG. 1 is an example of a display device according to one embodiment of the present disclosure.

[0013] FIG. 2 is a block diagram showing the configuration of a display device according to one embodiment of the present disclosure.

[0014] FIG. 3 is a drawing for explaining the operation of a display device according to one embodiment of the present disclosure.

[0015] FIG. 4a is a flowchart illustrating a method of operating a display device according to one embodiment of the present disclosure.

[0016] FIG. 4b is a diagram illustrating an alpha blending map according to one embodiment of the present disclosure.

[0017] FIG. 5 is a flowchart illustrating an example of a method for determining a picture quality processing mode in a display device according to one embodiment of the present disclosure.

[0018] FIG. 6 is a drawing for explaining an example in which a display device according to one embodiment of the present disclosure determines a quality processing mode and processes graphics according to the determined quality processing mode.

[0019] FIG. 7 is a diagram illustrating an example in which a display device according to one embodiment of the present disclosure determines a quality processing mode and processes graphics and video according to the determined quality processing mode.

[0020] FIG. 8 is a diagram illustrating an example in which a display device according to one embodiment of the present disclosure determines a quality processing mode and processes graphics and video according to the determined quality processing mode.

[0021] FIG. 9 is a diagram illustrating an example in which a display device according to one embodiment of the present disclosure determines a quality processing mode and processes graphics and video according to the determined quality processing mode.

[0022] FIG. 10 is a diagram illustrating an example in which a display device according to one embodiment of the present disclosure determines a quality processing mode and processes graphics and video according to the determined quality processing mode.

[0023] FIG. 11 is a drawing for explaining the operation of a display device according to one embodiment of the present disclosure.

[0024] FIG. 12 is a block diagram of a video quality processing unit according to one embodiment of the present disclosure.

[0025] The terms used in this specification will be briefly explained, and the present invention will be described in detail.

[0026] The terms used in this invention have been selected from widely used, current terms, taking into account the functions of the invention. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names, but rather based on their inherent meanings and the overall content of the invention.

[0027] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0028] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.

[0029] The artificial intelligence-related functions according to the present disclosure are operated via a processor and memory. The processor may be comprised of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, an AP, a Digital Signal Processor (DSP), a graphics-only processor such as a GPU or a Vision Processing Unit (VPU), or an artificial intelligence-only processor such as an NPU. One or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0030] The predefined operation rules or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that the basic artificial intelligence model is trained using a learning algorithm using a plurality of learning data, thereby creating a predefined operation rules or artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed on the device itself on which the artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and / or system. Examples of the learning algorithm include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0031] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values, and performs neural network operations through operations between the operation results of the previous layer and the multiple weights. The multiple weights of the multiple neural network layers may be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model is reduced or minimized during the learning process. The artificial neural network may include a deep neural network (DNN), and examples thereof include, but are not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks.

[0032] In the embodiments of this specification, the term "user" means a person who controls a function or operation of a computing device or electronic device using a control device, and may include a viewer, an administrator, or an installer.

[0033] FIG. 1 is an example of a display device (1000) according to one embodiment of the present disclosure.

[0034] Referring to FIG. 1, a display device (1000) according to one embodiment of the present disclosure is a device that visually provides information, and may be a TV. However, this is only one embodiment, and may be implemented in various forms including a display. For example, the display device (1000) may be implemented as various electronic devices such as a mobile phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a tablet PC, a desktop, an e-book reader, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation system, an MP3 player, a wearable device, and the like. In addition, the display device (1000) may be fixed or mobile, and may be a digital broadcasting receiver capable of receiving digital broadcasting.

[0035] The display device (1000) may be implemented as a flat display device, a curved display device having a screen with a curvature, or a flexible display device whose curvature can be adjusted. The output resolution of the display device (1000) may include, for example, HD (High Definition), Full HD, Ultra HD, or a resolution clearer than Ultra HD.

[0036] A display device (1000) according to one embodiment of the present disclosure may display graphics (100), video (200), or both graphics (100) and video (200) within a display area (10). The graphics (100) may be generated within the display device (1000). For example, the graphics (100) may include various objects such as menus, icons, images, text, etc. The video (200) may be received from an external device (not shown) connected to the display device (1000) wirelessly or by wire. For example, the external device (not shown) may include, but is not limited to, a server device, a mobile terminal, a wearable device (e.g., a watch, a band, glasses, a mask, etc.), a home appliance (e.g., a TV, a desktop PC, a laptop, a DVD device, a washing machine, a refrigerator, etc.).

[0037] FIG. 1 illustrates an example in which a graphic (100) is displayed in a portion of a display area (10) of a display device (1000), for example, a left half area, and a video (200) is displayed in the remaining portion of the display area (10), for example, a right half area. However, the embodiment is not limited thereto, and the ratio of the area where the graphic (100) is displayed and the area where the video (200) is displayed within the display area (10) may vary depending on the image to be provided. Alternatively, the area where the graphic (100) is displayed or the area where the video (200) is displayed within the display area (10) may each be configured in multiple portions. Alternatively, the graphic (100) and the video (200) may be displayed at least partially overlapping each other within the display area (10).

[0038] Typically, since the characteristics of graphics (100) and video (200) are different, image quality processing units may be provided separately. That is, video (200) may be processed by a dedicated video quality processing unit for processing the image quality of video (200), and graphics (100) may be processed by a dedicated graphic quality processing unit for processing the image quality of graphics (100). Typically, the video quality processing unit may be implemented with higher specifications than the graphic quality processing unit. Accordingly, when an image includes video (200) and graphics (100), the video (200) may be processed by the video quality processing unit, and the graphics (100) may be processed by the graphic quality processing unit. However, recently, the performance of graphics (100) has improved, and graphics (100) may occupy most of the image. However, if the graphic (100) is simply processed by the graphic quality processing unit, a high-spec resource called the video quality processing unit is wasted. Therefore, if the graphic (100) occupies a large proportion of the image, it may be desirable to improve the graphic quality by processing the graphic (100) using the video quality processing unit. Accordingly, in the embodiments disclosed in the present disclosure, if the graphic (100) occupies a large proportion of the displayed image, the quality processing of the graphic (100) that occupies most of the image can be improved by using the video quality processing unit for graphic quality processing.

[0039] FIG. 2 is a block diagram showing the configuration of a display device (1000) according to one embodiment of the present disclosure.

[0040] Referring to FIG. 2, a display device (1000) according to one embodiment of the present disclosure may include an input unit (110), a processor (120), a memory (130), an image processing unit (140), and a display (150). The input unit (110), the processor (120), the memory (130), the image processing unit (140), and the display (150) may each be electrically and / or physically connected to each other. Only components for explaining the operation of the display device (1000) are illustrated in FIG. 2, and the components included in the display device (1000) are not limited as illustrated in FIG. 2.

[0041] The input unit (110) receives data from various data sources. For example, the input unit (110) may include a tuner for receiving a live stream coming in through a broadcast, a USB (Universal Serial Bus) for playing stored media files, an HDMI (High Definition Multimedia Interface) for receiving external input from an external playback device or set-top box, and a component. The tuner may receive broadcast signals and / or broadcast-related information from an external source through a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel.

[0042] Additionally, the input unit (110) may include a communication unit (not shown), and the communication unit may include one or more components that enable communication between the display device (1000) and a server device (not shown), or between the display device (1000) and an external device (not shown). For example, the communication unit may include a short-range communication unit.

[0043] The short-range wireless communication unit may include, but is not limited to, a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA, infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, a UWB (Ultra-wideband) communication unit, an Ant+ communication unit, etc.

[0044] The communication unit can obtain content from an external device (not shown). The communication unit can obtain content from an external device (not shown) via wired or wireless communication. Here, the external device (not shown) may include, but is not limited to, a server device, a mobile terminal, a wearable device (e.g., a watch, a band, glasses, a mask, etc.), a home appliance (e.g., a TV, a desktop PC, a laptop, a DVD player, a washing machine, a refrigerator, etc.). The content may include multimedia files, video files, and audio files.

[0045] The input unit (110) can receive input data in various formats. For example, the input data in various formats can include video data, photo data, and audio data.

[0046] The input unit (110) can output input data in various formats and transmit it to the processor (120).

[0047] A processor (120) according to one embodiment of the present disclosure may perform a function of controlling the overall operation of the display device (1000) and signal flow between the durable components of the display device (1000), and processing data.

[0048] The processor (120) may include single cores, dual cores, triple cores, quad cores, and multiples thereof. Furthermore, the processor (120) may include multiple processors. For example, the processor (120) may be implemented as a main processor (not shown) and a subprocessor (not shown) operating in sleep mode.

[0049] Additionally, the processor (120) may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a VPU (Video Processing Unit). Alternatively, according to an embodiment, the processor (120) may be implemented in the form of a SoC (System On Chip) that integrates at least one of a CPU, a GPU, and a VPU.

[0050] A memory (130) according to one embodiment of the present disclosure can store various data, programs or applications for driving and controlling a display device (1000).

[0051] Additionally, the program stored in the memory (130) may include one or more instructions. The program (one or more instructions) or application stored in the memory (130) may be executed by the processor (120).

[0052] The memory (130) may be configured as at least one type of storage medium among, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), or an optical disk.

[0053] In an embodiment of the present disclosure, the processor (120) may store one or more instructions in an internally provided memory (130) and control the execution of operations of the display device (1000) by executing one or more instructions stored in the internally provided memory (130). That is, the processor (120) may execute at least one instruction or program stored in an internal memory provided within the processor (120) or in the memory (130) to perform a predetermined operation. The processor (130) may be operably coupled to the memory (140).

[0054] The processor (120) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. At least one processor, one or more processors may be configured to perform the various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, for example and without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various of the disclosed functions in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0055] The processor (120) controls the overall operation of the display device (1000). For example, the processor (120) may perform the functions of the display device (1000) described in the present disclosure by executing one or more instructions stored in the memory (130).

[0056] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can detect information about the ratio at which graphics are displayed in an image based on graphic data.

[0057] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the video quality processing unit to process the graphics when the ratio at which the graphics are displayed is equal to or greater than a first threshold value, based on information about the ratio at which the graphics are displayed.

[0058] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the graphic quality processing unit and the video quality processing unit so that the graphic quality processing unit processes the graphic and the video quality processing unit processes the video, based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than a first threshold value.

[0059] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the graphic quality processing unit to process the video when the ratio at which the graphics are displayed is greater than or equal to a first threshold and the image includes a video.

[0060] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can detect whether the display device (1000) is running in an operating mode in which graphics can be displayed.

[0061] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can detect information about the ratio at which graphics are displayed when the display device (1000) is executed in an operating mode in which graphics can be displayed.

[0062] Information about the proportion occupied by graphics according to one embodiment of the present disclosure may include the proportion occupied by pixels among pixels of the display having an alpha blending value greater than 0.

[0063] The ratio at which graphics are displayed according to one embodiment of the present disclosure may correspond to the ratio of pixels having an alpha blending value of 1 among the pixels of the display.

[0064] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the video quality processing unit and the graphic quality processing unit so that the video quality processing unit processes the graphic and the graphic quality processing unit processes the video, based on information about the ratio at which the graphic is displayed, if the ratio at which the graphic is displayed is lower than a first threshold but the ratio of pixels among the pixels of the display having an alpha blending value greater than 0 and less than or equal to 1 is equal to or greater than a second threshold higher than the first threshold.

[0065] Information about the ratio at which graphics are displayed according to one embodiment of the present disclosure may further include the degree of distribution of pixels having an alpha blending value greater than 0.

[0066] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the video quality processing unit to process the graphics when the graphics display ratio is less than or equal to a first threshold value and pixels having an alpha blending value greater than 0 are widely distributed, based on information about the graphics display ratio.

[0067] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the video quality processing unit to process the video through the first artificial intelligence model when the ratio at which graphics are displayed is lower than the first threshold.

[0068] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can control the video quality processing unit to process the graphics through the second artificial intelligence model when the ratio at which the graphics are displayed is equal to or greater than a first threshold value.

[0069] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can convert graphics expressed in RGB format to be expressed in YUV format when the ratio at which the graphics are displayed is equal to or greater than a first threshold value.

[0070] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can transmit graphics expressed in YUV format to a video quality processing unit.

[0071] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can convert a video expressed in YUV format to be expressed in RGB format when the ratio at which graphics are displayed is equal to or greater than a first threshold value.

[0072] By individually or collectively executing one or more instructions by at least one processor (120), the display device (1000) according to one embodiment of the present disclosure can transmit video expressed in RGB format to a graphic quality processing unit.

[0073] The image processing unit (140) performs the overall image processing operation of the display device (1000) and can be implemented by hardware, software, or a combination of hardware and software.

[0074] The image processing unit (140) may perform processing on video data received from the input unit (110). For example, the processor (120) may include a video decoder that performs decoding on the video data, and may perform various image processing such as scaling, noise filtering, frame rate conversion, and resolution conversion on the video data. The processed video data may be displayed on the display (140). The display device (1000) displaying the video data may mean playing the video.

[0075] The image processing unit (140) can generate graphics including various objects such as icons, images, text, etc. using the calculation unit and the rendering unit. The calculation unit can calculate attribute values ​​such as coordinate values, shape, size, color, etc. to be displayed for each object included in the graphics according to the layout of the screen using the user input received by the display device (1000). The rendering unit can generate screens with various layouts including objects based on the attribute values ​​calculated by the calculation unit. The screens generated by the rendering unit can be displayed on the display (150).

[0076] An image processing unit (140) according to one embodiment of the present disclosure may perform image quality processing on each of a video and a graphic, and may control the image quality-processed video and the image quality-processed graphic to be synthesized and displayed on a display (150). In one embodiment of the present disclosure, the image processing unit (140) may determine an image quality processing method of a video and / or graphic based on information regarding the ratio at which graphics are displayed in an image, and may perform image quality processing on the video and / or graphic based on the determined image quality processing method. The image quality processing method and the operation of determining the image quality processing method will be described in detail with reference to FIGS. 3 to 10.

[0077] The display (150) includes a plurality of pixels and can display a video signal. For example, if the resolution of the display (150) is 8K, the display panel can include pixels of 7680 X 4320. Alternatively, if the resolution of the display (150) is 4K, the display panel can include pixels of 3840 X 2160. However, the present invention is not limited thereto, and the display (150) can be implemented with various resolutions, and the aspect ratio of the length and width can also be changed.

[0078] The display (150) can display data processed by the processor (120) to the user through a panel. In one embodiment of the present disclosure, the display (150) can output a screen in which video and graphics that have been processed for image quality are mixed based on an image quality processing mode.

[0079] Each of the plurality of pixels included in the display (150) may be composed of sub-pixels representing R (Red), G (Green), and B (Blue). However, this is not limited thereto, and each of the plurality of pixels may be implemented in various forms.

[0080] Below, with reference to FIG. 3, the configuration of the image processing unit (140) that performs overall image processing is described in detail.

[0081] FIG. 3 is a drawing for explaining the operation of a display device (1000) according to one embodiment of the present disclosure.

[0082] Referring to FIG. 3, a processor (120) according to one embodiment of the present disclosure may include a CPU (310) and a GPU (320).

[0083] The CPU (310) can control the overall operation of the display device (1000). The CPU (310) can control the operation of the internal components of the display device (1000) according to the operation mode of the display device (1000). For example, the CPU (310) can request that the display device (1000) generate or process graphics and output them when the display device (1000) executes an On Screen Display (OSD) mode.

[0084] For example, the CPU (310) may request the display device (1000) to process and output the received video or to generate or process graphics and mix them with the video and output them as the display device (1000) executes the application mode.

[0085] The GPU (320) can generate graphics. In the present disclosure, the GPU (320) may be referred to as a graphics generation unit. For example, the GPU (320) can generate graphics including various objects such as menus, icons, images, text, etc., and can calculate attribute values ​​such as coordinate values, shape, size, color, etc. to be displayed for each object included in the graphics according to the layout of the screen output to the display (150). At this time, the size of the graphics generated by the GPU (320) may be the same as or smaller than the size of the screen displayed on the display (150). For example, the graphics generated by the GPU (320) may be displayed on the entire screen, or may be mixed with a video and displayed on a portion of the screen.

[0086] An image processing unit (140) according to one embodiment of the present disclosure may include a graphic memory (330), a video memory (340), a quality processing mode determination unit (350), a graphic quality processing unit (360), a video quality processing unit (370), a mixer (380), and a synchronization signal generation unit (390). In the present disclosure, the graphic quality processing unit (360) may be referred to as a first quality processing unit, and the video quality processing unit (370) may be referred to as a second quality processing unit.

[0087] At least one of the graphic memory (330), the video memory (340), the image quality processing mode determination unit (350), the graphic quality processing unit (360), the video quality processing unit (370), the mixer (380), and the synchronization signal generation unit (390) may be manufactured in the form of a hardware chip and mounted on the display device (1000). For example, the graphic memory (330), the video memory (340), the image quality processing mode determination unit (350), the graphic quality processing unit (360), the video quality processing unit (370), the mixer (380), and the synchronization signal generation unit (390) may each be implemented as separate hardware, or may be implemented on a single chip in the form of a system on chip (SoC).

[0088] Alternatively, at least one of the graphic memory (330), the video memory (340), the image quality processing mode determination unit (350), the graphic quality processing unit (360), the video quality processing unit (370), the mixer (380), and the synchronization signal generation unit (390) may be implemented as a software module. When at least one of the CPU (310), the GPU (320), the graphic memory (330), the video memory (340), the image quality processing mode determination unit (350), the graphic quality processing unit (360), the video quality processing unit (370), the mixer (380), and the synchronization signal generation unit (390) is implemented as a software module (or a program module including instructions), the software module may be stored in a non-transitory computer readable medium that can be read by a computer. In addition, in this case, at least one software module may be provided by an OS (Operating System) or by a predetermined application. Alternatively, at least some of the software modules may be provided by an operating system (OS) and others may be provided by a given application.

[0089] The graphics memory (330) can store graphics data received from the GPU (320). For example, the graphics memory (330) can be a dynamic random access memory (DRAM).

[0090] The video memory (340) can store video data received from the input unit (110, see FIG. 2). For example, the video data received from the input unit (110, see FIG. 2) can be decoded through a decoder (not shown), and the video memory (340) can store the decoded video data. The decoder (not shown) can interpret the encoded input data and decode the image data included in the input data using a decoding method suitable for the input data. For example, the video memory (340) can be a dynamic random access memory (DRAM).

[0091] Meanwhile, in FIG. 3, the graphics memory (330) for storing the generated graphics and the video memory (340) for storing the input video are shown as separate configurations, but according to an embodiment, the graphics memory (330) and the video memory (340) are substantially implemented as one memory, so that both the graphics and the video can be stored in the same memory.

[0092] The image quality processing mode determination unit (350) can receive information about the graphic area from the GPU (320). In the present disclosure, information about the graphic area refers to information about the area where graphics are displayed within the entire display area. Information about the graphic area can be detected through graphic data. For example, information about the graphic area can include the alpha blending value of each pixel of the display.

[0093] The image quality processing mode determination unit (350) can detect information regarding the ratio at which graphics are displayed in an image based on information regarding the graphic area. The image quality processing mode determination unit (350) can determine the image quality processing mode of graphics and video based on information regarding the ratio at which graphics are displayed. According to one embodiment of the present disclosure, the image quality processing mode of graphics and video can include a general mode and a graphic quality priority mode.

[0094] The image quality processing mode determination unit (350) can transmit information regarding the image quality processing mode to the graphics memory (330) and the video memory (340). In the present disclosure, the information regarding the image quality processing mode refers to information regarding the image quality processing mode of graphics and video determined by the image quality processing mode determination unit (350), and may include information regarding whether the mode is determined as a general mode or a graphic image quality priority mode. The operation of the image quality processing mode determination unit (350) to determine the image quality processing mode will be described in detail with reference to FIGS. 4A to 10.

[0095] When the graphic memory (330) receives information from the image quality processing mode determining unit (350) that the general mode has been determined, the graphic memory (330) can transmit graphic data to the graphic quality processing unit (360). When the graphic memory (330) receives information from the image quality processing mode determining unit (350) that the graphic quality priority mode has been determined, the graphic memory (330) can transmit graphic data to the video quality processing unit (370).

[0096] When the video memory (340) receives information from the image quality processing mode determining unit (350) that the mode has been determined as a general mode, the video memory (340) can transmit video data to the video quality processing unit (370). When the video memory (340) receives information from the image quality processing mode determining unit (350) that the mode has been determined as a graphic quality priority mode, the video memory (340) can transmit video data to the graphic quality processing unit (360).

[0097] The graphic quality processing unit (360) can, in normal mode, process graphics received from the graphic memory (330). In one embodiment of the present disclosure, the graphic quality processing unit (360) can receive graphics from the graphic memory (330) in units of one image frame.

[0098] In one embodiment of the present disclosure, graphic quality processing may include noise reduction, detail enhancement, contrast enhancement, block noise reduction, color control, etc. According to one embodiment of the present disclosure, the graphic quality processing unit (360) may include a scaler. The graphic quality processing unit (360) may scale the resolution of the graphic to match the resolution of the display (150) through the scaler. For example, the GPU (320) may generate a graphic with a lower resolution than the resolution of the display (150), and the graphic quality processing unit (360) may upscale the generated graphic to the resolution of the display (150). Meanwhile, if the GPU (320) generates a graphic to match the resolution of the display (150), the size of the graphic may not be additionally scaled. Meanwhile, the embodiment is not limited thereto, and the graphic quality processing unit (360) may perform various quality processing.

[0099] The video quality processing unit (370) can, in normal mode, process the quality of the video received from the video memory (340). In one embodiment of the present disclosure, the video quality processing unit (370) can receive the video from the video memory (340) in units of one image frame.

[0100] In one embodiment of the present disclosure, video quality processing may include noise reduction, detail enhancement, contrast enhancement, block noise reduction, color control, etc. In one embodiment of the present disclosure, the video quality processing unit (370) may include a scaler. The video quality processing unit (370) may scale the resolution of the video to match the resolution of the display (150) through the scaler. However, the present disclosure is not limited thereto. The video quality processing unit (370) may improve the quality of the video through various post-processing after decoding.

[0101] In the graphic quality priority mode, as opposed to the normal mode, the video quality processing unit (370) can quality-process the graphics received from the graphic memory (330). In the graphic quality priority mode, the graphic quality processing unit (360) can quality-process the video received from the video memory (340). That is, in the graphic quality priority mode, the input data of the video quality processing unit (370) and the graphic quality processing unit (360) can be exchanged with each other.

[0102] In one embodiment of the present invention, by processing graphics and video according to a quality processing mode, a high level of quality processing can be selectively applied to visually significant graphics and video, thereby providing images with improved quality within limited resources. The operation of determining a quality processing mode based on information regarding the graphic area will be described in detail with reference to FIGS. 4A to 5.

[0103] In normal mode, the graphic quality processing unit (360) can transfer the quality-processed graphics back to the graphic memory (330). In normal mode, the video quality processing unit (370) can transfer the quality-processed video back to the video memory (340).

[0104] In the graphic quality priority mode, the video quality processing unit (370) can transfer the quality-processed graphics back to the graphic memory (330). In the graphic quality priority mode, the graphic quality processing unit (360) can transfer the quality-processed video back to the video memory (340).

[0105] The mixer (380) can mix quality-processed graphics and quality-processed video. Quality-processed graphics output through the graphics memory (330) and quality-processed video output through the video memory (340) can be mixed and output to the screen through the display (150).

[0106] The synchronization signal generating unit (390) can generate a synchronization signal to synchronize the output of image quality-processed graphics and the output of image quality-processed video. The graphics memory (330) and the video memory (340) can simultaneously output image quality-processed graphics and image quality-processed video based on the synchronization signal. In other words, the synchronization signal generating unit (390) can synchronize the output of graphic data and the output of video data. Even if there is a speed difference between the image quality processing of video and the image quality processing of graphics, by synchronizing the video data and the graphic data output through the synchronization signal generating unit (390), it is possible to prevent the occurrence of a phenomenon in which the video is not displayed in an area where there is no graphic output or a phenomenon in which a part of the video is not displayed because it is covered by the graphic.

[0107] Hereinafter, with reference to FIG. 4a, an operation for performing quality processing of graphics and video based on information about the ratio at which the graphics are displayed will be described in detail.

[0108] FIG. 4a is a flowchart illustrating an operation method of a display device (1000) according to one embodiment of the present disclosure.

[0109] Referring to FIG. 4a, in operation 410, the display device (1000) can detect information about the ratio at which graphics are displayed in the display area based on graphic data.

[0110] In one embodiment of the present disclosure, the display device (1000) can obtain information about a graphic area, for example, an alpha blending value of each pixel, through a GPU (320, see FIG. 3). The display device (1000) can detect information about a graphic area, for example, an alpha blending value of each pixel, from graphic data. The alpha blending value is a coefficient indicating the transparency (or opacity) of each pixel of the generated graphic.

[0111] FIG. 4b is a diagram illustrating an alpha blending map (430) according to one embodiment of the present disclosure.

[0112] FIG. 4b schematically illustrates a pixel-by-pixel alpha blending map (430) indicating an alpha blending value of each pixel (440). The alpha blending map (430) may be an example of information regarding a graphic area that the image quality processing mode determining unit (350, see FIG. 3) obtains from the GPU (320, see FIG. 3). The mixer (380, see FIG. 3) may use the alpha blending map (430) to mix graphics and video using alpha blending. Alpha blending may be a technique for mixing graphics and video by adjusting the transparency of the graphics when overlaying the generated graphics on the video so that a portion of the video covered by the graphics is visible.

[0113] When overlaying generated graphics on a video, in an area where there is no graphics data and only video data, the alpha blending value of each pixel can be 0. In an area where the graphics data is displayed as 100% opaque and there is no video data, the alpha blending value of each pixel can be 1. In an area where the graphics are overlaid on a video and the video appears see-through because it is obscured by the graphics, the alpha blending value of each pixel can have a value greater than 0 and less than 1, and as the alpha blending value approaches 1, the transparency of the graphic can decrease.

[0114] In Fig. 4b, since no graphic data exists in an area where the alpha blending value is 0, it can be detected that this is an area where graphics are not displayed. In Fig. 4b, it can be detected that an area where graphics are displayed (450) is an area where the alpha blending value is x. (Here, x has a value greater than 0 and less than or equal to 1.) Therefore, information about the alpha blending value of each pixel can be detected as information about an area where graphics are displayed within the entire display area.

[0115] Referring back to FIG. 4A, the display device (1000) may detect information about the ratio at which graphics are displayed based on information about the graphic area (e.g., the alpha blending value of each pixel). In one embodiment of the present disclosure, the information about the ratio at which graphics are displayed may include the ratio of pixels on which graphs are displayed among the total pixels of the display. The ratio of pixels on which graphs are displayed may include both the ratio of pixels on which only graphs are displayed and the ratio of pixels on which graphics and video are mixed and displayed together. That is, the information about the ratio at which graphics are displayed may include the ratio of pixels on which an alpha blending value is greater than 0 among the total pixels of the display. In one embodiment of the present disclosure, the information about the ratio at which graphics are displayed may further include the degree of distribution of pixels on which graphics are displayed within the total display area on which images are displayed. That is, the information about the ratio at which graphics are displayed may further include the degree of distribution of pixels on which an alpha blending value is greater than 0.

[0116] In operation 420, based on information about the ratio at which the graphics are displayed, if the ratio at which the graphics are displayed is greater than or equal to a threshold value, the display device (1000) may operate in a video quality priority mode. If the ratio at which the graphics are displayed is greater than or equal to the threshold value, the display device (1000) may control the video quality processing unit (370, see FIG. 3) so that the video quality processing unit (370, see FIG. 3) processes the graphics. In one embodiment of the present disclosure, if the ratio at which the graphics are displayed is greater than or equal to the threshold value and the image includes video, the display device (1000) may control the graphic quality processing unit (360, see FIG. 3) so that the graphic quality processing unit (360, see FIG. 3) processes the video.

[0117] In operation 420, based on information about the ratio at which the graphics are displayed, if the ratio at which the graphics are displayed is lower than a threshold value, the display device (1000) may operate in a normal mode. If the ratio at which the graphics are displayed is lower than the threshold value, the display device (1000) may control the graphic quality processing unit (360, see FIG. 3) and the video quality processing unit (370, see FIG. 3) so that the graphic quality processing unit (360, see FIG. 3) processes the graphics and the video quality processing unit (370, see FIG. 3) processes the video.

[0118] In one embodiment of the present disclosure, the ratio at which graphics are displayed may correspond to the ratio of pixels having an alpha blending value of 1 among the pixels of the display (150, see FIG. 3). In this case, if the ratio of pixels having an alpha blending value of 1 is greater than or equal to a threshold value, the display may operate in a graphic quality priority mode, and if the ratio of pixels having an alpha blending value of 1 is lower than the threshold value, the display may operate in a general mode. However, the embodiment is not limited thereto, and even if the ratio of pixels having an alpha blending value of 1 is lower than the threshold value, the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 and / or the degree of distribution of pixels having an alpha blending value greater than 0 and less than or equal to 1 may be additionally taken into consideration to determine the quality processing mode. This will be described in detail with reference to FIG. 5.

[0119] When the display device (1000) operates in the graphic quality priority mode, the display device (1000) can convert graphic data that was input to the graphic quality processing unit (360, see FIG. 3) in the normal mode into input to the video quality processing unit (370, see FIG. 3). When the display device (1000) operates in the graphic quality priority mode, the display device (1000) can convert video data that was input to the video quality processing unit (370, see FIG. 3) in the normal mode into input to the graphic quality processing unit (360, see FIG. 3). That is, when the display device (1000) operates in the graphic quality priority mode, the display device (1000) can exchange transmission paths of graphic data and video data.

[0120] According to one embodiment of the present disclosure, the display device (1000) may perform image quality processing of graphics and video in one of a normal mode and a graphic image quality priority mode based on whether a ratio at which graphics are displayed exceeds a predetermined standard. The normal mode may be a mode that sets image quality processing of video as a priority over image quality processing of graphics, and the graphic image quality priority mode may be a mode that sets image quality processing of graphics as a priority over image quality processing of video. The video image quality processing unit may perform image quality processing at a higher level than the graphic image quality processing unit, and thus, in the normal mode, video may be image quality processed at a higher level than graphics, and in the graphic image quality processing priority mode, graphics may be image quality processed at a higher level than video.

[0121] Hereinafter, with reference to FIG. 5, a method for determining a quality processing mode by determining whether the ratio at which graphics are displayed exceeds a threshold will be described in detail.

[0122] FIG. 5 is a flowchart illustrating an example of a method for determining a picture quality processing mode in a display device (1000) according to one embodiment of the present disclosure.

[0123] Referring to FIG. 5, according to one embodiment of the present disclosure, operation 510 may be performed before operation 410. Since operation 410 of FIG. 5 corresponds to operation 410 of FIG. 4A, the description of operation 410 of FIG. 5 may be applied in the same manner as described with reference to FIG. 4A. In operation 510, the display device (1000) may detect whether the display device (1000) is running in an operation mode in which graphics can be displayed on an image. For example, when the operation mode of the display device (1000) is an on-screen display (OSD) mode, the display device (1000) may determine that the display device (1000) is running in an operation mode in which graphics can be displayed. For example, if the operating mode of the display device (1000) is application mode, the display device (1000) may determine that video will be displayed throughout the image and no graphics will be displayed while no user input is received to adjust screen settings while the application is running. For example, the display device (1000) may, in application mode, display content received through a web page, broadcast channel, or OTT (Over The Top) service.

[0124] In operation 510, if the display device (1000) is identified as being run in an operation mode in which graphics can be displayed, the display device (1000) may proceed to operation 520 to process the video in a general mode. For example, if the display device (1000) is identified as being run in an operation mode in which only video is displayed and no graphics are displayed, the display device (1000) may process the video in a quality manner through a video quality processing unit (370, see FIG. 3) and output the processed video to the display (150, see FIG. 3).

[0125] In operation 510, if it is determined that graphics are to be displayed based on the operating mode of the display device (1000), the display device (1000) may proceed to operation 410 to detect information regarding the ratio at which graphics are displayed in the image based on the graphic data. In one embodiment of the present disclosure, the operation of detecting information regarding the ratio at which graphics are displayed may be performed only when the display device (1000) is running in an operating mode in which graphics can be displayed. The description of operation 410 may be equally applicable to the description made with reference to FIG. 4A.

[0126] The display device (1000) can determine which mode among the general mode and the graphic quality priority mode to perform quality processing in based on information about the ratio at which the graphics detected through operation 410 are displayed.

[0127] First, in operation 530, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) can identify whether the ratio of pixels having an alpha blending value of 1 among all pixels is greater than or equal to a first threshold value. In other words, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) can identify whether the ratio of pixels on which only graphics are displayed and no video is displayed among the pixels is greater than or equal to the first threshold value.

[0128] In operation 530, if it is identified that the proportion of pixels having an alpha blending value of 1 is greater than or equal to a first threshold value, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) may perform operation 540 to process the image quality of graphics and video in a graphic image quality priority mode. The proportion of pixels having an alpha blending value of 1 being greater than or equal to the first threshold value may include a case where the proportion of pixels having an alpha blending value of 1 is 100%, i.e., only graphics are displayed in the entire display area.

[0129] In operation 530, if it is identified that the proportion of pixels having an alpha blending value of 1 is less than the first threshold value, the display device (1000) (or the image quality processing mode determination unit (350, see FIG. 3)) may perform operation 550 to determine whether the proportion of pixels having an alpha blending value greater than 0 and less than or equal to 1 among all pixels is greater than or equal to the second threshold value. In other words, the display device (1000) (or the image quality processing mode determination unit (350, see FIG. 3)) may determine whether the proportion of pixels in which graphics and video are mixed and displayed together among the pixels is greater than or equal to the second threshold value. The second threshold value may be higher than the first threshold value.

[0130] In operation 550, if it is identified that the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 is greater than or equal to the second threshold value, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) may perform operation 560 to determine the image quality processing mode as the graphic image quality priority mode.

[0131] In operation 550, if it is identified that the proportion of pixels having an alpha blending value greater than 0 and less than or equal to 1 is less than the second threshold value, the display device (1000) (or the image quality processing mode determination unit (350, see FIG. 3)) may perform operation 570 to determine whether pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed. In other words, the display device (1000) (or the image quality processing mode determination unit (350, see FIG. 3)) may determine whether the distribution of pixels on which graphics are displayed among the pixels is widespread or localized. As an example, the degree of distribution of pixels having an alpha blending value greater than 0 and less than or equal to 1 may be determined based on whether all pixels having an alpha blending value greater than 0 and less than or equal to 1 are located within a predetermined area of ​​the entire display area. If all pixels having an alpha blending value greater than 0 and less than or equal to 1 are located within the area of ​​the predetermined area, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) can determine that the graphic is displayed locally. If the pixels having an alpha blending value greater than 0 and less than or equal to 1 are not located only within the area of ​​the predetermined area but are distributed across multiple areas, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) can determine that the graphic is displayed widely.

[0132] In operation 570, if it is identified that pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed, the display device (1000) (or the image quality processing mode determining unit (350, see FIG. 3)) may perform operation 580 to determine the image quality processing mode as a graphic image quality priority mode.

[0133] In operation 570, if it is identified that pixels having an alpha blending value greater than 0 and less than or equal to 1 are not widely distributed (or are locally distributed), the display device (1000) (or the image quality processing mode determination unit (350, see FIG. 3)) may perform operation 580 to determine the image quality processing mode as a general mode.

[0134] According to one embodiment of the present disclosure, when the display device (1000) determines that the graphic (701) has a higher visual weight than the video (702) in a ratio of the graphic (701) to the image to be displayed, the display device (1000) may prioritize the image quality of the graphic (701) over the image quality of the video (702) if the graphic (701) is viewed as having a higher visual weight than the video (702). According to one embodiment of the present disclosure, the video image quality processing unit (760) may be implemented with higher specifications than the graphic image quality processing unit (750). Accordingly, when the priority of the graphic (701) is high, the display device (1000) may process the image quality of the graphic (701) with a higher priority through the high-spec video image quality processing unit (750), thereby providing a graphic (701) with a higher image quality within limited resources.

[0135] Hereinafter, with reference to FIGS. 6 to 10, various examples of determining a quality processing mode based on information about the ratio at which graphics are displayed are described.

[0136] FIG. 6 is a diagram illustrating an example of a display device (1000) according to one embodiment of the present disclosure determining a quality processing mode and processing graphics according to the determined quality processing mode. Hereinafter, the operation of the display device (1000) will be described with reference to FIGS. 5 and 6 together.

[0137] In one embodiment of the present disclosure, the image quality processing mode determination unit (620) may determine the image quality processing mode based on information regarding the graphic area received from the GPU (610). For example, the image quality processing mode determination unit (620) may detect information regarding the ratio at which the graphic (610) is displayed based on the alpha blending value of each pixel received from the GPU (610), and may determine the image quality processing mode based on the information regarding the ratio at which the detected graphic (610) is displayed.

[0138] The image quality processing mode determination unit (620) can detect 'information on the proportion of pixels with an alpha blending value of 1' based on the alpha blending value of each pixel received from the GPU (610). For example, the image quality processing mode determination unit (620) can detect that 'the proportion of pixels with an alpha blending value of 1 is 100%'.

[0139] The image quality processing mode determination unit (620) can identify whether the ratio of pixels having an alpha blending value of 1, which is operation 530 of FIG. 5, is greater than or equal to a first threshold based on the detected 'information on the ratio of pixels having an alpha blending value of 1'. For example, the first threshold may be 50%. The image quality processing mode determination unit (620) can identify that the ratio of pixels having an alpha blending value of 1 is greater than or equal to the first threshold. Accordingly, the image quality processing mode determination unit (620) can perform operation 540 of FIG. 5 to determine the image quality processing mode as a graphic image quality priority mode. Meanwhile, the first threshold is set as an example and is not limited thereto.

[0140] When the image quality processing mode is determined as the graphic quality priority mode, the display device (1000) can transmit graphic data from the graphic memory (630) to the video quality processing unit (640). The display device (1000) can convert the graphic data into an input of the video quality processing unit (640). When the graphic memory (630) receives a signal identified as the graphic quality priority mode from the image quality processing mode determination unit (620), it can transmit the stored graphic data (630) to the video quality processing unit (640).

[0141] The display device (1000) can process the graphics (601) through the video quality processing unit (620). For example, the graphics (601) can be upscaled through the video quality processing unit (620). The display device (1000) can store the processed graphics (601) in the graphics memory (630).

[0142] Meanwhile, the fact that the proportion of pixels with an alpha blending value of 1 is 100% means that only graphics (601) are displayed in the entire display area. The quality-processed graphics (601) can be output to the display (150) without undergoing mixing processing with the video.

[0143] FIG. 7 is a diagram illustrating an example of a display device (1000) according to one embodiment of the present disclosure determining a quality processing mode and processing graphics and video according to the determined quality processing mode. Hereinafter, the operation of the display device (1000) will be described with reference to FIG. 5 and FIG. 7 together.

[0144] In one embodiment of the present disclosure, the image quality processing mode determination unit (720) may determine the image quality processing mode based on information about the graphic area received from the GPU (710). For example, the image quality processing mode determination unit (720) may detect information about the ratio at which the graphic (701) is displayed based on the alpha blending value of each pixel received from the GPU (710), and may determine the image quality processing mode based on the information about the ratio at which the detected graphic (701) is displayed.

[0145] The image quality processing mode determination unit (720) can detect 'information on the proportion of pixels with an alpha blending value of 1' based on the alpha blending value of each pixel received from the GPU (710). For example, the image quality processing mode determination unit (720) can detect that 'the proportion of pixels with an alpha blending value of 1 is 70%.'

[0146] The image quality processing mode determination unit (720) can identify whether the ratio of pixels having an alpha blending value of 1, which is operation 530 of FIG. 5, is greater than or equal to a first threshold based on the detected 'information on the ratio of pixels having an alpha blending value of 1'. For example, the first threshold may be 50%. The image quality processing mode determination unit (720) can identify that the ratio of pixels having an alpha blending value of 1 is greater than or equal to the first threshold. Accordingly, the image quality processing mode determination unit (720) can perform operation 540 of FIG. 5 to determine the image quality processing mode as a graphic image quality priority mode. Meanwhile, the first threshold is set as an example and is not limited thereto.

[0147] When the graphic quality priority mode is determined, the display device (1000) can transmit graphic data from the graphic memory (730) to the video quality processing unit (750). The display device (1000) can convert the graphic data into an input of the video quality processing unit (750). When the graphic memory (730) receives a signal identified as the graphic quality priority mode from the quality processing mode determination unit (720), it can transmit the stored graphic data to the video quality processing unit (750).

[0148] When the image quality processing mode is determined to be the graphic quality priority mode, the display device (1000) can transmit video data from the video memory (740) to the graphic quality processing unit (760). The display device (1000) can convert the video data into an input of the graphic quality processing unit (760). When the video memory (740) receives a signal identified as the graphic quality priority mode from the image quality processing mode determination unit (720), it can transmit the stored video data to the graphic quality processing unit (760).

[0149] The display device (1000) can process graphics (701) through a video quality processing unit (750). In one embodiment of the present disclosure, graphics (701) can be upscaled through the video quality processing unit (750). The display device (1000) can store graphics (701) processed through the video quality processing unit (750) in the graphics memory (730).

[0150] The display device (1000) can process the quality of video (702) through the graphic quality processing unit (760). The display device (1000) can store the video (702) processed through the graphic quality processing unit (760) in the video memory (740).

[0151] The display device (1000) can mix the image quality-processed graphics (701) and the image quality-processed video (702) through the mixer (770) and output a frame image (703) in which the image quality-processed graphics (701) and the image quality-processed video (702) are mixed on the screen through the display (150). In one embodiment of the present disclosure, the display device (1000) can simultaneously output the image quality-processed graphics (701) and the image quality-processed video (702) based on a synchronization signal.

[0152] FIG. 8 is a diagram illustrating an example of a display device (1000) according to one embodiment of the present disclosure determining a quality processing mode and processing graphics and video according to the determined quality processing mode. Hereinafter, the operation of the display device (1000) will be described with reference to FIG. 5 and FIG. 8 together.

[0153] In one embodiment of the present disclosure, the image quality processing mode determination unit (820) may determine the image quality processing mode based on information about the graphic area received from the GPU (810). For example, the image quality processing mode determination unit (820) may detect information about the ratio at which the graphic (801) is displayed based on the alpha blending value of each pixel received from the GPU (810), and may determine the image quality processing mode based on the information about the ratio at which the detected graphic (801) is displayed.

[0154] The image quality processing mode determination unit (820) can detect 'information on the proportion of pixels with an alpha blending value of 1' based on the alpha blending value of each pixel received from the GPU (810). For example, the image quality processing mode determination unit (820) can detect that 'the proportion of pixels with an alpha blending value of 1 is 0%'.

[0155] The image quality processing mode determination unit (820) can identify whether the proportion of pixels having an alpha blending value of 1, which is operation 530 of FIG. 5, is greater than or equal to a first threshold based on the detected 'information on the proportion of pixels having an alpha blending value of 1'. For example, the first threshold may be 50%. The image quality processing mode determination unit (820) can identify that the proportion of pixels having an alpha blending value of 1 is not greater than or equal to the first threshold. Accordingly, the image quality processing mode determination unit (820) can perform operation 550 of FIG. 5. Meanwhile, the first threshold is set as an example and is not limited thereto.

[0156] The image quality processing mode determination unit (820) can detect 'information on the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1' based on the alpha blending value of each pixel received from the GPU (810). For example, the image quality processing mode determination unit (820) can detect that 'the ratio of pixels having an alpha blending value of 0.7 is 75%.'

[0157] The image quality processing mode determination unit (820) can identify whether the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 is greater than or equal to a second threshold value based on the detected 'information on the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1', which is operation 550 of FIG. 5. The second threshold value may be higher than the first threshold value. For example, the second threshold value may be 70%. The image quality processing mode determination unit (820) can identify that the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 is greater than or equal to the second threshold value. Accordingly, the image quality processing mode determination unit (820) can determine the image quality processing mode to be a graphic image quality priority mode by performing operation 560 of FIG. 5. Meanwhile, the second threshold value is set as an example and is not limited thereto.

[0158] When the image quality processing mode is determined as the graphic image quality priority mode, the display device (1000) can transmit graphic data from the graphic memory (830) to the video image quality processing unit (850) and transmit video data from the video memory (840) to the graphic image quality processing unit (860).

[0159] The display device (1000) can process the quality of the graphics (801) through the video quality processing unit (850). In one embodiment of the present disclosure, the graphics (801) can be upscaled through the video quality processing unit (850). The display device (1000) can store the graphics (801) that have been processed through the video quality processing unit (850) in the graphics memory (830). The display device (1000) can process the quality of the video (802) through the graphics quality processing unit (860). The display device (1000) can store the video (802) that has been processed through the graphics quality processing unit (860) in the video memory (840).

[0160] The display device (1000) can mix the image quality-processed graphics (801) and the image quality-processed video (802) through the mixer (870) and output a frame image (803) in which the image quality-processed graphics (801) and the image quality-processed video (802) are mixed on the screen through the display (150). In one embodiment of the present disclosure, the display device (1000) can simultaneously output the image quality-processed graphics (801) and the image quality-processed video (802) based on a synchronization signal.

[0161] FIG. 9 is a diagram illustrating an example of a display device (1000) according to one embodiment of the present disclosure determining a quality processing mode and processing graphics and video according to the determined quality processing mode. Hereinafter, the operation of the display device (1000) will be described with reference to FIG. 5 and FIG. 9 together.

[0162] In one embodiment of the present disclosure, the image quality processing mode determination unit (920) may determine the image quality processing mode based on information about the graphic area received from the GPU (910). For example, the image quality processing mode determination unit (920) may detect information about the ratio at which the graphic (901) is displayed based on the alpha blending value of each pixel received from the GPU (910), and may determine the image quality processing mode based on the information about the ratio at which the detected graphic (901) is displayed.

[0163] The image quality processing mode determination unit (920) can detect 'information on the proportion of pixels with an alpha blending value of 1' based on the alpha blending value of each pixel received from the GPU (910). For example, the image quality processing mode determination unit (920) can detect that 'the proportion of pixels with an alpha blending value of 1 is 0%'.

[0164] The image quality processing mode determination unit (920) can identify whether the proportion of pixels having an alpha blending value of 1, which is operation 530 of FIG. 5, is greater than or equal to a first threshold based on the detected 'information on the proportion of pixels having an alpha blending value of 1'. For example, the first threshold may be 50%. The image quality processing mode determination unit (920) can identify that the proportion of pixels having an alpha blending value of 1 is not greater than or equal to the first threshold. Accordingly, the image quality processing mode determination unit (920) can perform operation 550 of FIG. 5. Meanwhile, the first threshold is set as an example and is not limited thereto.

[0165] The image quality processing mode determination unit (920) can detect 'information on the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1' based on the alpha blending value of each pixel received from the GPU (910). For example, the image quality processing mode determination unit (920) can detect that 'the ratio of pixels having an alpha blending value of 0.7 is 50%'.

[0166] The image quality processing mode determination unit (920) can identify whether the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 is greater than or equal to a second threshold value based on the detected 'information on the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1', which is operation 550 of FIG. 5. The second threshold value may be higher than the first threshold value. For example, the second threshold value may be 70%. The image quality processing mode determination unit (920) can identify that the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1 is not greater than or equal to the second threshold value. Accordingly, the image quality processing mode determination unit (920) can perform operation 570 of FIG. 5. Meanwhile, the second threshold value is set as an example and is not limited thereto.

[0167] The image quality processing mode determination unit (920) can detect 'information on the degree of distribution of pixels having an alpha blending value greater than 0 and less than or equal to 1' based on the alpha blending value of each pixel received from the GPU (910). For example, the image quality processing mode determination unit (920) can detect that 'pixels having an alpha blending value of 0.7 are distributed and located in an area of ​​10% of the display area, an area of ​​15% of the display area, and an area of ​​25% of the display area'.

[0168] The image quality processing mode determination unit (820) can identify whether pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed based on the detected 'information on the degree of distribution of pixels having an alpha blending value greater than 0 and less than or equal to 1', which is operation 570 of FIG. 5. For example, whether pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed can be determined based on whether all pixels are arranged within an area of ​​a predetermined area among the entire display area. For example, the predetermined area may be preset according to the ratio of pixels having an alpha blending value greater than 0 and less than or equal to 1. In FIG. 9, when the proportion of pixels having an alpha blending value greater than 0 and less than or equal to 1 is 50%, the predetermined area is set to 50% of the display area as an example. For example, the image quality processing mode determining unit (920) can identify that pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed, since pixels having an alpha blending value greater than 0 and less than or equal to 1 are not located only within a 50% area but are distributed. Accordingly, the image quality processing mode determining unit (920) can determine the image quality processing mode to be a graphic image quality priority mode by performing operation 580 of FIG. 5.

[0169] When the image quality processing mode is determined as the graphic image quality priority mode, the display device (1000) can transmit graphic data from the graphic memory (930) to the video image quality processing unit (950) and transmit video data from the video memory (940) to the graphic image quality processing unit (960).

[0170] The display device (1000) can process graphics (901) through a video quality processing unit (950). In one embodiment of the present disclosure, graphics (901) can be upscaled through the video quality processing unit (950). The display device (1000) can store graphics (901) that have been processed through the video quality processing unit (950) in the graphics memory (830). The display device (1000) can process graphics (902) through a graphic quality processing unit (960). The display device (1000) can store video (902) that has been processed through the graphic quality processing unit (960) in the video memory (940).

[0171] The display device (1000) can mix the image quality-processed graphics (901) and the image quality-processed video (902) through the mixer (970) and output a frame image (903) in which the image quality-processed graphics (901) and the image quality-processed video (902) are mixed on the screen through the display (150). In one embodiment of the present disclosure, the display device (1000) can simultaneously output the image quality-processed graphics (901) and the image quality-processed video (902) based on a synchronization signal.

[0172] FIG. 10 is a diagram illustrating an example of a display device (1000) according to one embodiment of the present disclosure determining a quality processing mode and processing graphics and video according to the determined quality processing mode. Hereinafter, the operation of the display device (1000) will be described with reference to FIG. 5 and FIG. 10 together.

[0173] In one embodiment of the present disclosure, the image quality processing mode determination unit (1020) may determine the image quality processing mode based on information about the graphic area received from the GPU (1010). For example, the image quality processing mode determination unit (1020) may detect information about the ratio at which the graphic (1001) is displayed based on the alpha blending value of each pixel received from the GPU (1010), and may determine the image quality processing mode based on the information about the ratio at which the detected graphic (1001) is displayed.

[0174] Meanwhile, in the embodiment illustrated in FIG. 10, the fact that the image quality processing mode determination unit (1020) detected that 'the proportion of pixels with an alpha blending value of 1 is 0% and the proportion of pixels with an alpha blending value of 0.7 is 50%' is the same as the embodiment illustrated in FIG. 9, so that the image quality processing mode determination unit (1020) performing operations 530 and 550 of FIG. 5 can be applied in the same manner as described with reference to FIG. 9. The image quality processing mode determination unit (1020) can perform operation 570 of FIG. 5 by identifying that the proportion of pixels with an alpha blending value greater than 0 and less than or equal to 1 in operation 550 of FIG. 5 does not correspond to a second threshold value or more.

[0175] The image quality processing mode determination unit (1020) can detect information about the 'distribution degree of pixels having an alpha blending value greater than 0 and less than or equal to 1' based on the alpha blending value of each pixel received from the GPU (810). For example, the image quality processing mode determination unit (1020) can detect that 'pixels having an alpha blending value of 0.7 are all located within an area of ​​50% of the display area'.

[0176] The image quality processing mode determination unit (1020) can identify whether pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed, based on information about the degree of distribution of pixels having a detected alpha blending value greater than 0 and less than or equal to 1, which is operation 570 of FIG. 5.

[0177] In one embodiment of the present disclosure, whether pixels having an alpha blending value greater than 0 and less than or equal to 1 are widely distributed can be determined based on whether the pixels are all arranged within a predetermined area of ​​the entire display area. In FIG. 10, when the pixels having an alpha blending value greater than 0 and less than or equal to 1 account for 50%, the predetermined area is set to 50% of the display area. For example, the image quality processing mode determination unit (1020) can identify that the pixels having an alpha blending value greater than 0 and less than or equal to 1 are not widely distributed but locally distributed because all pixels having an alpha blending value greater than 0 and less than or equal to 1 are located within a 50% area. Accordingly, the image quality processing mode determination unit (1020) can perform operation 590 of FIG. 5 to determine the image quality processing mode to be a general mode.

[0178] When the image quality processing mode is determined to be the general mode, the display device (1000) can transmit graphic data from the graphic memory (1030) to the graphic quality processing unit (1050) and transmit video data from the video memory (1040) to the video quality processing unit (1060).

[0179] The display device (1000) can process the quality of graphics (1001) through a graphics quality processing unit (1050). In one embodiment of the present disclosure, graphics (1001) can be upscaled through the graphics quality processing unit (1050). The display device (1000) can store graphics (1001) that have been quality-processed through the graphics quality processing unit (1050) in the graphics memory (1030). The display device (1000) can process the quality of video (1002) through a video quality processing unit (1060). The display device (1000) can store video (1002) that has been quality-processed through the video quality processing unit (1060) in the video memory (1040).

[0180] The display device (1000) can mix the image quality-processed graphics (1001) and the image quality-processed video (1002) through the mixer (1070) and output a frame image (1003) in which the image quality-processed graphics (1001) and the image quality-processed video (1002) are mixed on the screen through the display (150). In one embodiment of the present disclosure, the display device (1000) can simultaneously output the image quality-processed graphics (1001) and the image quality-processed video (1002) based on a synchronization signal.

[0181] FIG. 11 is a diagram for explaining the operation of a display device (1000) according to one embodiment of the present disclosure. In FIG. 11, among the components of the image processing unit (140), only the components for explaining the operation of the display device (1000) according to one embodiment of the present disclosure are illustrated.

[0182] Graphic data may include a video signal expressed in RGB format. In this disclosure, a video signal expressed in RGB format is referred to as an RGB video signal. An RGB video signal refers to a video signal expressed in the three primary colors of light, Red, Green, and Blue. Graphic data may include pixel values ​​expressed in RGB format for each pixel. An RGB video signal may be expressed as (R, G, B), where R, G, and B represent red data, green data, and blue data, respectively. For example, if each data is expressed in 8 bits, red, green, and blue each have one of 256 levels. Red, green, and blue expressed in their respective levels can be mixed to express a color. For example, if RGB data is (255, 255, 255), it represents white, and if RGB data is (0, 0, 0), it represents black.

[0183] Video data may include a video signal expressed in YUV format. In this disclosure, a video signal expressed in YUV format is referred to as a YUV video signal. A YUV video signal refers to a video signal expressed with luminance (Y) representing horizontal and vertical synchronization signals and color signals (U, V). YUV may also be expressed as YCbCr. Here, Y represents luma (black and white, i.e. brightness), U (Cb) and V (Cr) represent chroma (color), U (Cb) represents the red component in brightness, and V (Cr) represents the blue component in brightness.

[0184] In one embodiment of the present disclosure, the graphic quality processing unit (1130) can perform quality processing on an image signal expressed in RGB format corresponding to the data format of the graphic. When the quality processing mode is determined to be a general mode, graphic data expressed in RGB format can be output from the graphic memory (1110) and input to the graphic quality processing unit (1130). On the other hand, when the quality processing mode is determined to be a graphic quality priority mode, input data of the video quality processing unit (1140) and the graphic quality processing unit (1130) can be exchanged with each other, so that video data can be input to the graphic quality processing unit (1130). In one embodiment of the present disclosure, the image processing unit (140) converts the data format of the video data output from the video memory (1120) through the first converter (1150) and transmits the converted video data to the graphic quality processing unit (1130). For example, video data expressed in YUV format can be converted to RGB format through the first converter (1150), and the video data expressed in RGB format can be transmitted to the graphic quality processing unit (1130).

[0185] The first converter (1150) can convert video data expressed in YUV format into RGB format using the first color conversion matrix as shown in Mathematical Expression 1 below.

[0186] [Mathematical Formula 1]

[0187] [Y] = [a1 b1 c1][R-α]

[0188] [U] = [d1 e1 f1][G-β]

[0189] [V] = [g1 h1 i1][B-γ]

[0190] In mathematical expression 1, R, G, and B represent the respective color signal levels of the RGB image signal, and Y, U, and V represent the respective signal levels of the YUV image signal. In addition, a1, b1, c1, d1, e1, f1, g1, h1, i1 and α, β, and γ represent arbitrary constants. In mathematical expression 1, by setting the values ​​of a1, b1, c1, d1, e1, f1, g1, h1, i1 and α, β, and γ to appropriate values, the Y, U, and V values ​​can be calculated.

[0191] In one embodiment of the present disclosure, the video quality processing unit (1140) can perform quality processing on a video signal expressed in YUV format corresponding to the data format of the video. When the quality processing mode is determined to be a general mode, video data expressed in YUV format can be output from the video memory (1120) and input to the video quality processing unit (1140). On the other hand, when the quality processing mode is determined to be a graphic quality priority mode, input data of the video quality processing unit (1140) and the graphic quality processing unit (1130) can be exchanged with each other, so that graphic data can be input to the video quality processing unit (1140). In one embodiment of the present disclosure, the video processing unit (140) can convert the data format of graphic data output from the graphic memory (1110) through a second converter (1160) and transmit the converted graphic data to the video quality processing unit (1140). For example, in one embodiment of the present disclosure, the image processing unit (140) may convert graphic data expressed in RGB format to be expressed in YUV format through the second converter (1160), and transmit the graphic data expressed in YUV format to the video quality processing unit (1140).

[0192] The second converter (1160) can convert graphic data expressed in RGB format into YUV format using a second color conversion matrix as shown in Mathematical Formula 2 below.

[0193] [Equation 2]

[0194] [R] = [a2 b2 c2][Yx]

[0195] [G] = [d2 e2 f2][Uy]

[0196] [B] = [g2 h2 i2][Vz]

[0197] In mathematical expression 2, R, G, and B represent the respective color signal levels of the RGB image signal, and Y, U, and V represent the respective signal levels of the YUV image signal. In addition, a2, b2, c2, d2, e2, f2, g2, h2, i2, and x, y, and z represent arbitrary constants. In mathematical expression 2, by setting the values ​​of a2, b2, c2, d2, e2, f2, g2, h2, i2, and x, y, and z to appropriate values, the R, G, and B values ​​can be calculated.

[0198] FIG. 12 is a block diagram of a video quality processing unit (1210) according to one embodiment of the present disclosure.

[0199] Referring to FIG. 12, a video quality processing unit (1210) according to one embodiment of the present disclosure may include an AI video quality processing model (1220) and an AI graphic quality processing model (1230). In the present disclosure, the AI ​​video quality processing model (1220) may be referred to as a first artificial intelligence model, and the AI ​​graphic quality processing model (1230) may be referred to as a second artificial intelligence model.

[0200] In one embodiment of the present disclosure, if the ratio at which graphics are displayed does not exceed a threshold (or, in normal mode), the display device (1000) can control the video quality processing unit (1210) to process the video. In normal mode, the video quality processing unit (1210) can process the input video through an AI video quality processing model (1220).

[0201] The video quality processing unit (1210) can apply appropriate quality processing according to the type of video through the AI ​​video quality processing model (1220). That is, the AI ​​video quality processing model (1220) may be an artificial intelligence model trained to receive an input video and output a quality-processed video with optimal quality (e.g., clear image). For example, if the video corresponds to content received through a broadcast channel, the video quality processing unit (1210) can apply appropriate quality processing according to the channel information of the video through the AI ​​video quality processing model (1220). For example, the video may be provided through various input paths, such as being received from a broadcast channel, a USB (Universal Serial Bus), an HDMI (High Definition Multimedia Interface), or an external playback device or set-top box through a component. In this case, the video quality processing unit (1210) can apply appropriate quality processing according to the input path of the video through the AI ​​video quality processing model (1220). For example, the video quality processing unit (1210) can apply appropriate quality processing according to the type of content provided by the video (e.g., movie, sports video, game screen, etc.) through the AI ​​video quality processing model (1220).

[0202] In one embodiment of the present disclosure, when the ratio at which graphics are displayed exceeds a threshold (or, in the graphic quality priority mode), the display device (1000) can control the video quality processing unit (1210) to process the graphics. In the graphic quality priority mode, the video quality processing unit (1210) can process the graphics received through the AI ​​graphic quality processing model (1230).

[0203] The video quality processing unit (1210) can apply appropriate quality processing according to the type of graphic through the AI ​​graphic quality processing model (1230). That is, the AI ​​graphic quality processing model (1230) may be an artificial intelligence model trained to input generated graphics and output quality-processed graphics with optimal quality (e.g., clear images). For example, the video quality processing unit (1210) can apply appropriate quality processing according to the type of image provided by the graphic through the AI ​​graphic quality processing model (1230) (e.g., screen setting menu screen, game screen provided on TV, etc.). For example, the video quality processing unit (1210) can perform upscaling of the graphic using Super Resolution (SR) imaging technology through the AI ​​graphic quality processing model (1230).

[0204] Meanwhile, if both the video quality processing unit and the graphic quality processing unit process quality using an artificial intelligence model, both the video and the graphic quality can be provided with a high level of quality, but problems such as increased chip size, increased cost, power consumption, and increased heat generation may occur. On the other hand, according to one embodiment of the present disclosure, since a high level of quality processing can be selectively applied to the visually significant part of the graphics and the video, it is possible to provide an image with improved quality within limited resources without causing problems such as increased chip size, increased cost, power consumption, and increased heat generation.

[0205] A display device according to one embodiment of the present disclosure can detect information about a ratio at which graphics are displayed in an image based on graphic data by individually or collectively executing the plurality of instructions by the at least one processor.

[0206] A display device according to one embodiment of the present disclosure can control the video quality processing unit to process the graphic based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is equal to or greater than a first threshold value, by individually or collectively executing the plurality of instructions by the at least one processor.

[0207] According to one embodiment of the present disclosure, a display device can control the graphic quality processing unit and the video quality processing unit to process the graphic and the video quality processing unit to process the video based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than the first threshold value, by individually or collectively executing the plurality of instructions by the at least one processor.

[0208] A display device according to one embodiment of the present disclosure can control the graphic quality processing unit to process the video when the ratio at which the graphics are displayed is greater than or equal to the first threshold value and the image includes the video, by individually or collectively executing the plurality of instructions by the at least one processor.

[0209] A display device according to one embodiment of the present disclosure can detect whether the display device is running in an operation mode in which the graphics can be displayed by individually or collectively executing the plurality of instructions by at least one processor. A display device according to one embodiment of the present disclosure can detect information about a ratio at which the graphics are displayed when the display device is running in an operation mode in which the graphics can be displayed by individually or collectively executing the plurality of instructions by at least one processor.

[0210] Information about the ratio at which the graphic is displayed according to one embodiment of the present disclosure may include the ratio of pixels having an alpha blending value greater than 0 among the pixels of the display.

[0211] The ratio at which the graphic is displayed according to one embodiment of the present disclosure may correspond to the ratio of pixels having the alpha blending value of 1 among the pixels of the display.

[0212] According to one embodiment of the present disclosure, a display device may control the video quality processing unit and the graphic quality processing unit so that the video quality processing unit processes the graphic and the graphic quality processing unit processes the video, based on information about a ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than the first threshold but the ratio of pixels having the alpha blending value greater than 0 and less than or equal to 1 among pixels of the display is equal to or greater than a second threshold higher than the first threshold, by individually or collectively executing the plurality of instructions by the at least one processor.

[0213] Information about the ratio at which the graphic is displayed according to one embodiment of the present disclosure may further include the degree of distribution of pixels having an alpha blending value greater than 0.

[0214] According to one embodiment of the present disclosure, a display device may control the video quality processing unit to process the graphic when the ratio at which the graphic is displayed is less than or equal to the first threshold value and pixels having the alpha blending value greater than 0 are widely distributed, based on information about the ratio at which the graphic is displayed, by individually or collectively executing the plurality of instructions by the at least one processor.

[0215] A display device according to one embodiment of the present disclosure may control the video quality processing unit to process the video through a first artificial intelligence model when the ratio at which the graphics are displayed is lower than the first threshold value by individually or collectively executing the plurality of instructions by the at least one processor.

[0216] A display device according to one embodiment of the present disclosure can control the video quality processing unit to process the graphics through a second artificial intelligence model when the ratio at which the graphics are displayed is greater than or equal to the first threshold value, by individually or collectively executing the plurality of instructions by the at least one processor.

[0217] A display device according to one embodiment of the present disclosure can convert the graphic expressed in RGB format to be expressed in YUV format when the ratio at which the graphic is displayed is greater than or equal to the first threshold value by individually or collectively executing the plurality of instructions by the at least one processor.

[0218] A display device according to one embodiment of the present disclosure can transmit the graphics expressed in YUV format to the video quality processing unit by individually or collectively executing the plurality of instructions by the at least one processor.

[0219] A display device according to one embodiment of the present disclosure can convert the video expressed in YUV format to be expressed in RGB format when the ratio at which the graphics are displayed is greater than or equal to the first threshold value by individually or collectively executing the plurality of instructions by the at least one processor.

[0220] A display device according to one embodiment of the present disclosure can transmit the video expressed in RGB format to the graphic quality processing unit by individually or collectively executing the plurality of instructions by the at least one processor.

[0221] A method of operating a display device according to one embodiment of the present disclosure may include an operation of detecting information regarding a ratio at which graphics are displayed in an image based on graphic data.

[0222] A method of operating a display device according to one embodiment of the present disclosure may include an operation of controlling a video quality processing unit to process the graphic when the ratio at which the graphic is displayed is greater than or equal to a first threshold value, based on information about the ratio at which the graphic is displayed.

[0223] A method of operating a display device according to one embodiment of the present disclosure may include controlling the graphic quality processing unit and the video quality processing unit so that the graphic quality processing unit processes the graphic and the video quality processing unit processes the video, based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than a first threshold value.

[0224] A method of operating a display device according to one embodiment of the present disclosure may further include an operation of controlling the graphic quality processing unit to process the video when the ratio at which the graphic is displayed is greater than or equal to the first threshold value and the image includes the video.

[0225] A method of operating a display device according to one embodiment of the present disclosure may include an operation of detecting whether the display device is running in an operating mode in which the graphics can be displayed.

[0226] In a method of operating a display device according to one embodiment of the present disclosure, the operation of detecting information regarding the ratio at which the graphic is displayed can be performed when the display device is running in an operation mode in which the graphic can be displayed.

[0227] In a method of operating a display device according to one embodiment of the present disclosure, information about the proportion occupied by the graphic may include the proportion occupied by pixels having an alpha blending value greater than 0 among pixels of the display.

[0228] In a method of operating a display device according to one embodiment of the present disclosure, the ratio at which the graphic is displayed may correspond to the ratio of pixels having an alpha blending value of 1 among the pixels of the display.

[0229] The operating method of the display device according to one embodiment of the present disclosure may further include, based on information about the ratio at which the graphic is displayed, controlling the video quality processing unit and the graphic quality processing unit so that the video quality processing unit processes the graphic and the graphic quality processing unit processes the video, when the ratio at which the graphic is displayed is lower than the first threshold but the ratio of pixels having the alpha blending value greater than 0 and less than or equal to 1 among the pixels of the display is equal to or greater than a second threshold higher than the first threshold.

[0230] In a method of operating a display device according to one embodiment of the present disclosure, information regarding a ratio at which the graphic is displayed may further include a degree of distribution of pixels having an alpha blending value greater than 0.

[0231] A method of operating a display device according to one embodiment of the present disclosure may further include controlling the video quality processing unit to process the graphic, based on information about a ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is less than or equal to the first threshold value and pixels having an alpha blending value greater than 0 are widely distributed.

[0232] In a method of operating a display device according to one embodiment of the present disclosure, the operation of controlling the video quality processing unit so that the video quality processing unit processes the graphic when the ratio at which the graphic is displayed is equal to or greater than the first threshold value may include the operation of controlling the video quality processing unit so that the video quality processing unit processes the video through a first artificial intelligence model.

[0233] In an operating method of a display device according to one embodiment of the present disclosure, when the ratio at which the graphic is displayed is lower than the first threshold value, the operation of controlling the graphic quality processing unit and the video quality processing unit so that the graphic quality processing unit processes the graphic and the video quality processing unit processes the video may include an operation of controlling the video quality processing unit so that the video quality processing unit processes the graphic through a second artificial intelligence model.

[0234] The operating method of a display device according to one embodiment of the present disclosure may further include an operation of converting the graphic expressed in RGB format to be expressed in YUV format when the ratio at which the graphic is displayed is equal to or greater than the first threshold value.

[0235] The operating method of a display device according to one embodiment of the present disclosure may further include an operation of transmitting the graphics expressed in YUV format to the video quality processing unit.

[0236] The operating method of a display device according to one embodiment of the present disclosure may further include an operation of converting the video expressed in YUV format to be expressed in RGB format when the ratio at which the graphic is displayed is equal to or greater than the first threshold value.

[0237] The operating method of a display device according to one embodiment of the present disclosure may further include an operation of transmitting the video expressed in RGB format to the graphic quality processing unit.

[0238] Meanwhile, embodiments of the present disclosure may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules, executed by a computer. Computer-readable media may be any available media that can be accessed by a computer, and include both volatile and nonvolatile media, removable and non-removable media. Furthermore, computer-readable media may include computer storage media and communication media. Computer storage media include both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Communication media may typically include computer-readable instructions, data structures, or other data in a modulated data signal, such as program modules.

[0239] Additionally, a computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0240] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0241] The above description of the present disclosure is provided for illustrative purposes only, and those skilled in the art will readily appreciate that modifications to other specific forms can be made without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as being single may be implemented in a distributed manner, and similarly, components described as being distributed may be implemented in a combined manner.

[0242] The scope of the present disclosure is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present disclosure.

Claims

1. In the display device (1000), display (150); A memory (130) storing multiple instructions; and At least one processor (120) operably coupled to the memory (130) and including processing circuitry; By the at least one processor (120) individually or collectively executing the plurality of instructions, the display device (1000) Based on the graphic data, information about the ratio at which the graphic is displayed in the image is detected, Based on the information about the ratio at which the graphic is displayed, if the ratio at which the graphic is displayed is greater than or equal to a first threshold value, the video quality processing unit (370) is controlled to process the graphic. A display device (1000) that controls the graphic quality processing unit (360) and the video quality processing unit (370) so that the graphic quality processing unit (360) processes the graphic and the video quality processing unit (370) processes the video when the graphic quality processing unit (360) processes the graphic and the video quality processing unit (370) processes the video, based on information about the ratio at which the graphic is displayed, if the ratio at which the graphic is displayed is lower than the first threshold value.

2. In paragraph 1, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, A display device (1000) that controls the graphic quality processing unit to process the video when the ratio at which the graphic is displayed is greater than or equal to the first threshold value and the image includes the video.

3. In either of paragraphs 1 and 2, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, Detecting whether the above display device is running in an operating mode in which the above graphics can be displayed, A display device (1000) that detects information about the ratio at which the graphic is displayed when the display device is running in an operation mode in which the graphic can be displayed.

4. In any one of paragraphs 1 to 3, Information about the ratio at which the above graphic is displayed includes the ratio of pixels of the display having an alpha blending value greater than 0, A display device (1000) in which the ratio at which the above graphic is displayed corresponds to the ratio of pixels of the display having the alpha blending value of 1.

5. In paragraph 4, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, A display device (1000) that controls the video quality processing unit and the graphic quality processing unit so that the video quality processing unit processes the graphic and the graphic quality processing unit processes the video, when the ratio at which the graphic is displayed is lower than the first threshold but the ratio of pixels among the pixels of the display having the alpha blending value greater than 0 and less than or equal to 1 is greater than or equal to a second threshold higher than the first threshold, based on information about the ratio at which the graphic is displayed.

6. In paragraph 4, Information about the ratio at which the above graphic is displayed further includes the degree of distribution of pixels having an alpha blending value greater than 0, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, A display device (1000) that controls the video quality processing unit to process the graphic, based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is less than or equal to the first threshold value and pixels having an alpha blending value greater than 0 are widely distributed.

7. In any one of paragraphs 1 to 6, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, If the ratio at which the above graphic is displayed is lower than the first threshold value, the video quality processing unit controls the video quality processing unit to process the video through the first artificial intelligence model, A display device (1000) that controls the video quality processing unit to process the graphic through a second artificial intelligence model when the ratio at which the graphic is displayed is greater than or equal to the first threshold value.

8. In any one of paragraphs 1 to 7, The display device, by the at least one processor (120) individually or collectively executing the plurality of instructions, If the ratio at which the above graphic is displayed is greater than or equal to the first threshold value, the graphic expressed in RGB format is converted to be expressed in YUV format, A display device (1000) that transmits the above graphics expressed in YUV format to the video quality processing unit.

9. In a method for processing an image in a display device (1000), An operation of detecting information about the ratio at which graphics are displayed in an image based on graphic data; An operation of controlling the video quality processing unit (370) to process the graphic based on information about the ratio at which the graphic is displayed, if the ratio at which the graphic is displayed is greater than a first threshold value; and A method comprising an operation of controlling the graphic quality processing unit (360) and the video quality processing unit (370) so that the graphic quality processing unit (360) processes the graphic and the video quality processing unit (370) processes the video, based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than a first threshold value.

10. In paragraph 9, A method further comprising an action of controlling the graphic quality processing unit to process the video when the ratio at which the graphic is displayed is greater than or equal to the first threshold value and the image includes the video.

11. In any one of paragraphs 9 and 10, Further comprising an operation of detecting whether the display device is running in an operating mode in which the graphics can be displayed; A method wherein the operation of detecting information about the ratio at which the above graphic is displayed is performed when the display device is running in an operation mode in which the graphic can be displayed.

12. In any one of paragraphs 9 to 11, Information about the proportion occupied by the above graphics includes the proportion occupied by pixels of the display whose alpha blending value is greater than 0, A method in which the ratio at which the above graphic is displayed corresponds to the ratio of pixels having an alpha blending value of 1 among the pixels of the display.

13. In paragraph 12, A method further comprising: controlling the video quality processing unit and the graphic quality processing unit so that the video quality processing unit processes the graphic and the graphic quality processing unit processes the video, based on information about the ratio at which the graphic is displayed, when the ratio at which the graphic is displayed is lower than the first threshold but the ratio of pixels among the pixels of the display having the alpha blending value greater than 0 and less than or equal to 1 is equal to or greater than a second threshold higher than the first threshold.

14. In paragraph 12, Information about the ratio at which the above graphic is displayed further includes the degree of distribution of pixels having an alpha blending value greater than 0, A method further comprising: controlling the video quality processing unit to process the graphic based on information about the ratio at which the graphic is displayed, if the ratio at which the graphic is displayed is less than or equal to the first threshold value and pixels having an alpha blending value greater than 0 are widely distributed.

15. A computer-readable recording medium having recorded thereon a program for executing the method of any one of clauses 9 to 14 on a computer.

Images