Display device and operating method thereof

Abstract

A display device is disclosed. A display device according to an embodiment disclosed herein may acquire output graphics data by: acquiring first graphics data from a memory; determining a size of a graphics buffer to be enlarged by at least two scalers based on a resolution of the first graphics data and a resolution of the display device; rendering the first graphics data in the graphics buffer having a determined size; dividing the at least one graphics buffer into at least two divided regions based on specifications of the at least two scalers; magnifying each of the data rendered in the at least two divided regions using the at least two scalers; and mixing the at least two pieces of magnified graphic data obtained from the result of the magnification. Various other embodiments as understood from the specification are also possible.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to a display device and an operating method thereof. Specifically, embodiments of the present disclosure relate to a device for displaying graphics while minimizing degradation of image quality and performance and an operating method thereof. Background Art

[0002] With the technological advancement for display devices, the demand for high-resolution video services has increased recently. TVs and monitors may have predefined output resolutions and output ratios, and TVs and monitors may use display systems with, for example, 2K (full high definition, FHD) and 4K (ultra high definition, UHD) resolutions at a ratio of 16:9. Recently, display systems supporting various resolutions such as 8K, wide quad HD (WQHD), and double UHD (DUHD) are being commercialized. Also being developed are display systems supporting multiple ratios such as 21:9 and 32:9.

[0003] In this regard, graphics and images displayed by the display device may also have various resolutions. When the resolution of the original graphics and images displayed by the display device is higher than the resolution of the display device, no problem occurs. However, if the resolution of the original graphics and images is lower than the resolution of the display device, degradation of image quality occurs, such as blurring, causing the user to feel uncomfortable. In order to solve these problems that occur when the resolution of the original graphics and images is lower than the resolution of the display device, an upscaling technology for increasing the resolution of the original graphics and images may be applied. Summary of the invention

[0004] Technical Solution

[0005] A TV or monitor may include a buffer and a scaler for rendering the original graphics to perform amplification on the original graphics. However, if the resolution of the original graphics cannot be processed according to the specifications of the scaler, the original graphics need to be reduced to solve the problem, which leads to degradation of image quality.

[0006] Embodiments of the present disclosure provide an apparatus for adaptively enlarging original graphics having various resolutions according to the specifications of a display apparatus and an operating method thereof.

[0007] Embodiments of the present disclosure also provide a device and an operating method thereof for displaying graphics without reducing image quality when displaying graphic data on a display device through a single view (e.g., displaying only one application on the screen) and multiple views (e.g., displaying multiple applications on the screen).

[0008] A display device according to an embodiment of the present disclosure may include a memory and at least one processor, the at least one processor being electrically connected to the memory and including at least one graphics buffer and at least two scalers. In an embodiment, the at least one processor may obtain first graphics data from the memory. In an embodiment, the at least one processor may determine the size of the at least one graphics buffer enlarged by the at least two scalers based on the resolution of the first graphics data and the resolution of the display device. In an embodiment, the at least one processor may render the first graphics data to the at least one graphics buffer having a determined size. In an embodiment, the at least one processor may divide the at least one graphics buffer into at least two partitioned areas based on the specifications of the at least two scalers. In an embodiment, the at least one processor may use the at least two scalers to enlarge the rendering data to each of the at least two partitioned areas. In an embodiment, the at least one processor may obtain output graphics data by mixing at least two enlarged graphics data obtained as a result of the enlargement.

[0009] In an embodiment, the at least one processor may obtain the second graphics data from a memory.In an embodiment, the at least one processor may render the first graphics data and the second graphics data to at least one graphics buffer.

[0010] In an embodiment, the at least one processor may overlay and render the first graphics data and the second graphics data at a center position of the at least one graphics buffer.

[0011] In an embodiment, at least one graphics buffer may have a ratio corresponding to a resolution of the display device.

[0012] In an embodiment, the resolution of the graphic data may be a first ratio (16:9), and the resolution of the display device may be a second ratio (21:9) or a third ratio (32:9).

[0013] In an embodiment, the at least two divided areas of the at least one graphics buffer may include a first area configured in a first direction relative to a center of a vertical axis of the at least one graphics buffer and a second area configured in a second direction opposite to the first direction.

[0014] In an embodiment, a horizontal length of at least two enlarged graphic data may be equal to half a horizontal length of a resolution of the display device, and a vertical length of at least two enlarged graphic data may be equal to a vertical length of the resolution of the display device.

[0015] In an embodiment, the display device may further include a display and an image input unit. In an embodiment, the at least one processor may receive video data from the image input unit. In an embodiment, the at least one processor may decode the video data to obtain output video data. In an embodiment, the at least one processor may display a screen in which the output video data and the output graphic data are combined through the display.

[0016] In an embodiment, the specifications of the at least two scalers may include resolutions of the scalers and information on whether the scalers support integer magnification.

[0017] In an embodiment, at least two scalers may have the same specifications.

[0018] A method for operating a display device according to an embodiment of the present disclosure may include obtaining first graphic data from a memory. In an embodiment, the method for operating a display device may include determining the size of at least one graphic buffer to be enlarged by at least two scalers based on the resolution of the first graphic data and the resolution of the display device. In an embodiment, the method for operating a display device may include rendering the first graphic data to at least one graphic buffer having a determined size. In an embodiment, the method for operating a display device may include dividing at least one graphic buffer into at least two partitioned areas based on the specifications of at least two scalers. In an embodiment, the method for operating a display device may include enlarging the rendered data to each of the at least two partitioned areas using at least two scalers. In an embodiment, the method for operating a display device may include obtaining output graphic data by mixing at least two enlarged graphic data obtained as a result of the enlargement.

[0019] In an embodiment, the method for operating a display device may include obtaining second graphics data from a memory. In an embodiment, the method for operating a display device may include rendering the first graphics data and the second graphics data to at least one graphics buffer.

[0020] In an embodiment, a method for operating a display device may include superimposing and rendering first graphic data and second graphic data at a center position of at least one graphic buffer.

[0021] In an embodiment, in the method for operating a display device, at least one graphic buffer may have a ratio corresponding to a resolution of the display device.

[0022] In an embodiment, the resolution of the graphic data may be a first ratio (16:9), and the resolution of the display device may be a second ratio (21:9) or a third ratio (32:9).

[0023] In an embodiment, the at least two divided areas of the at least one graphics buffer may include a first area configured in a first direction relative to a center of a vertical axis of the at least one graphics buffer and a second area configured in a second direction opposite to the first direction.

[0024] In an embodiment, the horizontal length of the at least two magnified graphic data may be equal to half of the horizontal length of the resolution of the display device. In an embodiment, the vertical length of the at least two magnified graphic data may be the same as the vertical length of the resolution of the display device.

[0025] In an embodiment, the method for operating a display device may include receiving video data from an image input unit. In an embodiment, the method for operating a display device may include decoding the video data to obtain output video data. In an embodiment, the method for operating a display device may include displaying a screen in which the output video data and the output graphic data are combined through a display.

[0026] In an embodiment, in the method for operating a display device, the specifications of the at least two scalers may include resolutions of the scalers and information on whether the scalers support integer multiple up-scaling.

[0027] In an embodiment, at least two scalers may have the same specifications.

[0028] According to the examples disclosed in the present disclosure, a display system having various ratios and resolutions can provide various application graphic screens without degrading the image quality of the original graphics.

[0029] In addition, according to the examples disclosed in the present disclosure, although there are restrictions on the specifications of the scaler (for example, restrictions on the input size of the scaler or restrictions on the scaling ratio of the scaler), the display device can output the screen at the resolution of the original graphics without reducing the original graphics by operating multiple scalers in parallel.

[0030] Furthermore, according to the examples disclosed in the present disclosure, graphic screens of various applications can be displayed without reducing the image quality of original graphics without increasing data and logic required for processing by a graphics processing unit (GPU).

[0031] Effects obtainable from the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be apparent to those of ordinary skill in the art from the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 is a block diagram showing a configuration of a display device according to an embodiment;

[0033] Figure 2is a block diagram showing a detailed configuration of a display device according to an embodiment;

[0034] Figure 3a shows an example of enlargement of a display device according to an embodiment;

[0035] Figure 3b shows an example of enlargement of a display device according to an embodiment;

[0036] Figure 4 shows an example of enlargement of a display device according to an embodiment; and

[0037] Figure 5 An operation flow of the display device according to the embodiment is shown.

[0038] In conjunction with the description of the drawings, the same or similar reference numerals may be used to represent the same or similar elements. DETAILED DESCRIPTION

[0039] Hereinafter, embodiments of the present invention are described with reference to the accompanying drawings. However, it should be understood that the present disclosure is not limited to the embodiments, and all changes and / or equivalents or replacements thereto also belong to the scope of the present disclosure. In the following description, the same / similar reference numerals are used to represent substantially the same parts, and no repeated description is given.

[0040] Figure 1 is a block diagram showing a configuration of a display device according to an embodiment. Figure 1 The display device 100 may be, but is not limited to, a smart phone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop computer, a media player, a micro server, a digital broadcast terminal, a navigation, a self-service terminal, a home appliance, or other mobile or non-mobile computing devices. In addition, the display device 100 may perform various computing functions, such as real-time video viewing and communication. In the following description, it is assumed that the display device 100 is a TV or a monitor, but this is merely an example, and the embodiments of the present disclosure may also be applied to electronic devices having a display function.

[0041] Figure 1 is a block diagram showing a configuration of a display device according to an embodiment.

[0042] According to an embodiment, the display device 100 may include a processor 110 , a memory 120 , an image input unit 130 , a display 140 , and a communication unit 150 .

[0043] According to an embodiment, the memory 120 is a storage medium used by the display device 100 and may store data such as at least one command 121 or configuration information corresponding to at least one program. The program may include an operating system (OS) program and various application programs.

[0044] In an embodiment, the memory 120 may include at least one type of storage medium selected from the group consisting of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory card), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a disk, or an optical disk.

[0045] According to an embodiment, the image input unit 130 may receive image data through a tuner (not shown), an input / output unit (not shown), or a communication unit 150. The image input unit 130 may include at least one of a tuner and an input / output unit. The tuner may tune and select only the frequency of a broadcast channel to be received by the display device 100 among many radio components by amplifying, mixing, and resonating a wired / wirelessly received broadcast signal. The broadcast signal may include video, audio, and additional data (e.g., an electronic program guide (EPG)). The tuner may receive a broadcast channel (or view an image) from various broadcast sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, Internet broadcasting, etc. The tuner may be implemented integrally with the display device 100, or may be implemented as a separate tuner electrically connected to the display device 100. The input / output unit may include at least one of a high-definition multimedia interface (HDMI) input port, a component input jack, a PC input port, and a USB input jack capable of receiving image data from an external device of the display device 100 under the control of the processor 110. It will be apparent to those of ordinary skill in the art that the input / output unit may be added, deleted, and / or changed according to the performance and structure of the display apparatus 100 .

[0046] According to an embodiment, the display 140 may perform a function for outputting information in the form of numbers, characters, images and / or graphics. The display 140 may include at least one hardware module for output. The at least one hardware module may include, for example, at least one of a liquid crystal display (LCD), a light emitting diode (LED), a light emitting polymer display (LPD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED) or a flexible LED (FLED). The display 140 may display a screen corresponding to the data received from the processor 110. The display 140 may be referred to as an "output unit", "display unit" or other terms with equivalent technical meanings.

[0047] According to an embodiment, the communication unit 150 may provide a wired / wireless communication interface capable of communicating with an external device. The communication unit 150 may include at least one of a wired Ethernet, a wireless LAN communication unit, and a short-range communication unit. The wireless LAN communication unit may include, for example, Wi-Fi, and may support the wireless LAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE). The wireless LAN communication unit may be wirelessly connected to an access point (AP) under the control of the processor 110. The short-range communication unit may wirelessly perform short-range communication with an external device under the control of the processor 110. Short-range communication may include Bluetooth, Bluetooth low energy consumption, infrared data association (IrDA), ultra-wideband (UWB), and near field communication (NFC). The external device may include a server device and a mobile terminal (e.g., a phone, a tablet, etc.) that provide, for example, a video service.

[0048] According to an embodiment, the processor 110 may control at least one other component of the display device 100 and / or perform calculations or data processing regarding communication by executing at least one command 121 stored in the memory 120. The processor 110 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microcontroller unit (MCU), a sensor hub, an auxiliary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), and may have a plurality of cores.

[0049] Figure 2 is a block diagram showing a configuration of a display device according to an embodiment. Figure 2 The display device 200 shown may include the display device 100, and some components may correspond to each other. For the part related to the description of the present disclosure, Figure 2 The block components shown in can be represented in detail Figure 1 The block components shown in .

[0050] The display device 200 according to the embodiment may include a storage unit 210 , an input unit 220 , a controller 230 , and a display 240 .

[0051] The storage unit 210 according to an embodiment may be a component corresponding to the memory 120. For example, the storage unit 210 may include a flash memory.

[0052] In an embodiment, the storage unit 210 may store graphic data displayed on the display device 200. For example, the graphic data may include data about an application and a user interface (UI) including on-screen display (OSD) data indicating whether a function for controlling a user is executed or providing information about image data.

[0053] In an embodiment, the graphic data may have a predetermined ratio and a predetermined resolution. For example, the graphic data input to the display device 200 according to the graphic data may have a resolution of FHD (full HD) and UHD (ultra HD) with a ratio of 16:9 depending on the type of the graphic data.

[0054] The input unit 220 according to an embodiment may include the image input unit 130 .

[0055] The input unit 220 according to an embodiment may receive image data. The image data may include video data and graphic data. The video data may mean data related to an image received from the outside, and the graphic data may mean data related to a user interface displayed on the electronic device.

[0056] In an embodiment, the input unit 220 may include a double data rate (DDR) memory for loading graphic data obtained from the storage unit 210, an antenna 224 for receiving video data, a tuner 223 for tuning the received video data, a USB port 225 for receiving data from an external device, and an HDMI input port 227 for receiving external input.

[0057] In an embodiment, the input unit 220 may obtain the graphic data 221 - 1 , 221 - 2 , and 221 - 3 from the storage unit 210 .

[0058] In an embodiment, the input unit 220 may store the obtained graphic data 221 - 1 , 221 - 2 , and 221 - 3 in a double data rate (DDR) memory.

[0059] In an embodiment, the input unit 220 may receive an image signal through the antenna 224 .

[0060] In an embodiment, the tuner 223 may tune and select only the frequency of a broadcast channel to be received by the display apparatus 100 among radio wave components through amplification, mixing, and resonance of a wirelessly or wired received broadcast signal.

[0061] In an embodiment, the input unit 220 may receive image data from an external device through the USB input port 225 .

[0062] In an embodiment, the input unit 220 may receive image data from an external device through the HDMI port 227 .

[0063] In an embodiment, the controller 230 may include graphics processing units 232-1 and 232-2, a plurality of graphics buffers 234-1, 234-2, ..., a plurality of scalers 236-1 and 236-2, a mixer 238, an FRC 239, a video processing unit 231, and a video memory 237. Figure 2 In addition to the components shown, other components may be added, and in some cases some components may be omitted.

[0064] In an embodiment, the controller 230 may obtain graphic data from the input unit 220. For example, the 3D graphic engine 232-1 may obtain 3D graphic data from the input unit 220. For example, the 2D graphic engine 232-2 may obtain 2D graphic data from the input unit 220.

[0065] In an embodiment, a graphics processing unit (eg, 3D graphics engine 232-1 or 2D graphics engine 232-2) may render graphics data to a graphics buffer (eg, first graphics buffer 234-1 or second graphics buffer 234-2). Figure 2 Only two graphics buffers are shown in FIG, but this is just an example and there may be more than two graphics buffers.

[0066] In an embodiment, a plurality of scalers (eg, first scaler 236-1 and second scaler 236-2) may perform upscaling on graphics data rendered to a plurality of graphics buffers (eg, first graphics buffer 234-1 and second graphics buffer 234-2).

[0067] In one embodiment, the specifications of the scaler may include, for example, the resolution of the original resource that can be processed (e.g., up to 2K (FHD, 1920*1080) or up to 4K (UHD, 3840*2160), and the scaling ratio (e.g., whether it supports only fixed scaling ratios (integer multiples)). For example, if the specifications of the scaler are limited to a specific resolution or are set to a specific bandwidth (B / W) or a fixed scaling ratio, the scaler may not be able to scale the graphics data at a specific resolution at a specific ratio. Although not shown in the drawings, in this case, the electronic device may reduce the original data rendered to the graphics buffer to a resolution of a ratio at which the scaler can perform scaling, and then perform upscaling again.

[0068] In an embodiment, the mixer 238 - 1 may mix data upscaled from a plurality of scalers (eg, the first scaler 236 - 1 and the second scaler 236 - 2 ).

[0069] In an embodiment, the video processing unit 231 may process video data received from the input unit 220 .

[0070] In an embodiment, the video processing unit 231 may render the video data to a video buffer (eg, the first video buffer 233-1 or the second video buffer 233-2). Figure 2Only two video buffers are shown in FIG, but this is just an example and there may be more than two video buffers.

[0071] In an embodiment, a plurality of scalers (e.g., a first scaler 235-1 and a second scaler 235-2) may perform upscaling on video data rendered to a plurality of video buffers (e.g., a first video buffer 233-1 and a second video buffer 233-2). The upscaling of the plurality of scalers 235 may correspond to the above-mentioned upscaling method of the graphics scaler.

[0072] In an embodiment, the mixer 238 - 2 may mix data upscaled from a plurality of scalers (eg, the first scaler 235 - 1 and the second scaler 235 - 2 ). In an embodiment, the mixed video data may be transmitted to the video memory 237 .

[0073] In an embodiment, a frame rate conversion (FRC) 239 may mix the graphics data received from the mixer 238 - 1 and the video data received from the video memory 237 and send it to the display 240 .

[0074] According to an embodiment, the display 240 may output the received data on a screen. For example, the display 240 may be a component for displaying data received through low voltage differential signaling (LVDS) to a user through a panel of the display. A mixed screen of video and graphics adjusted in frame rate may be output through the display 240.

[0075] like Figure 2 As described in , the graphics system of DTV and monitor can use resources of a specific resolution (FHD for 4KTV, or UHD for 8K TV) to render it to a graphics buffer, and perform enlargement in the graphics hardware (HW) and display it on the screen. Each graphics buffer is connected to a scaler so that the image of each graphics buffer can be scaled to the screen size and output to the panel through a mixer. For example, in order to output graphics from a UHD TV, FHD resources stored in flash memory can be loaded into a DDR memory, and the application can use a GPU, CPU, or graphics HW to render the resources loaded into the DDR memory to an FHD graphics buffer. The rendered graphics buffer can be enlarged FHD->UHD by the HW and output on the final screen at UHD size. However, instead of the scaler being connected to only one graphics buffer, multiple scalers can be connected to one graphics buffer.

[0076] Figure 3a An example of enlargement of the display device according to the embodiment is shown. Figure 3b An example of enlargement of the display device according to the embodiment is shown. Figure 3a and Figure 3bThe display device described in the embodiment may be Figure 1 The display device 100 and Figure 2 A device corresponding to the display device 200.

[0077] In an embodiment, the display device may determine the size of the graphic buffer in consideration of the ratio and resolution of the original resource and the ratio and resolution of the screen to be output.

[0078] For example, in a display system having a graphics engine structure that scales up an original graphic having a 16:9 FHD resolution to a graphic having a UHD resolution, it is necessary to generate graphic data having a 21:9 WQHD resolution based on the original graphic data having a 16:0 FHD resolution so that the display device outputs a 21:9 WQHD (3440×1440) graphic. In this case, since the ratio of the graphics buffer to be scaled should be maintained at 21:9, the buffer size may be determined to be 3440x1440. In addition, when the display device 200 finally outputs an FHD resolution graphic having a ratio of 16:9, the FHD resolution graphic may be placed at the center of the graphics buffer generated at a ratio of 21:9, thereby being displayed at a ratio of 16:9. Therefore, the final buffer output size may have a buffer size of 2560*1080 with respect to the height (ie, 1080).

[0079] For example, in a display system having a graphics engine structure that scales up an original graphic having a 16:9 FHD resolution to a graphic having a UHD resolution, it is necessary to generate graphic data having a 32:9 DQHD resolution based on the original graphic data having a 16:0 FHD resolution so that the display device outputs a 32:9 DQHD (5120×1440) graphic. In this case, since the ratio of the graphics buffer to be scaled should be maintained at 32:9, the buffer size may be determined to be 5120x1440. In addition, when the display device 200 finally outputs an FHD resolution graphic having a ratio of 16:9, the FHD resolution graphic may be placed in the center of the graphics buffer generated at a ratio of 32:9, thereby being displayed at a ratio of 16:9. Therefore, the final buffer output size may have a buffer size of 3840*1080 with respect to the height (i.e., 1080).

[0080] In this regard, if the specification of the scaler is limited to a specific resolution or is set to B / W or a fixed scaling ratio, the scaler may not be able to process a specific resolution with a specific ratio. In other words, in a display device that processes multiple resolutions and multiple ratios, the display device may render graphic data to a graphic buffer at a ratio of a fixed ratio according to the resolution and the ratio to support the graphic data. If enlargement may not be performed on the data rendered to the graphic buffer due to the specification of the scaler, reduction may be performed, and image quality may be deteriorated in the process.

[0081] refer to Figure 3a As an example, in a system in which a graphics scaler supports up to only FHD (1920 × 1080), in order to output normal graphics on the display 240 when the display 240 of the display device displays 21:9 WQHD, the size of the graphics buffer 234-1 for the first graphics data 221-1 should be determined as 2560 × 1080, but, due to the specification of the scaler, the size of the graphics buffer 234-1 may be determined as 1720 × 720. Similarly, the size of the graphics buffer 234-2 for the second graphics data 221-2 should be 2560 × 1080, but due to the specification of the scaler, the size of the graphics buffer 234-1 may be determined as 1720 × 720. Therefore, the graphics data 221-1 and 221-2 rendered to the graphics buffers 234-1 and 234-2 may each be scaled down to 1280*720, resulting in deterioration in image quality.

[0082] refer to Figure 3b In a system where the graphics scaler has an integer multiple scaling ratio, in order for the display 240 of the display device to output a normal graphic of DQHD with a 32:9 ratio on the display 240, the size of the graphics buffer 234-1 for the first graphic data 221-1 should be 3840*1080, but since the enlargement ratio to 3840*1080 or 5120*1440 is 1.3 times, that is, not an integer multiple, upscaling may not be performed. Therefore, for normal graphics output, the buffer size should be determined to be 2560×720, so that the original graphics data is reduced, resulting in a decrease in image quality. In the following description, a display device and an operating method thereof for minimizing the reduction in image quality caused by reducing the size of the original graphics data are described.

[0083] Figure 4 An example of enlargement of the display device according to the embodiment is illustrated. Figure 5 An operation flow of the display device according to the embodiment is illustrated. Figure 4 The diagram shows Figure 5 The operation flow of the display device. Figure 4 and5 The display device described in the embodiment may correspond to Figure 1 , Figure 2 , Figure 3a and Figure 3b display device.

[0084] According to an embodiment, the display device may obtain first graphic data 410 from a memory in operation 510. The graphic data may include data about an application and a user interface (UI) including on-screen display (OSD) data indicating whether a function for controlling a user is executed or providing information about image data.

[0085] In an embodiment, the display device may obtain second graphic data 411 to be displayed on the screen together with the first graphic data 410. The second graphic data 411 may represent data related to a graphic different from the first graphic data 410, and the first graphic data 410 and the second graphic data 411 may be superimposed and displayed. For example, the first graphic data 410 may be displayed on a lower layer, and the second graphic data 411 may be data displayed on an upper layer of the first graphic data 410 at a central position. The following description relates to an operation of performing a zoom-in on the first graphic data 410, but this is merely an example, and the operation according to the present disclosure may be equally applied not only to the first graphic data 410, but also to the second graphic data 411 or data in which the first graphic data 410 and the second graphic data 411 overlap each other, and third graphic data (not shown) other than the first graphic data 410 and the second graphic data 411.

[0086] In an embodiment, the horizontal length 412-1 of the first graphic data 410 and the vertical length 414-1 of the first graphic data may have a first ratio. In an embodiment, the horizontal length 412-2 of the second graphic data 411 and the vertical length 414-2 of the second graphic data 411 may have a second ratio. In an embodiment, the first ratio and the second ratio may be determined according to the properties of the application.

[0087] In an embodiment, the resolutions of the first graphic data 410 and the second graphic data 411 may have resolutions corresponding to the first ratio and the second ratio, respectively. For example, when the first ratio is 16:9, the resolution of the first graphic data may be HD (1280 × 720), FHD (1920 × 1080), QHD (2560 × 1440), 4K UHD (3840 × 2160), or 8K UHD (7680 × 4320). When the second ratio is 16:9, the resolution of the second graphic data may be HD (1280 × 720), FHD (1920 × 1080), QHD (2560 × 1440), 4K UHD (3840 × 2160), or 8K UHD (7680 × 4320).

[0088] According to an embodiment, in operation 520, the display device may determine the size of the graphics buffer enlarged by at least two scalers based on the resolution of the first graphics data and the resolution of the display device. The graphics buffer may refer to a memory for rendering the next graphics to be displayed on the display by the graphics processing unit. The graphics buffer may be a memory that can be indexed as (x, y) coordinates. Each pair of coordinates may correspond to a pixel. In the description of the present invention, the graphics buffer for rendering graphics data is described as an example, but the same content may be applied to the video buffer for rendering video data.

[0089] In an embodiment, the size of the graphics buffer may represent information about a horizontal length of the graphics buffer, a vertical length of the graphics buffer, and a ratio of the horizontal length to the vertical length of the graphics buffer.

[0090] In an embodiment, a display device may include multiple graphics buffers. Figure 4 Only two graphics buffers (eg, first graphics buffer 420 and second graphics buffer 421) are shown, but this is merely an example and there may be more than two graphics buffers.

[0091] In an embodiment, the horizontal length 422 and vertical length 424 of the graphics buffer may be determined based on the horizontal length 426 and vertical length 428 of the original graphics data (eg, the first graphics data 410 and the second graphics data 411 ) and the horizontal length 462 and vertical length 464 of the display 460 .

[0092] In an embodiment, a ratio of a horizontal length to a vertical length (hereinafter, referred to as a ratio) of the first graphic buffer 420 may correspond to a ratio of the display 460, and a vertical length 424 of the first graphic buffer 410 or 411 may correspond to a vertical length 414-1 of the first graphic data 410. For example, when the display 460 has a size of 3440*1440 of a 21:9 ratio, the first graphic buffer 420 may have a size of 2560*1080 of a 21:9 ratio. For example, when the display 460 has a size of 5120*1440 of a 32:9 ratio, the first graphic buffer 420 may have a size of 3840*1080 of a 32:9 ratio.

[0093] According to an embodiment, the display device may render the first graphic data to a graphic buffer having a determined size.

[0094] In the embodiments, reference Figure 4 , the display device may render the first graphic data 410 to the first graphic buffer 420. In an embodiment, the display device may render the second graphic data 411 to the first graphic buffer 420. In an embodiment, the display device may overlay and arrange the first graphic data 410 and the second graphic data 411 in the first graphic buffer 420. In an embodiment, the display device may render the first graphic data 410 and the second graphic data 411, where they are overlaid at the center of the first graphic buffer 420.

[0095] According to an embodiment, in operation 540, at least two divided areas constituting the graphic buffer may be identified based on the specification of the scaler.

[0096] In an embodiment, the at least two divided areas of the first graphic buffer 420 may include a first area 420-1 configured in a first direction relative to the center of the vertical axis of the first graphic buffer 420 and a second area 420-2 configured in a second direction opposite to the first direction.

[0097] According to an embodiment, in operation 550 , the display device may perform up-scaling on data rendered to at least two divided regions using at least two scalers.

[0098] According to an embodiment, the display device may obtain output graphic data by mixing at least two enlarged graphic data obtained as a result of the enlargement in operation 560. The output graphic data may mean graphic data displayed on a display unit of the display device.

[0099] According to an embodiment, the display device may receive video data from the image input unit. According to an embodiment, the display device may decode the video data to obtain output video data. In an embodiment, the display device may combine the output video data and the output graphic data and display them on the display.

[0100] For example, when the display device outputs graphics data having a 16:9 FHD resolution to a 21:9 display, the display device can use the GPU to render it to the center of the first graphics buffer 420 having a size of 2650*1080 to output the size of the graphics buffer normally. After the rendering is completed, the display device can use the first scaler and the second scaler to identify the first area and the second area as the first area and the second area having a size of 1280*1080 in the first graphics buffer 420. For the (x, y) value, the first scaler can perform an enlargement from (0, 0) to (1280, 1080) on the data, and the second scaler can perform an enlargement from (1281, 0) to (2560, 1080). Through this method, the 2560*1080 buffer can be cropped by the scaler without data loss. Each of the divided areas (first area 420-1 and second area 420-2) can enlarge each 1280*1080 area to 1720*1440 to be normally output to the 3440*1440 panel of the display 460. Each enlarged graphic data can be input to the mixer 450, and the mixer 450 can mix each enlarged graphic data into one graphic data. The 16:9 FHD original image can be set at the center of the display 460 of the 3440x1440 specification by the mixed data without reducing the image quality, and can be output. The above operation of the display device can be applied not only when the original image has a ratio of 16:9, but also when the original image has a resolution of another ratio.

[0101] The electronic device according to various embodiments of the present disclosure may be one of various types of electronic devices. The electronic device may include, for example, a display device, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the above-mentioned electronic devices.

[0102] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, and include various changes, equivalents or replacements of the corresponding embodiments. As used herein, the singular forms "one", "an" and "the" are intended to also include plural forms, unless the context clearly states otherwise. As used herein, the term "and / or" should be understood to cover any and all possible combinations of one or more enumerated items. As used herein, the terms "include", "have" and "include" are only used to specify the presence of features, components, parts or combinations thereof described herein, but the use of this term does not exclude the possibility of the presence or addition of one or more other features, components, parts or combinations thereof. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" can include all possible combinations of items listed together in a corresponding phrase. As used herein, terms such as “1st” and “2nd” or “first” and “second” may be used to simply distinguish a corresponding component from another component, and do not limit the components in other aspects (eg, importance or order).

[0103] As used herein, the term "component" or "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "component," or "circuit"). A component or module may be a single integrated component suitable for performing one or more functions, or its smallest unit or component. For example, according to an embodiment, a "component" or "module" may be implemented in the form of an application specific integrated circuit (ASIC).

[0104] As used in various embodiments of the present disclosure, the term "if" may be interpreted as "when," "at," "in response to determining," or "in response to detecting," depending on the context. Similarly, "if A is determined" or "if A is detected" may be interpreted as "when A is determined" or "in response to determining A," or "when A is detected" or "in response to detecting A," depending on the context.

[0105] The program executed by the display device 200 described herein may be implemented as a hardware component, a software component, and / or a combination thereof. The program may be executed by any system capable of executing computer-readable instructions.

[0106] Software may include a computer program, code, instruction, or a combination of one or more thereof, and may configure a processing device as needed when it is operated, or may indicate a processing device independently or collectively. Software may be implemented as a computer program including instructions stored in a computer-readable storage medium. Computer-readable storage media may include, for example, magnetic storage media (e.g., read-only memory (ROM), random access memory (RAM), floppy disk, hard disk, etc.) and optically readable media (e.g., CD-ROM or digital versatile disk (DVD)). In addition, computer-readable storage media may be distributed to computer systems connected via a network, and computer-readable codes may be stored and executed in a distributed manner. The computer program may be distributed (e.g., downloaded or uploaded) directly between two UEs (e.g., smart phones) or online via an application store (e.g., Play Store™). If distributed online, at least a portion of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server.

[0107] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. Some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as performed by a corresponding one of the multiple components before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or heuristically, or one or more of the operations may be performed or omitted in a different order, or one or more other operations may be added.

Claims

1. A display device, include: Memory; and at least one processor electrically connected to the memory and comprising at least one graphics buffer and at least two scalers, wherein the at least one processor: Obtaining first graphic data from the memory; determining a size of the at least one graphics buffer to be upscaled by the at least two scalers based on a resolution of the first graphics data and a resolution of the display device; rendering the first graphics data to at least one graphics buffer having a determined size; dividing the at least one graphics buffer into at least two partitioned regions based on a specification of the at least two scalers; enlarging the rendering data into each of the at least two divided regions using the at least two scalers; The output graphic data is obtained by mixing at least two enlarged graphic data obtained as a result of the enlargement.

2. The display device according to claim 1, in, The at least one processor: obtaining second graphic data from the memory; as well as The first graphics data and the second graphics data are rendered to the at least one graphics buffer.

3. The display device according to claim 2, in, The at least one processor: The first graphics data and the second graphics data are superimposed and rendered at a center position of the at least one graphics buffer.

4. The display device according to claim 1, in, The at least one processor: the graphics buffer has a ratio corresponding to a resolution of the display device.

5. The display device according to claim 4, in, The resolution of the graphic data is a first ratio (16:9), and the resolution of the display device is a second ratio (21:9) or a third ratio (32:9).

6. The display device according to claim 5, in, The at least two divided areas of the at least one graphic buffer include a first area arranged in a first direction with respect to a center of a vertical axis of the at least one graphic buffer and a second area arranged in a second direction opposite to the first direction.

7. The display device according to claim 6, wherein a horizontal length of the at least two enlarged graphic data is equal to half a horizontal length of the resolution of the display device, and a vertical length of the at least two enlarged graphic data is equal to a vertical length of the resolution of the display device.

8. The display device according to claim 1, further comprising: include: monitor; and An image input unit, wherein the at least one processor: receiving video data from the image input unit; decoding the video data to obtain output video data; and A screen in which the output video data and the output graphic data are combined is displayed by the display. 9 . The display device according to claim 1 , wherein the specifications of the at least two scalers include resolutions of the at least two scalers and information on whether the at least two scalers support integer multiple upscaling. 10 . The display device according to claim 9 , wherein the at least two scalers have the same specifications.

11. A method for operating a display device, the method include: Obtaining first graphic data from a memory; determining a size of at least one graphics buffer to be upscaled by at least two scalers based on a resolution of the first graphics data and a resolution of the display device; rendering the first graphics data to the at least one graphics buffer having a determined size; dividing the at least one graphics buffer into at least two partitioned regions based on a specification of the at least two scalers; enlarging the rendering data into each of the at least two divided regions using the at least two scalers; The output graphic data is obtained by mixing at least two enlarged graphic data obtained as a result of the enlargement.

12. The method according to claim 11, include: obtaining second graphic data from the memory; as well as The first graphics data and the second graphics data are rendered to the at least one graphics buffer.

13. The method of claim 12, comprising overlaying and rendering the first graphics data and the second graphics data at a center position of the at least one graphics buffer.

14. The method according to claim 11, in, The at least one graphics buffer has a ratio corresponding to a resolution of the display device.

15. The method according to claim 14, in, The resolution of the graphic data is a first ratio (16:9), and the resolution of the display device is a second ratio (21:9) or a third ratio (32:9).

Images