Display device and control method thereof
By processing graphic data through a video scaler and upsampling in a video buffer, the display device maintains high frame rates and resolutions for both graphic and video elements, enhancing overall image quality.
Patent Information
- Application Number
- PCT/KR2024/018083
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-12
- Filing Date
- 2024-11-15
- Publication Date
- 2025-07-17
AI Technical Summary
Existing display devices face a trade-off between graphic image resolution and frame rate, where improving one typically degrades the other, leading to inconsistent image quality when combining graphic and video elements.
The display device processes graphic data through a video scaler, storing it in a video buffer and using a high-performance video scaler to upscale the resolution before generating a graphic image frame, thereby bypassing the traditional graphic scaler path to maintain or enhance resolution without reducing frame rate.
This approach ensures that the graphic image achieves the same resolution and frame rate as video, resulting in improved overall image quality by synchronizing the processing paths for graphic and video data, eliminating discrepancies in image quality.
Smart Images

Figure KR2024018083_17072025_PF_FP_ABST
Abstract
Description
Display device and control method thereof
[0001] The disclosed invention relates to a display device capable of outputting a screen and a method for controlling the same.
[0002] A display device includes a display panel and can display images by controlling the amount of light emitted from each pixel of the display panel. Display panels can be categorized into self-luminous display panels, which emit light on their own depending on the image, and non-luminous display panels, which block or allow light emitted from a separate light source to pass through depending on the image. An example of a non-luminous display panel is a liquid crystal display panel (LCD panel).
[0003] A display device may include various connection interfaces for connecting to external devices. For example, the display device may include a High Definition Multimedia Interface (HDMI). The display device may be connected to an external source via the connection interface. As a sink device, the display device may receive video data from a source device. The display device may process the video data to generate video frames.
[0004] A display device can process graphic data stored in memory to generate a graphic image frame. The graphic image frame can include various graphic elements. The display device can generate a screen frame by synthesizing a video frame and a graphic image frame, and output the generated screen frame. Therefore, a user can view a screen composed of a composite of a video frame and a graphic image frame.
[0005] The disclosed invention provides a display device and a control method thereof that can improve the image quality of a graphic image without reducing the frame rate of the graphic image by using a data path for processing video data to process graphic data.
[0006] A display device according to one embodiment may include: a display panel; a graphics processor that stores graphic data in a video buffer; a video scaler that processes the graphic data stored in the video buffer and stores the processed graphic data in a graphics buffer; a graphics scaler that generates a graphic image frame based on the processed graphic data stored in the graphics buffer; and a main processor that controls the display panel to output a screen including the graphic image frame.
[0007] A method for controlling a display device according to one embodiment may include: storing graphic data generated by a graphic processor in a video buffer; processing the graphic data stored in the video buffer by a video scaler, storing the processed graphic data in a graphic buffer; generating a graphic image frame based on the processed graphic data stored in the graphic buffer by a graphic scaler; and outputting a screen including the graphic image frame through a display panel.
[0008] A non-transitory computer-readable recording medium according to one embodiment can store a program for executing the control method of the above-described display device.
[0009] The disclosed display device and its control method can increase the resolution of a graphic image without reducing the frame rate of the graphic image by using a data path for processing video data to process graphic data.
[0010] FIG. 1 illustrates a display device according to one embodiment.
[0011] FIG. 2 illustrates the configuration of a screen provided through a display device according to one embodiment.
[0012] Figure 3 illustrates a configuration of a display device according to one embodiment.
[0013] FIG. 4 illustrates an example of a data path for processing graphic data in a display device according to one embodiment.
[0014] FIG. 5 illustrates an example of a data path for processing video data in a display device according to one embodiment.
[0015] FIG. 6 illustrates a data path for processing graphic data and a data path for processing video data described in FIGS. 4 and 5.
[0016] FIG. 7 illustrates another example of a data path for processing video data in a display device according to one embodiment.
[0017] It should be understood that the various embodiments and terms used in this document are not intended to limit the technical features described in this document to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.
[0018] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.
[0019] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.
[0020] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in that phrase, or all possible combinations thereof. For example, "at least one of A, B, and C" can refer to A, B, C, a combination of A and B, a combination of A and C, a combination of B and C, or a combination of A, B, and C.
[0021] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).
[0022] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0023] The terms “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.
[0024] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.
[0025] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.
[0026] The term “and / or” includes any combination of a plurality of related described elements or any one of a plurality of related described elements.
[0027] The operating principle and embodiments of the present invention will be described with reference to the attached drawings below.
[0028] FIG. 1 illustrates a display device according to one embodiment.
[0029] Referring to FIG. 1, a display device (10) may include a frame (11) and a display panel (400). The frame (11) may support the display panel (400). A cover for supporting the frame (11) and the display panel (400) may be provided on the rear side of the display panel (400). A control circuit for controlling the operation of the display device (10) and a power circuit for supplying power to components of the display device (10) may be provided on the rear side of the display panel (400).
[0030] The control circuit and power circuit may each include at least one processor and at least one memory. The memory may store various programs, applications, algorithms, instructions, and / or data for operating the display device (10). The processor may control the operation of the display device (10) using the programs, applications, algorithms, instructions, and / or data stored in the memory.
[0031] The display panel (400) can display a screen. The screen output through the display panel (400) can include at least one of an image and a video. The display panel (400) includes a plurality of pixels (P). The screen displayed by the display panel (400) can be formed by light emitted from each of the plurality of pixels (P). The plurality of pixels (P) can be arranged in a matrix form. The plurality of pixels (P) can be arranged in a plurality of rows and a plurality of columns. The screen can be output by combining the light emitted from each of the plurality of pixels (P) like a mosaic. Each of the plurality of pixels (P) can emit light of various brightness and colors. In order to emit light of various colors, each of the plurality of pixels (P) can include sub-pixels (PR, PG, PB).
[0032] A pixel (P) may include a red sub-pixel (PR) capable of emitting red light, a green sub-pixel (PG) capable of emitting green light, and a blue sub-pixel (PB) capable of emitting blue light. By combining the red light of the red sub-pixel (PR), the green light of the green sub-pixel (PG), and the blue light of the blue sub-pixel (PB), the pixel (P) may emit light of various brightnesses and colors.
[0033] The arrangement of sub-pixels (PR, PG, PB) may vary. For example, red sub-pixels (PR), green sub-pixels (PG), and blue sub-pixels (PB) may be arranged in a row, but is not limited thereto. In addition, the sizes of the red sub-pixels (PR), green sub-pixels (PG), and blue sub-pixels (PB) may be the same or different from each other.
[0034] Additionally, a unit pixel (P) does not necessarily have to consist of a red subpixel (PR), a green subpixel (PG), and a blue subpixel (PB). A pixel (P) may also include subpixels that emit yellow light or white light. In other words, the color and type of light emitted from each subpixel, as well as the number of subpixels, may vary depending on the design.
[0035] The display device (10) may include various devices capable of displaying images and / or videos. The display device (10) may also output audio. For example, the display device (10) may correspond to a light-emitting diode (LED) display device, a liquid crystal display (LCD) device, an organic light-emitting diode (OLED) display device, an inorganic light-emitting diode display device, or a beam projector. The display device (10) is not limited to those exemplified.
[0036] The display device (10) may correspond to a self-luminous display device in which each pixel emits light by itself without a backlight unit. An organic light-emitting diode (OLED) that emits light of a different color may be arranged in each sub-pixel. For example, a red organic light-emitting diode may be arranged in a red sub-pixel (PR), a green organic light-emitting diode may be arranged in a green sub-pixel (PG), and a blue organic light-emitting diode may be arranged in a blue sub-pixel (PB). Accordingly, one sub-pixel may be implemented with one organic light-emitting diode. A plurality of pixels composed of organic light-emitting diodes may be driven independently.
[0037] Self-luminous displays offer structural simplicity because they do not require components such as a backlight unit or liquid crystal layer, and may even omit color filters. This allows for a high degree of design freedom. Furthermore, self-luminous displays can achieve a thin profile and offer excellent contrast ratio, brightness, and viewing angle.
[0038] In addition, the display device (10) may correspond to a light-emitting display device including a backlight unit that supplies light from the rear of the display panel (400), a liquid crystal layer that acts as a switch to pass / block light, and a color filter that changes the color of the light. A representative example of a light-emitting display device is an LCD (Liquid Crystal Display) device.
[0039] FIG. 2 illustrates the configuration of a screen provided through a display device according to one embodiment.
[0040] Referring to FIG. 2, a screen (S) provided through a display device (10) may be formed by graphic image frames and video frames. The graphic image frames may be generated based on graphic data. A graphic processor (110) described below may generate graphic data, and a graphic scaler (130) may process the graphic data to generate graphic image frames. The video frames may be generated based on video data acquired from an external source (20).
[0041] A graphic image frame may include various graphic elements. For example, a first graphic element (GI1), a second graphic element (GI2), a third graphic element (GI3), and a fourth graphic element (GI4) appearing on a screen (S) of FIG. 2 may be included in the graphic image frame. In addition, the graphic image frame may include a video display area (V1, V2) for displaying a video frame. The video frame may be output from the video display areas (V1, V2). Different video frames may be output from the first video display area (V1) and the second video display area (V2).
[0042] The first graphic element (GI1), the second graphic element (GI2), the third graphic element (GI3), and the fourth graphic element (GI4) may each include at least one of text and an image. The graphic elements may include a graphical user interface (GUI) for providing interaction between a user and the display device (10). For example, the first graphic element (GI1), the second graphic element (GI2), and the third graphic element (GI3) may correspond to various GUIs for selecting or changing a video displayed in a video display area (V1, V2). The fourth graphic element (GI4) may provide information corresponding to a video output from one of the plurality of video display areas (V1, V2).
[0043] The display device (10) can obtain user input through a display panel (400), a remote controller, or a user device (e.g., a smartphone). The display panel (400) can include a touch display. Various graphic elements (GI1, GI2, GI3, GI4) and various video display areas (V1, V2) appearing on the screen (S) can be selected according to the user input. When one of the various graphic elements (GI1, GI2, GI3, GI4) is selected by the user input, the video appearing in the video display area (V1, V2) can be changed. When one of the video display areas (V1, V2) is selected by the user input, the video can be played or paused in the selected video display area. In addition, when one of the video display areas is selected, the video corresponding to the selected video display area can be provided in full screen.
[0044] The display device (10) can synthesize graphic image frames and video frames to create a screen (S). For example, the display device (10) can perform alpha blending to synthesize the graphic image frames and video frames. Alpha blending refers to a process of adjusting the transparency of partial pixels or all pixels in an image and placing another image or video on the partial pixels or all pixels with adjusted transparency. Alpha blending is a known technique in the graphics and / or image processing field.
[0045] Referring to FIG. 2, the display device (10) can set the transparency of the video display areas (V1, V2) in the graphic image frame to be relatively high. The video display areas (V1, V2) can be determined by alpha data included in the graphic data. The alpha data can include transparency information regarding at least a portion of the graphic image frame. Some pixels of the graphic image frame can be processed to be transparent through alpha blending. Some transparent pixels of the graphic image frame can be set as the video display areas (V1, V2). The display device (10) can create a screen frame by inserting, overlapping, or overlaying a video frame into the video display areas (V1, V2) of the graphic image frame. The display panel (400) can display a screen (S) corresponding to the screen frame.
[0046] Although the screen (S) displayed by the display device (10) is exemplified as including graphic image frames and video frames, it is not limited thereto. The display device (10) may also display a screen (S) including only graphic image frames. The display device (10) may also display a screen (S) including only video frames.
[0047] Figure 3 illustrates a configuration of a display device according to one embodiment.
[0048] Referring to FIG. 3, the display device (10) may include a graphics processor (110), a graphics buffer (120), a graphics scaler (130), a video buffer (210), a video scaler (220), a mixer (300), a display panel (400), and a main processor (500). In addition, the display device (10) may include a connection interface (101) for connection with an external source (20). The components of the display device (10) may be electrically connected.
[0049] The graphics processor (110), graphics buffer (120), graphics scaler (130), video buffer (210), video scaler (220), mixer (300), display panel (400), main processor (500), and connection interface (101) are all hardware and may include at least one electrical element and electronic circuit. The electronic circuit may include a logic circuit, an arithmetic circuit, and a control circuit.
[0050] The connection interface (101) can connect the display device (10) and an external source (20). For example, the connection interface (101) can include a wired interface such as an HDMI (High Definition Multimedia Interface), a display port, a component port, a VGA port, a USB port, and an audio port.
[0051] In addition, the connection interface (101) may include a communication interface for wireless communication with an external source (20). For example, the communication interface may include a wireless communication circuit to which various wireless communication technologies such as 3G communication, 4G communication, wireless LAN, Wi-Fi, Bluetooth, Zigbee, Wi-Fi Direct (WFD), Ultra-Wide Band (UWB), infrared communication, Bluetooth Low Energy (BLE), Near Field Communication (NFC), and / or Z-Wave are applied.
[0052] An external source (20) can transmit source data including at least one of video data and audio data to a display device (10). For example, the external source (20) may correspond to a server, a set-top box, a cable receiver, a satellite broadcast receiver, a personal computer, a game console, a smartphone, or a Blu-ray disc player. The external source (20) is not limited to those exemplified.
[0053] The graphics buffer (120) and the video buffer (210) correspond to memories and can be implemented as separate memories. The graphics buffer (120) can store graphics data. The video buffer (210) can store not only video data but also graphics data.
[0054] In addition to the graphics buffer (120) and the video buffer (210), the display device (10) may further include a memory that stores various information necessary for the operation of the display device (10). For example, the memory may store programs, data, instructions, software, and / or applications for controlling the operation of the display device (10).
[0055] The memory may include volatile memory such as Static Random Access Memory (S-RAM) or Dynamic Random Access Memory (D-RAM) for temporarily storing data. In addition, the memory (322) may include nonvolatile memory such as Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), or Electrically Erasable Programmable Read Only Memory (EEPROM) for long-term storage of data.
[0056] The graphics processor (110) can generate graphic data. The graphic data can be generated from various graphic source data stored in memory. The graphic source data can be pre-stored in memory or downloaded from the Internet. The graphic source data can also be obtained from an external source (20).
[0057] Graphic data may include color data and alpha data. The color of each of the plurality of pixels constituting the graphic image frame may be determined by the color data. For example, the color data may include RGB data. The alpha data may include transparency information regarding at least a portion of the graphic image frame. The alpha data may determine at least a portion of the pixels in the graphic image frame that are processed as transparent.
[0058] The graphics processor (110) can store graphic data in a graphics buffer (120) or a video buffer (210). The graphics processor (110) can be controlled to store graphic data in a video buffer (210) when upscaling of the graphic data is required.
[0059] The graphic scaler (130) can generate at least one graphic image frame based on graphic data stored in the graphic buffer (120). The graphic scaler (130) can adjust the size and / or ratio of the graphic image frame to suit the specifications of the display panel (400).
[0060] The video scaler (220) can generate a video frame based on video data stored in the video buffer (210). The video scaler (220) can adjust the size and / or ratio of the video frame to match the specifications of the display panel (400). The video scaler (220) can restore the resolution of the video data. Restoring the resolution may refer to upscaling the resolution.
[0061] In addition, the video scaler (220) can process graphic data stored in the video buffer (210). The video scaler (220) can upscale the graphic data. Upscaling the graphic data may include upscaling the resolution of color data included in the graphic data. For example, the video scaler (220) can upscale graphic data having HD (High Definition) resolution to increase the resolution of the graphic data to UHD (Ultra High Definition). The HD resolution may indicate that the number of pixels composing an image is 1280x720. The UHD resolution may indicate that the number of pixels composing an image is 3840x2160.
[0062] The video scaler (220) may include a resolution restoration circuit (221) for upscaling at least one of video data and graphic data. The resolution restoration circuit (221) may also be referred to as a super-resolution processing circuit. The resolution restoration circuit (221) may upscale the resolution of at least one of the video data and graphic data. In addition, the resolution restoration circuit (221) may adjust the size and / or ratio of at least one of the video frame and the graphic image frame.
[0063] Although the resolution restoration circuit (221) is described as being included in the video scaler (220), it is not limited thereto. The resolution restoration circuit (221) may also be provided as separate hardware.
[0064] The mixer (300) can synthesize a graphic image frame generated by the graphic scaler (130) and a video frame generated by the video scaler (220). The mixer (300) can perform alpha blending to synthesize the graphic image frame and the video frame. The mixer (300) can generate a screen frame by synthesizing the graphic image frame and the video frame.
[0065] The mixer (300) can adjust the transparency of the video display area (V1, V2) in the graphic image frame based on alpha data included in the graphic image frame. The mixer (300) can generate a screen frame by inserting, overlapping, or overlaying a video frame in the video display area (V1, V2) of the graphic image frame. The screen frame generated by the mixer (300) is transmitted to the display panel (400), and a screen (S) corresponding to the screen frame can be displayed on the display panel (400).
[0066] The display panel (400) may be provided as a self-luminous display panel or a water-luminous display panel. As described above, the display panel (400) includes a plurality of pixels (P), and each pixel may include a plurality of sub-pixels (PR, PG, PB). The display panel (400) may display a screen (S).
[0067] The main processor (500) can control the overall operation of the display device (10). The main processor (500) can control the operation of the graphics processor (110), graphics scaler (130), video scaler (220), mixer (300), and display panel (400).
[0068] In addition to the components described in FIG. 3, the display device (10) may further include various devices and / or components. For example, the display device (10) may further include a speaker that outputs sound.
[0069] The control method of the disclosed display device (10) is described in more detail with reference to FIGS. 4 to 7 below.
[0070] FIG. 4 illustrates an example of a data path for processing graphic data in a display device according to one embodiment.
[0071] The number of graphic image frames, i.e., the frame rate and resolution of the graphic image, may vary depending on the performance of the graphic processor (110). The resolution and frame rate of the graphic image are in a trade-off relationship. Typically, the resolution of the graphic image is lowered to provide a high frame rate.
[0072] Comparing the graphics scaler (130) and the video scaler (220), the video scaler (220) can provide relatively high data processing performance. The video scaler (220) can process more data more quickly. The video scaler (220) can process video data to output video frames with relatively high resolution and high frame rate.
[0073] Conventionally, graphic data generated by a graphic processor (110) was directly stored in a graphic buffer (120), and a graphic scaler (130) read the graphic data stored in the graphic buffer (120) to generate a graphic image frame. This caused a problem in that the resolution of the graphic image frame output from the graphic scaler (130) was lower than the resolution of the video frame output from the video scaler (220). That is, conventionally, a difference in image quality between graphic elements and video occurred on a screen (S) displayed through a display panel (400).
[0074] To address these issues, the disclosed display device (10) can use a data path for processing video data to process graphic data. The graphic processor (110) of the disclosed display device (10) can store graphic data in a video buffer (210) rather than a graphic buffer (120) (P1).
[0075] The video scaler (220) can be controlled to process graphic data stored in the video buffer (210) and store the processed graphic data in the graphic buffer (120). Specifically, the video scaler (220) can obtain color data of the graphic data stored in the video buffer (120) (P2). The video scaler (220) can upscale the resolution of color data included in the graphic data and store the upscaled color data in the graphic buffer (120) (P3). For example, through upscaling, the resolution of the color data can increase from HD (High Definition) to UHD (Ultra High Definition). The resolution of the upscaled color data can be the same as the resolution of the video data.
[0076] Additionally, the main processor (500) can copy alpha data included in the graphic data from the video buffer (210) to the graphic buffer (120) (P4). Since the alpha data relates to the video display area (V1, V2) within the graphic image frame, it does not need to be processed by the video scaler (220). Alternatively, the video scaler (220) can copy the alpha data from the video buffer (210) to the graphic buffer (120).
[0077] The graphic scaler (130) can generate a graphic image frame based on processed graphic data stored in a graphic buffer. The main processor (500) can control the graphic scaler (130) to generate the graphic image frame. The graphic scaler (130) can obtain upscaled graphic data including upscaled color data and alpha data from the graphic buffer (120) (P5). The graphic scaler (130) can generate a graphic image frame based on the upscaled graphic data (P6).
[0078] The graphic image frame can be transmitted to the mixer (300). The main processor (500) can control the display panel (400) to output a screen including the graphic image frame.
[0079] In this way, the display device (10) can increase the resolution of the graphic image by processing the graphic data using the video scaler (220) with relatively high performance. In addition, the frame rate of the graphic image can also be provided at a high level. In other words, the display device (10) can improve the image quality of the graphic image by bypassing the processing path of the graphic data and allowing the graphic data to be processed first in the video scaler (220) before being stored in the graphic buffer (120).
[0080] FIG. 5 illustrates an example of a data path for processing video data in a display device according to one embodiment.
[0081] Referring to FIG. 5, video data can be obtained from an external source (20). The main processor (500) can control the video scaler (220) to generate a video frame based on the video data transmitted from the external source (20).
[0082] The display device (10) can obtain video data from an external source (20) via a connection interface (101) (VP1). The video data obtained from the external source (20) can be stored in a video buffer (210) (VP2). A video scaler (220) can obtain video data from the video buffer (210) (VP3) and process the video data to generate at least one video frame. The video scaler (220) can perform at least one of changing the resolution of the video data, adjusting the size of the video frame, and adjusting the ratio of the video frame. The video frame generated by the video scaler (220) can be transmitted to a mixer (300) (VP4). A main processor (500) can control a display panel (400) to output a screen including the video frame.
[0083] FIG. 6 illustrates a data path for processing graphic data and a data path for processing video data described in FIGS. 4 and 5.
[0084] Referring to FIG. 6, the main processor (500) can control the mixer (300) to generate a screen frame by synthesizing a graphic image frame generated by the graphic scaler (130) and a video frame generated by the video scaler (220) (SF). The main processor (500) can control the mixer (300) to perform alpha blending for synthesizing the graphic image frame and the video frame.
[0085] The mixer (300) can adjust the transparency of the video display area (V1, V2) in the graphic image frame based on alpha data included in the graphic image frame. The mixer (300) can generate a screen frame by inserting, overlapping, or overlaying a video frame in the video display area (V1, V2) of the graphic image frame. The main processor (500) can control the display panel (400) to output a screen (S) corresponding to the screen frame. For example, the configuration of the screen (S) can be as illustrated in FIG. 2.
[0086] Since the resolution of the graphic data in the video scaler (220) is made the same as the resolution of the video data, there is no difference in the image quality between the graphic elements and the video on the screen (S) output through the display panel (400). That is, the disclosed display device (10) can not only make the frame rate of the graphic image frame the same as the frame rate of the video frame, but can also make the resolution of the graphic image the same as the resolution of the video. Therefore, the screen (S) output through the display panel (400) can have an overall improved image quality.
[0087] FIG. 7 illustrates another example of a data path for processing video data in a display device according to one embodiment.
[0088] Referring to FIG. 7, the display device (10) may include a plurality of video buffers (210, 240) and a plurality of video scalers (220, 240). The first video buffer (210) may be used to store graphic data generated by the graphic processor (110). The first video scaler (220) may be used to upscale the graphic data stored in the first video buffer (210).
[0089] The second video buffer (230) can be used to store video data obtained from an external source (20). The second video scaler (240) can be used to process the video data stored in the second video buffer (230).
[0090] Although not illustrated in FIG. 7, as described above, video data may also be stored in the first video buffer (210), and the first video scaler (220) may also process the video data. The video data processed by the first video scaler (220) and the video data processed by the second video scaler (240) may be obtained from different external sources (20).
[0091] Although the example shows two video buffers and two video scalers, this is not a limitation. Three or more video buffers and three or more video scalers may be provided.
[0092] The main processor (500) can control the mixer (300) to generate a screen frame by synthesizing a plurality of video frames and graphic image frames generated by each of the plurality of video scalers (220, 240). The video frames generated by different video scalers can be placed in different video display areas of the graphic image frame.
[0093] For example, a first video frame output from a first video scaler (220) may be placed in a first video display area (V1) of a graphic image frame. A second video frame output from a second video scaler (240) may be placed in a second video display area (V2) of the graphic image frame. In this case, different videos may be played simultaneously on a single screen (multi-view).
[0094] When video frames are generated from each of three or more video scalers, three or more video display areas within the graphic image frame may also be provided.
[0095] A display device according to one embodiment may include: a display panel; a graphics processor that stores graphic data in a video buffer; a video scaler that processes the graphic data stored in the video buffer and stores the processed graphic data in a graphics buffer; a graphics scaler that generates a graphic image frame based on the processed graphic data stored in the graphics buffer; and a main processor that controls the display panel to output a screen including the graphic image frame.
[0096] The main processor can control the video scaler to upscale the resolution of color data included in the graphic data and store the upscaled color data in the graphic buffer.
[0097] The main processor may copy alpha data included in the graphic data from the video buffer to the graphic buffer. The main processor may control the graphic scaler to obtain the upscaled color data and the alpha data from the graphic buffer and generate the graphic image frame.
[0098] The main processor may control the video scaler to generate a video frame based on video data transmitted from an external source. The main processor may control a mixer to generate a screen frame by synthesizing the graphic image frame and the video frame. The main processor may control the display panel to output the screen corresponding to the screen frame.
[0099] The main processor can control the mixer to perform alpha blending to composite the graphic image frame and the video frame.
[0100] The mixer can adjust the transparency of a video display area in the graphic image frame based on alpha data included in the graphic image frame. The mixer can insert the video frame into the video display area of the graphic image frame.
[0101] The above video scaler may be provided in multiple numbers. The main processor may control the mixer to generate the screen frame by synthesizing a plurality of video frames generated by each of the plurality of video scalers and the graphic image frame.
[0102] The above video scaler may include a resolution restoration circuit that performs at least one of resolution upscaling of the graphic data and size adjustment of the graphic data.
[0103] A method for controlling a display device according to one embodiment may include: storing graphic data generated by a graphic processor in a video buffer; processing the graphic data stored in the video buffer by a video scaler, storing the processed graphic data in a graphic buffer; generating a graphic image frame based on the processed graphic data stored in the graphic buffer by a graphic scaler; and outputting a screen including the graphic image frame through a display panel.
[0104] Processing the above graphic data may include upscaling the resolution of color data included in the graphic data; and storing the upscaled color data in the graphic buffer.
[0105] The control method of the display device may further include copying, by the main processor, alpha data included in the graphic data from the video buffer to the graphic buffer. The graphic image frame may be generated based on the upscaled color data and the alpha data stored in the graphic buffer.
[0106] The method for controlling the display device may further include generating a video frame based on video data transmitted from an external source by the video scaler. Outputting the screen may include generating a screen frame by synthesizing the graphic image frame and the video frame by a mixer; and outputting the screen corresponding to the screen frame.
[0107] Generating the above screen frame may include performing alpha blending to composite the graphic image frame and the video frame.
[0108] Performing the alpha blending may include adjusting transparency of a video display area in the graphic image frame based on alpha data included in the graphic image frame, and inserting the video frame into the video display area of the graphic image frame.
[0109] Generating the above screen frame may include synthesizing the graphic image frame with a plurality of video frames generated by each of a plurality of video scalers.
[0110] A non-transitory computer-readable recording medium according to one embodiment can store a program for executing the control method of the above-described display device.
[0111] The disclosed display device and its control method can increase the resolution of a graphic image without reducing the frame rate of the graphic image by using a data path for processing video data to process graphic data.
[0112] Meanwhile, the disclosed embodiments may be implemented in the form of a storage medium storing computer-executable instructions. The instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform the operations of the disclosed embodiments.
[0113] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0114] The methods according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0115] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.
Claims
1. Display panel; A graphics processor that stores graphics data in a video buffer; A video scaler that processes the graphic data stored in the video buffer and stores the processed graphic data in the graphic buffer; A graphics scaler that generates a graphics image frame based on the processed graphics data stored in the graphics buffer; and A display device comprising a main processor for controlling the display panel to output a screen including the graphic image frame.
2. In paragraph 1, The above main processor A display device that controls the video scaler to upscale the resolution of color data included in the graphic data and store the upscaled color data in the graphic buffer.
3. In paragraph 2, The above main processor Copying alpha data included in the above graphic data from the video buffer to the graphic buffer, A display device that controls the graphics scaler to generate the graphics image frame by obtaining the upscaled color data and the alpha data from the graphics buffer.
4. In paragraph 1, The above main processor Controlling the video scaler to generate a video frame based on video data transmitted from an external source; Controlling the mixer to generate a screen frame by synthesizing the graphic image frame and the video frame; A display device that controls the display panel to output the screen corresponding to the screen frame.
5. In paragraph 4, The above main processor A display device that controls the mixer to perform alpha blending for compositing the graphic image frame and the video frame.
6. In paragraph 5, The above mixer Adjusting the transparency of the video display area in the graphic image frame based on alpha data included in the graphic image frame, A display device that inserts the video frame into the video display area of the graphic image frame.
7. In paragraph 4, The above video scaler is provided in multiple units, The above main processor A display device that controls the mixer to generate the screen frame by synthesizing a plurality of video frames generated by each of a plurality of video scalers and the graphic image frame.
8. In paragraph 1, The above video scaler A display device comprising a resolution restoration circuit that performs at least one of resolution upscaling of the graphic data and size adjustment of the graphic data.
9. Store the graphic data generated by the graphic processor in the video buffer; By the video scaler, the graphic data stored in the video buffer is processed, and the processed graphic data is stored in the graphic buffer; By a graphics scaler, a graphics image frame is generated based on the processed graphics data stored in the graphics buffer; and A method for controlling a display device, comprising: outputting a screen including the graphic image frame through a display panel; 10. In paragraph 9, Processing the above graphic data Upscales the resolution of color data included in the above graphic data; A method of controlling a display device, comprising: storing upscaled color data in the graphics buffer; 11. In paragraph 10, further comprising, by the main processor, copying alpha data included in the graphic data from the video buffer to the graphic buffer; The above graphic image frame is A method for controlling a display device, the method comprising: generating upscaled color data and alpha data stored in the graphics buffer; 12. In paragraph 9, Further comprising: generating a video frame based on video data transmitted from an external source by the video scaler; Outputting the above screen By means of a mixer, the graphic image frame and the video frame are synthesized to generate a screen frame; A method for controlling a display device, comprising: outputting the screen corresponding to the screen frame.
13. In paragraph 12, Creating the above screen frame A method for controlling a display device, comprising: performing alpha blending to composite the graphic image frame and the video frame.
14. In paragraph 13, Performing the above alpha blending is: Adjusting the transparency of the video display area in the graphic image frame based on alpha data included in the graphic image frame, A method for controlling a display device, comprising: inserting the video frame into the video display area of the graphic image frame.
15. In paragraph 12, Creating the above screen frame is: A method of controlling a display device, comprising: synthesizing a plurality of video frames generated by each of a plurality of video scalers and the graphic image frame.
Citation Information
Patent Citations
Device for an on screen display scaling and the method thereof
KR100744519B1
Video output control apparatus of broadcasting receiver
KR100789539B1
Disaster relief robot including multiple communication relay device
KR102700549B1
Apparatus and method for mixing graphics with video images
US20120188459A1
Full-screen displays
US20210035537A1