Image processing apparatus and method

Abstract

The display device may include a memory for storing at least one instruction, wherein the at least one instruction, when executed by at least one processor, causes the display device to: acquire a first screen capture image having a first data format; change the data format of the first screen capture image from the first data format to a second data format including a transparency element; adjust the value of the transparency element of a video region in the first screen capture image associated with a first video image to transparently process the video region; generate a second composite image based on the first video image or a second video image following the first video image and a second screen capture image including the transparently processed video region; and perform blurring processing on the second composite image.

Description

Technical Field

[0001] This disclosure relates to an image processing apparatus and method. Background Technology

[0002] Recently, display devices such as TVs have been using broadcast signals to display graphic information, such as program guide information, along with video images and providing it to users.

[0003] When video and graphic images are provided together, it may sometimes be necessary to apply image processing effects, such as blurring, to the images in order to effectively convey the desired information to the user. In such cases, image processing methods need to be considered to apply the desired image processing effects despite performance limitations such as hardware and software limitations. Summary of the Invention

[0004] Technical solution

[0005] According to one or more example embodiments, a display device may include: a display; at least one processor; and a memory storing at least one instruction that, when executed by the at least one processor, causes the display device to: capture a first composite image generated based on a first video image and at least one graphic image using a screen capture method to obtain a first screen capture image having a first data format, wherein the first data format does not include a transparency element indicating transparency; change the data format of the first screen capture image from the first data format to a second data format including the transparency element; make a video region transparent by adjusting the value of the transparency element of a video region associated with the first video image in the first screen capture image based on data of the second data format; generate a second composite image based on a second screen capture image including the transparent video region and the first video image or a second video image following the first video image, wherein the area in the second composite image displaying the first video image or the second video image is in the transparent video region; blur the second composite image; and control the display to display at least a portion of the blurred second composite image.

[0006] According to one or more example embodiments, a method of a display device may include: capturing a first composite image generated based on a first video image and at least one graphic image using a screen capture method to obtain a first screen capture image having a first data format, wherein the first data format does not include a transparency element indicating transparency; changing the data format of the first screen capture image from the first data format to a second data format that may include the transparency element; making a video region transparent by adjusting the value of the transparency element of a video region associated with the first video image in the first screen capture image based on data of the second data format; generating a second composite image based on a second screen capture image that may include the transparent video region and the first video image or a second video image following the first video image, wherein the area in the second composite image displaying the first video image or the second video image is in the transparent video region; blurring the second composite image; and displaying at least a portion of the blurred second composite image.

[0007] According to one or more example embodiments, a display device may include: a display; at least one processor; and a memory storing at least one instruction, which, when executed by the at least one processor, causes the display device to: generate a composite image including a graphic image and a video image located in a transparent area; receive instructions for performing an application supporting blurring; blur the composite image based on the instructions; generate a display image including at least a portion of the blurred composite image, the blurred composite image having an application-associated image superimposed thereon; and control the display to display the display image. Attached Figure Description

[0008] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0009] Figure 1 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure;

[0010] Figure 2 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure;

[0011] Figure 3 This is a view illustrating the process by which a display device processes video data and graphics data according to embodiments of the present disclosure;

[0012] Figure 4 This is a view illustrating the capture operation of a display device according to an embodiment of the present disclosure;

[0013] Figure 5 This is a view showing an image obtained by a capture operation of a display device according to an embodiment of the present disclosure;

[0014] Figure 6 The changes in the output image according to the execution of an application that supports image effects processing, according to an embodiment of the present disclosure, are illustrated.

[0015] Figure 7 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure;

[0016] Figure 8 This is a view showing the blurring result according to the blurring process in a multi-window scenario, based on an embodiment of the present disclosure;

[0017] Figure 9 This is a view showing the blurring result according to the blurring process in a multi-window scenario, based on an embodiment of the present disclosure;

[0018] Figure 10 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure;

[0019] Figure 11 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure;

[0020] Figure 12 The image changes shown are a result of processing a screen-captured image during a blurring process, according to an embodiment of the present disclosure.

[0021] Figure 13 An image obtained during the blurring process according to an embodiment of the present disclosure is shown; and

[0022] Figure 14 This is a flowchart illustrating a method of using a display device according to an embodiment of the present disclosure. Detailed Implementation

[0023] Embodiments of this disclosure will be described in detail below with reference to the accompanying drawings to enable those skilled in the art to easily practice this disclosure. However, this disclosure may be implemented in various other forms and is not limited to the embodiments set forth herein. Throughout the specification and drawings, the same or similar reference numerals may be used to refer to the same or similar elements. Furthermore, for clarity and brevity, well-known functions and configurations are not described in the drawings and related descriptions.

[0024] It should be understood that the boxes in each flowchart and the combination of flowcharts can be executed by computer program instructions.

[0025] Furthermore, each box may represent a module, segment, or portion of code comprising one or more executable instructions for performing the specified logical functions(s). It should also be noted that in some alternative embodiments, the functions mentioned in the boxes may occur in a different order. For example, depending on the respective function, two consecutively shown boxes may be executed substantially simultaneously or in reverse order.

[0026] As used herein, the term "unit" refers to a software element or hardware element, such as a field-programmable gate array (FPGA) or application-specific integrated circuit (ASIC). A unit plays a specific role. However, a "unit" is not limited to software or hardware. A "unit" can be configured in an addressable storage medium or can be configured to execute one or more packet processing devices. Thus, by way of example, a "unit" includes elements (e.g., software elements, object-oriented software elements, class elements, and task elements), processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data schemas, tables, arrays, and variables. The functionality provided within components and "units" can be combined into a smaller number of components and "units," or further separated into additional components and "units." Furthermore, elements or "units" can be implemented to reproduce one or more central processing units (CPUs) in a device or secure multimedia card. According to embodiments, "...unit" can include one or more packet processing devices.

[0027] Figure 1 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.

[0028] Figure 1 The display device 100 may be, but is not limited to, a smartphone, tablet PC, PC, smart TV, mobile phone, personal digital assistant (PDA), laptop computer, media player, microserver, digital broadcasting terminal, navigation, kiosk, home appliance, or other mobile or non-mobile computing device. Using the display device 100, various computing functions can be performed, such as real-time video viewing and communication. In the following description, it is assumed that the display device 100 is a TV or monitor, but this is merely an example, and the embodiments of this disclosure can be equally applied to electronic devices with display functions.

[0029] According to an embodiment, the display device 100 may include a processor (e.g., processing circuitry) 110, a memory 120, an image input interface 130 (e.g., including image input circuitry), a display 140, and a communication interface (e.g., including communication circuitry) 150.

[0030] According to an embodiment, memory 120 is a storage medium used by display device 100 and can store data, such as at least one instruction 121 (e.g., at least one instruction corresponding to at least one program) or configuration information. The program may include operating system (OS) programs and various application programs.

[0031] According to an embodiment, the memory 120 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card type (e.g., SD or XD memory card), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, or optical disk.

[0032] According to an embodiment, the image input interface 130 can receive image data via a tuner, an input / output interface, or a communication interface 150. The image input interface 130 may include at least one of a tuner or an input / output interface. The tuner can amplify, mix, and resonate a broadcast signal received via wired / wireless connection, tuning and selecting only the frequency of the broadcast channel desired to be received by the display device 100 among many radio components. The broadcast signal may include video, audio, and additional data (e.g., an electronic program guide (EPG)). The tuner can receive broadcast channels (or view images) from various broadcast sources, such as terrestrial broadcasts, cable broadcasts, satellite broadcasts, internet broadcasts, etc. The tuner may be integrated with the display device 100 or implemented as a separate tuner electrically connected to the display device 100. The input / output interface may include at least one of a High Definition Multimedia Interface (HDMI) input port, a component input jack, a PC input port, or a USB input jack, capable of receiving image data from external devices of the display device 100 under the control of the processor 110. It will be apparent to those skilled in the art that input / output interfaces can be added, removed, and / or changed depending on the performance and structure of the display device 100.

[0033] According to an embodiment, display 140 can perform functions for outputting information in the form of numbers, characters, images, and / or graphics. Display 140 may include at least one hardware module for output. The at least one hardware module may include at least one of, for example, a liquid crystal display (LCD), a light-emitting diode (LED), a light-emitting polymer display (LPD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), or a flexible LED (FLED). Display 140 can display a screen corresponding to data received from processor 110. Display 140 may be referred to as an "output unit," a "display unit," or other terms with equivalent technical meanings.

[0034] According to an embodiment, communication interface 150 can provide a wired / wireless communication interface enabling communication with external devices. Communication interface 150 may include at least one of wired Ethernet, a wireless LAN communication interface, or a short-range communication interface. The wireless LAN communication interface may include, for example, Wi-Fi and may support the Institute of Electrical and Electronics Engineers (IEEE) wireless LAN standard (IEEE 802.11x). The wireless LAN communication interface can wirelessly connect to an access point (AP) under the control of processor 110. The short-range communication interface can wirelessly perform short-range communication with external devices under the control of processor 110. Short-range communication may include Bluetooth, Bluetooth Low Energy, Infrared Data Association (IrDA), Ultra Wideband (UWB), WiFi Direct, and Near Field Communication (NFC). External devices may include server equipment and mobile terminals (e.g., telephones, tablets, etc.) that provide, for example, video services.

[0035] According to an embodiment, processor 110 can control at least one other component of display device 100 and / or perform computations or data processing related to communication by executing at least one instruction 121 stored in memory 120. Processor 110 may include at least one of central processing unit (CPU), graphics processing unit (GPU), microcontroller unit (MCU), sensor hub, auxiliary processor, communication processor, application processor, application-specific integrated circuit (ASIC) or field-programmable gate array (FPGA), and may have multiple cores.

[0036] Figure 2 This is a block diagram illustrating the configuration of a display device according to an embodiment of the present disclosure.

[0037] refer to Figure 2 The display device 200 may include a processor 110, a memory 120, an image input interface 130, a display 140, a communication interface 150, and a capture unit (e.g., including capture circuitry) 210. Figure 1 Compared to display device 100, Figure 2 The display device 200 may also include a capture unit 210. See reference... Figure 1 describe Figure 2 The display device 200 includes a processor 110, a memory 120, an image input interface 130, a display 140, and a communication interface 150. These will not be described again below.

[0038] According to an embodiment, processor 110 can generate a video image based on input video data input through image input interface 130. According to an embodiment, the video image can correspond to a video frame.

[0039] According to an embodiment, a video image can be an image corresponding to a received image signal (e.g., a broadcast signal). For example, a video image can be the content image itself, generated by converting a video signal corresponding to content into an image. For example, a video image can be a moving image constituting an image in which objects on the screen move over time, but is not limited thereto.

[0040] According to an embodiment, processor 110 can generate a graphic image based on input graphic data input through image input interface 130. According to an embodiment, the graphic image can correspond to a graphic frame.

[0041] According to an embodiment, the graphic image may be an image displayed together with a video image. For example, the graphic image may be a static image constituting an image in which objects on the screen do not move over time, but is not limited thereto. According to an embodiment, the graphic image may be an image generated (or graphics processed) by the processor 110 of the display device (e.g., a GPU). According to an embodiment, the graphic image may include at least one piece of graphic information. The graphic information may include at least one of, for example, a user interface, menu information, configuration information, user guide information, electronic program guide information, or notification information.

[0042] According to an embodiment, the capture unit 210 can capture images. For example, the capture unit 210 can capture video images and / or graphic images (e.g., still images).

[0043] According to an embodiment, the capture unit 210 may store data of captured images (hereinafter, captured images) in a memory (e.g., a capture buffer). For example, the capture unit 210 may store data of captured video images (hereinafter, captured video images) in a video capture buffer, and may store data of captured graphic images (hereinafter, captured graphic images) in a graphic capture buffer.

[0044] According to an embodiment, in the display device 200, the capture unit 210 can allocate a capture buffer for each captured image. For example, the display device 200 can allocate a video capture buffer for each captured video image and a graphics capture buffer for each captured graphic image.

[0045] According to an embodiment, the capture unit 210 may include hardware components and / or software components. For example, the capture unit 210 may include hardware components (e.g., a video capture driver) for capturing video images and software components for capturing graphic images.

[0046] According to an embodiment, when capturing video images using hardware components (e.g., a video capture driver), the capture unit 210 may not be able to capture all of the live streaming video images due to hardware performance limitations. For example, when the video images are streaming at 60 frames per second (FPS), the capture unit 210 may capture video images with a capture performance of less than 60 frames per second (e.g., 15 frames per second). In this case, the display device can interpolate the uncaptured video images (e.g., 45 video images per second) using an interpolation function.

[0047] The following is for reference Figure 4 and Figure 5 An example is provided to illustrate the operation of the capture unit 210.

[0048] Figure 3 This is a view illustrating the process of processing video data and graphics data respectively through a video path and a graphics path of a display device according to embodiments of the present disclosure. The video path may refer to an image processing path used for moving a sequence of video frames, while the graphics path may refer to an image processing path used for still images.

[0049] refer to Figure 3 Display devices (e.g., Figure 1 Display device 100 or Figure 2 The display device 200 can generate multiple images, generate a composite image based on the generated multiple images, and output the composite image. For example, the display device can generate video images and graphic images using input video data and input graphic data respectively, generate a composite image based on the generated video images and graphic images, and output the composite image. According to an embodiment, the size of the composite image can be the same as the size of the screen displayed (or output) through the display 140.

[0050] According to an embodiment, a video image can be an image corresponding to a received image signal (e.g., a broadcast signal). For example, a video image can be the content image itself, generated by converting a video signal corresponding to content into an image. For example, a video image can be a moving image constituting an image in which objects on a screen move over time.

[0051] According to an embodiment, the graphic image may be an image displayed together with a video image. For example, the graphic image may be a static image constituting an image in which objects on the screen do not move over time. For example, the graphic image may be an image generated by the processor 110 (e.g., GPU) of the display device. According to an embodiment, the graphic image may include at least one piece of graphic information. The graphic information may include at least one of, for example, user interface information, menu information, configuration information, user guide information, electronic program guide information, or notification information.

[0052] According to an embodiment, the display device 200 can generate and / or process video images and graphic images through separate paths or pipelines. For example, the display device 200 can generate and / or process video images on the video plane through video path 310, and can generate and / or process graphic images on the graphic plane through graphic path 320.

[0053] According to an embodiment, the video plane can be a plane used to support the generation and / or processing of video images. For example, the video plane can support the generation and / or processing of video images having a first data format (e.g., YUV data format). Here, the first data format can be a data format that does not include elements indicating transparency (hereinafter referred to as transparency elements). For example, the first data format can be a YUV data format, but is not limited thereto. Here, the YUV data format is one of the video data formats and includes a luminance (Y) component indicating luminance information, a chroma blue (U) component indicating blue difference information, and a chroma red (V) component indicating red difference information.

[0054] According to an embodiment, the graphics plane can be a plane used to support the generation and / or processing of graphic images. For example, the graphics plane can support the processing and / or generation of graphic images having a second data format different from the first data format of the video plane. Here, the second data format can be a data format that includes a transparency element. For example, the second data format can be an RGBA data format, but is not limited thereto. Here, the RGBA data format is one of the data formats that indicates color information and includes a red (R) component indicating the red component, a green (G) component indicating the green component, a blue (B) component indicating the blue component, and an alpha (A) component indicating transparency. The corresponding values ​​of the components can be in the range of, for example, 0 to 255. For example, the alpha value can be in the range of 0 to 255, where 0 can indicate complete transparency and 255 can indicate complete opacity.

[0055] According to an embodiment, the video plane including the video image may have a different layer than the graphics plane including the graphic image. For example, the video plane may be a lower layer than the graphics plane. For example, when generating a composite image, the video image (or video plane) may be positioned below the graphic image (or graphics plane).

[0056] The generation and / or processing of video images via video path 310 can be performed by video input interface (e.g., including video input circuitry) 131 and video processor 111.

[0057] According to an embodiment, the video input interface 131 may be included in the image input interface 130.

[0058] According to an embodiment, the video input interface 131 can obtain input video data. For example, the video input interface 131 can obtain input data from an image signal received from a broadcast server. The input video data may include, for example, data used to generate at least one video image (e.g., video pixel data), but is not limited thereto.

[0059] According to an embodiment, video processor 111 may be included in processor 110. In this disclosure, the operation of video processor 111 can be understood as the operation of processor 110.

[0060] According to an embodiment, the video processor 111 can generate video images based on input video data. For example, the video processor 111 can generate at least one video image on the video plane based on video pixel data.

[0061] According to an embodiment, when multiple video images need to be generated, the video processor 111 can generate the video images on multiple video planes respectively. When generating video images on multiple video planes, different image settings (e.g., resolution, size / position, size / position of the window including the video image, etc.) can be applied to each video plane. The multiple video planes can have different layers.

[0062] According to an embodiment, the video processor 111 may include a scaler 111a and / or an image quality processor 111b. The video image generated by the video processor 111 on the video plane may be processed by the scaler 111a and / or the image quality processor 111b.

[0063] According to an embodiment, scaler 111a can perform scaling processing on a video image. Scaling processing may include adjusting the size and / or position of the video image. For example, scaling processing may include adjusting the dimensions or resolution of the video image. For example, scaling processing may include increasing or decreasing the dimensions of the video image, or increasing or decreasing the resolution of the video image. For example, scaling processing may include adjusting the position of the video image whose size or resolution has been adjusted. For example, scaling processing may include adjusting the position of the video image whose size or resolution has been adjusted.

[0064] According to an embodiment, scaler 111a can perform scaling processing on a video image such that the area displaying the video image in the composite image corresponds to a portion of a graphic image associated with the video image (e.g., a transparent area). For example, scaler 111a can scale the video image such that the area displaying the video image in the composite image matches a portion of a graphic image associated with the video image. For example, scaler 111a can scale the video image such that the area displaying the video image in the composite image is included in a portion of a graphic image associated with the video image. The graphic image associated with the video image may be, for example, a graphic image used to generate the composite image together with the video image.

[0065] According to an embodiment, scaler 111a can scale a video image based on scaling configuration information received from graphics processor 112 (or GPU 112a). The scaling configuration information may include a scaling factor and / or a position adjustment value. The scaling factor can be a ratio indicating how much the size of the video image should be adjusted. For example, the scaling factor can be a value representing a relative size change relative to the original size. If the scaling factor is less than 1, the size can be reduced, and if the scaling factor is greater than 1, the size can be enlarged. For example, when the scaling factor is 2, scaler 111a can enlarge the video image to twice its original size.

[0066] According to an embodiment, the image quality processor 111b can perform image quality processing on a video image (or a scaled video image). Image quality processing may include operations for enhancing the image quality of the video image. For example, image quality processing may include, but is not limited to, contrast and brightness adjustment operations, color correction operations, sharpness enhancement operations, tone mapping operations, filter and effects application operations, and / or noise removal operations.

[0067] exist Figure 3 In the embodiments described, the operation of the image quality processor 111b is performed after the operation of the scaler 111a; however, the embodiments are not limited thereto. For example, if desired, the operation of the image quality processor 111b may be performed before the operation of the scaler 111a. Furthermore, if desired, at least one of the operations of the scaler 111a and the image quality processor 111b for a specific video image may be omitted.

[0068] The generation and processing of graphics images via graphics path 320 can be performed by graphics input interface (e.g., including graphics input circuitry) 132 and graphics processor 112.

[0069] According to an embodiment, the graphics input interface 132 may be included in the image input interface 130.

[0070] According to an embodiment, the graphics input interface 132 can obtain input graphics data. For example, the graphics input interface 132 can receive input graphics data generated by at least one application of the display device. The input graphics data may include, for example, data for generating at least one graphic image (e.g., graphic pixel data).

[0071] According to an embodiment, graphics processor 112 may be included in processor 110. In this disclosure, operation of graphics processor 112 can be understood as operation of processor 110. According to an embodiment, graphics processor 112 may include GPU 112a.

[0072] According to an embodiment, the graphics processor 112 (or GPU 112a) can generate a graphic image based on input graphics data. For example, the graphics processor 112 (or GPU 112a) can generate at least one graphic image on a graphics plane based on graphics pixel data.

[0073] According to an embodiment, when multiple graphic images need to be generated (e.g., Figure 8 or Figure 9 In a multi-window scenario, the graphics processor 112 (or GPU 112a) can generate graphics images on multiple graphics planes separately. When generating graphics images on multiple graphics planes, different image settings (e.g., resolution, size / position, size / position of the window including the graphics image, etc.) can be applied to each graphics plane. The multiple graphics planes can have different layers.

[0074] According to an embodiment, the graphics processor 112 (or GPU 112a) can generate scaling configuration information for video images associated with the graphics images and send the scaling configuration information to the scaler 111a.

[0075] According to an embodiment, the display device can generate a composite image based on video images and graphic images. For example, the display device can generate a composite image by mixing video images and graphic images using mixer 113. For example, the display device can generate a composite image by overlapping video images and graphic images. For example, the display device can generate a composite image by placing a video image (e.g., a scaled video image) below a graphic image. In this case, the area displaying the scaled video image can correspond to a portion of the graphic image (e.g., a transparent area). Therefore, even though the video image is placed below the graphic image in the composite image, the video image is still visible to the user of the display device.

[0076] According to an embodiment, the display 140 can display the composite image as an output image 141. The output image 141 is an image visually recognized by the user of the display device and may be an image included on the screen of the display 140.

[0077] Figure 4 This is a view illustrating the capture operation of a display device according to an embodiment of the present disclosure. Figure 5 This is a view showing an image obtained by a capture operation of a display device according to an embodiment of the present disclosure.

[0078] refer to Figure 4 and Figure 5 Display devices (e.g., Figure 1 Display device 100 or Figure 2 The display device 200 can capture images. According to an embodiment, Figure 4 The capture operation can be performed by the capture unit of the display device (e.g., Figure 2 The capture unit 210) or processor (e.g., Figure 1 / Figure 2 The processor 110 executes the commands.

[0079] According to an embodiment, the display device may capture video images (hereinafter referred to as video capture 410) and / or capture graphic images (hereinafter referred to as graphic capture 420).

[0080] According to an embodiment, it can be in the video path (e.g., Figure 3 Video capture 410 is performed on the video path 310 (or video plane), and can be performed on the graphics path (e.g., Figure 3 Perform a graphics capture 420 on the graphics path 320 (or graphics plane).

[0081] According to an embodiment, video capture 410 may include a master / child zoomer capture operation 411, a post-capture operation 412, and / or a screen capture operation 413. According to an embodiment, graphics capture 420 may include a graphics window capture operation 421.

[0082] According to an embodiment, the captured image obtained by video capture 410 may have a video image data format (e.g., YUV data format). For example, the captured image obtained by master / child zoomer capture operation 411, post-capture operation 412, and screen capture operation 413 may have a YUV data format. According to an embodiment, the captured image obtained by graphics capture 420 may have a graphics image data format (e.g., RGBA data format). For example, the captured image obtained by graphics window capture operation 421 may have an RGBA data format.

[0083] According to an embodiment, the display device can perform at least one of the master / sub-scaler capture operation 411, the post-capture operation 412, or the screen capture operation 413 on the video path. For example, the display device can bypass the master / sub-scaler capture operation 411 and the post-capture operation 412, and can perform the screen capture operation 413 on the video path. For example, the display device can bypass the master / sub-scaler capture operation 411 and the screen capture operation 413, and can perform the post-capture operation 412 on the video path.

[0084] According to an embodiment, the display device may optionally perform the graphics window capture operation 421 on the graphics path. For example, when performing the screen capture operation 413 on the video path, the display device may not perform the graphics window capture operation 421 on the graphics path.

[0085] According to an embodiment, master / child scaler capture can be targeted at the scaler (e.g., Figure 3 The scaler 111a) performs a method for capturing the video image before scaling. The video image before scaling can be, for example, the video image itself generated based on the input video data. Since the video image is the video image before scaling, it can be, for example, a video image displayed over an entire area of ​​the screen.

[0086] According to an embodiment, in master / child scaler capture operation 411, the display device can obtain a scaler-captured image by capturing a video image before performing scaling using the master / child scaler capture method. An example of a scaler-captured image can be found with... Figure 5 The scaler captures the same image 511. (Example) Figure 5 As shown, the zoomer captures image 511, which can include a video image displayed across the entire area of ​​the screen.

[0087] According to an embodiment, the data of the scaled captured image can be stored in a buffer (hereinafter referred to as the scaler buffer) corresponding to the master / child scaler capture operation 411. The scaled captured image stored in the scaler buffer can be used for scaling by the scaler. In this disclosure, the master / child scaler capture 411 can be referred to as scaler capture.

[0088] According to an embodiment, post-capture may be performed after a zoomer (e.g., Figure 3 The method for capturing a video image after scaling performed by the scaler 111a). The scaled video image can be, for example, a video image generated by adjusting the position and / or size of a video image generated based on input video data. Since the video image is a scaled video image, it can be, for example, a video image displayed in a portion of the entire area of ​​the screen.

[0089] According to an embodiment, in post-capture operation 412, the display device can obtain a post-capture image by capturing a scaled video image using a post-capture method. An example of a post-capture image can be found in... Figure 5 The captured image 512 is the same. Figure 5 As shown, the post-captured image 512 may include a video image displayed in a portion of the screen.

[0090] According to an embodiment, the data of the post-captured image can be stored in a buffer (hereinafter referred to as the post-capture buffer) corresponding to the post-capture operation 412. The post-captured image stored in the post-capture buffer can be used for compositing with a graphic image.

[0091] According to an embodiment, graphics window capture can be a capture method for graphics images (or windows including graphics images).

[0092] According to an embodiment, in the graphics window capture operation 421, the display device can obtain a graphics window capture image by capturing a graphics image (or a window including a graphics image) using a graphics window capture method. An example of a graphics window capture image can be found in... Figure 5 The graphics window captures the same image as 521. Figure 5 As shown, the image captured by the graphics window can correspond to a graphic image included in a window (or graphics plane).

[0093] According to an embodiment, the data of the image captured by the graphics window can be stored in a buffer (hereinafter referred to as the graphics window capture buffer) corresponding to the graphics window capture operation 421. The graphics window capture image stored in the graphics window capture buffer can be used for compositing with a subsequent image.

[0094] At the same time, when multiple graphic images are presented on a single screen through multiple windows (or graphics planes) (e.g., Figure 8 or Figure 9 In multi-window scenarios, due to performance limitations of the windowing system, the display device can capture only one window via the graphics window capture operation 421. For example, the display device may capture only the window corresponding to the layer immediately below the window (or graphics plane), where information about a specific application (e.g., a blur app) associated with the graphics window capture operation 421 is displayed. In other words, windows located in layers below the captured window may not be captured. In other words, in multi-window scenarios, when using the graphics window capture operation 421, images where composite graphics images are formed may not be captured.

[0095] According to an embodiment, screen capture can be a method for capturing a composite image generated based on video images and graphic images. According to an embodiment, screen capture can be a method for capturing the entire screen. For example, screen capture can be a method for capturing the entire screen including the composite image. This can be achieved by using a mixer (e.g., Figure 3 The mixer 113) mixes, for example, a video image and at least one graphic image associated with the video image to generate a composite image.

[0096] According to an embodiment, in screen capture operation 413, the display device can obtain a screen capture image by capturing a composite image using a screen capture method. In this disclosure, a screen capture image may be referred to as a screenshot image. Examples of screen capture images can be related to... Figure 5 The screen capture image 513 is the same. For example... Figure 5 As shown, the screen capture image 513 may include a composite image (or the entire screen image including the composite image) generated by combining the captured image 512 and the captured image 521 in the graphics window. In the composite image, the area displaying the scaled video image may correspond to the transparent area of ​​the graphics window.

[0097] According to an embodiment, the data of the screen-captured image can be stored in a buffer (hereinafter, the screen capture buffer) corresponding to the screen capture operation 413. The screen-captured image stored in the screen capture buffer can be post-processed and used for compositing with a later-captured image. References below... Figures 10 to 13 Describe the post-processing of screen-captured images and the compositing of screen-captured images with post-captured images.

[0098] Figure 6 The changes in the output image according to the execution of an application that supports image effects processing, according to an embodiment of the present disclosure, are illustrated.

[0099] According to an embodiment, image effect processing can be blurring. According to an embodiment, blurring can include an operation of applying a blur effect (hereinafter referred to as a blur effect application operation) and / or an operation of outputting information associated with the blur application (hereinafter referred to as a blur output operation). A blur effect can be, for example, an effect that softens or blurs at least a portion of an image. For example, a blur effect can be an effect that blurs an entire area of ​​an image to which a blur effect has been applied (e.g., the first image 610) or a screen. Through blurring effects, details in an image can be hidden, or content displayed on an image that has undergone blur effect processing can be highlighted.

[0100] In the following description, blurring is used as an example of image effect processing to illustrate various embodiments of this disclosure, but the disclosure is not limited thereto. For example, various embodiments of this disclosure can also be applied to filtering, mosaic effect processing, averaging, or other processing for blurred images. In this disclosure, applications that support blurring may be referred to as blur apps or blur applications.

[0101] According to an embodiment, the display device (e.g., Figure 1 Display device 100 or Figure 2 The display device 200 can initiate blurring based on the recognition of events related to blurring. For example, the display device can initiate blurring in response to the execution of a blurring application.

[0102] According to an embodiment, the blurring can be caused by the processor of the display device (e.g., ...). Figure 1 / Figure 2 The processor 110) or GPU (e.g., Figure 3 The GPU 112a) is used for execution.

[0103] refer to Figure 6 The first image 610 corresponds to a composite image generated based on the video image 611 and the first graphic image 612.

[0104] The second image 620 corresponds to the image to which the blur effect applied to the first image 610 has been applied. According to an embodiment, the display device can apply the blur effect to an image by mixing the pixel values ​​of the image with those of adjacent pixels and setting the mixed pixel values ​​as new pixel values.

[0105] According to an embodiment, when a blur application is performed while displaying a first image 610, the display device can generate a second image 620 by applying a blur effect to the first image 610. For example, in response to performing a blur application while displaying the first image 610, the display device can generate a second image 620 by applying a blur effect to the first image 610. In this disclosure, the second image 620 with the applied blur effect can be referred to as a blurred image.

[0106] The third image 630 corresponds to the image in which the second graphic image 631 associated with the blurred application is displayed on the second image 620. For example, when the blurred second image 620 is generated normally, the display device can display the second graphic image 631 associated with the blurred application on the second image. According to an embodiment, the second graphic image 631 may include at least one piece of graphic information. At least one piece of graphic information may include at least one of, for example, menu information, configuration information (e.g., graphic window configuration information), user guide information, electronic program guide information, or notification information. According to an embodiment, the graphic information may be generated by a processor (e.g., Figure 1 / Figure 2 The processor 110) (or GPU (e.g., Figure 3 The GPU 112a) was generated.

[0107] Figure 7 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure. Figure 8 This is a view showing the blurring result of the blurring process in a multi-window scenario according to an embodiment of the present disclosure. Figure 9 This is a view showing the blurring result of the blurring process in a multi-window scenario according to an embodiment of the present disclosure.

[0108] refer to Figure 7 In operation 710, the display device (e.g., Figure 1 Display device 100 or Figure 2 The display device 200) can perform video capture on the first video image (e.g., Figure 4 Video capture 410). For example, a display device can perform a post-capture operation on a scaled first video image (e.g., Figure 4 The post-capture operation 412) is used to obtain the post-captured image (e.g., Figure 5 (Image captured after 512).

[0109] In operation 720, the display device can perform graphics capture on the graphic image (e.g., Figure 4 Graphics capture 420). For example, a display device can obtain a graphics window capture image (e.g., graphics window capture 421) by performing a graphics window capture operation on the graphics image. Figure 5 The graphics window captures the image (521). Operation 720 can be executed in parallel with operation 710. For example, operation 720 can be executed simultaneously or together with operation 710.

[0110] In operation 730, the display device can generate a first composite image based on the post-captured image and the image captured in the graphics window. For example, the display device can do so by using a mixer (e.g., Figure 3 The mixer 113) mixes the post-capture image and the graphics window capture image to generate a first composite image. For example, the display device can generate the first composite image by overlaying the post-capture image and the graphics window capture image. For example, the display device can generate the composite image by placing the post-capture image below the graphics window capture image. In this case, the area in the post-capture image that displays the video image can correspond to a portion of the graphics image (e.g., a transparent area). Therefore, even though the video image is placed below the graphics image in the composite image, the video image is still visible to the user of the display device. The first composite image can be, for example, with... Figure 5 The same image as the screen capture image 513.

[0111] In operation 740, the display device can perform a blur effect application operation on the first composite image. In operation 750, the display device can perform a blur output operation on the first composite image with the blur effect applied. For descriptions of the blur effect application operation, the blur output operation, and the resulting image, please refer to... Figure 6 The description is as follows. It will not be repeated below.

[0112] Subsequently, the display device can repeatedly perform operations 710 to 750 on video images(s) following the first video image. The video images(s) following the first video image(s) can be, for example, video images(s) configured to be displayed later in time than the first video image. For example, the video images(s) following the first video image(s) can belong to the same video stream as the first video image and be configured to be displayed later in time than the first video image(s). In this case, the graphics window capture image obtained through operation 720 described above can be used in the same manner for the associated video images(s) without change. Thus, the graphics image obtained through a single graphics window capture can be reused in the associated video images to blur the real-time video images. The associated video images can be, for example, video images configured to be displayed sequentially on a screen together with the graphics window capture image.

[0113] Furthermore, as mentioned above, due to limitations in software performance (e.g., window system performance), graphics capture methods (e.g., graphics window capture methods) may capture only one window (or graphics plane). For example, a display device may capture only the window (or graphics plane) corresponding to the layer immediately below the layer associated with the blurring application via graphics window capture. In other words, windows located in layers below the captured window may not be captured.

[0114] For example, such as Figure 8As shown, multiple graphic images can be configured to be provided on a single screen through multiple windows (or graphic planes) (multi-window case). For example, a first window 810 providing information associated with a blur application, a second window 820 positioned below the first window 810 and providing a notification, third-1 windows 831 and third-2 windows 832 positioned below the second window 820 and providing a TV viewer and a text viewer respectively, and a fourth window 840 positioned below the third-1 windows 831 and third-2 windows 832 and providing multiple views can be configured to be provided on a single screen. In this case, the display device may capture only the second window 820 (or the graphic images included in the second window 820, such as those including notifications) positioned in the layer immediately below the first window 810. In this case, the second window 820 corresponds to a window that is not displayed in the entire area of ​​the screen but in a partial area. Therefore, when the blur effect is applied to the corresponding window, the blur effect is not applied to the entire screen as originally intended, but only to a partial area of ​​the entire screen. Therefore, in the case of multiple windows, the initially expected ambiguous results may not be provided.

[0115] For example, such as Figure 9 As shown, multiple graphic images can be configured to be displayed on the screen through multiple windows (or graphic planes) (multi-window case). For example, a first window 910 providing information associated with a blur application, a second window 920 positioned below the first window 910 and providing a menu, a third window 930 positioned below the second window 920 and providing a guide application including a transparent hole 931, and a fourth window 940 positioned below the third window 930 and providing a TV viewer can be configured to be displayed on a single screen. In this case, the display device may only capture the second window 920 (or the graphic image included in the second window 920, such as the graphic image providing the menu) located in the layer immediately below the first window 910. In this case, the second window 920 corresponds to a window that is not displayed in the entire area of ​​the screen but in a partial area. Therefore, when the blur effect is applied to the corresponding window, the blur effect is not applied to the entire screen as originally expected, but only to a partial area of ​​the entire screen. Therefore, in the case of multiple windows, the originally expected blur result may not be provided.

[0116] As mentioned above, when applying blur using a composite image captured from a graphics window, it may not provide the full-screen blurring result initially expected in a multi-window scenario. Therefore, even in a multi-window scenario, a new blurring process is needed that can provide a full-screen blurring result as initially intended. This new blurring process could, for example, be a process that uses the screen to capture the image.

[0117] Figure 10 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure. Figure 11 This is a view illustrating a fuzzy process according to an embodiment of the present disclosure. Figure 12 The image changes shown are the result of processing a screen-captured image during a blurring process, according to an embodiment of the present disclosure. Figure 13 An image obtained during the blurring process according to an embodiment of the present disclosure is shown.

[0118] According to an embodiment, the display device (e.g., Figure 1 Display device 100 or Figure 2 The display device 200 can initiate the blurring process based on the recognition of events related to blurring. For example, the display device can initiate operation 1010 in response to the execution of the blurring application.

[0119] refer to Figure 10 and Figure 11 In operations 1010 and 1110, the display device may perform a screen capture operation on the first composite image (e.g., Figure 4 Screen capture operation 413).

[0120] According to an embodiment, operations 1010 and 1110 can be performed before the blurred application (or graphic information associated with the blurred application) is displayed on the screen. For example, operations 1010 and 1110 can be performed after the blurred application is applied and before the blurred application is displayed on the screen. When screen capture is performed after the blurred application is displayed on the screen, it is not possible to apply the blur effect to the lower layer of the blurred application because the blurred application is included in the screen capture image along with the first composite image.

[0121] According to an embodiment, the display device can obtain a screen capture image by capturing a first composite image using a screen capture method (e.g., Figure 5 Screen capture image 513 or Figure 12 (Screen capture image 1210). The data of the obtained screen capture image can be stored in the screen capture buffer.

[0122] According to an embodiment, a first composite image can be generated based on a first video image and at least one graphic image. For example, the first composite image can be generated by mixing the first video image and at least one graphic image. For example, the first composite image can be generated by overlapping the first video image and at least one graphic image.

[0123] According to an embodiment, the first video image may be a scaled video image. For example, the first video image may be generated by a scaler (e.g., Figure 3 The scaler 111a) scales the video image. (See reference...) Figure 3 Scaling is described. This will not be repeated below.

[0124] According to an embodiment, at least one graphic image may be associated with the first video image. For example, the at least one graphic image may be a graphic image configured to be displayed on a screen together with the first video image (or each video image in a first group of video images including the first video image).

[0125] According to an embodiment, at least one graphic image may include a first graphic image (e.g., Figure 9 The second window 920's graphic image) and the second graphic image (e.g., Figure 9 (The third window 930's graphic image).

[0126] According to an embodiment, a first graphic image and a second graphic image can be generated on different graphic planes. For example, a first graphic image can be generated on a first graphic plane, and a second graphic image can be generated on a second graphic plane, which is a lower graphic plane than the first graphic plane.

[0127] According to an embodiment, the first graphic image and the second graphic image can be provided on different windows. For example, the first graphic image can be provided through a first window, and the second graphic image can be provided through a second window. According to an embodiment, the first window and the second window can exist on the same graphic plane, or they can exist on different graphic planes.

[0128] According to an embodiment, the screen capture image may include a video region corresponding to a first video image and a graphic region corresponding to at least one graphic image associated with the first video image. For example, such as Figure 12 As shown, the first image 1210 may include a video region 1211 corresponding to the first video image and a graphic region 1212 corresponding to at least one graphic image associated with the first video image.

[0129] According to an embodiment, the screen-captured image may have a first data format. The first data format may be a data format that does not include a transparency element indicating transparency. For example, the first data format may be a YUV data format, but it is not limited thereto.

[0130] In operation 1011, the display device may perform post-processing on the screen-captured image. According to an embodiment, the post-processing operation on the screen-captured image may include operations to make video regions in the screen-captured image transparent.

[0131] According to an embodiment, the video region in the screen capture image may be associated with the first video image. For example, the video region in the screen capture image may be the same as the area displaying the first video image. For example, the video region in the screen capture image may include the area displaying the first video image.

[0132] According to an embodiment, when the screen-captured image has a first data format that does not include transparent elements, the display device can perform... Figure 11 Operations 1111 and 1112.

[0133] In operation 1111, the display device may change the data format of the screen-captured image from a first data format to a second data format that includes a transparency element. For example, before making a video area transparent, the display device may change the data format of the screen-captured image from the first data format to a second data format that includes a transparency element. The second data format may be a data format that includes a transparency element. For example, the second data format may be an RGBA data format, but is not limited to this. An example of a format-changed screen-captured image can be found with... Figure 12 The second image 1220 is identical. Since the processing through operation 1111 only changes the format of the data, the first image 1210 and the second image 1220 correspond to visually identical images.

[0134] In operation 1112, the display device can make a video region in a screen-captured image transparent. For example, after a data format change, the display device can identify a video region in the screen-captured image and adjust the value of the transparency element of the video region in the screen-captured image based on the data of the second data format, thereby making the video region transparent. For example, the display device can make the video region transparent by adjusting the alpha value of the pixel corresponding to the video region in the second data format data of the screen-captured image to 0. An example of a screen-captured image in which the video region is identified can be compared with... Figure 12 The third image 1230 is the same. An example of a screen capture image including a transparent video area can be found with... Figure 12 The fourth image 1240 is the same as the transparent video region 1241.

[0135] According to one embodiment, when a screen-captured image has a second data format including a transparency element, the display device can identify a video region in the screen-captured image and adjust the value of the transparency element of the video region in the screen-captured image based on the data of the second data format, thereby making the video region transparent without changing the data format. For example, the display device can make the video region transparent by adjusting the alpha value of the pixel value corresponding to the video region in the second data format data of the screen-captured image to 0.

[0136] According to an embodiment, the data of the post-processed screen capture image can be stored in a screen capture buffer. For example, the data of a screen capture image in which a video region is made transparent can be stored in the screen capture buffer.

[0137] In operations 1020 and 1120, the display device can perform video capture on the second video image (e.g., Figure 4 (Video capture 410). According to an embodiment, the second video image may be the same video image as the first video image used to obtain the screen capture image, or it may be a video image following the first video image (e.g., one of the video images in a first group of video images that includes the first video image). The second video image may be, for example, a graphic image configured to be displayed on a screen together with at least one graphic image associated with the first video image.

[0138] According to an embodiment, the second video image may be a scaled video image. For example, the second video image may be generated by a scaler (e.g., Figure 3 The scaler 111a) scales the video image. (See reference...) Figure 3 Scaling is described. This will not be repeated below.

[0139] According to an embodiment, the display device can obtain a first video capture image by capturing a second video image using a video capture method (e.g., Figure 13 The first video capture image 1310). For example, a display device can obtain the first post-captured image by capturing a second video image using a post-capture method (e.g., Figure 5 The data of the first video capture image (e.g., the first post-capture image) may be stored in a video capture buffer (e.g., the post-capture buffer). The data of the first video capture image stored in the video capture buffer may be used to generate a composite image based on the first video capture image, the post-processed screen capture image, and the data of the post-processed (e.g., video region transparency) screen capture image stored in the screen capture buffer.

[0140] During operations 1030 and 1130, the display device can perform compositing of the first video capture image and the post-processed screen capture image.

[0141] According to an embodiment, a display device can generate a second composite image based on a first video capture image (e.g., a first post-capture image) and a post-processed screen capture image (e.g., a screen capture image with a transparent video region). For example, the display device can generate the second composite image based on the first post-capture image and the screen capture image with a transparent video region. For example, the display device can generate the second composite image by synthesizing (or merging) the first post-capture image and the screen capture image with a transparent video region. For example, the display device can generate the second composite image by mixing the first post-capture image and the screen capture image with a transparent video region. For example, the display device can generate the second composite image by overlapping the first post-capture image and the screen capture image with a transparent video region.

[0142] For example, such as Figure 13 As shown, a display device can generate a second composite image 1330 by placing a first post-capture image 1310 below a screen capture image 1320 with a transparent video area. In this case, the area displaying the video image in the post-capture image 1310 can correspond to a portion of the screen capture image 1320 with a transparent video area (e.g., a transparent area). Therefore, even though the video image is arranged below the graphic image in the composite image 1330, the video image is still visible to the user of the display device.

[0143] According to an embodiment, the layer of the video plane (or window) including the first video capture image (e.g., the first post-captured image) can be the layer below the layer of the plane (or window) including the post-processed screen capture image (e.g., the screen capture image with a transparent video region). According to an embodiment, a scaled second video image in the first video capture image (e.g., the first post-captured image) can be arranged in the transparent video region of the second composite image. Therefore, even if the first video capture image is set as the layer below the post-processed screen capture image, the scaled second video image in the first video capture image can still be visible to the user of the display device through the transparent video region.

[0144] In operations 1040 and 1140, the display device can perform a blur effect application operation on the second composite image 1330 to generate a second composite image 1340 with the blur effect applied. In operations 1050 and 1150, the display device can perform a blur output operation on the second composite image 1340 with the blur effect applied. The display device can output a blur application image 1350, in which graphic information associated with the blur application supporting the blur is displayed on the second composite image 1340 with the blur effect applied. Therefore, at least a portion of the blurred second composite image 1340 can be displayed on the monitor. For a description of the blur effect application operation and the blur output operation, as well as a description of the resulting image, please refer to... Figure 6 The description is as follows. It will not be repeated below.

[0145] Subsequently, the display device can repeatedly perform operations 1020 to 1050 (or operations 1120 to 1150) on video images(s) following the second video image. The video images(s) following the second video image(s) can be, for example, video images(s) configured to be displayed later in time than the second video image. For example, the video images(s) following the second video image(s) can be video images(s) belonging to the same video stream as the first and second video images and configured to be displayed later in time than the first and second video images. In this case, the display device can use the post-processed screen capture image (or screen capture image with transparent video areas) obtained through the above-described operation 1011 (or operations 1111 and 1112) for the associated video images(s) without modification. The associated video images(s) can be graphic images following the second video image and are configured to be displayed on a screen together with at least one graphic image associated with the first video image (or the second video image). Thus, the screen capture image obtained through a single screen capture can be repeatedly used for the associated video images to blur the real-time video image.

[0146] Unlike the blurring process using a graphics window capture method, the blurring process using a screen capture method involves capturing the entire screen, including a composite image generated based on a video window and an associated graphics window, and then blurring the screen. Such a screen capture image can include all graphics images from multiple windows. Therefore, even when multiple graphics images are configured to be provided on a single screen through multiple windows (or graphics planes) (in the multi-window case), the blurring effect can be applied to the entire screen instead of just one window. Thus, even in the multi-window scenario, the blurring effect can be applied to the entire screen as originally intended.

[0147] For example, such as Figure 8As shown, a first window 810 providing information associated with the blur application, a second window 820 positioned below the first window 810 and providing notifications, third windows 831 and 832 positioned below the second window 820 and providing a TV viewer and a text viewer respectively, and a fourth window 840 positioned below the third windows 831 and 832 and providing multiple views can be configured to be provided through a single screen. In this case, the screen capture image may include the entire screen image containing all the graphic images of the second window 820, the third window 831, the third window 832, and the fourth window 840. Therefore, when the blur effect is applied to the corresponding screen capture image, the blur effect can be applied to the entire screen as originally intended. Thus, even in the case of multiple windows, the originally intended blur result can be provided.

[0148] For example, such as Figure 9 As shown, a first window 910 providing information associated with the blur application, a second window 920 positioned below the first window 910 and providing a menu, a third window 930 positioned below the second window 920 and providing a guide application including a transparent hole 931, and a fourth window 940 positioned below the third window 930 and providing a TV viewer can be configured to be provided through a single screen. In this case, the screen capture image can include the entire screen image containing all the graphic images of the second window 920, the third window 930, and the fourth window 940. Therefore, when the blur effect is applied to the corresponding screen capture image, the blur effect can be applied to the entire screen as originally intended. Thus, even in the case of multiple windows, the originally intended blur result can be provided.

[0149] Figure 14 This is a flowchart illustrating a method performed by a display device according to an embodiment of the present invention.

[0150] refer to Figure 14 Display devices (e.g., Figure 1 Display device 100 or Figure 2 The display device 200 can obtain a screen capture image (14010) having a first data format by capturing a first composite image generated based on a first video image and at least one graphic image using a screen capture method. According to an embodiment, the first data format may not include a transparency element indicating transparency.

[0151] The display device can change the data format of the captured image from a first data format to a second data format (14020) that includes a transparency element.

[0152] The display device can make the video region associated with the first video image in the screen capture image transparent by adjusting the value of the transparency element of the video region based on data in the second data format (14030).

[0153] The display device can generate a second composite image (14040) based on a screen capture image including a first video image or a second video image following the first video image and a transparent video region. According to an embodiment, the area in the second composite image that displays the first video image or the second video image may include the transparent video region.

[0154] The display device can blur the second composite image (14050).

[0155] According to an embodiment, at least one graphic image may include a first graphic image and a second graphic image, and the window including the first graphic image and the window including the second graphic image may be positioned in different layers.

[0156] According to an embodiment, obtaining a screen capture image can be performed before displaying a blur application or graphic information associated with a blur application on the screen.

[0157] According to an embodiment, the first data format may be YUV data format, and the second data format may be RGBA data format.

[0158] According to an embodiment, in order to make the video area transparent, the display device can adjust the alpha value of the pixel corresponding to the video area to 0 in the data of the second data format.

[0159] According to an embodiment, the second video image may correspond to a post-captured image obtained by capturing a video image scaled to be composited with at least one graphic image using a video capture method, and the second video image may have a first data format.

[0160] According to an embodiment, a second composite image can be generated by positioning a second video image in the layer below the layer containing the screen capture image, which includes the transparent video area.

[0161] According to an embodiment, in order to blur the second composite image, the display device can apply a blurring effect to the second composite image and output graphic information associated with the blurring application that supports blurring the second composite image to which the blurring effect has been applied.

[0162] According to embodiments of this disclosure, after blurring the second composite image, the display device can generate a third composite image by combining a third video image following the second video image with a screen capture image including a transparent video area, and blur the third composite image.

[0163] According to an embodiment, at least one graphic image may be configured to be displayed on a screen sequentially with each of a first video image, a second video image, and a third video image.

[0164] According to an embodiment, the graphic image may include at least one piece of graphic information, and the at least one piece of graphic information may be included in a graphic area located outside the video area in the screen capture image, and may include at least one of user interface, menu information, configuration information, user guide information, electronic program guide information, or notification information.

[0165] According to embodiments of this disclosure, the first video image and the graphic image may have different data formats, and the first video image and the screen capture image may have the same data format.

[0166] According to an embodiment, the display device can identify events related to blurring and, in response to identifying such events, obtain a screen capture image having a first data format.

[0167] In the specific embodiments described above, the components included in this disclosure are represented in either a singular or plural form according to the proposed specific embodiments. However, the singular or plural form is chosen to suit the context suggested for ease of description, and this disclosure is not limited to singular or plural components. As used herein, the singular forms “a”, “an”, and “the” are intended to also include the plural forms, unless the context clearly indicates otherwise.

[0168] Furthermore, although specific embodiments of this disclosure have been described above, various modifications can be made thereto without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the above embodiments, but should be defined by the appended claims and their equivalents.

Claims

1. A display device, comprising: monitor; At least one processor; and The memory stores at least one instruction, which, when executed by at least one processor, causes the display device to: A first screen capture image with a first data format is obtained by capturing a first composite image generated based on a first video image and at least one graphic image using a screen capture method, wherein the first data format does not include a transparency element indicating transparency; Change the data format of the first screen captured image from a first data format to a second data format that includes transparency elements; The video region is made transparent by adjusting the value of the transparency element of the video region associated with the first video image in the first screen capture image based on data in the second data format; A second composite image is generated based on a second screen capture image including a transparent video region and a first video image or a second video image following the first video image, wherein the area in the second composite image displaying the first video image or the second video image is in the transparent video region; Blurred second composite image; and Control the display to show at least a portion of the blurred second composite image.

2. The display device according to claim 1, wherein, At least one graphic image includes a first graphic image and a second graphic image, wherein the window including the first graphic image and the window including the second graphic image are positioned in different layers.

3. The display device according to any one of claims 1 to 2, wherein, The first data format is YUV data format, and the second data format is RGBA data format. In order to make the video area transparent, at least one instruction, when executed by at least one processor, also causes the display device to adjust the alpha value of the pixel corresponding to the video area to 0 in the data of the second data format.

4. The display device according to claim 1, in, The second video image corresponds to a post-captured image obtained by capturing a video image scaled for composite with at least one graphic image using a video capture method, and The second video image has a first data format.

5. The display device according to claim 3, wherein, The second composite image is generated by positioning the second video image in a lower layer than the layer that includes the second screen capture image.

6. The display device according to claim 1, wherein, In order to blur the second composite image, at least one instruction, when executed by at least one processor, also causes the display device to: Apply a blur effect to the second composite image; and Outputs graphic information associated with the blur application that supports blurring a second composite image to which a blur effect has been applied.

7. The display device according to claim 1, in, After blurring the second composite image, at least one instruction, when executed by at least one processor, also causes the display device to: A third composite image is generated by combining a third video image following the second video image with a screen capture image that includes a transparent video region; and Blurred third-party composite image, and In this configuration, at least one graphic image is configured to be displayed on a screen sequentially with each of the first video image, the second video image, and the third video image.

8. The display device according to claim 1, in, The first video image and at least one graphic image have different data formats, and The first video image and the first screen capture image have the same data format.

9. The display device according to claim 1, wherein, At least one instruction, when executed by at least one processor, further causes the display device to: Identify events related to fuzziness; and The first screen capture image is obtained by recognizing events related to blur.

10. A method for using a display device, the method comprising: A first screen capture image with a first data format is obtained by capturing a first composite image generated based on a first video image and at least one graphic image using a screen capture method, wherein the first data format does not include a transparency element indicating transparency; Change the data format of the first screen captured image from a first data format to a second data format that includes transparency elements; The video region is made transparent by adjusting the value of the transparency element of the video region associated with the first video image in the first screen capture image based on data in the second data format; A second composite image is generated based on a second screen capture image including a transparent video region and a first video image or a second video image following the first video image, wherein the area in the second composite image displaying the first video image or the second video image is in the transparent video region; Blurred second composite image; and Display at least a portion of a blurred second synthetic image.

11. The method according to claim 10, At least one of the graphic images includes a first graphic image and a second graphic image, and This includes a window containing a first graphic image and a window containing a second graphic image positioned on different layers.

12. The method according to claim 10 or 11, in, The first data format is YUV data format, and the second data format is RGBA data format. Making the video region transparent includes adjusting the alpha value of the pixels corresponding to the video region to 0 in the data of the second data format.

13. The method according to any one of claims 10 to 12, wherein, Obtaining the first screen capture image is performed before displaying the blur application or graphic information associated with the blur application on the screen.

14. The method of claim 10, wherein, The second composite image is generated by positioning the second video image in a lower layer than the layer that includes the second screen capture image.

15. The method according to claim 10, wherein, The blurred second composite image includes: Apply a blur effect to the second composite image; and Outputs graphic information associated with the blur application that supports blurring a second composite image to which a blur effect has been applied.

Images