Electronic device and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes a display and a processor, wherein the processor is configured to: obtain a low-frequency variation based on low-frequency information obtained from a first frame of a plurality of frames included in an input image and low-frequency information obtained from a second frame; obtain a high-frequency variation based on high-frequency information obtained from the first frame and the second frame; apply a weight obtained based on the difference between the low-frequency variation and the high-frequency variation to a high-frequency frame corresponding to the second frame to obtain a high-frequency frame to which the weight is applied; obtain an output frame corresponding to the second frame based on the second frame and the high-frequency frame to which the weight has been applied; and control the display to show the obtained output frame.

Description

Technical Field

[0001] The apparatus and method conforming to this disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same for performing image processing. Background Technology

[0002] Various devices and methods have been developed for outputting an image after performing image processing on an input image to improve its sharpness.

[0003] in this regard, Figure 1 This demonstrates the most commonly used methods in the field of image processing for improving image sharpness.

[0004] refer to Figure 1 A high-pass filter can be applied to an input frame included in an image to extract high-frequency components from that frame, and the extracted high-frequency components can then be added to the input frame to amplify the high-frequency components of the input frame.

[0005] Adding high-frequency components to the input frame can produce an output frame with increased sharpness and improved image quality. For example, the output frame can have amplified high-frequency components compared to the input frame, so objects in the frame can have sharper boundaries and amplified fine detail signals on their surfaces, thus improving the overall sharpness of the frame.

[0006] However, the output frames obtained using this method may have amplified high-frequency components, resulting in increased high-frequency variations between previous and subsequent frames.

[0007] If such increased variation exists between the high frequencies of multiple frames included in an image, flickering may occur when the image is reproduced. Flickering is an artifact that may occur if the image is provided by an electronic device. Users of the provided image are more sensitive to the image quality degradation (or artifacts) caused by flickering than to the improved sharpness resulting from the amplified high-frequency components.

[0008] Therefore, there is a growing need for a method to perform image processing to prevent flickering by minimizing high-frequency variations among the multiple frames included in an image while improving the sharpness of the frame. Summary of the Invention

[0009] Technical issues

[0010] This disclosure provides an electronic device and its control method for minimizing flicker while improving image clarity.

[0011] Technical solution

[0012] According to one aspect of this disclosure, an electronic device may include a display and a processor configured to: obtain a low-frequency variation based on low-frequency information corresponding to a first frame and low-frequency information corresponding to a second frame; obtain a high-frequency variation based on high-frequency information corresponding to the first frame and high-frequency information corresponding to the second frame; obtain a weight based on the difference between the low-frequency variation and the high-frequency variation; apply the weight to a high-frequency frame corresponding to the second frame; obtain an output frame corresponding to the second frame based on the second frame and the high-frequency frame to which the weight is applied; and control the display to display the obtained output frame.

[0013] This weight can be inversely proportional to the difference. This difference can be obtained by subtracting the low-frequency change from the high-frequency change.

[0014] The processor can also be configured to: obtain a low-frequency change based on a first low-frequency information of a first block among multiple blocks included in a first frame and a second low-frequency information of a second block among multiple blocks included in a second frame; obtain a high-frequency change based on a first high-frequency information of a first block and a second high-frequency information of a second block; obtain a first weight corresponding to the second block based on the difference between the low-frequency change and the high-frequency change; apply the first weight to the high-frequency block corresponding to the second block; and obtain an output block corresponding to the second block based on the second block and the high-frequency block to which the first weight is applied.

[0015] The processor can also be configured to: obtain multiple weights corresponding to each of the multiple blocks included in the second frame by comparing low-frequency change amounts with high-frequency change amounts, and apply each of the multiple weights to the corresponding block among the multiple blocks included in the high-frequency frame corresponding to the second frame.

[0016] The processor can also be configured to: obtain an output block by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block based on the difference between the low-frequency change amount and the high-frequency change amount being less than or equal to a first threshold; and obtain the second block as an output block based on the difference between the low-frequency change amount and the high-frequency change amount being greater than or equal to a second threshold.

[0017] The processor can also be configured to obtain an output block based on a first weight, based on the difference between low-frequency and high-frequency changes being greater than a first threshold and less than a second threshold.

[0018] The processor can also be configured to: obtain a high-frequency frame corresponding to the second frame by applying a first high-pass filter (HPF) to the second frame, obtain low-frequency information corresponding to the second frame by applying a first low-pass filter (LPF) to the second frame, and obtain high-frequency information corresponding to the second frame by applying a second HPF to the second frame.

[0019] The processor can be configured to obtain the weight based on the ratio of high-frequency changes to low-frequency changes.

[0020] The processor can also be configured to: obtain a low-frequency frame corresponding to the second frame and low-frequency information including frequencies below a threshold frequency by applying a low-pass filter (LPF) to the second frame, and obtain a high-frequency frame corresponding to the second frame including frequencies greater than or equal to a threshold frequency and high-frequency information based on the difference between the second frame and the low-frequency frame.

[0021] The processor can also be configured to obtain the low-frequency change based on the low-frequency information obtained from the first frame, which includes frequencies greater than or equal to a first threshold frequency and less than a second threshold frequency.

[0022] According to one aspect of this disclosure, a control method for an electronic device may include: obtaining a low-frequency change based on low-frequency information corresponding to a first frame and low-frequency information corresponding to a second frame; obtaining a high-frequency change based on high-frequency information corresponding to the first frame and high-frequency information corresponding to the second frame; obtaining a weight based on the difference between the low-frequency change and the high-frequency change; applying the weight to a high-frequency frame corresponding to the second frame; obtaining an output frame corresponding to the second frame based on the second frame and the high-frequency frame to which the weight is applied; and displaying the obtained output frame.

[0023] This weight can be inversely proportional to the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0024] Obtaining low-frequency variation may include: obtaining low-frequency variation based on first low-frequency information of a first block among multiple blocks included in the first frame and second low-frequency information of a second block among multiple blocks included in the second frame. Obtaining high-frequency variation may include: obtaining high-frequency variation based on first high-frequency information of the first block and second high-frequency information of the second block. Obtaining the weight may include: obtaining a first weight corresponding to the second block based on the difference between the low-frequency variation and the high-frequency variation. Applying the weight may include: applying the first weight to the high-frequency block corresponding to the second block. Obtaining the output frame may include: obtaining the output block corresponding to the second block based on the second block and the high-frequency block to which the first weight is applied.

[0025] Obtaining the weights may include: obtaining multiple weights corresponding to each of the multiple blocks included in the second frame by comparing low-frequency change amounts with high-frequency change amounts. Applying the weights may include: applying each of the multiple weights to the corresponding block among the multiple blocks included in the high-frequency frame corresponding to the second frame.

[0026] Obtaining an output frame may include: obtaining an output block by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block based on the difference between the low-frequency change amount and the high-frequency change amount being less than or equal to a first threshold; and obtaining the second block as an output block based on the difference between the low-frequency change amount and the high-frequency change amount being greater than or equal to a second threshold.

[0027] Here, obtaining an output frame may include: if the difference obtained by subtracting the low-frequency change from the high-frequency change is greater than a first threshold and less than a second threshold, then an output block is obtained based on a first weight, which is obtained based on the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0028] Additionally, the control method may include obtaining a high-frequency frame corresponding to the second frame by applying a first high-pass filter (HPF) to the second frame, wherein obtaining the low-frequency change amount includes obtaining a low-frequency frame and low-frequency information corresponding to the second frame by applying a low-pass filter (LPF) to the second frame, obtaining the high-frequency change amount includes obtaining high-frequency information corresponding to the second frame by applying a second high-pass filter to the second frame, and obtaining the high-frequency frame with applied weights includes obtaining the high-frequency frame with applied weights by applying weights obtained based on the low-frequency change amount and the high-frequency change amount to the high-frequency frame.

[0029] In addition, obtaining the output frame may include obtaining the weight based on the ratio of high-frequency changes to low-frequency changes.

[0030] In addition, obtaining low-frequency variation can include obtaining low-frequency frames and low-frequency information corresponding to the second frame and below a threshold frequency by applying a low-pass filter to the second frame, and obtaining high-frequency variation can include obtaining high-frequency frames and high-frequency information corresponding to the second frame and above or equal to a threshold frequency based on the difference between the second frame and the low-frequency frames.

[0031] Obtaining the low-frequency change may include obtaining the low-frequency change based on low-frequency information obtained from the first frame that is higher than or equal to a first threshold frequency and lower than a second threshold frequency, and low-frequency information obtained from the second frame, and obtaining the output frame may include obtaining the weight based on the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0032] Invention Effects

[0033] According to various embodiments of this disclosure, flickering can be minimized by allowing differential amplification of high-frequency components based on the amount of change in frequency energy over time.

[0034] It can provide images with improved sharpness, detail, image quality, etc., and minimize the degree of image quality degradation.

[0035] An image can be divided into multiple blocks, and the high-frequency components of each block can be amplified differentially. Attached Figure Description

[0036] Figure 1 This is a view illustrating a high-frequency method for magnifying an image according to the prior art.

[0037] Figure 2 This is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0038] Figure 3 This is a view showing low-frequency information and high-frequency information according to embodiments of the present disclosure.

[0039] Figure 4a and Figure 4b The diagrams show low-frequency and high-frequency frames, respectively, according to embodiments of the present disclosure.

[0040] Figure 5 This is a view showing the low-frequency variation and high-frequency variation according to an embodiment of the present disclosure.

[0041] Figure 6 Graphs are shown, each illustrating a function for obtaining weights according to an embodiment of the present disclosure.

[0042] Figure 7a and Figure 7b Each of these is a view showing a plurality of blocks included in a frame according to an embodiment of the present disclosure.

[0043] Figure 7c This is a view illustrating the weights according to embodiments of this disclosure.

[0044] Figure 8 This is a view showing low-frequency information and high-frequency information according to another embodiment of the present disclosure.

[0045] Figure 9 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0046] Figure 10 This is a flowchart illustrating a control method for an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0047] This specification will briefly describe the terminology used in it, and then describe the disclosure in detail.

[0048] Considering the functionality of this disclosure, currently widely used general terms are selected as the terms used in the embodiments of this disclosure, but these may be changed based on the intent of those skilled in the art, judicial precedent, the emergence of new technologies, etc. Furthermore, in certain circumstances, terms may be arbitrarily chosen by the applicant. In such cases, the meanings of these terms are detailed in the corresponding descriptive sections of this disclosure. Therefore, the terms used in the embodiments of this disclosure should be defined based on their meanings throughout the disclosure and its content, rather than simply their names.

[0049] This disclosure can be modified in various ways and has several embodiments, and specific embodiments of this disclosure are therefore shown in the accompanying drawings and described in detail in the specific implementation. However, it should be understood that this disclosure is not limited to the specific embodiments, but includes all modifications, equivalents, and substitutions without departing from the scope and spirit of this disclosure. Detailed descriptions of known technologies related to this disclosure will therefore be omitted where it is determined that such detailed descriptions might obscure the main points of this disclosure.

[0050] Terms such as “first” and “second” can be used to describe various components, but these components should not be interpreted as being limited by these terms. These terms are only used to distinguish one component from another.

[0051] Unless otherwise expressly indicated, the singular form used herein is intended to include the plural form. It should be understood that the terms "comprising" or "forming of" as used herein specify the presence of a feature, number, step, operation, component, part, or combination thereof mentioned herein, and do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0052] In the embodiments, a "module" or "device" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. Furthermore, except for "modules" or "devices" that require implementation by specific hardware, multiple "modules" or multiple "devices" may be integrated into at least one module and may be implemented by at least one processor (not shown).

[0053] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, enabling those skilled in the art to readily practice the present disclosure. However, the present disclosure can be modified in various different forms and is not limited to the embodiments provided in this specification. Furthermore, in the drawings, portions irrelevant to the description have been omitted for clear illustration, and similar portions are indicated by similar reference numerals throughout the specification.

[0054] Figure 1 This is a view illustrating a high-frequency method for magnifying an image according to the prior art.

[0055] refer to Figure 1 According to existing technology, electronic devices can use a high-pass filter (HPF) to obtain a high-frequency frame I corresponding to the input frame I. HF Then, according to existing electronic devices, the obtained high-frequency frame I can be... HF Add to input frame I to obtain output frame O.

[0056] Here, the output frame O can be a frame in which the high-frequency components of the input frame I are amplified, and compared with the input frame I, the output frame O can have improved sharpness and image quality.

[0057] However, existing image processing techniques can amplify the high-frequency components of each of the multiple frames included in an input image, thereby increasing the variation in high frequencies between consecutive frames. As a result, users of the provided image can primarily perceive degraded image quality, artifacts, or flickering (e.g., the display flickers if the frame switches to another frame), rather than improved image sharpness.

[0058] Below, various embodiments of the present disclosure are described as methods for performing image processing to improve the sharpness and image quality of an input frame while preventing flickering.

[0059] Figure 2 This is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0060] refer to Figure 2 The electronic device 100 includes a display 110 and a processor 120.

[0061] Here, electronic device 100 can be implemented as a television (TV), but is not limited to this. Electronic device 100 can be used without restriction, as long as the device has a display function, such as a smartphone, tablet PC, laptop PC, head-mounted display (HMD), near-eye display (NED), large-format display (LFD), digital signage, digital information display (DID), video wall, or projector display.

[0062] The display 110 according to embodiments of this disclosure can be implemented as any of various types of displays such as liquid crystal display (LCD), organic light-emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), quantum dot (QD) display panel, quantum dot light-emitting diode (QLED), micro light-emitting diode (μLED), or mini LED. Furthermore, the display 110 can be implemented as a touchscreen combined with a touch sensor, a flexible display, a rollable display, a three-dimensional (3D) display, or a display with multiple display modules physically connected to each other.

[0063] The processor 120 can control the overall operation of the electronic device 100.

[0064] Processor 120 may be implemented as a digital signal processor (DSP), microprocessor, or time controller (TCON) for processing digital video signals. However, processor 120 is not limited to these and may include one or more of a central processing unit (CPU), microcontroller unit (MCU), microprocessor unit (MPU), controller, application processor (AP), communication processor (CP), or advanced RISC machine (ARM) processor, or as defined by these terms. Additionally, processor 120 may be implemented as a system-on-a-chip (SoC) or large-scale integration (LSI) in which processing algorithms are embedded, or may be implemented as a field-programmable gate array (FPGA).

[0065] refer to Figure 1 Existing technology can obtain high-frequency frame I from input frame I. HF Add to input frame I to obtain output frame O.

[0066] Conversely, the processor 120 according to various embodiments of this disclosure can measure flicker intensity and differentiate the high-frequency frame I obtained from the input frame I based on the measured flicker intensity. HF Add to input frame I to obtain output frame O.

[0067] Here, flicker intensity can indicate the increase in the variation between high frequencies of consecutive frames as the high frequency components of input frame I are amplified, and digitally predict (or express) the flicker phenomenon that is thus predicted.

[0068] For example, if based on the flicker intensity, it is predicted that a strong flickering phenomenon will occur as the high-frequency components of the input frame I are amplified, then the processor 120 can obtain the high-frequency frame I from the input frame I. HF The high-frequency component is adjusted to be slightly amplified, and then added to the input frame I to obtain the output frame O. In this way, flickering can be prevented.

[0069] For example, if it is predicted, based on the flicker intensity, that flicker will not occur even if the high-frequency components of the input frame I are amplified, then the processor 120 can obtain the high-frequency frame I from the input frame I. HF The input frame I is added to obtain the output frame O. Therefore, the output frame O can have improved sharpness and image quality compared to the input frame I.

[0070] Various embodiments for measuring scintillation intensity are described below.

[0071] Figure 3 This is a view showing low-frequency information and high-frequency information according to embodiments of the present disclosure.

[0072] <Time point t-1>

[0073] At time point t-1, processor 120 can obtain a low-frequency frame corresponding to the first frame among multiple frames included in the input image by using a low-pass filter (LPF) (S310). Then, processor 120 can obtain low-frequency information based on the low-frequency frame corresponding to the first frame. For example, processor 120 can obtain frequency information including frequencies below a threshold frequency from the first frame. Here, the threshold frequency can correspond to the filtering strength of the low-pass filter.

[0074] Additionally, processor 120 can obtain a high-frequency frame corresponding to the first frame by using a high-pass filter (HPF) (S320). Then, processor 120 can obtain high-frequency information based on the high-frequency frame corresponding to the first frame. For example, processor 120 can obtain high-frequency information higher than or equal to a threshold frequency from the first frame. Here, the threshold frequency can correspond to the filtering strength of the low-pass filter or the filtering strength of the high-pass filter as described above.

[0075] Meanwhile, low-frequency information and high-frequency information can be referred to as low-frequency components and high-frequency components, respectively. However, for ease of description, in the various embodiments below, these components will be collectively referred to as low-frequency information and high-frequency information.

[0076] Here, the first frame can indicate the frame corresponding to time point t-1 among the multiple frames included in the input image.

[0077] refer to Figure 3 According to the embodiment, the processor 120 can obtain a high-frequency frame corresponding to the first frame by using a high-pass filter (HPF). Alternatively, the processor 120 can also obtain a high-frequency frame, i.e., a difference frame obtained by subtracting the low-frequency frame obtained in operation S310 from the first frame.

[0078] Meanwhile, the processor 120 according to an embodiment of the present disclosure can store the low-frequency information and high-frequency information, both corresponding to the first frame, obtained in operations S310 and S320 at time point t-1 in a memory (not shown).

[0079] <Time point t>

[0080] At time point t, processor 120 can obtain a low-frequency frame corresponding to the second frame among multiple frames included in the input image by using a low-pass filter (LPF) (S310). Then, processor 120 can obtain low-frequency information based on the low-frequency frame corresponding to the second frame. For example, processor 120 can obtain low-frequency information below a threshold frequency from the second frame.

[0081] Additionally, processor 120 can obtain a high-frequency frame corresponding to the second frame by using a high-pass filter (HPF) (S320). Then, processor 120 can obtain high-frequency information based on a low-frequency frame corresponding to the second frame. For example, processor 120 can obtain high-frequency information higher than or equal to a threshold frequency from the second frame.

[0082] Here, the second frame can refer to the frame corresponding to time point t among the multiple frames included in the input image, that is, the frame that is temporally continuous with the first frame.

[0083] like Figure 4a and Figure 4b As shown in the attached figures, the low-frequency frame and high-frequency frame obtained at time point t-1 and time point t, respectively.

[0084] Figure 4a and Figure 4b The diagrams show low-frequency and high-frequency frames, respectively, according to embodiments of the present disclosure.

[0085] refer to Figure 4a The processor 120 can obtain the first frame I at time point t-1. (t-1) Low-frequency frame I of 1 LF(t-1) 1-1 and high-frequency frame I HF(t-1) 1-2.

[0086] According to the embodiment, the processor 120 can obtain low-frequency information based on low-frequency frames 1-1 corresponding to the first frame 1.

[0087] For example, processor 120 can obtain low-frequency information based on Equation 1.

[0088] [Equation 1]

[0089]

[0090] here, (x,y) It can indicate the pixel coordinates in the frame, ILF (x,y) can indicate the pixel value or frequency value of the (x,y) pixel in a low-frequency frame, and E LF It can indicate low-frequency information (low-frequency energy or low-frequency power, and is referred to as low-frequency information below) of low-frequency frames.

[0091] In addition, the processor 120 according to the embodiment can obtain high-frequency information based on high-frequency frames 1-2 corresponding to the first frame 1.

[0092] [Equation 2]

[0093]

[0094] here, (x,y) I(x,y) can indicate the pixel coordinates in a frame, and I(x,y) can indicate the pixel value or frequency value of the (x,y) pixel in the input frame. HF (x,y) can indicate the pixel value or frequency value of the (x,y) pixel in a high-frequency frame, and E HF It can indicate high-frequency information (high-frequency energy or high-frequency power, and is referred to as high-frequency information in the following text) of high-frequency frames.

[0095] Next, refer to Figure 4b At time point t, processor 120 can obtain data corresponding to the second frame I. (t) 2 low-frequency frame I LF(t) 2-1 and high-frequency frame I HF(t) 2-2.

[0096] According to the embodiment, the processor 120 can obtain low-frequency information corresponding to the second frame 2 based on the low-frequency frame 2-1 corresponding to the second frame 2 and Equation 1.

[0097] In addition, according to the embodiment, the processor 120 can obtain high-frequency information corresponding to the second frame 2 based on the high-frequency frame 2-2 corresponding to the second frame 2 and Equation 2.

[0098] Meanwhile, the embodiments show that Equations 1 and 2 calculate low-frequency information E based on the sum of the absolute pixel values ​​or absolute frequency values ​​of multiple pixels. LF and high-frequency information E HF However, these equations are merely examples, and this disclosure is not limited thereto. For example, low-frequency information (e.g., E) LF =∑ (x,y) {|I LF (x,y)| 2}) and high-frequency information (e.g., E) HF =∑ (x,y) {|I HF (x,y)| 2Each of the values ​​in} can also be obtained based on the sum of the squares of the individual pixel values ​​or frequency values ​​of multiple pixels.

[0099] Return to reference Figure 3 The processor 120 can base its analysis on the low-frequency information E obtained from the first frame 1. LF (t-1) and low-frequency information E obtained from the second frame 2 LF (t) is used to obtain the low-frequency change (S330).

[0100] Additionally, the processor 120 can base its work on the high-frequency information E obtained from the first frame 1. HF (t-1) and high-frequency information E obtained from the second frame 2 HF (t) is used to obtain high-frequency changes (S340).

[0101] refer to Figure 5 The operation for obtaining low-frequency and high-frequency changes is described.

[0102] Figure 5 This is a view showing the low-frequency variation and high-frequency variation according to an embodiment of the present disclosure.

[0103] refer to Figure 5 The processor 120 can base its analysis on the low-frequency information E obtained from the first frame 1 at time point t-1. LF (t-1) and the low-frequency information E obtained from the second frame 2 at time point t. LF The difference between (t) is used to obtain the low-frequency change σE corresponding to the second frame 2. LF .

[0104] Additionally, the processor 120 can base its work on the high-frequency information E obtained from the first frame 1 at time point t-1. HF (t-1) and the high-frequency information E obtained from the second frame 2 at time point t. HF The difference between (t) is used to obtain the high-frequency variation σE corresponding to the second frame 2. HF .

[0105] The above reference Figure 5 The description can be represented by the following equation 3.

[0106] [Equation 3]

[0107] δE LF =|E LF (t)-E LF (t-1)|

[0108] δE HF =|E HF (t)-E HF (t-1)|

[0109] Return to reference Figure 3 The processor 120 can be based on the low-frequency variation δE LF and high-frequency variation δE HF To measure the scintillation intensity (S350).

[0110] Here, the flicker intensity can indicate the high-frequency frame I added to the input frame I to improve sharpness. HF The degree to which the intensity of the flicker is adjusted, and this degree of intensity can be referred to as the weight. In the following text, for ease of explanation, the flicker intensity is referred to as the weight.

[0111] Figure 6 Graphs are shown, each illustrating a function for obtaining the weight according to an embodiment of the present disclosure.

[0112] Low-frequency variation δE LF and high-frequency variation δE HF Each indicates the change in low-frequency energy over time and the change in high-frequency energy over time.

[0113] In embodiments of this disclosure, it can be assumed that when the change in high-frequency energy is greater than the change in low-frequency energy (e.g., δE) HF >δE LF When ), the flicker intensity is higher.

[0114] In addition, processor 120 can consider only the high-frequency variation δE. HF To calculate the flicker intensity. However, the processor 120 according to embodiments of this disclosure can take into account low-frequency variations δE. LF and high-frequency variation δE HF Both.

[0115] If the low-frequency change δE LF and high-frequency variation δE HF If both are large, it's more likely that the object is moving within the frame or the scene is changing, rather than flickering occurring when the frame switches to another. Therefore, processor 120 can consider the low-frequency variation δE. LF and high-frequency variation δE HF Both are used to calculate the flicker intensity.

[0116] For example, processor 120 can obtain the flicker intensity, i.e., the weight, based on Equation 4 below.

[0117] [Equation 4]

[0118] F=f(δE HF -δE LF )

[0119] Here, for reference Figure 6 The diagram shown is an example to illustrate the function f(x).

[0120] The value of F can be between 0 and 1, and the function f(x) can be a one-dimensional function whose output is proportional to x. For example, when the high-frequency change δE HF Greater than the low-frequency change δE LF When the F value is greater, the F value can be larger.

[0121] at the same time, Figure 6 The Sigmoid function and the Corrected Linear Unit (ReLU) function shown are merely examples, and the processor 120 can utilize them when the high-frequency change δE... HF Greater than the low-frequency change δE LF The F-value is obtained by using various types of functions f(x) with larger F-values. High-frequency change quantity δE HF and low-frequency variation δE LF The larger the difference between them, the larger the F value. In this case, the weight 1-F can be compared with the high-frequency change δE. HF and low-frequency variation δE LF The difference between them is inversely proportional.

[0122] Return to reference Figure 3 The processor 120 can be based on the low-frequency variation δE LF and high-frequency variation δE HF The weight is obtained by the difference between the two frames, and this weight can be applied to the high-frequency frame I corresponding to the second frame 2. HF (t)2-2 is used to obtain the high-frequency frames that have applied this weight.

[0123] Meanwhile, the above example describes how processor 120 obtains the F value and weight 1-F based on the difference obtained by subtracting the low-frequency change from the high-frequency change. However, this approach is merely an example and may not be limited to this.

[0124] For example, processor 120 can obtain the F value and weight 1-F based on the ratio of high-frequency change to low-frequency change. For instance, if the ratio of high-frequency change to low-frequency change is greater than or equal to a threshold ratio, processor 120 can predict that: because the high-frequency change is greater than the low-frequency change (e.g., δE), HF >δE LF The flicker intensity is relatively high. The processor 120 can obtain the F-value and weight 1-F based on the ratio of high-frequency changes to low-frequency changes. Here, when the high-frequency change δE... HF With low-frequency variation δE LF The larger the ratio, the larger the F value can be.

[0125] Meanwhile, according to various embodiments of this disclosure, it is assumed that the weight has a value from 1 to F. However, this assumption is merely an example, and the weight can indicate any of a variety of values ​​inversely proportional to the F value, such as a weight of 1 / F. The processor 120 can then use high-frequency frames I... HF Substituting (t)2-2 and the weight 1-F of the second frame 2 into Equation 5, we obtain the third frame (t)2-2. Figure 3 (S360 in the middle).

[0126] [Equation 5]

[0127] I HF(t) ′=(1-F)*I HF(t)

[0128] Here, I HF(t) 'It can indicate the application of weights 1-F for high-frequency frames, and I HF(t) It can indicate the high-frequency frame 2-2 of the second frame 2.

[0129] Then, the processor 120 can apply high-frequency frame I based on the weight 1-F. HF(t) 'and the second frame 2 to obtain the output frame O( Figure 3 (S370 in the equation). This operation can be represented as Equation 6 below.

[0130] [Equation 6]

[0131] O=I+(1-F)*I HF(t)

[0132] Here, I can indicate the input frame, i.e., the second frame 2 at time point t, and 1-F*I HF(t) 'Can indicate the application of a high-frequency frame I with weight 1-F at time point t.' HF(t) '.

[0133] As shown in Equations 5 and 6, the output frame O can be obtained by summing the high-frequency frames 2-2 of the second frame 2 and the second frame 2 together. At this point, the processor 120 can merge the high-frequency frames 2-2 and the second frame 2 together by adjusting the intensity of the high-frequency frames 2-2 of the second frame 2 based on the flicker intensity (i.e., weight 1-F).

[0134] The above embodiments describe how the processor 120 can base its low-frequency information E on the first frame corresponding to time point t-1. LF (t-1) and the low-frequency information E of the second frame 2 corresponding to time point t. LF (t) is used to obtain the low-frequency variation δE LF ; can be based on the high-frequency information E of the first frame 1 corresponding to time point t-1. HF (t-1) and the high-frequency information E of the second frame 2 corresponding to time point t. HF(t) Obtain the high-frequency variation δE HF ; and then can be based on the low-frequency variation δE LF and high-frequency variation δE HF To obtain the weight 1-F corresponding to the second frame 2. According to the embodiment, the low-frequency change δE LF and high-frequency variation δE HF The larger the difference between them, the larger the F value, and the smaller the weight 1-F.

[0135] However, this is just an example, and the processor 120 can obtain a weight 1-F corresponding to each of the multiple consecutive frames included in the input image, and can obtain an output frame O corresponding to each of the multiple frames.

[0136] For example, processor 120 can base its analysis on the low-frequency information E of the second frame 2 corresponding to time point t. LF(t) and the low-frequency information E of the third frame corresponding to time point t+1 LF(t+1) To obtain the low-frequency variation δE LF ; can be based on the high-frequency information E of the second frame 2 corresponding to time point t. HF(t) and the frequency information E of the third frame corresponding to time point t+1 HF(t+1) To obtain the high-frequency change δE LF ; and then can be based on the low-frequency variation δE LF and high-frequency variation δE HF To obtain the weight 1-F corresponding to the third frame.

[0137] Meanwhile, according to the embodiment, the function f(x) can be assumed to be a ReLU function, that is, a one-dimensional function that outputs a value proportional to x. Here, if the difference obtained by subtracting the low-frequency change from the high-frequency change is greater than a first threshold and less than a second threshold, the processor 120 can apply the weight obtained based on the difference obtained by subtracting the low-frequency change from the high-frequency change to the high-frequency frame I of the second frame 2. HF(t) 2-2 Obtaining high-frequency frame I with application weight 1-F HF(t) ′.

[0138] For example, if the difference between the low-frequency change and the high-frequency change is less than or equal to a first threshold, the processor 120 can convert the second frame 2 and the high-frequency frame I of the second frame 2 into a single frame. HF(t) 2-2 are summed to obtain the output frame O.

[0139] That is, if the difference between the low-frequency change and the high-frequency change is less than or equal to 0, i.e., if there is no difference between the two changes, then the processor 120 can transfer the high-frequency frame I of the second frame 2 to the second frame 2. HF(t) 2-2 are summed to obtain the output frame O.

[0140] For example, if the difference obtained by subtracting the low-frequency change from the high-frequency change is greater than or equal to the second threshold, the processor 120 can obtain the second frame 2 as the output frame 0 without having to convert the second frame 2 and the high-frequency frame 1 of the second frame 2 into the output frame 0. HF(t) 2-2 sum to each other.

[0141] Return to reference Figure 2 According to embodiments of the present disclosure, the processor 120 can divide each of the first frame and the second frame into block units of a predetermined size and obtain a weight I-F corresponding to each of the plurality of blocks. Various embodiments for obtaining the weight I-F of each block are described below.

[0142] Figure 7a and Figure 7b Each of these is a view showing a plurality of blocks included in a frame according to an embodiment of the present disclosure.

[0143] refer to Figure 7a The processor 120 can divide the first frame 1 corresponding to time point t-1 and the second frame 2 corresponding to time point t into block units of a predetermined size. Here, the predetermined size can be varied based on the size of the memory, the resources of the electronic device 100, the resolution of the input image, etc.

[0144] For example, processor 120 can divide the first frame 1 into block units of a predetermined size to obtain a total of 3600 blocks, including 80 horizontal blocks × 45 vertical blocks. Additionally, processor 120 can also divide the second frame 2 into a total of 3600 blocks. For ease of description, the specific numbers are merely examples, and this disclosure is not limited thereto.

[0145] Then, the processor 120 can obtain the low-frequency change based on the low-frequency information of the first block among the multiple blocks included in the first frame and the low-frequency information of the second block among the multiple blocks included in the second frame.

[0146] The following is for reference. Figure 7b Please describe this method in detail.

[0147] refer to Figure 7b The processor 120 can base its data on the low-frequency frame I of the first frame 1 corresponding to time point t-1. LF(t-1) The low-frequency information of the first block among the multiple blocks included in 1-1, and the low-frequency frame I of the second frame 2 corresponding to time point t. LF(t) The low-frequency variation is obtained from the low-frequency information of the second block among the multiple blocks included in 2-1. Here, the second block may be a block that corresponds to the first block in terms of location.

[0148] Additionally, the processor 120 can base its high-frequency frame I on the first frame 1 corresponding to time point t-1. HF(t-1)1- The high-frequency information of the first block among the multiple blocks included in 2, and the high-frequency frame I of the second frame 2 corresponding to time point t. HF(t)2-2 The high-frequency change is obtained by using the high-frequency information of the second block among the multiple blocks included in the process.

[0149] According to the embodiment, the processor 120 can obtain low-frequency variation and high-frequency variation corresponding to each of the plurality of blocks.

[0150] Processor 120 can be obtained based on the following equation 7. Figure 7b The bottom shows the low-frequency and high-frequency variations of each block.

[0151] [Equation 7]

[0152]

[0153]

[0154] Here, B can indicate a block, and the processor 120 can obtain the low-frequency information E corresponding to the block by summing the pixel values ​​or frequency values ​​of the multiple pixels included in the block B. LF Furthermore, the high-frequency information E corresponding to block B can be obtained by summing the pixel values ​​or frequency values ​​of the multiple pixels included in block B. HF .

[0155] Then, the processor 120 can obtain the energy change of each block over time, i.e., the low-frequency change δE, based on Equation 3. LF and high-frequency variation δE HF .

[0156] According to the embodiment, the processor 120 can be based on the low-frequency variation δE. LF and high-frequency variation δE HF To obtain the flicker intensity of each block in a multi-block dataset, i.e., the F-value and weight 1-F. See below for reference. Figure 7c Please describe this method in detail.

[0157] Figure 7c This is a view illustrating the weights according to embodiments of this disclosure.

[0158] According to the embodiment, the processor 120 can obtain the low-frequency variation δE based on the low-frequency information of the first block and the low-frequency information of the second block. LF Furthermore, the high-frequency variation δE can be obtained based on the high-frequency information of the first block and the high-frequency information of the second block. HF .

[0159] Then, the processor 120 can base its design on the low-frequency variation δE. LF and high-frequency variation δE HF To obtain the first weight corresponding to the second block.

[0160] refer to Figure 7c The processor 120 can base its calculations on the low-frequency variation δE of each of the multiple blocks included in the second frame 2. LF and high-frequency variation δE HF To obtain the flicker intensity corresponding to each of the multiple blocks, i.e., weight 1-F.

[0161] Here, processor 120 can obtain weight 1-F based on equation 4, and weight 1-F can have values ​​from 0 to 1.

[0162] See Figure 7c A bright color indicates that the weight 1-F corresponding to that block has a value close to 1, and a dark color indicates that the weight 1-F corresponding to that block has a value close to 0.

[0163] For example, processor 120 can identify the amount of energy variation (e.g., low-frequency variation δE) in each of the multiple blocks included in the frame. LF and high-frequency variation δE HF It can predict the high-frequency variation δE. HF Greater than the low-frequency change δE LF Flickering is about to occur in the block; and the high-frequency components of the corresponding block can be minimized to prevent flickering.

[0164] For example, if by the high-frequency change δE HF Subtract the low-frequency variation δE LF If the difference obtained is greater than or equal to the second threshold, the processor 120 can obtain 1 as the F value corresponding to the corresponding block and obtain zero as the weight 1-F, and can allow high-frequency components not to be amplified based on Equation 6.

[0165] For example, if we obtain the high-frequency variation δE HF Subtract the low-frequency variation δE LF The difference obtained is less than or equal to the first threshold (e.g., if the low-frequency change δE). LF and high-frequency variation δE HF If they are the same, then the processor 120 can obtain zero as the F value and 1 as the weight 1-F, and can improve the image sharpness, detail, image quality, etc. by summing the block with the high-frequency components of the block.

[0166] refer to Figure 7c High-frequency variation δE HF and low-frequency variation δELF Blocks with large differences between them can have bright colors because their weights 1-F have values ​​close to zero, and the high-frequency variation δE HF and low-frequency variation δE LF Blocks with small differences between them can have a dark color because their weights 1-F have values ​​close to 1. However, these specific numbers and colors are just examples and can be varied.

[0167] According to an embodiment of this disclosure, the processor 120 can obtain a high-frequency block to which the first weight is applied by applying a first weight corresponding to the second block to a high-frequency block among a plurality of blocks included in a high-frequency frame. (See also...) Figure 7b The high-frequency block for which the first weight is applied can be the high-frequency frame I corresponding to the second frame 2. HF(t) The high-frequency block in 2-2 that corresponds in position to the second block among the multiple high-frequency blocks included.

[0168] For example, processor 120 can obtain the high-frequency block with the first weight applied based on Equation 5 above. Here, refer to Equation 5 below.

[0169] [Equation 5]

[0170] I HF(t) ′=(1-F)*I HF(t)

[0171] Here, IHF(t)' can indicate the high-frequency block to which the first weight is applied, I HF(t) It can indicate the high-frequency blocks included in the high-frequency frame 2-2 of the second frame 2, and 1-F can indicate the first weight corresponding to the second block included in the second frame 2.

[0172] Then, the processor 120 can obtain an output block based on the second block included in the second frame 2 and the high-frequency block with the first weight applied. For example, the processor 120 can obtain the output block by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block with the first weight applied.

[0173] According to the embodiment, the processor 120 can apply a high-frequency frame I to the second frame 2 based on Equation 5. HF (t)2-2 includes multiple blocks, each corresponding to a weight, to obtain the high-frequency frame I for applying the weights. HF(t) Here, the weighted high-frequency frame I is applied. HF(t) 'It can be a combination of high-frequency blocks that apply weights corresponding to each of the multiple blocks.'

[0174] Figure 8This is a view showing low-frequency information and high-frequency information according to another embodiment of the present disclosure, and the processor 120 can obtain the output frame O by summing the second frame 2 and the weighted high-frequency frame IHF(t)'.

[0175] refer to Figure 8 According to another embodiment of this disclosure, the processor 120 can obtain low-frequency information and high-frequency information by using multiple filters. For ease of explanation, refer to... Figure 8 The description describes the case where the output frame O corresponding to the second frame 2 is obtained by assuming that the second frame 2 is the input frame I at time point t.

[0176] According to an embodiment, the processor 120 can obtain a low-frequency frame I corresponding to the second frame 2 by using a low-pass filter (LPF). LF .

[0177] Additionally, the processor 120 can obtain a first high-frequency frame I corresponding to the second frame 2 by using a first high-pass filter HPF. HF1 Furthermore, a second high-frequency frame I corresponding to the second frame 2 can be obtained by using a second high-pass filter. HF2 .

[0178] Then, the processor 120 can be based on low-frequency frame I LF To obtain low-frequency information E LF And it can be based on the second high-frequency frame I HF2 To obtain high-frequency information E HF .

[0179] Processor 120 can be based on low-frequency information E LF and high-frequency information E HF To obtain the low-frequency variation δE corresponding to the second frame. LF and high-frequency variation δE HF And weights 1-F can be obtained.

[0180] Then, the processor 120 can apply weights 1-F to the first high-frequency frame I obtained using the first high-pass filter. HF1 This allows us to obtain high-frequency frames that apply the weight, and the second and third frames can be summed together to obtain the output frame O.

[0181] Here, the first high-pass filter (HPF) and the second high-pass filter can have different filter strengths than each other. For example, the first high-pass filter can have a lower filter strength than the second high-pass filter. However, this configuration is merely an example and is not limited to this. For another example, if the first and second high-pass filters have the same filter strength, then... Figure 8 The output frame O obtained by the configuration shown can be... Figure 3 The output frame O is the same.

[0182] Meanwhile, according to another embodiment of this disclosure, the processor 120 can obtain low-frequency information from the first frame that is higher than or equal to a first threshold frequency and lower than a second threshold frequency. Additionally, the processor 120 can obtain intermediate-frequency information from the second frame.

[0183] For example, processor 120 can obtain low-frequency information that is higher than or equal to a first threshold frequency and lower than a second threshold frequency, and that corresponds to the first frame among a plurality of frames, by using multiple filters (e.g., low-pass filter LPF, high-pass filter HPF, band-pass filter BPF, etc.) with different intensities. Additionally, processor 120 can obtain low-frequency information that is higher than or equal to the first threshold frequency and lower than the second threshold frequency, and that corresponds to the second frame.

[0184] Here, low-frequency information can be referred to as intermediate-frequency information that is higher than or equal to the first threshold frequency and lower than the second threshold frequency. In the following text, for ease of explanation, intermediate-frequency information that is distinguished from high-frequency information will be uniformly referred to as low-frequency information.

[0185] Then, the processor 120 can obtain the low-frequency variation based on low-frequency information that is higher than or equal to the first threshold frequency and lower than the second threshold frequency and corresponds to each of the first and second frames.

[0186] Then, the processor 120 can obtain weights based on low-frequency and high-frequency changes. For example, the processor 120 can obtain weights based on the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0187] Figure 9 This is a block diagram illustrating a detailed configuration of an electronic device according to an embodiment of the present disclosure.

[0188] refer to Figure 9 The electronic device 100 may include a display 110, a processor 120, a memory 130, a communication interface 140, a control interface 150, and an input / output interface 160. (The description omits references to other devices.) Figure 2 Redundant descriptions of the components being described.

[0189] The memory 130 included in the electronic device 100 according to embodiments of the present disclosure can be implemented as internal memory (such as read-only memory (ROM, e.g., electrically erasable programmable read-only memory (EEPROM) or random access memory (RAM)) included in the processor 120, or as memory separate from the processor 120. In this case, for data storage purposes, the memory 130 can be implemented as memory embedded in the electronic device 100 or as memory removable from the electronic device 100. For example, data for driving the electronic device 100 can be stored in memory embedded in the electronic device 100, and data for extended functions of the electronic device 100 can be stored in removable memory within the electronic device 100. Meanwhile, the memory embedded in the electronic device 100 can be implemented as at least one of the following: volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), or non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard disk drive or solid-state drive (SSD); and memory removable from the electronic device 100 can be implemented as a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (microSD), mini secure digital (miniSD), high-speed digital (xD) or multimedia card (MMC)) or external memory (e.g., USB memory) that can be connected to a universal serial bus (USB) port, etc.

[0190] Specifically, under the control of the processor 120 according to an embodiment of the present disclosure, the memory 130 can store low-frequency information E obtained from the frame corresponding to each time point. LF and high-frequency information E HF Furthermore, it can load low-frequency information E obtained from the frame corresponding to the previous time point. LF and high-frequency information E HF This is done to obtain the weight F (or flicker intensity) of the frame corresponding to the next time point. Additionally, the number of blocks used to divide the frame can be proportional to the size of the storage space in memory 130.

[0191] According to embodiments of the present disclosure, the communication interface 140 can perform communication with external devices (e.g., source devices or external user terminals), external storage media (e.g., Universal Serial Bus (USB) memory), external servers (e.g., network drives), etc., using communication methods such as Access Point (AP) based Wi-Fi (i.e., Wireless Local Area Network (LAN)), Bluetooth, Zigbee, Wired / Wireless Local Area Network (LAN), Wide Area Network (WAN), Ethernet, IEEE 1394, High Definition Multimedia Interface (HDMI), USB, Mobile High Definition Link (MHL), Audio Engineering Society / European Broadcasting Union (AES / EBU) communication, optical communication, or coaxial communication to send or receive data.

[0192] Specifically, the electronic device 100 according to an embodiment of the present disclosure can use the communication interface 140 to receive an image comprising multiple frames from an external device, and can send an image-processed output frame O to the external device.

[0193] The operating interface 150 can be implemented in devices such as buttons, touchpads, mice, and keyboards, or in touchscreens that can also perform operational input functions in addition to the display functions described above. Here, buttons can be any type of button (such as mechanical buttons, touchpads, scroll wheels, etc.) located in any area of ​​the main body appearance of the electronic device 100 (such as the front surface portion, side surface portion, or rear surface portion).

[0194] The input / output interface 160 can be any of the following: High Definition Multimedia Interface (HDMI), Mobile High Definition Link (MHL), Universal Serial Bus (USB), DisplayPort (DP), Thunderbolt, Video Graphics Array (VGA) port, Red-Green-Blue (RGB) port, D-SUB, or Digital Video Interface (DVI).

[0195] The input / output interface 160 can input / output at least one of audio or video signals.

[0196] According to an embodiment, the input / output interface 160 may include a port for inputting and outputting audio signals only and a port for inputting and outputting video signals only as its separate ports, or it may be implemented as a single port for inputting and outputting both audio signals and video signals.

[0197] Figure 10 This is a flowchart illustrating a control method for an electronic device according to an embodiment of the present disclosure.

[0198] The control method of the electronic device according to an embodiment of the present disclosure may first include: obtaining a low-frequency change amount based on low-frequency information obtained from a first frame of a plurality of frames included in an input image and low-frequency information obtained from a second frame (S1010).

[0199] Then, the method may include: obtaining the high-frequency change amount based on the high-frequency information obtained from the first frame and the high-frequency information obtained from the second frame (S1020).

[0200] Then, the method may include: obtaining a high-frequency frame with applied weights by applying a weight obtained based on the difference between low-frequency and high-frequency changes to a high-frequency frame corresponding to the second frame (S1030).

[0201] Then, the method may include: obtaining an output frame corresponding to the second frame based on the second frame and a high-frequency frame with applied weights (S1040). Then, the method may include: displaying the obtained output frame (S1050).

[0202] Here, the operation S1030 of obtaining the applied weight of the high-frequency frame may include: obtaining a weight that is inversely proportional to the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0203] The control method according to embodiments of the present disclosure may further include dividing each of the first frame and the second frame into block units of a predetermined size, wherein the operation of obtaining low-frequency change amount S1010 includes obtaining low-frequency change amount based on low-frequency information of the first block among the multiple blocks included in the first frame and low-frequency information of the second block among the multiple blocks included in the second frame corresponding to the first block; the operation of obtaining high-frequency change amount S1020 includes obtaining high-frequency change amount based on high-frequency information of the first block and the second block; the operation of obtaining a high-frequency frame with applied weight S1030 includes obtaining a high-frequency block with applied first weight by applying a first weight obtained based on the difference between low-frequency change amount and high-frequency change amount to a high-frequency block among the multiple blocks included in the high-frequency frame corresponding to the second block; and the operation of obtaining an output frame S1040 includes obtaining an output block corresponding to the second block based on the second block and the high-frequency block with applied first weight.

[0204] According to an embodiment of this disclosure, the operation S1030 of obtaining a high-frequency frame with applied weights may include: obtaining multiple weights corresponding to each of the multiple blocks included in the second frame by comparing low-frequency change amounts with high-frequency change amounts, and obtaining a high-frequency frame with applied weights by applying the weights corresponding to each of the multiple blocks included in the high-frequency frame.

[0205] The operation S1040 of obtaining an output frame according to an embodiment of the present disclosure may include: if the difference between the low-frequency change amount and the high-frequency change amount is less than or equal to a first threshold, then obtaining an output block by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block; and if the difference between the low-frequency change amount and the high-frequency change amount is greater than or equal to a second threshold, then obtaining the second block as an output block.

[0206] The operation S1040 of obtaining an output frame according to an embodiment of the present disclosure may include: if the difference obtained by subtracting the low-frequency change from the high-frequency change is greater than a first threshold and less than a second threshold, then an output block is obtained based on a first weight, the first weight being obtained based on the difference obtained by subtracting the low-frequency change from the high-frequency change.

[0207] The control method according to embodiments of the present disclosure may further include obtaining a high-frequency frame corresponding to the second frame by applying a first high-pass filter (HPF) to the second frame, wherein the operation of obtaining low-frequency change amount S1010 includes obtaining a low-frequency frame and low-frequency information corresponding to the second frame by applying a low-pass filter (LPF) to the second frame, the operation of obtaining high-frequency change amount S1020 includes obtaining high-frequency information corresponding to the second frame by applying a second high-pass filter to the second frame, and the operation of obtaining a high-frequency frame with applied weights S1030 includes obtaining a high-frequency frame with applied weights by applying weights obtained based on low-frequency change amount and high-frequency change amount to the high-frequency frame.

[0208] The operation S1040 of obtaining the output frame according to an embodiment of the present disclosure may include obtaining the weight based on the ratio of high-frequency change to low-frequency change.

[0209] According to embodiments of the present disclosure, the operation S1010 for obtaining low-frequency change amounts may include obtaining low-frequency frames and low-frequency information corresponding to the second frame and below a threshold frequency by applying a low-pass filter to the second frame, and the operation S1020 for obtaining high-frequency change amounts may include obtaining high-frequency frames and high-frequency information corresponding to the second frame and above or equal to a threshold frequency based on the difference between the second frame and the low-frequency frames.

[0210] According to an embodiment of the present disclosure, the operation S1010 of obtaining low-frequency change amount may include obtaining low-frequency change amount based on low-frequency information obtained from a first frame that is higher than or equal to a first threshold frequency and lower than a second threshold frequency and low-frequency information obtained from a second frame, and the operation S1040 of obtaining output frame may include obtaining weight based on the difference obtained by subtracting low-frequency change amount from high-frequency change amount.

[0211] Furthermore, the various embodiments disclosed herein can be applied not only to electronic devices, but also to all types of electronic devices, including displays.

[0212] Furthermore, the various embodiments disclosed above can be implemented in a computer or computer-readable recording medium using software, hardware, or a combination of software and hardware. In some cases, the embodiments described in this disclosure can be implemented by the processor itself. According to software implementation, the embodiments such as processes and functions described in this disclosure can be implemented by separate software modules. Each software module can perform one or more functions and operations described in this disclosure.

[0213] Furthermore, computer instructions for performing processing operations of the electronic device 100 according to the various embodiments of the present disclosure may be stored in a non-transitory computer-readable medium. The computer instructions stored in the non-transitory computer-readable medium, if executed by a processor of a particular device, may allow the particular device to perform the processing operations of the electronic device 100 according to the various embodiments of the present disclosure.

[0214] Non-transitory computer-readable media may not be media that temporarily stores data (such as registers, caches, or memory), and may be media that stores data semi-permanently and is machine-readable. Specific examples of non-transitory computer-readable media may include compact discs (CDs), digital versatile discs (DVDs), hard disks, Blu-ray discs, universal serial buses (USB), memory cards, or read-only memory (ROM).

[0215] While embodiments of this disclosure have been shown and described above, this disclosure is not limited to the specific embodiments described above, and various modifications can be made by those skilled in the art to which this disclosure pertains without departing from the spirit of this disclosure as disclosed in the appended claims. These modifications should also be understood to fall within the scope and spirit of this disclosure.

Claims

1. An electronic device comprising: monitor; as well as The processor is configured as follows: The low-frequency variation is obtained based on the low-frequency information corresponding to the first frame and the low-frequency information corresponding to the second frame. The high-frequency variation is obtained based on the high-frequency information corresponding to the first frame and the high-frequency information corresponding to the second frame. The weights are obtained based on the difference between the low-frequency changes and the high-frequency changes. The weights are applied to the high-frequency frames corresponding to the second frame. Based on the second frame and the high-frequency frame with the applied weights, an output frame corresponding to the second frame is obtained, and Control the display to show the obtained output frame.

2. The electronic device according to claim 1, wherein, The weights are inversely proportional to the differences, and The difference is obtained by subtracting the low-frequency change from the high-frequency change.

3. The electronic device according to claim 1, wherein, The processor is also configured to: The low-frequency change is obtained based on the first low-frequency information of the first block among multiple blocks included in the first frame and the second low-frequency information of the second block among multiple blocks included in the second frame. Based on the first high-frequency information of the first block and the second high-frequency information of the second block, the high-frequency change is obtained. A first weight corresponding to the second block is obtained based on the difference between the low-frequency change and the high-frequency change, and the first weight is applied to the high-frequency block corresponding to the second block. Based on the second block and the high-frequency block with the first weight applied, an output block corresponding to the second block is obtained.

4. The electronic device according to claim 3, wherein, The processor is also configured to: Multiple weights corresponding to each of the multiple blocks included in the second frame are obtained by comparing the low-frequency change amount with the high-frequency change amount. Each of the plurality of weights is applied to the corresponding block among the plurality of blocks included in the high-frequency frame corresponding to the second frame.

5. The electronic device according to claim 3, wherein, The processor is also configured to: Based on the fact that the difference between the low-frequency change and the high-frequency change is less than or equal to a first threshold, the output block is obtained by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block. The second block is obtained as the output block based on the difference between the low-frequency change and the high-frequency change being greater than or equal to a second threshold.

6. The electronic device according to claim 5, wherein, The processor is further configured to obtain the output block based on the first weight, based on the difference between the low-frequency change and the high-frequency change being greater than the first threshold and less than the second threshold.

7. The electronic device according to claim 1, wherein, The processor is also configured to: The high-frequency frame corresponding to the second frame is obtained by applying a first high-pass filter (HPF) to the second frame. The low-frequency information corresponding to the second frame is obtained by applying a first low-pass filter (LPF) to the second frame, and The high-frequency information corresponding to the second frame is obtained by applying a second HPF to the second frame.

8. The electronic device according to claim 1, wherein, The processor is also configured to obtain the weight based on the ratio of the high-frequency change to the low-frequency change.

9. The electronic device according to claim 1, wherein, The processor is also configured to: By applying a low-pass filter (LPF) to the second frame, low-frequency frames corresponding to the second frame and low-frequency information including frequencies below a threshold frequency are obtained. Based on the difference between the second frame and the low-frequency frame, a high-frequency frame corresponding to the second frame and high-frequency information including frequencies greater than or equal to the threshold frequency are obtained.

10. The electronic device according to claim 1, wherein, The processor is also configured to: The low-frequency change amount is obtained based on the low-frequency information obtained from the first frame, which includes frequencies greater than or equal to a first threshold frequency and less than a second threshold frequency.

11. A method for controlling an electronic device, comprising: The low-frequency variation is obtained based on the low-frequency information corresponding to the first frame and the low-frequency information corresponding to the second frame; The high-frequency change is obtained based on the high-frequency information corresponding to the first frame and the high-frequency information corresponding to the second frame; The weights are obtained based on the difference between the low-frequency changes and the high-frequency changes. The weights are applied to the high-frequency frames corresponding to the second frame; The output frame corresponding to the second frame is obtained based on the second frame and the high-frequency frame with the weights applied. as well as Display the obtained output frame.

12. The control method according to claim 11, wherein, The weight is inversely proportional to the difference obtained by subtracting the low-frequency change from the high-frequency change.

13. The control method according to claim 11, wherein, Obtaining the low-frequency change amount includes: obtaining the low-frequency change amount based on the first low-frequency information of the first block among the multiple blocks included in the first frame and the second low-frequency information of the second block among the multiple blocks included in the second frame. Obtaining the high-frequency change includes: obtaining the high-frequency change based on the first high-frequency information of the first block and the second high-frequency information of the second block. Obtaining the weights includes: obtaining a first weight corresponding to the second block based on the difference between the low-frequency change and the high-frequency change. The application of the weights includes: applying the first weight to the high-frequency block corresponding to the second block, and Obtaining the output frame includes: obtaining an output block corresponding to the second block based on the second block and the high-frequency block with the first weight applied.

14. The control method according to claim 13, wherein, Obtaining the weights includes: By comparing the low-frequency variation with the high-frequency variation, multiple weights corresponding to each of the multiple blocks included in the second frame are obtained, and The application of the weights includes: Each of the plurality of weights is applied to the corresponding block among the plurality of blocks included in the high-frequency frame corresponding to the second frame.

15. The control method according to claim 13, wherein, Obtaining the output frame includes: Based on the fact that the difference between the low-frequency change and the high-frequency change is less than or equal to a first threshold, the output block is obtained by summing the pixel values ​​included in the second block and the corresponding pixel values ​​in the high-frequency block. The second block is obtained as the output block based on the difference between the low-frequency change and the high-frequency change being greater than or equal to a second threshold.

Images