Electronic device and video editing method of electronic device

Abstract

Provided may be a video editing method of an electronic device, the method comprising: receiving a first user input indicating a plurality of videos selected to be edited into an output video; determining a reference video from among the plurality of selected videos; analyzing the reference video to obtain a reference image quality-related parameter of the reference video; applying the reference image quality-related parameter to each of the plurality of videos to obtain the plurality of videos having adjusted image quality; and combining the plurality of videos having adjusted image quality into the output video.

Description

Electronic devices and video editing methods for electronic devices

[0001] The present disclosure generally relates to image processing, and more specifically to a method for editing multiple videos into a single video and an electronic device for the same.

[0002] Image quality is a term referring to the quality of an image in video media. Fundamentally, various objects exist within a video, and image quality can be considered the degree to which each object can be clearly distinguished and the subject of the video can be clearly grasped. Videos can be captured differently depending on the shooting environment (e.g., indoor / outdoor, camera type, exposure value, etc.), and as a result, each video may exhibit a different level of image quality.

[0003] Currently, there are various image editing tools available that allow users to check video quality and manually adjust it. However, users may find it difficult to manually edit the quality of each video one by one using these tools.

[0004] One or more embodiments of the present disclosure provide a method for editing a plurality of videos into a single video and an electronic device for the method.

[0005] A method for editing a video using an electronic device according to one embodiment of the present disclosure may include: receiving a first user input representing a plurality of videos selected to be edited into a single output video; determining a reference video among the selected plurality of videos; analyzing the reference video to obtain reference quality-related parameters of the reference video; applying the reference quality-related parameters to each of the plurality of videos to obtain a plurality of videos with adjusted quality; and combining the plurality of videos with adjusted quality into a single output video.

[0006] An electronic device according to one embodiment of the present disclosure may include a memory for storing at least one instruction; and at least one processor. The electronic device may receive user input representing a plurality of videos selected to be edited into a single output video. The electronic device may determine a reference video among the selected plurality of videos. The electronic device may analyze the reference video to obtain quality-related parameters of the reference video. The electronic device may apply the quality-related parameters to each of the plurality of videos to obtain a plurality of videos with adjusted quality. The electronic device may combine the plurality of videos with adjusted quality into a single output video.

[0007] According to one aspect of the present disclosure, a non-transitory computer-readable storage medium stores a computer-executable program for editing a video, and when the program is executed by at least one processor of an electronic device, the electronic device receives user input representing a plurality of videos selected to be edited into a single output video, determines a reference video among the selected plurality of videos, analyzes the reference video to obtain quality-related parameters of the reference video, applies the quality-related parameters to each of the selected plurality of videos to generate a plurality of adjusted videos with adjusted quality, and combines the plurality of adjusted videos into a single output video.

[0008] Additional aspects may be described in part of the following description, may become apparent from the description, or may be known through the practice of the presented embodiments.

[0009] The aspects, features, and advantages of the above and other specific embodiments of the present disclosure may become more apparent from the following description, which is referenced together with the accompanying drawings.

[0010] FIG. 1 is a drawing for explaining an electronic device for video editing according to one embodiment of the present disclosure.

[0011] FIG. 2 is a flowchart illustrating a method for an electronic device to edit a video according to one embodiment of the present disclosure.

[0012] FIG. 3 is a drawing for explaining an analyzer and a processing module of an electronic device according to one embodiment of the present disclosure.

[0013] FIG. 4 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure analyzing a plurality of videos.

[0014] FIG. 5 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure acquiring comparison information of a reference video.

[0015] FIG. 6 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure acquiring color information of a reference video.

[0016] FIG. 7 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure to acquire the clarity enhancement intensity of each video.

[0017] FIG. 8 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure adjusting the quality of a plurality of videos.

[0018] FIG. 9 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure adjusting the contrast of each video.

[0019] FIG. 10 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure interpolating mapping functions around a corresponding pixel.

[0020] FIG. 11 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure transferring the color tone of each video.

[0021] FIG. 12 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure to improve the clarity of each video.

[0022] FIG. 13 is a flowchart illustrating a method for an electronic device according to one embodiment of the present disclosure to further adjust the quality of a video according to user input.

[0023] FIG. 14 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure to additionally adjust the quality of a video according to user input.

[0024] FIG. 15 is a block diagram illustrating the function of an electronic device according to one embodiment of the present disclosure.

[0025] The terms used in this disclosure will be briefly explained, and an embodiment of this disclosure will be described.

[0026] The terms used in this disclosure have been selected to be as widely used and general as possible, taking into account the functions in the various embodiments of this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined not merely by their names, but based on their meanings and the content throughout this disclosure.

[0027] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0028] Throughout the entire disclosure, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "module," etc., as described in the disclosure refer to a unit that processes at least one function or operation, and "...part" or "module" may be implemented in hardware or software, or a combination of hardware and software.

[0029] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0030] Unless the context clearly indicates otherwise, the singular forms (e.g., "a," "an," and "the") may be understood to include plural objects. Thus, for example, the description "a component surface" may include cases where it refers to one or more of such surfaces.

[0031] Throughout the disclosure, references to "one embodiment," "an embodiment," "an example embodiment," or similar expressions may indicate that certain features, structures, or characteristics described in relation to such embodiments are included in at least one embodiment of the present invention. Accordingly, "in one embodiment," "in an embodiment," "in an example embodiment," and similar expressions used throughout the disclosure may all refer to the same embodiment, but do not necessarily mean the same embodiment. The embodiments described herein are exemplary embodiments and are therefore not limited thereto and may be implemented in various other forms.

[0032] The order or hierarchy of specific blocks in the disclosed processes / flowcharts should be understood as an example of an exemplary approach. It should be understood that the specific order or hierarchy of blocks in the processes / flowcharts may be rearranged according to design preference. Additionally, some blocks may be combined or omitted. The appended claims present the elements of various blocks in an exemplary order and are not intended to restrict them to a specific order or hierarchy.

[0033] All functions or operations described in this document may be processed by a single processor and / or a combination of processors. A single processor and / or a combination of processors is a circuitry that performs processing and may include circuitry such as an AP (Application Processor), CP (Communication Processor), GPU (Graphical Processing Unit), NPU (Neural Processing Unit), MPU (Microprocessor Unit), SoC (System on Chip), IC (Integrated Chip), etc.

[0034] In this disclosure, the articles "a" and "an" are intended to mean including one or more items and may be used interchangeably with "one or more." If only one item is intended, "one" or a similar expression is used. For example, the term "a processor" may mean a single processor or multiple processors.

[0035] Where it is described that a processor performs a certain operation and it is mentioned that the processor performs additional operations, those operations may be performed by a single processor, or by any one of multiple processors or a combination thereof.

[0036] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, an embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiment described herein. Furthermore, in order to clearly explain an embodiment of the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the present disclosure are denoted by similar reference numerals.

[0037] FIG. 1 is a drawing for explaining an electronic device (1000) for video editing according to one embodiment of the present disclosure.

[0038] An electronic device (1000) according to one embodiment of the present disclosure may be implemented in various forms. For example, the electronic device (1000) may be a digital camera, a smartphone, a laptop computer, a tablet PC, an e-book terminal, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), etc., but is not limited thereto. The electronic device (1000) may be a wearable device that can be worn by a user. The wearable device may include at least one of an accessory-type device (e.g., a watch, a ring, a wristband, an ankle band, a necklace, glasses, a contact lens), a head-mounted device (HMD), a fabric or clothing-integrated device (e.g., electronic clothing), a body-attached device (e.g., a skin pad), or a bio-implantable device (e.g., an implantable circuit), but is not limited thereto. For convenience of explanation, the following description will be given using the example where the electronic device (1000) is a smartphone. However, the embodiments of the present disclosure may not be limited thereto.

[0039] According to one embodiment of the present disclosure, the electronic device (1000) may provide various functions for editing videos. For example, the electronic device (1000) may provide a function for editing a plurality of videos into a single video.

[0040] Referring to FIG. 1, when a user runs a photo management application, the electronic device (1000) may provide a list of photos or videos through the execution window of the photo management application. For example, as shown in FIG. 1, the user may select N videos to be edited into one video from the list of photos or videos provided in the photo management application (S100). Here, N is a positive integer greater than 1. For example, the user may select a first video (10), a second video (20), a third video (30), and a fourth video (40) (e.g., N=4).

[0041] The electronic device (1000) may receive an input indicating the order of selected frames or selected first to fourth videos (10 to 40) (S200). For example, the user may select some frames and / or videos included in the execution window of a photo management application. Additionally, the user may adjust the combined order of the selected videos. For example, the user may change the order of the third video (30) and the fourth video (40). That is, the user may adjust the combined order so that the first video (10), the second video (20), the fourth video (40), and the third video (30) are played in that order. However, the embodiments of the present application are not limited thereto, and the number of selected videos and / or the combined order of the selected videos may be varied as long as they do not depart from the scope of the present disclosure.

[0042] The electronic device (1000) may select a reference video among the selected first to fourth videos (10, 20, 30, 40). The reference video may be a video that serves as a standard for setting image quality parameters such as contrast, color tone, and sharpness. For example, if the selected first to fourth videos (10, 20, 30, 40) are filmed under different conditions (e.g., indoor / outdoor, camera type, exposure value, etc.), there may be variations in contrast, color tone, sharpness, etc., for each video. Therefore, if videos filmed under different conditions are simply combined, the user may feel a sense of unfamiliarity when watching the combined video. Thus, according to one embodiment of the present disclosure, the electronic device (1000) may select one of the selected first to fourth videos (10, 20, 30, 40) as a reference video in order to uniformly process the image quality of the selected first to fourth videos (10, 20, 30, 40).

[0043] According to one embodiment of the present disclosure, an electronic device (1000) can select the first video among the selected first to fourth videos (10 to 40) as a reference video (S300). That is, the electronic device (1000) can determine the first video among them as a reference video based on the combination order of the selected first to fourth videos (10 to 40). For example, if the combination order is the first video (10), the second video (20), the fourth video (40), and the third video (30), the electronic device (1000) can automatically select the first video (10), which is the first in order, as a reference video.

[0044] According to one embodiment of the present disclosure, the electronic device (1000) may select a video selected by a user as a reference video (S400). For example, the user may select a second video (20) as a reference video among the selected first to fourth videos (10, 20, 30, 40), and the electronic device (1000) may determine the second video (20) as a reference video according to the user's selection.

[0045] According to one embodiment of the present disclosure, an electronic device (1000) can process the reference video and the remaining videos with uniform quality based on the reference video among the first to fourth videos (10, 20, 30, 40) selected by a user (S500). For example, when the first video (10) is selected as the reference video, the electronic device (1000) can improve the quality of the second video (20), the third video (30), and the fourth video (40) uniformly with the contrast and color tone of the first video (10). Additionally, the electronic device (1000) can improve the clarity of the first video (10) to maximum clarity and improve the clarity of the second video (20), the third video (30), and the fourth video (40) based on the improved clarity. Although FIG. 1 describes an example of adjusting the contrast, color tone, and clarity of each video, it is not limited thereto. The electronic device (1000) may also adjust additional or different image quality values ​​such as brightness, exposure, saturation, color temperature, clarity, etc.

[0046] The electronic device (1000) can combine the first video (10), the second video (20), the third video (30), and the fourth video (40), which are processed with uniform image quality, in the order of the first video (10), the second video (20), the fourth video (40), and the third video (30) to edit them into a single video. Since the first to fourth videos (10, 20, 30, 40) selected by the user are processed with uniform image quality, the user may not feel a sense of disparity between the first to fourth videos (10, 20, 30, 40) while playing the combined video. That is, a natural transition between the first to fourth videos (10, 20, 30, 40) can be induced.

[0047] Below, we will examine in detail, with reference to FIG. 2, how an electronic device (1000) processes multiple videos with uniform quality.

[0048] FIG. 2 is a flowchart for explaining how an electronic device (1000) according to one embodiment of the present disclosure edits a video.

[0049] Referring to FIG. 2, the method of an electronic device (1000) editing a video may include steps S210 to S250. In one embodiment of the present disclosure, steps S210 to S250 may be executed by at least one processor included in the electronic device (1000). The method of an electronic device (1000) editing a video is not limited to that illustrated in FIG. 2, and in one or more embodiments, additional steps not illustrated in FIG. 2 may be included, or some steps may be omitted.

[0050] In step S210, an electronic device (1000) according to one embodiment of the present disclosure may receive user input for selecting a plurality of videos to be edited into a single video.

[0051] According to one embodiment of the present disclosure, an electronic device (1000) may provide a list of videos to a user. The electronic device (1000) may provide a list of videos through a predetermined application (e.g., a photo management application). The list of videos may include identification information of videos stored in the memory of the electronic device (1000) (e.g., thumbnail image, total playback time, file name, etc.) or identification information of videos stored in an external device (e.g., a cloud server), but is not limited thereto. The electronic device (1000) may receive user input to select multiple videos from the list of videos. At this time, the user may select a video stored in the memory of the electronic device (1000) or may select videos stored in an external device.

[0052] According to one embodiment of the present disclosure, an electronic device (1000) may receive user input for selecting a plurality of videos and at least one still image (e.g., a photograph). Alternatively, the electronic device (1000) may receive user input for selecting a plurality of still images (e.g., a photograph) to be created into a single video, or a plurality of still images (photos) and music. For convenience of explanation, the following description is based on an example scenario in which a user selects a plurality of videos. However, the embodiments of the present disclosure are not limited thereto.

[0053] According to one embodiment of the present disclosure, an electronic device (1000) may receive an input that changes the combination order (selection order) of a plurality of videos. For example, a user may change the order (position) of the first video and the third video after selecting videos in the order of the first video, the second video, and the third video. For example, a user may instruct the videos to be played in the order of the first video, the third video, and the second video.

[0054] According to one embodiment of the present disclosure, an electronic device (1000) may receive an input to add effects to some of a plurality of videos. For example, the electronic device (1000) may receive an input to add bokeh effects to some of a plurality of videos, or to add text, emoticons, etc. However, the embodiments of the present disclosure are not limited thereto, and various other effects and / or variations may be applied to the plurality of videos.

[0055] In step S220, an electronic device (1000) according to one embodiment of the present disclosure can determine a reference video among a plurality of videos.

[0056] According to one embodiment of the present disclosure, an electronic device (1000) may determine one of a plurality of videos as a reference video. The reference video may be a video that serves as a standard for image quality. The electronic device (1000) may determine the reference video in various ways.

[0057] According to one embodiment of the present disclosure, an electronic device (1000) can automatically select a reference video according to the combination order (selection order or arrangement order) of a plurality of videos. For example, the electronic device (1000) may determine the first video among a plurality of videos as the reference video. Alternatively, the electronic device (1000) may determine the last video among a plurality of videos as the reference video, or determine an intermediate video as the reference video.

[0058] According to one embodiment of the present disclosure, the electronic device (1000) may automatically select the video with the longest playback time among a plurality of videos as a reference video, and may also automatically select the video with the highest clarity as a reference video.

[0059] Meanwhile, according to one embodiment of the present disclosure, the electronic device (1000) can determine a video selected by a user among a plurality of videos as a reference video. For example, if a user selects a second video that has the most pleasing color tone among a first video, a second video, and a third video, the electronic device (1000) can determine the second video as a reference video.

[0060] According to one embodiment of the present disclosure, a user may select or change criteria for determining a reference video. For example, the user may specify that the video in the first sequence be automatically determined as the reference video. Alternatively, the user may specify that the reference video be selected manually.

[0061] In step S230, an electronic device (1000) according to one embodiment of the present disclosure can analyze a reference video and obtain parameters related to the quality of the reference video.

[0062] According to one embodiment of the present disclosure, an electronic device (1000) can convert a reference video into a YUV video when the reference video is an RGB video. YUV is one of the methods for composing color, and it composes color using luminance (Y), blue color difference (U), and red color difference (V) information. However, the embodiments of the present disclosure are not limited thereto. That is, the color composition method is not limited to YUV, and may also include YCbCr, LAB, and HSV. That is, the electronic device (1000) may convert a reference video into one of a YCbCr video, a LAB video, or an HSV video when the reference video is an RGB video. As used in this specification, YCbCr may be a color representation method in which each color consists of luminance (or brightness) (Y), blue difference color difference (Cb), and red difference color difference (Cr) information; LAB may be a color representation method in which each color consists of lightness (L), green-red (A), and blue-yellow (B) information; and HSV may be a color representation method in which each color consists of hue (H), saturation (S), and lightness value (V) information. However, for the sake of convenience of explanation, this specification will explain the case in which an RGB video is converted into a YUV video as an example.

[0063] The electronic device (1000) can analyze a reference video converted into a YUV format to obtain image quality parameters of the reference video. The image quality parameters may include at least one of a contrast score, color information, or sharpness enhancement strength, but are not limited thereto. For example, the image quality parameters may include brightness, exposure, saturation, color temperature, clarity, etc.

[0064] According to one embodiment of the present disclosure, the electronic device (1000) may select sample frames from among all frames included in the reference video and analyze the selected sample frames in order to increase processing speed, but is not limited thereto. The electronic device (1000) may also obtain quality-related parameters of the reference video by analyzing all frames included in the reference video. However, below, the case in which the electronic device (1000) samples and analyzes the reference video will be described as an example.

[0065] According to one embodiment of the present disclosure, an electronic device (1000) can determine a contrast score of a reference video by using the intensity values ​​of the Y channels of sample frames included in the reference video. For example, the electronic device (1000) can divide each sample frame into a plurality of patches, calculate the contrast for each patch, and then calculate the average of the contrasts for each patch as the contrast score of each sample frame. Then, the electronic device (1000) can determine the average of the contrast scores of each sample frame as the contrast score of the reference video. The contrast of each patch may be a value obtained by dividing the difference between the maximum intensity value and the minimum intensity value by the sum of the maximum intensity value and the minimum intensity value. The operation of the electronic device (1000) determining the contrast score of the reference video will be examined in more detail later with reference to FIG. 5.

[0066] According to one embodiment of the present disclosure, an electronic device (1000) can obtain color information of a reference video by using the average and standard deviation of each of the Y channel, U channel, and V channel of sample frames included in the reference video. For example, the electronic device (1000) can obtain the average of the average and standard deviation of each of the Y channel, U channel, and V channel of sample frames as color information of the reference video. The operation of the electronic device (1000) obtaining color information of the reference video will be examined in more detail later with reference to FIG. 6.

[0067] According to one embodiment of the present disclosure, an electronic device (1000) can obtain a sharpness corresponding to each of a plurality of videos. For example, the electronic device (1000) can generate a low-frequency image by applying a Gaussian blur to the Y channel of a sample frame included in each video. The electronic device (1000) can detect an edge region in the Y channel of a sample frame included in each video by using the absolute deviation between the Y channel of a sample frame included in each video and the low-frequency image. The electronic device (1000) can extract a sharpness enhancement target mask by removing noise from the edge region. The electronic device (1000) can obtain the sharpness of each video by averaging the edge scores of the noise-removed edge region (sharpness enhancement target mask).

[0068] The electronic device (1000) can determine the maximum clarity among the clarity corresponding to each of the multiple videos. The electronic device (1000) can determine the clarity enhancement strength corresponding to each of the multiple videos by comparing the maximum clarity with the clarity corresponding to each of the multiple videos. The lower the clarity of each video is compared to the maximum clarity, the greater the clarity enhancement strength of the corresponding video may be. The operation of the electronic device (1000) determining the clarity enhancement strength corresponding to each of the multiple videos will be examined in more detail later with reference to FIG. 7.

[0069] In step S240, an electronic device (1000) according to one embodiment of the present disclosure can obtain a plurality of videos with adjusted quality by applying quality-related parameters of a reference video to each of a plurality of videos.

[0070] According to one embodiment of the present disclosure, an electronic device (1000) can convert a plurality of videos in RGB format into YUV format and apply quality-related parameters of a reference video to the plurality of videos converted into YUV format to obtain a plurality of videos with adjusted quality. For example, the electronic device (1000) may apply a contrast score of a reference video to the remaining videos excluding the reference video among the plurality of videos, or transfer the color tone of the reference video. Additionally, the electronic device (1000) may apply a sharpness enhancement intensity of the reference video to the reference video and apply a sharpness enhancement intensity of each video to the remaining videos. When the sharpness of the reference video is at maximum sharpness, the electronic device (1000) may apply a sharpness enhancement intensity of each video only to the remaining videos. We will examine in detail the operation of the electronic device (1000) applying quality-related parameters of the reference video to each of the plurality of videos.

[0071] According to one embodiment of the present disclosure, an electronic device (1000) may apply a comparison score of a reference video to a plurality of videos. For example, the electronic device (1000) may determine a comparison score of a current video among a plurality of videos. The current video may refer to a video that is currently to be processed. The current video may be the nth video (where n is a natural number greater than or equal to 1) among a plurality of videos, excluding the reference video.

[0072] The electronic device (1000) can compare the contrast score of the current video with the contrast score of the reference video and adjust the contrast of the current video so that the contrast score of the current video becomes equal to or similar to the contrast score of the reference video. For example, if the contrast score of the current video is higher than the contrast score of the reference video, the electronic device (1000) can reduce the contrast of the current video by compositing each frame included in the current video with a grayscale image. Additionally, if the contrast score of the current video is lower than the contrast score of the reference video, the electronic device (1000) can enhance the contrast of the current video.

[0073] For example, the electronic device (1000) can improve the contrast of the current video by determining the intensity value of a pixel using mapping functions corresponding to the surrounding patches of the pixel for each pixel included in each frame of the current video. Here, the mapping function may be a cumulative distribution function calculated by clipping a bin of a histogram that has been counted above a reference value (clip value) and distributing it to another bin, and then accumulating the distributed histogram. For example, the electronic device (1000) may divide each frame of the current video into multiple patches and obtain a histogram corresponding to each patch. The electronic device (1000) may determine the clip value of each histogram using the average of the intensity values ​​of each patch, the variance of the intensity values ​​of each patch, and the intensity value of the center pixel. And the electronic device (1000) can obtain a modified histogram by distributing the bins of the histogram that are counted above the clip value to other bins, and generate a cumulative distribution function of the modified histogram as a mapping function. When the bins of the histogram that are counted above the reference value (clip value) are clipped and distributed to other bins, the bins representing the same intensity value are changed to bins representing different intensity values, so the difference in intensity increases and the contrast can be improved.

[0074] Meanwhile, the electronic device (1000) can determine the intensity value of a pixel by interpolating mapping functions by considering the spatial distance between the center of the pixel and surrounding patches. Since the boundary between patches may be unnatural when the intensity value of a pixel is determined using only the mapping function of the patch containing the pixel, the electronic device (1000) can interpolate mapping functions by considering the spatial distance between the center of the pixel and surrounding patches. The operation of the electronic device (1000) obtaining a mapping function corresponding to each patch and enhancing the contrast of each video will be examined in more detail later with reference to FIGS. 9 and FIGS. 10.

[0075] According to one embodiment of the present disclosure, an electronic device (1000) can transfer color information of a reference video to a plurality of videos. For example, the electronic device (1000) can adjust the color of the remaining videos among the plurality of videos based on the color information of the reference video.

[0076] The electronic device (1000) can obtain the channel-specific average and channel-specific standard deviation of the current video among a plurality of videos. The channels may include Y channels, U channels, and V channels. The electronic device (1000) can normalize the data of each channel of the current video so that the channel-specific average of the current video approaches the channel-specific average of the reference video. For example, the electronic device (1000) can normalize the data of each channel of the current video using the channel-specific average and channel-specific standard deviation of the current video and the channel-specific average and channel-specific standard deviation of the reference video. Furthermore, the electronic device (1000) can apply blending so that the difference between the input image of the current video and the normalized image is appropriately reflected. For example, the electronic device (1000) can blend the data of each channel of the current video with the normalized data of each channel of the current video based on the difference between the channel-specific average of the current video and the channel-specific average of the reference video. If the difference in color tone between the current video and the reference video is too large, the color tone of the current video may appear unnatural if the color tone of the reference video is transferred to the current video as is. Therefore, the electronic device (1000) can blend the data of each channel with normalized data. The operation of the electronic device (1000) transferring the color tone information of the reference video to each video will be examined in more detail later with reference to FIG. 11.

[0077] According to one embodiment of the present disclosure, an electronic device (1000) can obtain a plurality of videos having the same clarity as a reference video by using a clarity enhancement intensity corresponding to each of the plurality of videos. For example, the electronic device (1000) can apply a clarity enhancement intensity of the reference video to the reference video and apply a clarity enhancement intensity corresponding to the remaining videos to the remaining videos. Since the clarity enhancement intensity of each video is determined by a value obtained by comparing the clarity of each video with the maximum clarity of the plurality of videos, each video can be adjusted to have maximum clarity. If the reference video is a video having maximum clarity, the clarity of the reference video can maintain the original clarity.

[0078] According to one embodiment of the present disclosure, an electronic device (1000) can detect an edge region of each frame included in the current video by applying a Gaussian blur to the Y channel of each frame included in the current video among a plurality of videos. For example, the electronic device (1000) can extract a low-frequency image by applying a Gaussian blur to the Y channel of each frame. The electronic device (1000) can extract an edge region from the Y channel of each frame by calculating the absolute difference between the Y channel image of each frame and the low-frequency image. The electronic device (1000) can extract a sharpness enhancement target mask to remove noise from the edge region. The electronic device (1000) can apply a sharpness enhancement intensity corresponding to the current video to the edge region from which noise has been removed. In this case, since the edges of each frame become distinct, the sharpness of each video can be enhanced. The operation of the electronic device (1000) enhancing the sharpness of each video will be examined in more detail later with reference to FIG. 12.

[0079] According to one embodiment of the present disclosure, the electronic device (1000) may adjust the quality of each video in the order of contrast, color tone, and sharpness, but is not limited thereto. For example, the electronic device (1000) may adjust the quality of each video in the order of contrast, sharpness, and color tone, may adjust the quality of each video in the order of color tone, contrast, and sharpness, may adjust the quality of each video in the order of color tone, sharpness, and contrast, may adjust the quality of each video in the order of sharpness, contrast, and color tone, or may adjust the quality of each video in the order of sharpness, color tone, and contrast.

[0080] Additionally, according to one embodiment of the present disclosure, the electronic device (1000) may adjust only some of the contrast, color tone, and sharpness, or adjust all of them. For example, the electronic device (1000) may adjust the contrast and color tone of a plurality of videos, adjust the contrast and sharpness of a plurality of videos, adjust the color tone and sharpness of a plurality of videos, or adjust the contrast, color tone, and sharpness of a plurality of videos. According to one embodiment of the present disclosure, the electronic device (1000) may adjust the contrast, color tone, and / or sharpness only for a part of the video, or adjust it for the entire video. For example, the electronic device (1000) may adjust the contrast and color tone of a first part of a plurality of videos, adjust the contrast and sharpness of a second part, adjust the color tone and sharpness of a third part, and also adjust the contrast, color tone, and sharpness of a fourth part.

[0081] According to one embodiment of the present disclosure, the electronic device (1000) can convert the multiple videos with adjusted image quality back into RGB format when the image quality adjustment for the multiple videos is completed.

[0082] In step S250, an electronic device (1000) according to one embodiment of the present disclosure can combine a plurality of videos with adjusted image quality and edit them into a single video.

[0083] According to one embodiment of the present disclosure, the electronic device (1000) can edit a plurality of videos into a single video according to the order in which a user selects the videos. For example, if a user selects the videos in the order of the first video (10), the second video (20), the fourth video (40), and the third video (30), the electronic device (1000) can combine them in the order of the first video (10), the second video (20), the fourth video (40), and the third video (30). Additionally, if a user adjusts the order of the plurality of videos, the electronic device (1000) can combine them into a single video according to the adjusted order.

[0084] According to one embodiment of the present disclosure, an electronic device (1000) can store a video edited into a single video in memory or output (play) it through an output interface (e.g., a display, a speaker, etc.). According to one embodiment of the present disclosure, the electronic device (1000) can maximize consistency (harmony and / or unity) and minimize disparity when editing a plurality of videos into a single video by uniformly adjusting the contrast, color tone, or sharpness of a plurality of videos based on quality-related parameters of a reference video.

[0085] In FIG. 2, an example is described in which an electronic device (1000) applies quality-related parameters of a reference video to each of a plurality of videos to obtain a plurality of videos with adjusted quality, but this is not limited thereto. Instead of the electronic device (1000), an external device (e.g., a server) may analyze the reference video to obtain quality-related parameters of the reference video and apply the quality-related parameters of the reference video to each of a plurality of videos to obtain a plurality of videos with adjusted quality.

[0086] Meanwhile, according to one embodiment of the present disclosure, the operation of obtaining a plurality of videos with adjusted quality by applying quality-related parameters of a reference video to each of a plurality of videos may be performed through an AI model. For example, when an electronic device (1000) inputs a plurality of videos selected by a user into an AI model, the AI ​​model may output a result of combining the plurality of videos with adjusted quality to the electronic device (1000). At this time, the AI ​​model may be pre-trained to estimate quality-related parameters of each video and to apply quality-related parameters of a reference video to each video.

[0087] Below, we will examine in more detail with reference to FIGS. 3 to 12 the operation in which an electronic device (1000) analyzes parameters related to the quality of a reference video and adjusts the quality of a plurality of videos.

[0088] FIG. 3 is a drawing for explaining an analyzer and a processing module of an electronic device (1000) according to one embodiment of the present disclosure.

[0089] Referring to FIG. 3, the electronic device (1000) may include a video analyzer (100) and a processing module (200). According to one embodiment of the present disclosure, the video analyzer (100) and / or the processing module (200) may be physically implemented by analog and / or digital circuits including one or more of logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, etc. For example, a field programmable gate array (FPGA) may be used to implement custom logic that includes the functions of the video analyzer (100) and / or the processing module (200). As another example, a processor (e.g., a processor of the electronic device (1000)) may be implemented in such a way that it is coupled with memory to execute one or more instructions to perform the functions of the video analyzer (100) and / or the processing module (200).

[0090] According to one embodiment of the present disclosure, when a user selects a plurality of first to fourth videos (10, 20, 30, 40) to be edited into a single video, the electronic device (1000) may input the plurality of first to fourth videos (10, 20, 30, 40) to a video analyzer (100). The video analyzer (100) of the electronic device (1000) may analyze quality-related features of each video. For example, the video analyzer (100) of the electronic device (1000) may analyze each video to obtain a contrast score or color tone information of each video. In addition, the video analyzer (100) of the electronic device (1000) may calculate the clarity of each video and determine the clarity enhancement strength of each video based on the maximum clarity among the clarity of each video.

[0091] According to one embodiment of the present disclosure, an analyzer (100) of an electronic device (1000) may sample N frames (N is a positive integer greater than 1) of each video and perform analysis on the sampled N frames. For example, the analyzer (100) of the electronic device (1000) may analyze N frames to extract parameters necessary for processing contrast, color tone, and sharpness of each video. In particular, the video analyzer (100) of the electronic device (1000) may obtain a contrast score, color tone information, and sharpness enhancement intensity of a reference video.

[0092] According to one embodiment of the present disclosure, a processing module (200) of an electronic device (1000) may perform processing to uniformly adjust the quality of each video. The processing module (200) may include a contrast adjustment module, a color transfer module, and a sharpness enhancement module, but is not limited thereto.

[0093] According to one embodiment of the present disclosure, a processing module (200) of an electronic device (1000) can reflect the contrast score and color information of a reference video (e.g., a first video (10)) into the remaining videos (20, 30, 40), and apply a sharpness enhancement intensity to each of the reference video (e.g., a first video (10)) and the remaining videos (20, 30, 40) to obtain a plurality of videos with adjusted image quality (e.g., an adjusted first video (10'), an adjusted second video (20'), an adjusted third video (30'), an adjusted fourth video (40')). At this time, the processing module (200) of the electronic device (1000) can perform contrast, color, and sharpness processing on all frames of each video to obtain a plurality of adjusted first to fourth videos (10', 20', 30', 40') having uniform image quality. The electronic device (1000) can combine a plurality of first to fourth videos (10', 20', 30', 40') with adjusted image quality to generate an edited video with minimized dissonance (hereinafter also referred to as a combined video).

[0094] FIG. 4 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure analyzing a plurality of videos.

[0095] Referring to FIG. 4, according to one embodiment of the present disclosure, an electronic device (1000) comprises a plurality of videos (RGB) selected by a user. n Each of them is a video in YUV format (YUV n Convert to ), and multiple videos converted to YUV format (YUV n Sample frames can be extracted by sampling each of them. The electronic device (1000) can input the sample frames into the video analyzer (100).

[0096] An electronic device (1000) according to one embodiment of the present disclosure has a plurality of videos (YUV) according to a predetermined standard. n) Refer to one of the following videos (YUV) ref It can be determined as ). For example, the video in the first sequence is the reference video (YUV ref Determine as ), or a video selected by the user as a reference video (YUV ref It can be decided as ).

[0097] The video analyzer (100) of the electronic device (1000) is a reference video (YUV ref By analyzing sample frames of ) reference video (YUV ref ) comparison score( ) and reference videos (YUV ref ) color tone( ) can be determined. In addition, the analyzer (100) of the electronic device (1000) can determine a reference video (YUV ref ) and the rest of the videos (YUV 1 , ..., YUV N-1 ) Determine the sharpness of each, and the maximum sharpness among them ( ) can be determined. At this time, the analyzer (100) can determine the contrast score and sharpness using the Y channel of the sample frames, and can determine the color tone using the Y channel, U channel, and V channel of the sample frames.

[0098] In Fig. 4, multiple videos (RGB n Each of them is a video in YUV format (YUV n Although the case of conversion to ) has been explained as an example, it is not limited thereto. For example, the electronic device (1000) may convert each of the multiple videos (RGBn) into a video in YCbCr format, a video in LAB format, or a video in HSV format.

[0099] Below, we will examine the specific operation of the video analyzer (100) in detail with reference to FIGS. 5 to 7.

[0100] FIG. 5 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure acquiring comparison information of a reference video.

[0101] Referring to FIG. 5, an electronic device (1000) according to one embodiment of the present disclosure comprises a Y channel (y) of sample frames included in a reference video. n The contrast score of the reference video can be determined using the intensity value of ).

[0102] For example, the electronic device (1000) can divide each sample frame into patches (S510). A patch is an area larger than a pixel, and a patch may include multiple pixels. The electronic device (1000) divides each patch (P i Contrast (C) for each i ) can be calculated (S520). The contrast of each patch can be determined according to an equation that can be expressed in a form similar to the following mathematical formula 1. That is, the contrast of each patch (C i ) is the maximum intensity value (maxp) within each patch i) and minimum strength value (min p i It can be the value obtained by dividing the difference of ) by the sum of the maximum strength value and the minimum strength value.

[0103] [Mathematical Formula 1]

[0104] The electronic device (1000) calculates the contrast of each patch for each sample frame, and the contrast average (= ) can be calculated (S530). Here, the contrast average may be the contrast of each sample frame. Thus, if there are multiple sample frames, the electronic device (1000) calculates the average of the contrasts of the sample frames as the contrast score of the reference video ( It can be decided as ).

[0105] FIG. 6 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure acquiring color information of a reference video.

[0106] Referring to FIG. 6, the electronic device (1000) may include a statistical module (610) for obtaining tone information of a reference video. According to one embodiment of the present disclosure, the statistical module (610) may be physically implemented by an analog and / or digital circuit comprising one or more of logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, etc. For example, a custom logic including the function of the statistical module (610) may be implemented using an FPGA. As another example, a processor (e.g., a processor of the electronic device (1000)) may be implemented in such a way that it is combined with memory to execute one or more instructions to perform the function of the statistical module (610). Alternatively, additionally or alternatively, at least a portion of the function of the statistical module (610) may be integrated into a processing module (200) or implemented as instructions executed by the processing module (200).

[0107] Referring to FIG. 6, the statistical module (610) of the electronic device (1000) provides overall color information of the reference video (yuvref) ( To obtain ), the average (for each channel (Y, U, V) of each sample frame ) and standard deviation( ) can be calculated. For example, the statistical module (610) can generate a histogram based on the intensity values ​​of the Y channel (yref) (601), U channel (uref) (602), and V channel (vref) (603). The Y channel (yref) (601), U channel (uref) (602), and V channel (vref) (603) may be represented as a Y channel image, a U channel image, and a V channel image. The statistical module (610) can calculate the average of the Y channel (601) based on the pixel values ​​of the Y channel (601). ) and standard deviation( ) can be obtained. The statistics module (610) can obtain the average of the U channel (602) based on the pixel values ​​of the U channel (602). ) and standard deviation( ) can be obtained. The statistics module (610) can obtain the average of the V channel (603) based on the pixel values ​​of the V channel (603). ) and standard deviation( ) can be obtained. At this time, the color information of the reference video ( ) can be expressed as the mean and standard deviation of the Y channel (601), the mean and standard deviation of the U channel (602), and the mean and standard deviation of the V channel (603). For example, color information of a reference video ( ) can be expressed as follows.

[0108]

[0109] Meanwhile, in the case of multiple sample frames, the average of the color information of each sample frame is the color tone information of the reference video ( It can be.

[0110] FIG. 7 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure acquiring the clarity enhancement intensity of each video.

[0111] Referring to 701 in FIG. 7, the electronic device (1000) can calculate the clarity of each of a plurality of videos selected by the user.

[0112] For example, the electronic device (1000) has a Y channel (y) of each sample frame included in a plurality of videos. n Applying a Gaussian blur to the low-frequency image (G(y) corresponding to each sample frame n )) can be extracted. The electronic device (1000) can extract the Y channel (y) of each sample frame. n ) and low-frequency image (G(y n Using the absolute deviation of )), the edge region (y) in the Y channel of each sample frame hf It can detect ). Edge regions (y in the Y channel hf ) can be expressed as an equation similar in form to mathematical equation 2.

[0113] [Mathematical Formula 2]

[0114] The electronic device (1000) has an edge region (y hf A mask (m) for clarity enhancement targets (true positives) to exclude noise (false positives) regions from ) hf ) can be extracted. For example, an electronic device (1000) can extract a kernel (K H Noise generated as a dot (.) in the edge region can be removed using ). That is, the electronic device (1000) has an edge region (y hf ) a specified kernel (K H It can perform convolution operations with ). And the electronic device (1000) determines that areas within the edge regions that are less than the threshold intensity (τ) are noise and removes them, thereby creating a clarity enhancement target mask (m hf) can be extracted. For example, the sharpness enhancement target mask (m) by removing hf ) can be expressed as an equation similar in form to mathematical equation 3.

[0115] [Mathematical Formula 3]

[0116] The electronic device (1000) can obtain the sharpness of each sample frame by averaging the edge scores of the noise-removed edge regions. For example, the electronic device (1000) has an edge region (y) having an intensity value hf ) and clarity enhancement target mask (m hf Divide the sum of the values ​​multiplied by ) by the area of ​​the sample frame (H*W) to obtain the sharpness score (S) of each sample frame (S n ) can be calculated. The electronic device (1000) can calculate the sharpness of the video by averaging the sharpness scores of each sample frame when each video includes multiple sample frames, and this can be expressed as an equation similar in form to Equation 4.

[0117] (H= height, W=width) [Equation 4]

[0118] Referring to 702 in FIG. 7, the electronic device (1000) has a clarity score (S) extracted from each video. n The maximum value (S) among ) can be determined. And the electronic device (1000) can determine the clarity score (S) of each video. n Using ) and the maximum value (S), the appropriate sharpness enhancement intensity ({ρ 0 , 쪋, ρ N-1}) can be calculated. For example, the electronic device (1000) can determine the intensity of the sharpness enhancement of each video using an equation similar to mathematical formula 5.

[0119] [Mathematical Formula 5]

[0120] The sharpness enhancement strength of each video may be a parameter for enhancing the sharpness of each video. For example, the sharpness enhancement strength of a reference video may be a parameter for enhancing the sharpness of a reference video. The electronic device (1000) enhances the sharpness of the reference video based on the sharpness enhancement strength of the reference video, and the remaining videos may also enhance their sharpness based on the sharpness enhancement strength.

[0121] Below, we will look at the operation of adjusting the quality of multiple videos using the quality-related parameters of a reference video obtained through a video analyzer (100) by the electronic device (1000) with reference to FIG. 8.

[0122] FIG. 8 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure adjusting the quality of a plurality of videos.

[0123] Referring to FIG. 8, the electronic device (1000) comprises, for each of a plurality of videos ( The video can be converted into YUV format (S800). The processing module (200) of the electronic device (1000) can sequentially perform contrast adjustment processing (S810), color preprocessing (S820), and sharpness enhancement processing (S830) for each video converted into YUV format. However, the order of processing for contrast adjustment processing (S810), color preprocessing (S820), and sharpness enhancement processing (S830) may be changed. For convenience of explanation, the following description will use an example where the contrast adjustment processing (S810), color preprocessing (S820), and sharpness enhancement processing (S830) are performed in that order.

[0124] According to one embodiment of the present disclosure, an electronic device (1000) may perform contrast adjustment processing (S810), color transfer processing (S820), and sharpness enhancement processing (S830) for all frames of each video. At this time, the electronic device (1000) performs the contrast adjustment processing (S810) and sharpness enhancement processing (S830) on the Y channel ( of each frame) Apply to ), and color preprocessing (S820) to the Y channel of each frame ( ), U Channel( ), V channel( It can be applied to ).

[0125] According to one embodiment of the present disclosure, the electronic device (1000) comprises the Y channel of the entire frame included in each video ( Contrast adjustment processing (S810) can be performed on ). For example, the electronic device (1000) can perform contrast score ( of a reference video) Based on ), the Y channel of the remaining videos excluding the reference video among the multiple videos selected by the user ( A contrast adjustment process (S810) can be performed on the electronic device (1000). The contrast-adjusted Y channel ( ) and U Channel( ), V channel( Color transfer processing (S820) can be performed on ). For example, the electronic device (1000) can perform color information of a reference video ( Based on ), color preprocessing (S820) can be performed on all frames included in the remaining video. Additionally, the electronic device (1000) can perform color preprocessing (S820) on the Y channel ( Sharpness enhancement processing (S830) can be performed on ). For example, the sharpness enhancement intensity of each video ( Based on ), the Y channel of each video ( Sharpness enhancement processing (S830) can be performed on ). At this time, the electronic device (1000) is, in the case of a reference video, the original Y channel (where contrast adjustment and color transfer have not been applied) A sharpness enhancement process (S830) can be performed on ). However, the embodiments of the present disclosure are not limited thereto, and the number of processing operations to be performed, as well as the order in which the processing operations are performed, may be varied as long as they do not deviate from the scope of the present disclosure.

[0126] The electronic device (1000) is a YUV video (when contrast adjustment processing (S810), color transfer processing (S820), and sharpness enhancement processing (S830) are completed. ) RGB video( It can be converted into (S840). According to one embodiment of the present disclosure, the electronic device (1000) can combine RGB videos to edit them into a single video. Alternatively, the electronic device (1000) may combine YUV videos to edit them into a single video and then convert them into an RGB video.

[0127] In FIG. 8, an example was described in which an electronic device (1000) adjusts contrast, color tone, and sharpness to uniformly adjust the quality of multiple videos, but this is not limited thereto. For example, the electronic device (1000) may further adjust at least one of brightness, exposure, saturation, color temperature, or clarity to uniformly adjust the quality of multiple videos.

[0128] Below, with reference to FIGS. 9 to 12, we will examine the contrast adjustment process (S810), color transfer process (S820), and sharpness enhancement process (S830) in more detail.

[0129] FIG. 9 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure adjusting the contrast of each video.

[0130] FIG. 9 describes, as an example, a case in which an electronic device (1000) adjusts the contrast of a single frame included in a plurality of videos. A single frame is a frame currently to be processed and can be represented as an input image. The contrast adjustment for the input image can be applied in the same way to other frames included in the plurality of videos.

[0131] Referring to FIG. 9, the electronic device (1000) has an input image ( ) and reference video(y ref The contrast of the input image can be reduced or enhanced based on the result of comparing the contrast score of the input image. For example, the electronic device (1000) can reduce or enhance the contrast of the input image's contrast score ( Calculate ) (S910), and the contrast score of the input image and the contrast score of the reference image ( ) can be compared (S920). The contrast score of the input image can be calculated according to the method described in FIG. 5. The electronic device (1000) determines, based on the comparison result, if the contrast score of the input image is greater than the contrast score of the reference image ( )(Yes of S920), the contrast of the input image can be reduced (S931). For example, the electronic device (1000) can reduce the contrast of the input image by compositing the input image with a gray image (S931).

[0132] According to one embodiment of the present disclosure, an electronic device (1000) is used when the contrast score of an input image is smaller than the contrast score of a reference image ( )(No of S920), the contrast of the input image can be improved (S940). For example, the electronic device (1000) patches the input image (P k It can be divided into ) (S941). A patch is an area larger than a pixel and may include multiple pixels. The electronic device (1000) has a histogram (h) corresponding to each patch. k)(901) can be calculated (S942). That is, the electronic device (1000) can generate a histogram (901) by counting the intensity values ​​contained in each patch. The electronic device (1000) can generate each histogram (h) using an equation similar to Equation 6. k Clip value (C) for every )(901) k )(902) can be calculated (S943). According to mathematical formula 6, the clip value (902) of each histogram (901) can be calculated as the absolute deviation between the intensity value of the center pixel of each patch and the average intensity value of each patch divided by the standard deviation of the intensity value of each patch.

[0133] [Mathematical Formula 6]

[0134] where is the intensity value of the center pixel in patch P k

[0135] are mean and standard deviation of intensity values ​​patch P k

[0136] λ is some constant

[0137] The electronic device (1000) can clip bins of histogram (901) that are counted at or above the clip value (902) and distribute them to other bins (S944). When distributing bins, the number of bins with the same intensity value may decrease. At this time, the electronic device (1000) can generate a new histogram (903) by uniformly filling the bins of histogram (901) that are counted at or above the clip value (902) from the bottom of other bins. The electronic device (1000) accumulates the distributed histogram (903) to form a cumulative distribution function (cdf kA cumulative distribution function (904) is generated (S945), and the cumulative distribution function (904) can be used as a mapping function. In the following, the cumulative distribution function (904) will be expressed as a mapping function. In the cumulative distribution function (904), the x-axis can be the input intensity value and the y-axis can be the output intensity value.

[0138] According to one embodiment of the present disclosure, an electronic device (1000) can improve the contrast of an input image by interpolating mapping functions around each pixel of the input image (S946). Refer to FIG. 10.

[0139] FIG. 10 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure interpolating mapping functions around a corresponding pixel.

[0140] According to one embodiment of the present disclosure, when determining the intensity value of a pixel using only the mapping function of a patch containing the pixel, unnaturalness may occur at the patch boundary. Therefore, the electronic device (1000) can determine the intensity value of a pixel by interpolating the mapping functions around the pixel.

[0141] For example, referring to FIG. 10, the intensity value of the current pixel (1001) can be determined by interpolating the mapping functions (e.g., first mapping function (1011), second mapping function (1021), third mapping function (1031), fourth mapping function (1041)) of patches located around the current pixel (1001) (e.g., first patch (1010), second patch (1020), third patch (1030), fourth patch (1040)). Referring to 1000-1 of FIG. 10, the electronic device (1000) determines the weight (W) of each patch by taking into account the spatial distance between the current pixel and the center of the surrounding patches. k ) can be determined. The farther the distance between the current pixel and the center of the surrounding patch, the greater the weight (W k) can be determined to be small. A first weight (W1) can be determined based on the distance between the first center (P1) of the first patch (1010) containing the current pixel (1001) and the current pixel (1001). A second weight (W2) can be determined based on the distance between the second center (P2) of the second patch (1020) located to the right of the first patch (1010) and the current pixel (1001). A third weight (W3) can be determined based on the distance between the third center (P3) of the third patch (1030) located to the bottom of the first patch (1010) and the current pixel (1001). A fourth weight (W4) can be determined based on the distance between the fourth center (P4) of the fourth patch (1040) located to the bottom right of the first patch (1010) and the current pixel (1001).

[0142] Referring to 1000-2 of FIG. 10, the electronic device (1000) can determine a value mapped to an intensity value of the current pixel (1001) by a mapping function for each patch. For example, the electronic device (1000) can determine a first intensity value (Z1) corresponding to the intensity value of the current pixel (1001) by using a first mapping function (1011) of a first patch (1010). The electronic device (1000) can determine a second intensity value (Z2) corresponding to the intensity value of the current pixel (1001) by using a second mapping function (1021) of a second patch (1020). The electronic device (1000) can determine a third intensity value (Z3) corresponding to the intensity value of the current pixel (1001) by using a third mapping function (1031) of a third patch (1030). The electronic device (1000) can determine a fourth intensity value (Z4) corresponding to the intensity value of the current pixel (1001) by using the fourth mapping function (1041) of the fourth patch (1040).

[0143] The electronic device (1000) has a weight value (w) of each patch. k ) and output value(z kThe intensity value of the current pixel (1001) is determined by adding the product of ), and an image can be constructed using the intensity value of each pixel to obtain an input image with enhanced contrast. This can be expressed as an equation similar in form to Equation 7.

[0144] [Mathematical Formula 7]

[0145] FIG. 10 describes an example of interpolating mapping functions of four patches, but is not limited thereto. For example, the electronic device (1000) may interpolate mapping functions of additional patches (e.g., more than four, e.g., nine) around the current pixel, or may interpolate mapping functions of a smaller number of patches (e.g., less than four, e.g., two).

[0146] FIG. 11 is a drawing for explaining the operation of an electronic device (1000) according to one embodiment of the present disclosure transferring the color tone of each video.

[0147] According to one embodiment of the present disclosure, an electronic device (1000) can transfer the color tone of a reference video to the remaining video. To this end, the electronic device (1000) can calculate the mean and standard deviation for each channel (Y, U, V) of each video (S1110). For example, the electronic device (1000) can generate a histogram for each channel of each video and calculate the mean and standard deviation. The electronic device (1000) can apply normalization for each channel (Y, U, V) by utilizing the mean and standard deviation of the reference video (S1120). For example, the electronic device (1000) can normalize the data of each channel of the current video by utilizing the channel-specific mean and standard deviation of the video to be processed (current video) and the channel-specific mean and standard deviation of the reference video. Referring to 1101 in FIG. 11, the mean of the Y channel of the current video ( ) is the average of the Y channel of the reference video( The data of the Y channel of the current video can be normalized to approximate (e.g., substantially similar or identical). For example, the electronic device (1000) can normalize the data of each channel by subtracting the mean of each channel from the data of each channel according to Equation 8, multiplying the value obtained by dividing the standard deviation of the reference video by the standard deviation of each channel, and then adding the mean of the reference video.

[0148] [Mathematical Formula 8]

[0149] According to one embodiment of the present disclosure, the electronic device (1000) may apply blending so that the difference between the input image (currently processed frame) and the normalized image is appropriately reflected (S1130). For example, the electronic device (1000) may transfer color information of the reference video to the current video by blending the data of each channel of the current video with the normalized data of each channel of the current video based on the difference between the channel-by-channel average of the current video and the channel-by-channel average of the reference video.

[0150] According to one embodiment of the present disclosure, an electronic device (1000) can blend data (image) of each channel and normalized data (image) of each channel according to an equation similar to Equation 9. For example, if the difference between the channel-by-channel average of the current video and the channel-by-channel average of the reference video is smaller than a first threshold value (τ0), the electronic device (1000) can blend the data of each channel of the current video and the normalized data of each channel of the current video at a ratio of 3:1. On the other hand, as the difference between the channel-by-channel average of the current video and the channel-by-channel average of the reference video increases, the blending ratio of the normalized data may decrease. If the difference between the channel-by-channel average of the current video and the channel-by-channel average of the reference video exceeds a second threshold value (τ1), the data of each channel may be output as is without being blended with the normalized data. That is, if the amount of color change compared to the original video is too large, the user may feel a great sense of unfamiliarity, so the electronic device (1000) can blend the data (video) of each channel and the normalized data (video) of each channel at an appropriate ratio.

[0151] [Mathematical Formula 8]

[0152]

[0153]

[0154] According to one embodiment of the present disclosure, if a reference video has a yellow tint, the remaining videos can also be adjusted to have a yellow tint.

[0155] Although FIG. 11 describes an example using the YUV color space, it is not limited thereto. The electronic device (1000) may use the YCbCr color space, the LAB color space, or the HSV color space. For example, when the electronic device (1000) uses the YCbCr color space, it may apply normalization to each video channel (Y channel, Cb channel, Cr channel) by utilizing the mean and standard deviation of the reference video. When the electronic device (1000) uses the LAB color space, it may apply normalization to each video channel (L channel, a channel, b channel) by utilizing the mean and standard deviation of the reference video. When the electronic device (1000) uses the HSV color space, it may apply normalization to each video channel (H channel, S channel, V channel) by utilizing the mean and standard deviation of the reference video.

[0156] FIG. 12 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure to improve the clarity of each video.

[0157] According to one embodiment of the present disclosure, an electronic device (1000) can improve the clarity of each video based on the clarity improvement intensity (clarity score) of each video calculated according to the process described in FIG. 7.

[0158] FIG. 12 describes, as an example, a case in which an electronic device (1000) adjusts the sharpness of a single frame included in a plurality of videos. A single frame is a frame currently to be processed and can be represented as an input image. The sharpness adjustment for the input image can be applied in the same way to other frames included in the plurality of videos.

[0159] The electronic device (1000) is the Y channel of the input image ( Applying a Gaussian blur to the low-frequency image (G(y) corresponding to the input image) n)) can be extracted (S1210). The electronic device (1000) can extract the Y channel of the input image ( ) and low-frequency image (G(y n Using the absolute deviation of )), the edge region (y) in the Y channel of the input image hf ) can be detected (S1220), which can be expressed as an equation similar in form to mathematical formula 10.

[0160] [Mathematical Formula 10]

[0161] The electronic device (1000) has an edge region (y hf A mask (m) for clarity enhancement targets (true positives) to exclude noise (false positives) regions from ) hf ) can be extracted. For example, an electronic device (1000) can extract a kernel (K H Noise generated as a dot (.) in the edge region can be removed using ). That is, the electronic device (1000) has an edge region (y hf For ), a predetermined kernel (K H It can perform a convolution operation with ). And the electronic device (1000) determines that areas within the edge regions that are less than the threshold intensity (τ) are noise and removes them, thereby creating a clarity enhancement target mask (m hf ) can be extracted (S1230), which can be expressed as an equation similar in form to mathematical formula 11.

[0162] [Mathematical Formula 11]

[0163] According to one embodiment of the present disclosure, the electronic device (1000) can apply a sharpness enhancement intensity to an edge region from which noise has been removed (S1240). For example, an edge region (y hf ) and clarity enhancement target mask (m hf A sharpness enhancement intensity can be further multiplied to the product of ). The electronic device (1000) applies a sharpness enhancement intensity ( to the input image according to an equation similar to mathematical formula 12) An image with enhanced clarity can be obtained by adding an edge area to which ) is applied (S1250). That is, the electronic device (1000) can enhance clarity by reinforcing the edges of each frame based on the intensity of the clarity enhancement.

[0164] [Mathematical Formula 12]

[0165] Although FIG. 12 describes an example using the YUV color space, it is not limited thereto. The electronic device (1000) may use the YCbCr color space, the LAB color space, or the HSV color space. For example, the electronic device (1000) may use the L channel of the input image (in the case of the LAB color space) or the V channel of the input image (in the case of the HSV color space) instead of the Y channel of the input image.

[0166] According to one embodiment of the present disclosure, a user may additionally adjust the image quality of a plurality of videos in which contrast, color tone, and sharpness are automatically adjusted by an electronic device (1000). Hereinafter, with reference to FIG. 13, we will examine in detail a method in which the electronic device (1000) additionally adjusts the image quality of a video according to user input.

[0167] FIG. 13 is a flowchart illustrating a method for an electronic device (1000) according to one embodiment of the present disclosure to further adjust the quality of a video according to user input.

[0168] Referring to FIG. 13, the method by which the electronic device (1000) further adjusts the video quality may include steps S1310 to S1350. In one embodiment of the present disclosure, steps S1310 to S1350 may be executed by at least one processor included in the electronic device (1000). The method by which the electronic device (1000) further adjusts the video quality is not limited to that illustrated in FIG. 13, and in one or more embodiments, additional steps not illustrated in FIG. 13 may be included, or some steps may be omitted.

[0169] In step S1310, an electronic device (1000) according to one embodiment of the present disclosure may provide a list of a plurality of videos with adjusted image quality.

[0170] According to one embodiment of the present disclosure, the electronic device (1000) may output a list of multiple videos with adjusted image quality to a screen when the contrast, color tone, or sharpness adjustment for multiple videos selected by a user is completed. According to one embodiment of the present disclosure, the electronic device (1000) may provide a list of multiple videos along with a combined video in which multiple videos are combined into one, or may provide a list of multiple videos when the user requests editing of the combined video.

[0171] According to one embodiment of the present disclosure, a thumbnail image or a representative frame of each video may be displayed in a list of a plurality of videos with adjusted image quality, but is not limited thereto.

[0172] In step S1320, an electronic device (1000) according to one embodiment of the present disclosure may receive user input selecting a first video among a plurality of videos with adjusted image quality. For example, the electronic device (1000) may receive input of touching a thumbnail image of the first video for a predetermined amount of time or more, or touching it more than a predetermined number of times, from a list of a plurality of videos with adjusted image quality.

[0173] In other words, the user can select one video from among multiple videos with adjusted quality to check quality-related parameters.

[0174] In step S1330, an electronic device (1000) according to one embodiment of the present disclosure may provide parameters related to the quality of the first video based on user input selecting the first video. For example, the electronic device (1000) may provide parameters related to the contrast, color tone, or sharpness of the first video with adjusted quality.

[0175] According to one embodiment of the present disclosure, the electronic device (1000) may display a contrast icon, a color icon, and a sharpness icon in relation to a first video, and may provide specific parameters according to an input selecting one of these. For example, the electronic device (1000) may display a contrast score of the first video when it receives an input selecting a contrast icon, display color information of the first video when it receives an input selecting a color icon, and display a sharpness enhancement intensity (sharpness score) of the first video when it receives an input selecting a sharpness icon.

[0176] In step S1340, an electronic device (1000) according to one embodiment of the present disclosure may receive user input for adjusting parameters related to the image quality of the first video.

[0177] According to one embodiment of the present disclosure, an electronic device (1000) may receive user input that adjusts the intensity of at least one of the contrast, color tone, or sharpness of a first video. For example, the electronic device (1000) may receive input that increases or decreases the contrast of the first video, input that changes the color tone of the first video, and input that increases or decreases the sharpness enhancement intensity.

[0178] Additionally, according to one embodiment of the present disclosure, the electronic device (1000) may receive an input to turn each processing module on or off. For example, the electronic device (1000) may receive an input to disable or enable a contrast adjustment module, an input to disable or enable a color adjustment module, and an input to disable or enable a sharpness adjustment module.

[0179] In step S1350, the electronic device (1000) according to one embodiment of the present disclosure may further adjust the quality-related parameters of the first video based on user input that adjusts the quality-related parameters of the first video.

[0180] According to one embodiment of the present disclosure, when the electronic device (1000) receives input from a user to adjust parameters related to the quality of the first video, it can further adjust the quality of the first video that has been automatically adjusted.

[0181] For example, when the electronic device (1000) receives input from a user to adjust the contrast score of the first video, it may apply the contrast score selected by the user to each frame included in the first video. Additionally, when the electronic device (1000) receives input from a user to disable the contrast adjustment module, it may restore the contrast of each frame of the first video to its original state.

[0182] According to one embodiment of the present disclosure, the electronic device (1000) can combine the first video with the additionally adjusted video with the remaining videos to edit it into one video when the video quality of the first video is additionally adjusted.

[0183] Accordingly, according to one embodiment of the present disclosure, the user can additionally modify the quality-related parameters of each automatically adjusted video. With reference to FIG. 14, we will look a little further into the operation of the electronic device (1000) additionally adjusting the quality of the video according to user input.

[0184] FIG. 14 is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure to additionally adjust the quality of a video according to user input.

[0185] Referring to FIG. 14, the electronic device (1000) may provide a list (1410) of multiple videos with adjusted image quality. For example, the electronic device (1000) may provide a list (1410) including a first video (VID1), a second video (VID2), a fourth video (VID4), and a third video (VID3).

[0186] When a user selects a third video (VID3) from a list (1410), the electronic device (1000) may provide parameters related to the quality of the third video (VID3). For example, the electronic device (1000) may provide a list of processing modules (1420) capable of adjusting the quality of the third video. The list of processing modules (1420) may include a first icon (1421) representing a contrast adjustment module, a second icon (1422) representing a color tone adjustment module, and a third icon (1423) representing a sharpness adjustment module. When a user selects the third icon (1423) representing a sharpness adjustment module from the list of processing modules (1420), the electronic device (1000) may display an indicator (e.g., 32) representing the sharpness enhancement intensity (1430) of the third video (VID3). When the electronic device (1000) receives input from a user to adjust the sharpness enhancement intensity, it can adjust the sharpness (1440) of the third video (VID3). For example, when the electronic device (1000) receives input to adjust an indicator indicating the sharpness enhancement intensity from 32 to 62, it can enhance the sharpness by strengthening the edges of each frame of the third video (VID3).

[0187] Meanwhile, the electronic device (1000) may receive an input to disable some of the icons included in the processing module list (1420). For example, the electronic device (1000) may receive an input to disable a third icon representing a sharpness adjustment module. In this case, the electronic device (1000) may maintain the original sharpness without adjusting the sharpness of the third video (VID3).

[0188] FIG. 15 is a block diagram for explaining the function of an electronic device (1000) according to one embodiment of the present disclosure.

[0189] As illustrated in FIG. 15, an electronic device (1000) according to one embodiment of the present disclosure may include an output unit (1100), a sensor unit (1200), a processor (1300), a communication interface (1400), an A / V input unit (1500), a user input unit (1600), and a memory (1700).

[0190] The number and arrangement of components of the electronic device (1000) illustrated in FIG. 15 are merely examples. In reality, more components may be included than illustrated in FIG. 15, fewer components may be included, different components may be included, or components may be arranged differently. Additionally, two or more components illustrated in FIG. 15 may be implemented as a single component, or conversely, a single component illustrated in FIG. 15 may be implemented as a plurality of distributed components. Alternatively, one or more sets of components illustrated in FIG. 15 may be integrated with each other, implemented as an integrated circuit, as software, or as a combination of circuit and software. For example, memory (1700) and processor (1300) may be combined into a single component or device.

[0191] The output unit (1100) is for outputting an audio signal, a video signal, or a vibration signal, and may include a display unit (1111), an audio output unit (1112), a vibration motor (1113), etc.

[0192] When the display unit (1111) and the touchpad form a layered structure and are configured as a touchscreen, the display unit (1111) can be used as an input interface in addition to an output interface. The display unit (1111) may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display. Additionally, depending on the implementation form of the electronic device (1000), two or more display units (1111) may be included.

[0193] The sound output unit (1112) outputs an audio signal received from the communication interface (1400) or stored in the memory (1700). Additionally, the sound output unit (1112) outputs an audio signal related to a function performed by the electronic device (1000) (e.g., a call signal reception sound, a message reception sound, a notification sound). The sound output unit (1112) may include a speaker, a buzzer, etc.

[0194] The vibration motor (1113) can output a vibration signal. For example, the vibration motor (1113) can output a vibration signal corresponding to the output of audio data or video data (e.g., a call signal reception sound, a message reception sound, etc.). Additionally, the vibration motor (1113) can output a vibration signal when a touch is input to the touchscreen.

[0195] The sensor unit (1200) may include at least one of a magnetic sensor (1211), an acceleration sensor (1212), a tilt sensor (1213), an infrared sensor (1214), a gyroscope sensor (1215), a position sensor (e.g., GPS) (1216), a temperature and humidity sensor (1217), a proximity sensor (1218), and a barometric pressure sensor (1219), but is not limited thereto. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, a detailed description is omitted.

[0196] The processor (1300) typically controls the overall operation of the electronic device (1000). For example, the processor (1300) can control the output unit (1100), sensor unit (1200), communication interface (1400), A / V input unit (1500), user input unit (1600), memory (1700), etc., by executing programs stored in memory (1700).

[0197] The processor (1300) may be composed of one or more processors. The one or more processors included in the processor (1300) may be circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC). The one or more processors included in the processor (1300) may be general-purpose processors such as a CPU (Central Processing Unit), MPU (Micro Processor Unit), AP (Application Processor), or DSP (Digital Signal Processor); graphics-dedicated processors such as a GPU (Graphic Processing Unit) or VPU (Vision Processing Unit); artificial intelligence-dedicated processors such as an NPU (Neural Processing Unit); or communication-dedicated processors such as a CP (Communication Processor). If the one or more processors included in the processor (1300) are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model. The processor (1300) may be implemented as a single core processor or as a multicore processor.

[0198] The processor (1300) can write data to memory (1700) or read data stored in memory (1700), and in particular, can process data according to a predefined operation rule or artificial intelligence model by executing a program or at least one instruction stored in memory (1700).

[0199] The communication interface (1400) may include one or more components that enable communication between an electronic device (1000) and an external device (an IoT device (3000) or a server (2000)). For example, the communication interface (1400) may include a short-range communication unit (1411), a mobile communication unit (1412), and a broadcast receiving unit (1413).

[0200] The short-range wireless communication unit (221) is Bluetooth TM Communications Department, BLE (Bluetooth TM Low Energy (LE) communication unit, Near Field Communication unit, WLAN communication unit (e.g., Wi-Fi), Zigbee TM It may include, but is not limited to, a communication unit, an infrared (IrDA, infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant+ communication unit, etc.

[0201] The mobile communication unit (1412) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various forms of data such as voice call signals, video call call signals, or text / multimedia message transmission and reception.

[0202] The broadcast receiver (1413) receives broadcast signals and / or broadcast-related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Depending on the implementation example, the electronic device (1000) may not include the broadcast receiver (1413).

[0203] The A / V (Audio / Video) input unit (1500) is for inputting audio signals or video signals and may include a camera (1511), a microphone (1512), etc. The camera (1511) can obtain image frames, such as still images or video, through an image sensor in a video call mode or a shooting mode. Images captured through the image sensor may be processed through a processor (1300) or a separate image processing unit. Image frames processed by the camera (1511) may be stored in a memory (1700) or transmitted externally through a communication interface (1400). According to one embodiment of the present disclosure, the camera (1511) may include at least one of a telephoto camera, a wide-angle camera, and a standard camera, but is not limited thereto.

[0204] The microphone (1512) receives an external acoustic signal and processes it into electrical voice data. For example, the microphone (1512) can receive an acoustic signal from an external device or a speaker. The microphone (1512) can use various noise removal algorithms to remove noise generated during the process of receiving the external acoustic signal.

[0205] The user input unit (1600) refers to a means for a user to input data for controlling an electronic device (1000). For example, the user input unit (1600) may include a key pad, a dome switch, a touch pad (contact capacitive method, pressure resistive method, infrared detection method, surface ultrasonic conduction method, integral tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, etc., but is not limited thereto.

[0206] The memory (1700) may store a program for processing and / or controlling the processor (1300), and may also store input / output data (e.g., voice data, photo images, memo data, user biometric information, etc.).

[0207] The memory (1700) may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk.

[0208] The memory (1700) may not exist separately but may be configured to be included in the processor (1300). The memory (1700) may be composed of volatile memory, non-volatile memory, or a combination of volatile and non-volatile memory. The memory (1700) may store a program or at least one instruction for performing operations according to one embodiment of the present disclosure. The memory (1700) may provide stored data to the processor (1300) upon the request of the processor (1300).

[0209] According to one embodiment of the present disclosure, the memory (1700) may include a video analyzer (100) and a processing module (200). The video analyzer (100) may be a module for analyzing an input video and obtaining image quality-related parameters (e.g., contrast score, color tone information, sharpness enhancement intensity, brightness, exposure, saturation, color temperature, clarity, etc.) as described above with reference to FIGS. 1 to 14. The processing module (200) may be a module for adjusting the contrast, color tone, or clarity of each video. Additionally, the processing module (200) may be a module for adjusting the brightness, exposure, saturation, color temperature, clarity, etc. of each video as described above with reference to FIGS. 1 to 14.

[0210] According to one embodiment of the present disclosure, an electronic device (1000) may be provided that minimizes the disparity of a combined video by automatically adjusting image quality-related parameters when combining a plurality of videos shot under different conditions into a single video.

[0211] A method for editing a video by an electronic device (1000) according to one embodiment of the present disclosure may include: receiving a user input selecting a plurality of videos to be edited into a single video; determining a reference video among the selected plurality of videos; analyzing the reference video to obtain quality-related parameters of the reference video; applying the quality-related parameters of the reference video to each of the plurality of videos to obtain a plurality of videos with adjusted quality; and combining the plurality of videos with adjusted quality to edit them into a single video.

[0212] A picture quality-related parameter according to one embodiment of the present disclosure may include at least one of a contrast score, color information, or sharpness enhancement strength. Additionally, a picture quality-related parameter according to one embodiment of the present disclosure may include at least one of a brightness score, a saturation score, color temperature information, or a clarity score.

[0213] A method according to one embodiment of the present disclosure may include the step of receiving user input that controls the combination order between a plurality of selected videos.

[0214] A step of determining a reference video according to one embodiment of the present disclosure may include determining the first video among a plurality of videos as the reference video.

[0215] A step of determining a reference video according to one embodiment of the present disclosure may include a step of determining a video selected by a user among a plurality of videos as a reference video.

[0216] A method according to one embodiment of the present disclosure may include: providing a list of a plurality of videos with adjusted image quality; providing image quality-related parameters of a first video based on receiving a user input selecting a first video among a plurality of videos with adjusted image quality; and further adjusting image quality-related parameters of a first video based on receiving a user input adjusting the image quality-related parameters of a first video.

[0217] A step of obtaining quality-related parameters of a reference video according to one embodiment of the present disclosure may include: a step of converting a plurality of videos including the reference video into a YUV format; and a step of analyzing the reference video converted into the YUV format. A step of obtaining a plurality of videos with adjusted quality according to one embodiment of the present disclosure may include: a step of obtaining a plurality of videos with adjusted quality by applying quality-related parameters of the reference video to a plurality of videos converted into the YUV format; and a step of converting the plurality of videos with adjusted quality into an RGB format. A step of obtaining quality-related parameters of a reference video according to one embodiment of the present disclosure may include a step of converting a plurality of videos including the reference video into one of the YCbCr format, LAB format, or HSV (Hue, Saturation, Value) format.

[0218] A step of obtaining quality-related parameters of a reference video according to one embodiment of the present disclosure may include: a step of selecting sample frames from among all frames included in the reference video; and a step of analyzing the selected sample frames to obtain quality-related parameters of the reference video.

[0219] The step of obtaining quality-related parameters of a reference video according to one embodiment of the present disclosure may include the step of determining a contrast score of the reference video using the intensity values ​​of the Y channel of sample frames included in the reference video. The step of obtaining a plurality of videos with adjusted quality according to one embodiment of the present disclosure may include the step of applying the contrast score of the reference video to the plurality of videos.

[0220] The step of applying a contrast score of a reference video to a plurality of videos according to one embodiment of the present disclosure may include: a step of determining a contrast score of a current video among a plurality of videos; and a step of reducing the contrast of a current video by compositing each frame included in the current video with a grayscale image when the contrast score of the current video is higher than the contrast score of the reference video.

[0221] The step of applying a contrast score of a reference video to a plurality of videos according to one embodiment of the present disclosure may include: determining a contrast score of a current video among a plurality of videos; when the contrast score of the current video is lower than the contrast score of the reference video, dividing each frame of the current video into a plurality of patches and obtaining a mapping function corresponding to each patch; and improving the contrast of the current video by determining the intensity value of a pixel using mapping functions corresponding to the surrounding patches of the pixel for each pixel included in each frame of the current video.

[0222] A step of obtaining a mapping function corresponding to each patch according to one embodiment of the present disclosure may include: obtaining a histogram corresponding to each patch; determining a clip value of each histogram using the average of the intensity values ​​of each patch, the variance of the intensity values ​​of each patch, and the intensity value of the center pixel; obtaining a modified histogram by distributing the bins of the histogram that are counted above the clip value to other bins; and generating a cumulative distribution function of the modified histogram as a mapping function.

[0223] A step of enhancing the contrast of a current video according to one embodiment of the present disclosure can determine the intensity value of a pixel by interpolating mapping functions by considering the spatial distance between the center of the pixel and surrounding patches.

[0224] A step of obtaining quality-related parameters of a reference video according to one embodiment of the present disclosure may include a step of obtaining color information of the reference video using the mean and standard deviation of each of the Y channel, U channel, and V channel of sample frames included in the reference video. A step of obtaining a plurality of videos with adjusted quality according to one embodiment of the present disclosure may include a step of transferring color information of the reference video to the plurality of videos. According to one embodiment of the present disclosure, the method of composing the colors of the sample frames is not limited to YUV and may include other color composition methods (e.g., YCbCr, LAB, HSV).

[0225] The step of transferring color information of a reference video to a plurality of videos according to one embodiment of the present disclosure may include: a step of obtaining the channel-specific average and channel-specific standard deviation of a current video among a plurality of videos; a step of normalizing the data of each channel of the current video using the channel-specific average and channel-specific standard deviation of the current video and the channel-specific average and channel-specific standard deviation of the reference video; and a step of transferring color information of the reference video to the current video by blending the data of each channel of the current video with the normalized data of each channel of the current video based on the difference between the channel-specific average of the current video and the channel-specific average of the reference video.

[0226] A step of obtaining a quality-related parameter of a reference video according to one embodiment of the present disclosure may include: a step of obtaining a sharpness corresponding to each of a plurality of videos; a step of determining a maximum sharpness among the sharpnesses corresponding to each of a plurality of videos; and a step of comparing the maximum sharpness with the sharpness corresponding to each of a plurality of videos to determine a sharpness enhancement strength corresponding to each of a plurality of videos.

[0227] The step of acquiring a plurality of videos with adjusted image quality according to one embodiment of the present disclosure may include the step of enhancing the clarity of each of the plurality of videos using a clarity enhancement intensity corresponding to each of the plurality of videos.

[0228] A step of obtaining sharpness corresponding to each of a plurality of videos according to one embodiment of the present disclosure includes: a step of generating a low-frequency image by applying a Gaussian blur to the Y channel of a sample frame included in an input video among the plurality of videos; a step of detecting an edge region in the Y channel of a sample frame included in an input video using the absolute difference between the Y channel of a sample frame included in an input video and the low-frequency image; a step of removing noise from the edge region; and averaging the edge scores of the edge region from which noise has been removed to obtain the sharpness of the input video.

[0229] The step of obtaining a plurality of videos having the same clarity as a reference video according to one embodiment of the present disclosure may include: applying a Gaussian blur to the Y channel of each frame included in the current video among the plurality of videos to detect an edge region of each frame included in the current video; removing noise from the edge region; and applying a clarity enhancement intensity corresponding to the current video to the edge region from which noise has been removed.

[0230] An electronic device (1000) according to one embodiment of the present disclosure may include a memory (1700) for storing a program or at least one instruction; and at least one processor (1300). The electronic device (1000) may receive user input for selecting a plurality of videos to be edited into a single video. The electronic device (1000) may determine a reference video among the selected plurality of videos. The electronic device (1000) may analyze the reference video to obtain quality-related parameters of the reference video. The electronic device (1000) may apply the quality-related parameters of the reference video to each of the plurality of videos to obtain a plurality of videos with adjusted quality. The electronic device (1000) may combine the plurality of videos with adjusted quality to edit them into a single video.

[0231] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0232] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0233] Although the present disclosure has been described with reference to exemplary embodiments, such description should not be interpreted in a limiting sense. By referring to this specification, various modifications and combinations of the exemplary embodiments, as well as other embodiments of the present disclosure, may be apparent to those skilled in the art. Accordingly, the appended claims are intended to include all such modifications or embodiments.

Claims

1. In a method for an electronic device (1000) to edit a video, A step (S210) of receiving a first user input representing a plurality of videos selected to be edited into a single output video; Step (S220) of determining a reference video among the selected plurality of videos; A step of analyzing the above reference video to obtain parameters related to the reference quality of the above reference video (S230); A step of obtaining a plurality of videos with adjusted image quality by applying the above-mentioned image quality-related parameters to each of the plurality of videos (S240); and A method comprising the step (S250) of combining a plurality of videos with adjusted image quality into a single output video.

2. In paragraph 1, the above reference image quality related parameter is, A method comprising at least one of a contrast score, color information, or sharpness enhancement strength.

3. In paragraph 1 or 2, the above method is, A step of providing a list of multiple videos with adjusted image quality to the user; A step of receiving a second user input selecting a first video among a plurality of videos with adjusted image quality; A step of providing a first image quality-related parameter of the first video to the user based on the reception of the second user input; A step of receiving a third user input that adjusts a first image quality-related parameter of the first video; and A method further comprising the step of additionally adjusting a first image quality-related parameter of the first video based on the reception of the third user input.

4. In any one of claims 1 to 3, the step of obtaining the reference image quality related parameters is A step of converting each of the above-mentioned multiple videos into YUV format; and The method includes the step of analyzing the reference video converted into the above YUV format, and The step of acquiring a plurality of videos with the above-mentioned image quality adjusted is, A step of applying the reference image quality related parameters to a plurality of videos converted into the above YUV format; and A method comprising the step of converting each of the plurality of videos with adjusted image quality into RGB format.

5. In any one of claims 1 to 4, the step of obtaining the reference image quality related parameters is, A step of selecting sample frames from a plurality of frames included in the above reference video; and A method comprising the step of analyzing the selected sample frames to obtain the reference image quality related parameters.

6. In any one of claims 1 to 5, the step of obtaining the reference image quality related parameters is The method includes the step of determining a reference contrast score of the reference video using the intensity values ​​of the Y channel of the sample frames included in the reference video. The step of acquiring a plurality of videos with the above-mentioned image quality adjusted is, A method comprising the step of applying the reference comparison score to the selected plurality of videos.

7. In paragraph 6, the step of applying the above reference comparison score is, A step of determining the current contrast score of the current video among the plurality of selected videos; A step of reducing the contrast of the current video by compositing each frame included in the current video with a grayscale image based on the fact that the current contrast score is higher than the reference contrast score; and A method comprising the step of improving the contrast of a current video by dividing each frame of the current video into a plurality of patches based on the fact that the current contrast score is lower than the reference contrast score, obtaining a mapping function corresponding to each of the plurality of patches, and determining the intensity value of a pixel for each pixel included in each frame of the current video using mapping functions corresponding to the surrounding patches of the pixel.

8. In paragraph 7, the step of obtaining the above mapping function A step of obtaining a histogram corresponding to each of the plurality of patches above; A step of determining the clip value of each histogram using the average of the intensity values ​​of each of the plurality of patches, the variance of the intensity values ​​of each of the plurality of patches, and the intensity value of the center pixel; A step of obtaining a modified histogram by distributing the bins of the histogram counted above the clip value to other bins; and The step of generating a cumulative distribution function accumulated from the modified histogram as the mapping function, and the step of enhancing the contrast of the current video, A method comprising the step of determining the intensity value of the corresponding pixel by interpolating the mapping functions based on the spatial distance between the center of the corresponding pixel and the center of the surrounding patches.

9. In any one of claims 1 to 8, the step of obtaining the reference image quality related parameters is, The method includes the step of obtaining color information of the reference video using the mean and standard deviation of each of the Y channel, U channel, and V channel of the sample frames included in the reference video. The step of acquiring a plurality of videos with the above-mentioned image quality adjusted is, A method comprising the step of transferring color information of the reference video to the selected plurality of videos.

10. In claim 9, the step of transferring the color information is, A step of obtaining the average and standard deviation by current channel of the current video among the plurality of selected videos above; A step of normalizing the data of each channel of the current video using the average and standard deviation of the current channel and the average and standard deviation of the reference channel of the reference video; and A method comprising the step of transferring color information of the reference video to the current video by blending the data of each channel of the current video with the normalized data of each channel of the current video based on the difference between the average of each current channel and the average of each reference channel.

11. In any one of claims 1 to 10, the step of obtaining the reference image quality related parameters is A step of acquiring a plurality of clarity levels corresponding to each of the selected plurality of videos; A step of determining the maximum clarity among the above plurality of claritys; and The method includes a step of determining a sharpness enhancement strength corresponding to each of the selected plurality of videos by comparing the maximum sharpness with the sharpness corresponding to each of the selected plurality of videos. The step of acquiring a plurality of videos with the above-mentioned image quality adjusted is, A method comprising the step of enhancing the clarity of each of the selected plurality of videos using a clarity enhancement intensity corresponding to each of the selected plurality of videos.

12. In claim 11, the step of acquiring a plurality of clarity levels is, A step of generating a low-frequency image by applying a Gaussian blur to the Y channel of a sample frame included in the input video among the plurality of selected videos above; A step of detecting an edge region in the Y channel of the sample frame using the Y channel of the sample frame and the absolute deviation of the low-frequency image; A step of removing noise from the above edge regions; and A method comprising the step of obtaining the sharpness of the input video by averaging the edge scores of the noise-removed edge regions.

13. In paragraph 11, the step of acquiring a plurality of videos with adjusted image quality is, A step of detecting edge regions of each frame included in the current video by applying a Gaussian blur to the Y channel of each frame included in the current video among the plurality of selected videos; A step of removing noise from the above edge regions; and A method comprising the step of applying a current sharpness enhancement intensity corresponding to the current video to the edge region from which the noise has been removed.

14. Memory (1700) for storing at least one instruction; and It includes at least one processor (1300) including a processing circuit, and By the above at least one processor (1300) executing the program or the above at least one instruction stored in the memory (1700), the electronic device (1000) Receiving a first user input representing a plurality of videos selected to be edited into a single output video, and Determine a reference video among the multiple videos selected above, and By analyzing the above reference video, parameters related to the image quality of the above reference video are obtained, and The above image quality-related parameters are applied to each of the above-mentioned multiple videos to obtain multiple videos with adjusted image quality, and An electronic device that combines multiple videos with adjusted image quality into a single video.

15. A computer-readable recording medium having a program recorded thereon for performing the method of any one of paragraphs 1 through 13 on a computer.

Images