Electronic device and image processing method

Abstract

Provided is an electronic device comprising: a communication interface; a display configured to play back an image signal; a memory which stores at least one instruction; and at least one processor which is electrically connected to the communication interface, the display, and the memory, and executes the at least one instruction. The at least one processor: receives an image input through the communication interface; decodes the image input; on the basis of the image input, acquires a set of luma values and a set of chroma values corresponding to pixel positions of a series of pixels; on the basis of one set of the set of luma values and the set of chroma values, determines p candidate sets by shifting pixel positions corresponding to respective values belonging to the one set by each of a plurality of predetermined p values; determines respective correlations based on the respective candidate sets and the other set of the set of luma values and the set of chroma values; on the basis of the correlations, selects one P value from among the plurality of P values; and on the basis of the selected P value, generates the image signal to be played back by the display.

Description

Electronic device and image processing method

[0001] The present disclosure relates to an image processing method for a display device, and more specifically, to an image processing method for correcting a phase error of a color signal with respect to a brightness signal and a display device supporting the same.

[0002] Video signals often undergo various processes across multiple systems, such as editing, encoding / decoding, transcoding, storage, and transmission, before finally being acquired and played back on a user display device. Each system processing video signals performs necessary tasks according to its own defined standards and protocols. Consequently, the video signal delivered to the user display device may be distorted from the original signal due to the various standards and protocols used in each process it passes through to reach the user display device.

[0003] In the context of video encoding technology, chroma subsampling is widely used. Chroma subsampling refers to a technique used when encoding video signals that separates the luminance (luma) and color (chroma) signals contained within the signal, and then encodes the signal by reducing the resolution of the color signal relative to the luminance signal. The human eye has approximately 90 million rod cells that sense changes in brightness, while there are only about 6 million cone cells that perceive color; consequently, human vision is characterized by being less sensitive to changes in color compared to changes in brightness. Due to these perceptual characteristics, there may not be a significant difference in human perception even if the resolution of color information is reduced relative to luminance information. Therefore, many video systems widely utilize chroma subsampling technology to minimize the loss of video information while reducing the data size required for information storage and / or transmission.

[0004] Embodiments of the present disclosure provide a display device capable of reproducing an image of improved quality by correcting a phase error that a color signal has with respect to a brightness signal among image signals, and an image processing method in such a display device.

[0005] According to one embodiment of the present disclosure, an electronic device comprises: a communication interface including a communication circuit; a display configured to play an image signal; a memory storing at least one instruction; and at least one processor including the communication interface and a processing circuit and electrically connected to the display and the memory, wherein the at least one processor executes at least one instruction individually and / or collectively, and the electronic device receives an image input through the communication interface, decodes the image input, obtains a set of brightness values ​​and a set of color values ​​corresponding to pixel locations of a series of pixels based on the image input, determines a candidate set obtained by horizontally shifting the locations of pixels corresponding to the one set by a specified value based on one of the set of brightness values ​​or the set of color values, determines the correlation of the candidate set with the other of the set of brightness values ​​or the set of color values, and generates the image signal to be played by the display based on the correlation.

[0006] According to one embodiment of the present disclosure, an image signal processing method is provided, comprising: acquiring an image input; decoding the image input; acquiring a set of brightness component values ​​and a set of color component values ​​corresponding to pixel positions of a series of pixels based on the decoding; acquiring a first set of change amounts corresponding to a value corresponding to a previous pixel position of a value corresponding to each pixel position with respect to one set among the set of brightness component values ​​and the set of color component values; acquiring a second set of change amounts corresponding to a value corresponding to a previous pixel position of a value corresponding to each pixel position with respect to another set among the set of brightness component values ​​and the set of color component values; determining a candidate set obtained by horizontally shifting the positions of pixels corresponding to one set by a predetermined value from one set selected among the first set of change amounts and the second set of change amounts; determining a correlation between the other set among the first set of change amounts and the second set of change amounts and the candidate set; and generating an image signal for playback based on the correlation.

[0007] According to various embodiments of the present disclosure, even when a phase error occurs between a color signal and a brightness signal of a resulting image signal processed by various standards and protocols, a display device can correct the phase error in such image signal to reproduce an image with clearer quality.

[0008] The effects obtainable by the exemplary embodiments of the present disclosure are not limited to those mentioned above, and other unmentioned effects can be clearly derived and understood by those skilled in the art to which the exemplary embodiments of the present disclosure belong from the description below. That is, unintended effects resulting from the implementation of the exemplary embodiments of the present disclosure can also be derived by those skilled in the art from the exemplary embodiments of the present disclosure.

[0009] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, the above and other aspects, features, and advantages of any embodiment of the present disclosure will become more apparent from the following detailed description, which is taken into account in conjunction with the accompanying drawings.

[0010] FIG. 1 is a diagram illustrating an exemplary network environment in which an image signal can be transmitted to a display device according to various embodiments.

[0011] FIGS. 2a and 2b are drawings illustrating various chroma subsampling methods that can be applied when compressing image signals according to various embodiments.

[0012] FIGS. 3A, FIGS. 3B, FIGS. 3C, and FIGS. 3D are drawings illustrating various sampling methods that can be used when compressing an image signal by applying chroma subsampling technology according to various embodiments.

[0013] FIG. 4 is a diagram showing an exemplary image reproduced in a conventional display device, in which a phase error of the color component with respect to the brightness component occurs.

[0014] FIGS. 5a and FIGS. 5b are exemplary graphs showing the brightness component value (Y) and color component value (Cr) for each pixel located along line AA of FIG. 4.

[0015] FIGS. 6a and FIGS. 6b are exemplary graphs showing the change in brightness component value (Y) and the change in color component value (Cr) relative to the previous pixel for each pixel along line AA of FIG. 4.

[0016] FIG. 7 is a block diagram illustrating an exemplary configuration of a display device according to various embodiments.

[0017] FIG. 8 is a block diagram illustrating exemplary functions of an image signal processing device according to various embodiments.

[0018] FIG. 9 is a flowchart showing exemplary color signal phase error correction processing performed by an image processing device according to various embodiments.

[0019] FIG. 10 is a diagram illustrating an exemplary processing process in which a phase error of a color signal is corrected according to various embodiments.

[0020] FIGS. 11a and FIGS. 11b are drawings showing exemplary images played on a display device before and after correction of color signal phase error according to various embodiments.

[0021] FIG. 12 is a block diagram of an exemplary electronic device in a network environment according to various embodiments.

[0022] Various exemplary embodiments of the present disclosure will be described in more detail below with reference to the drawings. However, the present disclosure may be implemented in various different forms and is not limited to the exemplary embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Additionally, in the drawings and related description, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0023] FIG. 1 is a diagram illustrating an exemplary network environment in which an image signal can be transmitted to a display device according to various embodiments.

[0024] According to one embodiment, the network environment (100) may include a camera (110), a network (120), a plurality of image processing systems (130a-130n), and a display device (140). The camera (110), the plurality of image processing systems (130a-130n), and the display device (140) may transmit and receive information to and from each other through the network (120).

[0025] According to one embodiment, a camera (110) can capture a subject to generate a captured image. The captured image may include video and still images. The camera (110) may include a lens and an image sensor. The lens may collect light from the subject to form an optical image in the shooting area. The lens may include a general-purpose lens, a wide-angle lens, and a zoom lens, but is not limited thereto. The image sensor may generate a digital image signal from an optical signal. The image sensor may include a Complementary Metal Oxide Semiconductor (CMOS) and a Charge Coupled Device (CCD), but is not limited thereto.

[0026] The network (120) may support any communication protocol such as TCP / IP, UDP, HTTP, HTTPS, FTP, SFTP, or MQTT. According to one embodiment, the network (120) may support any wireless communication protocol such as GSM, CDMA, WCDMA, WiMAX, LTE, LTE-A, 5G, or 6G. The network (120) may include both a wired communication network and a wireless communication network. The wired communication network may include a cable network or a telephone network. The wireless communication network may include any network that transmits and receives signals via radio waves. The wired communication network and the wireless communication network may be connected to each other. The network (120) may include a wide area network (WAN), such as the Internet, a local area network (LAN) formed around an access point (AP), and / or a short-range wireless network that does not pass through an access point (AP). Short-range wireless networks may include, but are not limited to, Bluetooth (IEEE 802.15.1), WLAN (Wireless LAN), Zigbee (IEEE 802.15.4), Wi-Fi Direct, NFC (Near Field Communication), Z-Wave, etc.

[0027] According to one embodiment, a video signal acquired by a camera (110) may be edited, encoded / decoded, transcoded, stored, and / or transmitted in various ways by one or more video processing systems (130a-130n). Each of the multiple video processing systems (130a-130n) may process the video signal as needed and each may encode / decode and / or transcode the video signal according to a defined standard and protocol. In one embodiment, each of the multiple video processing systems (130a-130n) may be of a different or the same type of system, and the present disclosure is not limited to a specific form. In one embodiment, the video processing systems (130a-130n) may include various content editing / providing servers such as a broadcaster server, an IPTV server, an OTT server, a video storage device, a game server, and the present disclosure is not limited to a specific form.

[0028] A display device (140) may acquire an image signal from any one of a camera (110) and / or a plurality of image processing systems (130a-130n) via a network (120). In one embodiment, the image signal acquired by the display device (140) may be a signal compressed and encoded according to various methods. In one embodiment, the image signal acquired by the display device (140) may include a brightness signal representing the brightness of each pixel of the image and a color signal representing the color of each pixel. According to one embodiment, the color signal may include a Cr signal and a Cb signal. In one embodiment, among the image signals acquired by the display device (140), the brightness signal and the color signal may each be signals compressed and encoded at different resolutions. According to one embodiment, among the image signals acquired by the display device (140), the color signal may be a signal sampled and compressed at a lower resolution than the brightness signal according to a chroma subsampling method.

[0029] In one embodiment, the display device (140) can decode a compressed image signal. In one embodiment, the display device (140) can decode a compressed brightness signal to obtain a series of brightness component values. In one embodiment, the display device (140) can decode a compressed color signal to obtain a series of color component values.

[0030] In one embodiment, the display device (140) can correct the phase error that the acquired color component values ​​may have with respect to the brightness component values. As described above, the color signal among the image signals acquired by the display device (140) may be a signal that has been sampled and compressed according to a chroma subsampling method at several stages prior to being acquired by the display device (140), and accordingly, there may be a phase error of the color component values ​​with respect to the brightness component values ​​acquired by the display device (140). According to one embodiment, the display device (140) can correct the phase error existing in these color component values ​​to reproduce an image of improved quality. Hereinafter, with reference to FIGS. 2 to 6, the phase error that the color component values ​​have with respect to the brightness component values ​​will be explained in more detail.

[0031] FIGS. 2a and 2b are drawings illustrating various exemplary chroma subsampling methods that can be applied when compressing image signals according to various embodiments.

[0032] Chroma subsampling methods can be expressed in the form (a:b:c) based on the ratio of the lightness component (Y) and the hue components (Cb, Cr). Here, a can represent the horizontal sampling reference unit. b represents the number of hue component (Cb, Cr) samples in the first row of sample a, and c represents the number of changes in hue component (Cb, Cr) samples between the first and second rows of sample a.

[0033] FIG. 2a conceptually illustrates a (4:2:2) sampling method, which may be an example of a chroma subsampling technique according to one embodiment of the present disclosure. As illustrated, in the (4:2:2) method, four brightness components and two color components can be sampled for the first row of four pixels in a 4x2 pixel area, and four brightness components and two color components can be sampled for the second row of four pixels. According to the (4:2:2) method, the horizontal resolution of the color components is reduced by half, and the bandwidth for the video signal can be reduced by one-third compared to the case where chroma subsampling technique is not used. Various video standards and formats adopt the (4:2:2) method. For example, the (4:2:2) sampling method is adopted in Digital Betacam, DVCPRO50, DVCPRO HD, Digital-S, etc.

[0034] FIG. 2b conceptually illustrates a (4:2:0) sampling method, which may be an example of a chroma subsampling technique according to one embodiment of the present disclosure. As illustrated, in the (4:2:0) method, four brightness components and two color components may be sampled for the first row of four pixels in a 4x2 pixel area, and four brightness components and zero color components may be sampled for the second row of four pixels. According to the (4:2:0) method, the horizontal and vertical resolution of the color components are each reduced by half, and the bandwidth for the video signal may be reduced by half compared to the case where chroma subsampling technique is not used. Various video standards and formats adopt the (4:2:0) method. For example, the (4:2:0) sampling method is adopted in All ISO / IEC MPEG and ITU-T VCEG H.26x video coding standards, DVD-Video and Blu-ray Disc.[5][6], 576i "PAL" DV and DVCAM, HDV, AVCHD and AVC-Intra 50, Apple Intermediate Codec, JPEG / JFIF and MJPEG implementations, VC-1, WebP, etc.

[0035] The drawings and description are intended to aid in understanding the present disclosure and are not intended to limit the present disclosure. According to various embodiments of the present disclosure, various chroma subsampling methods other than the aforementioned (4:2:2) or (4:2:0) methods may be used, and the present disclosure is not limited to specific examples.

[0036] FIGS. 3a, FIGS. 3b, FIGS. 3c, and FIGS. 3d are drawings illustrating various exemplary sampling methods that can be used when compressing an image signal by applying chroma subsampling technology according to various embodiments.

[0037] Sampling methods of chroma subsampling technology can be distinguished not only by the sampling ratio of color components as described in relation to FIGS. 2a and 2b, but also by the sampling locations of color components. FIGS. 3a, 3b, 3c, and 3d illustrate various cases in which the sampling locations of each color component differ when sampling one color component, specifically one Cr component and one Cb component, in a 2x2 pixel area (corresponding to four brightness components) according to, for example, the (4:2:0) method. For example, FIG. 3a illustrates a Left method in which both the Cr component and the Cb component are sampled at the vertical center of the left two pixels among the four pixels of the 2x2. For example, FIG. 3b illustrates a Center method in which both the Cr component and the Cb component are sampled at the horizontal and vertical center of the four pixels of the 2x2. For example, FIG. 3c illustrates a left-top method in which both the Cr component and the Cb component are sampled from the top-left pixel among four 2x2 pixels. For example, FIG. 3d illustrates another left-top method in which the Cb component is sampled from the top-left pixel and the Cr component is sampled from the bottom-left pixel among four 2x2 pixels. As illustrated, in the case of a color signal to which chroma subsampling is applied, color components at different locations may be sampled, and such differences in sampling locations may cause a phase error with respect to the brightness component of the color component during the decoding stage.

[0038] The drawings and description are intended merely to aid in understanding the present disclosure and are not intended to limit the present disclosure. According to various embodiments of the present disclosure, the sampling positions of color signals may be determined in various ways other than those illustrated, and the present disclosure is not limited to specific examples.

[0039] FIG. 4 is a diagram showing an exemplary image reproduced in a conventional display device, in which a phase error of the color component with respect to the brightness component occurs.

[0040] In FIG. 4, an image (410) including a chimney-shaped object is shown. Referring to FIG. 4, it can be seen that the color of the chimney-shaped object is slightly off from the boundary line of the object. In particular, looking at the right boundary line (420) of the chimney-shaped object, it can be observed that the reddish color of the object (the diagonal hatched part on the left) protrudes slightly toward the right background.

[0041] FIGS. 5a and 5b are graphs showing exemplary brightness component values ​​(Y) and color component values ​​(Cr) for each pixel located along the A-A' line of FIGS. 4. FIGS. 6a and 6b are exemplary graphs showing exemplary changes in brightness component values ​​(Y) and color component values ​​(Cr) relative to the previous pixel for each pixel along the A-A' line of FIGS. 4.

[0042] In the graph illustrated in FIG. 5a, the X-axis represents the location of each pixel, and the Y-axis represents the value of an exemplary brightness component at each corresponding pixel. In the graph illustrated in FIG. 5b, the X-axis represents the location of each pixel, and the Y-axis represents the value of an exemplary color component, specifically a Cr component, at each corresponding pixel. As illustrated, it can be seen that the location (502) with the largest change in brightness component and the location (504) with the largest change in Cr component do not coincide.

[0043] In the graph illustrated in FIG. 6a, the X-axis represents the position of each pixel, and the Y-axis represents the change in the brightness component value from the previous pixel of each corresponding pixel. In the graph illustrated in FIG. 5b, the X-axis represents the position of each pixel, and the Y-axis represents the change in the color component value, specifically the Cr component value, from the previous pixel of each corresponding pixel. As illustrated, it can be seen that the position (604) with the largest change in the Cr component value is shifted slightly to the right compared to the position (602) with the largest change in the brightness component value. Such a phase shift of the color component can be confirmed from the image illustrated in FIG. 4.

[0044] FIG. 7 is a block diagram illustrating an exemplary configuration of a display device according to various embodiments. According to one embodiment, the display device (700) may be the display device (140) of FIG. 1.

[0045] According to one embodiment, the display device (700) may include a communication interface (710) (e.g., including a communication circuit), a controller (720) (e.g., including a circuit), a memory (730), and a display (740). The display device (700) may include additional components in addition to the illustrated components, or at least one of the illustrated components may be omitted.

[0046] According to one embodiment, the communication interface (710) may include various communication circuits and may receive video signals transmitted from the outside. The communication interface (710) may be implemented with at least one wired communication circuit or a wireless communication circuit, and each communication circuit may support a predetermined bandwidth. It will be understood by those skilled in the art that the communication interface (710) may transmit and receive data with the outside using various protocols.

[0047] According to one embodiment, the controller (720) may include various circuits, such as processing circuits, and may perform overall control operations of the display device (700). The controller (720) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, it is not limited thereto, and may include or be defined by one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics processing unit (GPU), a communication processor (CP), or an ARM processor. Additionally, the controller (720) may be implemented as a system on chip (SoC) or large scale integration (LSI) with a built-in processing algorithm, or may be implemented in the form of a field programmable gate array (FPGA). Furthermore, the controller (720) can perform various functions by executing computer executable instructions stored in memory (730). The controller (720) includes memory (730), a communication interface (710), and It can be electrically connected to the display (740). Therefore, the controller (720) may include various processing circuits and / or multiple processors.For example, the term “processor” as used herein, including in the claims, may include various processing circuits comprising at least one processor, and at least one of the at least one processor may be configured to perform various functions described herein individually and / or collectively in a distributed manner. When “processor,” “at least one processor,” and “one or more processors” as used herein are described as being configured to perform a plurality of functions, these terms include, but are not limited to, situations where, for example, one processor performs part of the mentioned functions and other processor(s) perform other parts of the mentioned functions, and situations where a single processor can perform all the mentioned functions. Additionally, at least one processor may include a combination of processors performing the various functions mentioned / disclosed, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0048] According to one embodiment, the controller (720) can acquire a video signal received from the outside through a communication interface (710). According to one embodiment, the video signal received by the controller (720) may include a brightness signal and a color signal (e.g., a Cr signal and a Cb signal). The controller (720) can decode each of the received brightness signal and color signal and correct the phase error of the color signal with respect to the brightness signal as described below to generate a playback video signal. According to one embodiment, the controller (720) can store the generated playback video signal in a memory (730) or make it playable through a display (740).

[0049] According to one embodiment, the memory (730) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the controller (720), or as a memory separate from the controller (720). In this case, the memory (730) may be implemented in the form of a memory embedded in the display device (700) or in the form of a memory that can be attached to the display device (700) depending on the purpose of data storage. For example, data for driving the display device (700) may be stored in the memory embedded in the display device (700), and data for the expansion function of the display device (700) may be stored in the memory that can be attached to the display device (700).

[0050] In the case of memory embedded in the display device (700), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD). In the case of memory that is detachable from the display device (700), it may be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory that can be connected to a USB port (e.g., USB memory).

[0051] According to one embodiment, the display (740) can display an image corresponding to a playback video signal generated by the controller (720). The display (740) may include at least one display panel of various types, such as a liquid crystal display panel (LCD), a light-emitting diode panel (LED), an organic light-emitting diode panel (OLED), and a plasma display panel (PDP), and may include at least one panel driving unit for driving the display panel.

[0052] FIG. 8 is a block diagram illustrating various exemplary functions of an image signal processing device according to various embodiments. According to one embodiment, the image signal processing device (800) may be implemented as at least part of the controller (720) of the display device (700) of FIG. 7.

[0053] According to one embodiment, an image processing device (800) may receive an encoded brightness signal and an encoded color signal. The received color signal may be a signal that has been sampled and compressed according to a chroma subsampling method. According to one embodiment, the image processing device (800) may include a brightness signal decoder (810) and a color signal decoder (820), each of which may include various circuits and / or executable program instructions. According to one embodiment, the brightness signal decoder (810) may receive an encoded brightness signal and decode the received brightness signal according to a predetermined algorithm to obtain a series of brightness component values. According to one embodiment, the color signal decoder (820) may receive an encoded color signal and decode the received color signal according to a predetermined algorithm to obtain a series of color component values. In this drawing, one color signal decoder (820) for a color signal is illustrated, but the present disclosure is not limited thereto. According to one embodiment of the present disclosure, a color signal decoder for each of the color signal Cr and the color signal Cb may be included in the image processing device (800).

[0054] According to one embodiment, the image processing device (800) may include a color signal phase error correction unit (830) which may include various circuits and / or executable program instructions. As described above, due to a series of processing steps such as editing, storage, and transmission that the image signal undergoes after generation, a phase error may exist between the color component values ​​and the brightness component values ​​obtained after decoding. According to one embodiment, the color signal phase error correction unit (830) may correct the phase error of the brightness signal present in the color signal based on the relationship between the change in the brightness component and the change in the color signal.

[0055] According to one embodiment, the image processing device (800) may include a playback image generating unit (840) that may include various circuits and / or executable program instructions. The playback image generating unit (840) may obtain brightness component values ​​decoded from a brightness signal decoder (810). The playback image generating unit (840) may obtain color component values ​​with phase error correction from a color signal phase error correction unit (830). The playback image generating unit (840) may generate a playback image signal to be displayed through a display using the brightness component values ​​and the color component values ​​with phase error correction.

[0056] FIG. 9 is a flowchart illustrating exemplary color signal phase error correction processing performed by an image processing device according to various embodiments. According to one embodiment, the color signal phase error correction processing illustrated in FIG. 9 may be implemented at least partially by a controller (720) of the display device (700) of FIG. 7 and / or an image processing device (800) of FIG. 8. The illustrations in this figure are for illustrative purposes only and the present disclosure is not limited to specific examples.

[0057] According to one embodiment, in step (902), brightness component values ​​and color component values ​​for a series of pixels may be obtained. In one embodiment, the obtained brightness component values ​​and color component values ​​may have the same resolution as they have already undergone decoding processing in a previous step. In one embodiment, a series of pixels is position index x(0= <x<n, x 및 n은 자연수)를 가질 수 있다. 일 실시예에서, 디코딩으로 얻어진 일련의 픽셀들에 관한 명도 성분 값들은 Y in Indicated by [x], and the color component values ​​are C inIt may be indicated by [x]. In one embodiment, the series of pixels may be pixels arranged horizontally. In one embodiment, the series of pixels may be pixels arranged vertically.

[0058] According to one embodiment, in step (904), the brightness component values ​​Y in [x] can be flattened to generate a flattened set of brightness components Y[x]. The flattening process is performed on the brightness component values ​​Y in By applying a low-pass filter to [x], the process may remove high-frequency portions present in the brightness component values ​​and reduce variability. In one embodiment, the brightness component values ​​Y in Flattening treatment for [x] can be performed according to the following mathematical formula 1.

[0059]

[0060] Here, f(t) is a filter for flattening processing, which may be, for example, an average filter or a Gaussian filter, and the present disclosure is not limited to specific cases. For example, if an average filter of size 5 is used for flattening processing, f(t) may be 1 / 5 (-2 ≤ t ≤ 2). In this drawing and related description, the brightness component values ​​Y received in step (902) in [x] Although the description focuses on the case where Y[x] obtained therefrom after flattening processing in this step (904) is used for color signal phase error correction processing, the present disclosure is not limited thereto. In one embodiment, the brightness component values ​​Y in Flattening treatment for [x] may be optionally performed for stable operation. In one embodiment, the flattening treatment of step (904) may be omitted, and the brightness component values ​​Y in [x] can be used for subsequent color signal phase error correction processing.

[0061] According to one embodiment, in step (906), a set of brightness component change amounts may be generated. According to one embodiment, from the flattened brightness component set Y[x] generated in step (904), the absolute value of the change amount for the previous pixel position for each pixel position is obtained, and a set of brightness component change amounts ΔY[x] may be generated therefrom. In one embodiment, the acquisition of the set of brightness component change amounts ΔY[x] can be expressed by the following Equation 2.

[0062]

[0063] According to one embodiment, in step (908), a plurality of color component candidate sets may be generated. According to one embodiment, a plurality of phase correction amount candidate values ​​P may be predetermined (e.g., designated). In one embodiment, the P value may represent a correction amount (e.g., number of pixels to be corrected) for correcting the phase error of the color component, and may include a plurality of integers or real numbers. In one embodiment, the phase correction amount candidate values ​​P may be, for example, {-1, 0, +1}, but the present disclosure is not limited thereto. In one example, P being -1 may indicate that the phase of the color signal for each pixel is shifted one pixel to the right and therefore must be corrected to shift one pixel to the left (e.g., shift the corresponding pixel position of each color signal by -1). In one example, if a P value of -1 is determined as the final phase correction amount, the color component value at each pixel location can be corrected to the color component value at the location one pixel to the right. In one example, P being +1 may indicate that, for instance, since the phase of the color signal for each pixel is shifted one pixel to the left, it must be corrected to shift one pixel to the right (e.g., shifting the corresponding pixel location of each color signal by +1). In one example, if a P value of +1 is determined as the final phase correction amount, the color component value at each pixel location can be corrected to the color component value at the location one pixel to the left. According to one embodiment, in step (908), a set of color component candidates C for each of a predetermined plurality of phase correction amount candidate values ​​P is p [x] can be obtained. In one embodiment, a set of color component candidate C p [x] can be generated by mathematical formula 3.

[0064]

[0065] In this example, the case where the phase correction amount candidate value P is three integer values ​​has been described, but the present disclosure is not limited thereto. According to one embodiment, the phase correction amount candidate value P may be more or fewer integers or real numbers. According to one embodiment, if the phase correction amount candidate value P is a real number, the corresponding C p [x] can be obtained through interpolation from the color component values ​​of pixels at integer positions adjacent to position P.

[0066] According to one embodiment, in step (910), a color component candidate set C p [x] For each, a set of color component change amounts can be generated. According to one embodiment, a set of color component candidate C generated in step (908). p From [x], obtain the absolute value of the change amount relative to the previous pixel position for each pixel position, and from there, obtain the set of color component change amounts ΔC p [x] can be generated. In one embodiment, a set of color component change amounts ΔC p The acquisition of [x] can be expressed by the following mathematical formula 4.

[0067]

[0068] According to one embodiment, in step (912), the set of brightness component change amounts ΔY[x] obtained in step (906) and the set of color component change amounts ΔC obtained in step (910) p [x] Correlation between each can be obtained. According to one embodiment, the correlation may be any indicator measuring the similarity relationship between two signals. According to one embodiment, a set of brightness component change amounts ΔY[x] and a set of color component change amounts ΔC p Correlation between [x] Cor[ΔY, ΔC p ] can be obtained, for example, by the following mathematical formula 5.

[0069]

[0070] According to one embodiment, a set of changes in brightness components ΔY[x] and a set of changes in color components ΔC p Correlation between [x] Cor[ΔY, ΔC p ] indicates that the larger the value, the more similar the directionality of the lightness component signal and the color component signal is to the directionality of increasing or decreasing together, that is, the directionality of change.

[0071] According to one embodiment, in step (914), a final set of color component candidates and a phase correction amount may be determined. In one embodiment, a set of color component change amounts ΔC p Among [x], the correlation Cor[ΔY, ΔC for the set of brightness component changes ΔY[x] p The set having the largest value as ] can be determined as the final color component candidate set, and the corresponding P value can be determined as the final phase correction amount. In one embodiment, as described above, Cor[ΔY, ΔC p If ] has the largest value, the corresponding set of color component change amounts ΔC p [x] can be determined to have the most similar directionality of change to the set of brightness component changes ΔY[x], and based on this, the corresponding set of color component changes ΔC p [x] can be determined as the final set of color component candidates. In this case, the given P value can be the final phase correction amount and can be determined by the following mathematical formula 6.

[0072]

[0073] According to one embodiment, in step (916), a set of color component values ​​with phase error correction can be obtained using the final color component candidate set and / or the final phase correction amount P obtained in step (914). In one embodiment, the set of color component values ​​with phase error correction may be obtained by shifting each of the color component values ​​prior to correction obtained by decoding by the final phase correction amount P. In one embodiment, the set of color component values ​​with phase error correction C out [x] can be obtained by mathematical formula 7.

[0074]

[0075] In FIG. 9 and the related description, it is explained that the correlation of each color component change amount for each of a plurality of color component candidate sets obtained by shifting the phase of color component values ​​with respect to the change amounts of color component values ​​for a series of pixels is used for color phase error correction, but the present disclosure is not limited thereto. According to one embodiment, the correlation of each color component change amount for each of a plurality of color component candidate sets obtained by shifting the phase of color component values ​​with respect to the change amounts of color component values ​​for a series of pixels can be used for color phase error correction.

[0076] FIG. 9 and the related description describe cases where color signal phase error correction processing is performed in a predetermined order, but the present disclosure is not limited thereto. According to one embodiment, each step of the operation flow of FIG. 9 may be performed in a different order than that illustrated. For example, as illustrated in FIG. 9, a plurality of color component candidate sets are generated by first shifting the phase of color component values ​​and then a set of color component change amounts for each color component candidate set is generated, but the present disclosure is not limited thereto. In one embodiment, change amounts of color component values ​​for a series of pixels are first obtained, and then a plurality of color component candidate sets may be generated by shifting the phase of the obtained change amounts of color component values. According to various embodiments of the present disclosure, each step of the method for correcting color signal phase error may be performed in a different order than that illustrated in FIG. 9.

[0077] FIG. 10 is a diagram illustrating an exemplary processing process in which a phase error of a color signal is corrected according to various embodiments. According to one embodiment, the correction of the phase error of the color signal exemplified in FIG. 10 may be implemented at least partially by a controller (720) of the display device (700) of FIG. 7 and / or an image processing device (800) of FIG. 8. The illustrations in this figure are for illustrative purposes only and the present disclosure is not limited to specific examples.

[0078] According to one embodiment, a set of brightness component values ​​Y[x] (1002) and a set of color component values ​​C for 12 pixels having indices x from 0 to 11. in [x](1004) may be given. Although not specified in the drawings, a given set of brightness component values ​​Y[x](1002) may be values ​​after flattening treatment, and the present disclosure is not limited thereto. According to one embodiment, a given set of color component values ​​Cin [x](1004) may be a set of Cr values ​​obtained for each pixel. According to one embodiment, a given set of color component values ​​C in [x](1004) may be a set of Cb values ​​obtained for each pixel, and the present disclosure is not limited to specific examples.

[0079] According to one embodiment, when the phase correction amount candidate value P is set to {-1, 0, +1}, a set of color component candidate values ​​for each P value, e.g., C -1 [x](1006), C0[x](1008), and C +1 [x](1010) can be obtained. In one embodiment, as described above, C p [x] = C in It can be obtained as [xp].

[0080] According to one embodiment, a set of brightness component change amounts ΔY[x] (1012) may be generated. According to one embodiment, the set of brightness component change amounts ΔY[x] (1012) may be a set of values ​​indicating how much a given brightness component value Y[x] of a pixel at position x has changed from a brightness component value Y[x-1] at a previous pixel position, for example, at pixel position x-1.

[0081] According to one embodiment, a set of color component candidates C for each P, p A set of color component change amounts for [x] can be generated. According to one embodiment, a set of color component change amounts ΔC p [x] is a given set of color component candidate C p In [x], the given color component value C of the pixel at position x. p [x] is the color component value C of the previous pixel position, for example, the x-1 pixel position. p It may be a set of values ​​indicating how much it has changed from [x-1]. As illustrated, according to one embodiment, a set of color component candidates C when the phase correction amount candidate value P is -1.-1 Set of color component change amounts ΔC for [x] -1 [x](1014) is shown. As illustrated, according to one embodiment, a set of color component changes ΔC0[x](1016) for a set of color component candidates C0[x] when the phase correction amount candidate value P is 0 is shown. As illustrated, according to one embodiment, a set of color component candidates C when the phase correction amount candidate value P is +1 is shown. +1 Set of color component change amounts ΔC for [x] +1 [x](1018) is shown.

[0082] According to one embodiment, there is a set of changes in brightness components ΔY[x] (1012) and a set of color component candidates C for each P. p A set of color component changes for [x], e.g., ΔC -1 [x](1014), ΔC0[x](1016), and ΔC +1 The correlation between each of [x](1018) can be calculated. According to one embodiment, the correlation is, for example, Cor[ΔY, ΔC p ] = Σ x {ΔY[x]ΔC p It can be calculated according to [x]}. In FIG. 10, at reference numeral (1020), ΔC according to one embodiment -1 The correlation with respect to [x](1014), i.e., Cor[ΔY[x], ΔC -1 [x]] is shown as 166.63. In FIG. 10, at reference numeral (1022), a correlation diagram for ΔC0[x] (1016) according to one embodiment, e.g. Cor[ΔY[x], ΔC0[x]] is shown as 151.54. In FIG. 10, at reference numeral (1024), ΔC according to one embodiment +1 Correlation for [x](10¹⁸), e.g. Cor[ΔY[x], ΔC +1 [x]] is shown as 110.09.

[0083] According to one embodiment, the final phase correction amount may be determined based on the generated correlations. According to one embodiment, the P value exhibiting the largest correlation may be determined as the final phase correction amount. According to one embodiment, for example, P opt =argmaxp∈{-1,0,1}{Cor[ΔY, ΔC p P according to ]} opt g can be determined as the final phase correction amount.{Cor[ΔY, ΔC p P according to ]} opt The final phase correction amount can be determined. In the example illustrated in this drawing, -1, which shows the largest correlation of 166.63, can be determined as the final phase correction amount, and the final phase correction amount determined in this way is shown in reference number (1026).

[0084] FIGS. 11a and FIGS. 11b are drawings showing exemplary images played on a display device before and after correction of color signal phase error according to various embodiments.

[0085] In FIG. 11a, an image (1110) similar to that shown in FIG. 4 is shown. As shown, a phase error of the color component with respect to the brightness component occurs, and it can be observed that the color of the chimney-shaped object protrudes slightly from the boundary line of the object toward the right background.

[0086] FIG. 11b shows an image (1120) after correction of a color signal phase error according to one embodiment of the present disclosure. In this example, the phase error of the color component facing to the right, which was included in the image (1110) of FIG. 11a, is corrected to match the brightness component. In the case of image (1120), it can be seen that the degradation of image quality that occurred in image (1110) has been improved.

[0087] In various embodiments of the present disclosure, the term "color component" may refer to each component signal included in the color signal, such as a Cr component or a Cb component, or to a single signal combining them. In the present disclosure, the description has focused on pixels arranged in a one-dimensional form in the horizontal direction, but the present disclosure is not limited thereto. Various embodiments of the present disclosure can be applied to both the horizontal and vertical directions to correct phase errors of the color component with respect to the brightness component that may occur in each of the directions.

[0088] FIG. 12 is a block diagram of an exemplary electronic device (1201) in a network environment (1200) according to various embodiments. Referring to FIG. 12, in the network environment (1200), the electronic device (1201) may communicate with an electronic device (1202) through a first network (1298) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (1204) or a server (1208) through a second network (1299) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1201) may communicate with the electronic device (1204) through a server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), memory (1230), input module (1250), sound output module (1255), display module (1260), audio module (1270), sensor module (1276), interface (1277), connection terminal (1278), haptic module (1279), camera module (1280), power management module (1288), battery (1289), communication module (1290), subscriber identification module (1296), or antenna module (1297). In some embodiments, at least one of these components (e.g., connection terminal (1278)) may be omitted from the electronic device (1201), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into a single component (e.g., display module (1260)).

[0089] The processor (1220) can, for example, execute software (e.g., program (1240)) to control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1220) can store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store the resulting data in non-volatile memory (1234). According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1201) includes a main processor (1221) and an auxiliary processor (1223), the auxiliary processor (1223) may be configured to use lower power than the main processor (1221) or to be specialized for a designated function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as part thereof. Therefore, the processor (1220) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits comprising at least one processor, and at least one of the processors may be configured to perform various functions described herein individually and / or collectively according to a distributed manner.When the terms “processor,” “at least one processor,” and “one or more processors” as used herein are described as being configured to perform a plurality of functions, these terms include, but are not limited to, situations where, for example, one processor performs part of the mentioned functions and other processor(s) perform other parts of the mentioned functions, and situations where a single processor can perform all the mentioned functions. Additionally, at least one processor may include a combination of processors performing the various mentioned / disclosed functions, for example, according to a distributed method. At least one processor may execute program instructions to achieve or perform the various functions.

[0090] The auxiliary processor (1223) may control at least some of the functions or states associated with at least one component of the electronic device (1201) (e.g., display module (1260), sensor module (1276), or communication module (1290)) on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1223) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1280) or communication module (1290)). According to one embodiment, the auxiliary processor (1223) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1201) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1208)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0091] The memory (1230) can store various data used by at least one component of the electronic device (1201) (e.g., processor (1220) or sensor module (1276)). The data may include, for example, software (e.g., program (1240)) and input or output data for related commands. The memory (1230) may include volatile memory (1232) or non-volatile memory (1234).

[0092] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).

[0093] The input module (1250) can receive commands or data to be used for a component of the electronic device (1201) (e.g., processor (1220)) from outside the electronic device (1201) (e.g., user). The input module (1250) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0094] The sound output module (1255) can output a sound signal to the outside of the electronic device (1201). The sound output module (1255) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0095] The display module (1260) can visually provide information to an external (e.g., user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0096] The audio module (1270) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250) or output sound through the sound output module (1255) or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1201).

[0097] The sensor module (1276) can detect the operating state of the electronic device (1201) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1276) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0098] The interface (1277) may support one or more specified protocols that can be used for the electronic device (1201) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1202)). According to one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0099] The connection terminal (1278) may include a connector through which the electronic device (1201) can be physically connected to an external electronic device (e.g., electronic device (1202)). According to one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0100] The haptic module (1279) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0101] The camera module (1280) can capture still images and video. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0102] The power management module (1288) can manage the power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0103] The battery (1289) can supply power to at least one component of the electronic device (1201). According to one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0104] The communication module (1290) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may include one or more communication processors that operate independently of the processor (1220) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1294) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1204) through a first network (1298) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1299) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) can identify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1296).

[0105] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1292) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1292) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1292) can support various requirements specified in the electronic device (1201), external electronic device (e.g., electronic device (1204)), or network system (e.g., second network (1299)). According to one embodiment, the wireless communication module (1292) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0106] An antenna module (1297) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1297) may include an antenna comprising a radiator having a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1298) or a second network (1299), may be selected from the plurality of antennas, for example, by a communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1297). According to various embodiments, the antenna module (1297) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0107] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0108] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) through a server (1208) connected to a second network (1299). Each of the external electronic devices (1202, or 1204) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations performed on the electronic device (1201) may be performed on one or more of the external electronic devices (1202, 1204, or 1208). For example, if the electronic device (1201) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1201) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1201) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0109] According to one example, the electronic device may include a communication interface. The electronic device may include a display configured to play a video signal. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor that is electrically connected to the communication interface, the display, and the memory, and executes the at least one instruction. The at least one processor may operate to receive a video input through the communication interface. The at least one processor may operate to decode the video input. The at least one processor may operate to obtain a set of brightness values ​​and a set of color values ​​corresponding to pixel locations of a series of pixels based on the video input. The at least one processor may operate to determine a candidate set obtained by horizontally shifting the locations of pixels corresponding to one set by a predetermined value based on one of the set of brightness values ​​or the set of color values. The at least one processor may operate to determine the correlation between the candidate set and the other of the set of brightness values ​​or the set of color values. The above at least one processor can operate to generate the video signal to be played by the display based on the correlation diagram.

[0110] According to one example, the at least one processor may operate to determine a plurality of candidate sets obtained by horizontally shifting the positions of pixels corresponding to one set by the amount of the P value for each of a plurality of predetermined P values.

[0111] According to one example, the at least one processor may operate to determine the correlation between the other set and each of the candidate sets.

[0112] According to one example, the at least one processor may operate to select one of the plurality of candidate sets based on the correlations.

[0113] According to one example, the at least one processor may operate to generate the video signal to be played by the display based on the selected set of candidates.

[0114] According to one example, color component values ​​corresponding to pixel locations of the series of pixels can be obtained according to the decoding. According to one example, the set of color values ​​may be a set including each absolute value of the change amount between the color component value corresponding to each pixel location and the color component value corresponding to the previous pixel location.

[0115] According to one example, the candidate sets can be obtained from the set of color values.

[0116] According to one example, the set of color values ​​may be a set of color component values ​​obtained for the series of pixels according to the decoding.

[0117] According to the example, the above set of candidates can be obtained from the above set of color values.

[0118] According to one example, the determination of the correlation may include, for each of the candidate sets, obtaining a set of changes including each absolute value of the change amount between a value belonging to the corresponding candidate set corresponding to each pixel position and a value belonging to the corresponding candidate set corresponding to the previous pixel position, and determining each correlation based on the set of brightness values ​​and each of the sets of changes.

[0119] According to one example, the set of brightness values ​​may be a set of brightness component values ​​obtained for the series of pixels according to the decoding.

[0120] According to one example, the determination of the correlation may include obtaining a set of brightness value change amounts including absolute values ​​of the change amounts of each brightness component value corresponding to each pixel position with respect to the brightness component value of the previous pixel position, and determining each correlation based on the set of brightness value change amounts and each of the change amount sets.

[0121] According to one example, the set of color values ​​may be associated with one of the Cr values ​​or Cb values ​​obtained with respect to the series of pixels.

[0122] According to one example, the set of brightness values ​​may be a set of absolute values ​​of the change amount for each of the previous position pixels of the brightness component values ​​obtained for the series of pixels according to the decoding.

[0123] According to one example, the above set of candidates can be obtained from the above set of brightness values.

[0124] According to one example, the set of brightness values ​​may be a set of brightness component values ​​obtained for the series of pixels according to the decoding.

[0125] According to one example, the above set of candidates can be obtained from the above set of brightness values.

[0126] According to one example, the determination of the correlation may include obtaining a set of changes including each absolute value of the change between a value belonging to a corresponding candidate set corresponding to each pixel position and a value belonging to a corresponding candidate set corresponding to the previous pixel position, and determining each correlation based on the set of color values ​​and each of the sets of changes.

[0127] According to one example, the set of color values ​​may be a set of color component values ​​obtained for the series of pixels according to the decoding.

[0128] According to one example, the determination of the correlation may include obtaining a set of color value change amounts including absolute values ​​of the change amounts of each color component value corresponding to each pixel position with respect to the color component value of the previous pixel position, and determining each correlation based on the set of color value change amounts and each of the change amount sets.

[0129] According to one example, the set of brightness values ​​can be obtained by flattening the brightness component values ​​obtained for the series of pixels according to the decoding.

[0130] According to one example, the flattening process may be performed using an average filter or a Gaussian filter.

[0131] According to one example, the correlation between the other set and each of the candidate sets can be determined for each pixel location based on the sum of the products between the corresponding value in the candidate set and the corresponding value in the other set.

[0132] According to one example, each of the plurality of P values ​​may be a predetermined integer or real value, and if the P value is a real value, a set of candidates for P may be obtained by interpolation based on a set determined for an integer value P' adjacent to P.

[0133] According to one example, a method for processing an image signal of an electronic device may include an operation of acquiring an image input. The image signal processing method may include an operation of decoding the image input. Based on the decoding, the image signal processing method may include an operation of acquiring a set of brightness component values ​​and a set of color component values ​​corresponding to pixel positions of a series of pixels. The image signal processing method may include an operation of acquiring a first set of change amounts regarding a value corresponding to a previous pixel position of a value corresponding to each pixel position, with respect to one of the set of brightness component values ​​and the set of color component values. The image signal processing method may include an operation of acquiring a second set of change amounts regarding a value corresponding to a previous pixel position of a value corresponding to each pixel position, with respect to the other set of the set of brightness component values ​​and the set of color component values. The image signal processing method may include an operation of determining a candidate set obtained by horizontally shifting the positions of pixels corresponding to one set by a predetermined value from one of the selected sets of the first set of change amounts and the second set of change amounts. The above image signal processing method may include an operation of determining the correlation between the other set among the first change amount set and the second change amount set and the candidate set. The above image signal processing method may include an operation of generating a video signal for playback based on the correlation.

[0134] According to one example, the operation of determining the candidate set may include determining a plurality of candidate sets obtained by horizontally shifting the positions of pixels corresponding to one set by the amount of the P value for each of a plurality of predetermined P values.

[0135] According to one example, the operation of determining the correlation may include the operation of determining the correlation between the other set and each of the candidate sets.

[0136] According to one example, the operation of generating the video signal for playback may select one of the plurality of candidate sets based on the correlations and generate the video signal for playback based on the selected candidate set.

[0137] According to one example, the set of brightness component values ​​can be obtained by flattening the brightness component values ​​obtained for the series of pixels according to the decoding.

[0138] According to one example, the flattening process may be performed using an average filter or a Gaussian filter.

[0139] According to one example, the operation of determining the correlation between the other set and each of the candidate sets may include, for each pixel location, determining each of the correlations based on the total sum of products between a corresponding value in the candidate set and a corresponding value in the other set.

[0140] According to one example, the set of color component values ​​may be associated with one of the Cr values ​​or Cb values ​​obtained with respect to the series of pixels.

[0141] According to one example, each of the plurality of P values ​​may be a predetermined integer or real value, and if the P value is a real value, a set of candidates for P may be obtained by interpolation based on a set determined for an integer value P' adjacent to P.

[0142] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a display device, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance, etc. The electronic device according to the embodiments of this document is not limited to the aforementioned devices.

[0143] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. For example, a component expressed in the singular should be understood as a concept including a plural component unless the context clearly implies only the singular. It should be understood that the term "and / or" as used in this document encompasses any possible combination of one or more of the listed items. Terms such as "comprising," "having," and "consisting of" used in this disclosure are intended merely to indicate the existence of the features, components, parts, or combinations thereof described in this disclosure, and the use of such terms is not intended to exclude the existence or addition of one or more other features, components, parts, or combinations thereof. In this document, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “at least one of A, B, or C” may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order).

[0144] The terms “part” or “module” as used in the various embodiments of this document may include a unit implemented in hardware, software or firmware, or a combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. The “part” or “module” may be a component formed integrally or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, the “part” or “module” may be implemented in the form of an application-specific integrated circuit (ASIC).

[0145] In the various embodiments of this document, the term “in the case of” as used may be interpreted, depending on the context, to mean “when,” “at the time of,” or “in response to a decision,” or “in response to a detection.” Similarly, “in the case where it is determined,” or “in the case where it is detected,” may be interpreted, depending on the context, to mean “at the time of determination,” or “in response to a decision,” or “at the time of detection,” or “in response to a detection.”

[0146] The program executed by the multi-display system (100) and electronic device (110) described in this document may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. The program may be executed by any system capable of executing computer-readable instructions.

[0147] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software may be implemented as a computer program containing instructions stored on computer-readable storage media. Examples of computer-readable storage media include magnetic storage media (e.g., ROM (Read-Only Memory), RAM (Random-Access Memory), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). Computer-readable storage media may be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. Computer programs may be distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0148] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0149] Although the present disclosure has been illustrated and described with reference to various exemplary embodiments, it should be understood that the various exemplary embodiments are intended to be illustrative and not limiting. Those skilled in the art should understand that various modifications, alternatives, and / or variations of the various exemplary embodiments may be made without departing from the true technical spirit and the entire technical scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it should be understood that any embodiment described herein may be used in conjunction with any other embodiment described herein.

Claims

1. As an electronic device, A communication interface including a communication circuit; A display configured to play a video signal; Memory for storing at least one instruction; and It includes at least one processor comprising a processing circuit, electrically connected to the communication interface, the display, and the memory, and configured to execute the at least one instruction individually and / or collectively. The above-mentioned at least one processor, individually and / or collectively, causes the electronic device, Receive video input through the above communication interface, and Decoding the above video input, Based on the above image input, a set of brightness values ​​and a set of color values ​​corresponding to the pixel locations of a series of pixels are obtained, and A candidate set is determined by horizontally shifting the positions of pixels corresponding to one set by a predetermined value based on one of the set of brightness values ​​or the set of color values. Determine the correlation between the set of the above-mentioned brightness values ​​or the other set of the above-mentioned color values ​​and the above-mentioned candidate set, and An electronic device that generates the video signal to be played by the display based on the above correlation diagram.

2. In Paragraph 1, The above-mentioned at least one processor, individually and / or collectively, causes the electronic device, For each of the predetermined plurality of P values, a plurality of candidate sets are determined by horizontally shifting the positions of pixels corresponding to the set by the amount of the P value. Determine the correlation between the above other set and each of the above candidate sets, and Based on the above correlations, one of the above multiple candidate sets is selected, and An electronic device that generates the image signal to be played by the display based on the above-mentioned selected set of candidates.

3. In Paragraph 2, Color component values ​​corresponding to the pixel locations of the series of pixels are obtained according to the above decoding, and The set of color values ​​above includes a set comprising each absolute value of the change amount between the color component value corresponding to each pixel position and the color component value corresponding to the previous pixel position, and An electronic device in which the candidate sets are obtained from the set of color values ​​above.

4. In Paragraph 2, The set of color values ​​above includes a set of color component values ​​obtained for the series of pixels according to the decoding, and The above candidate sets are obtained from the above set of color values, and An electronic device comprising determining the correlation, wherein for each of the candidate sets, obtaining a set of changes including each absolute value of the change amount between a value belonging to the corresponding candidate set corresponding to each pixel position and a value belonging to the corresponding candidate set corresponding to the previous pixel position, and determining each correlation based on the set of brightness values ​​and each of the sets of changes.

5. In Paragraph 4, The set of brightness values ​​above includes a set of brightness component values ​​obtained for the series of pixels according to the decoding, and An electronic device comprising determining the correlation, wherein the determination of the correlation comprises obtaining a set of brightness value change amounts including absolute values ​​of the change amounts of each brightness component value corresponding to each pixel position relative to the brightness component value of the previous pixel position, and determining each correlation based on the set of brightness value change amounts and each of the sets of change amounts.

6. In Paragraph 1, The above set of color values ​​is an electronic device associated with one of the Cr values ​​or Cb values ​​obtained with respect to the series of pixels.

7. In Paragraph 2, Brightness component values ​​corresponding to the pixel locations of the series of pixels are obtained according to the above decoding, and The set of brightness values ​​above includes a set of absolute values ​​of the change amount for each of the brightness component values ​​obtained for the series of pixels according to the decoding for the previous position pixel, and An electronic device in which the above candidate sets are obtained from the above set of brightness values.

8. In Paragraph 2, The set of brightness values ​​above includes a set of brightness component values ​​obtained for the series of pixels according to the decoding, and The above candidate sets are obtained from the above set of brightness values, and An electronic device comprising determining the correlation, wherein for each of the candidate sets, obtaining a set of changes including each absolute value of the change amount between a value belonging to the corresponding candidate set corresponding to each pixel position and a value belonging to the corresponding candidate set corresponding to the previous pixel position, and determining each correlation based on the set of color values ​​and each of the sets of changes.

9. In Paragraph 8, The set of color values ​​above includes a set of color component values ​​obtained for the series of pixels according to the decoding, and An electronic device comprising determining the correlation, wherein the determination of the correlation comprises obtaining a set of color value change amounts including absolute values ​​of the change amounts of each color component value corresponding to each pixel position with respect to the color component value of the previous pixel position, and determining each correlation based on the set of color value change amounts and each of the sets of change amounts.

10. In Paragraph 2, An electronic device in which the set of brightness values ​​above is obtained by flattening the brightness component values ​​obtained for the series of pixels according to the decoding above.

11. In Paragraph 10, The above-mentioned planarization process is performed using an average filter or a Gaussian filter in an electronic device.

12. In Paragraph 2, An electronic device in which the correlation between the other set and each of the candidate sets is determined, for each pixel location, based on the sum of the products between the corresponding value in the candidate set and the corresponding value in the other set.

13. In Paragraph 2, Each of the above plurality of P values ​​is a specified integer or real value, and An electronic device, wherein, based on the fact that the above P value is a real number, the candidate set for the above P is obtained by interpolation based on the set determined for the integer value P' adjacent to the above P.

14. As a method for processing video signals, Action of acquiring image input, The operation of decoding the above video input, Based on the above decoding, the operation of obtaining a set of brightness component values ​​and a set of color component values ​​corresponding to pixel locations of a series of pixels, With respect to one of the sets of the above-mentioned brightness component values ​​and the above-mentioned color component values, the operation of obtaining a first set of change amounts regarding the value corresponding to the previous pixel position of the value corresponding to each pixel position, With respect to the other set among the above-mentioned set of brightness component values ​​and the above-mentioned set of color component values, the operation of obtaining a second set of change amounts regarding the value corresponding to the previous pixel position of the value corresponding to each pixel position, The operation of determining a candidate set obtained by horizontally shifting the positions of pixels corresponding to one set by a predetermined value from one set selected among the first change amount set and the second change amount set, An operation to determine the correlation between the other set among the first change amount set and the second change amount set and the candidate set, A video signal processing method comprising the operation of generating a video signal for playback based on the above correlation diagram.

15. In Paragraph 14, The operation of determining the above candidate set includes, for each of the predetermined plurality of P values, the operation of determining a plurality of the above candidate sets obtained by horizontally shifting the positions of pixels corresponding to one set by the amount of the P value. The operation of determining the correlation above includes the operation of determining the correlation between the other set and each of the candidate sets, and An image signal processing method wherein the operation of generating the above-mentioned video signal for playback selects one of the plurality of candidate sets based on the above correlations and generates the above-mentioned video signal for playback based on the selected candidate set.

Images