Electronic device and method for operating electronic device

Abstract

This electronic device includes an optical layer, a display, a memory, and a processor. The electronic device may obtain a plurality of input images, obtain at least one of a depth map including a depth value for the plurality of input images or a color similarity map indicating a color difference between the plurality of input images, obtain, for each of the plurality of input images on the basis of at least one of the depth map or the color similarity map, a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation areas adjacent to the boundary of each of a plurality of display areas among a plurality of pixels, and display, in the plurality of display areas, a plurality of corrected images obtained by correcting each of the plurality of input images on the basis of the grayscale correction coefficient.

Description

Electronic device and method of operation of electronic device

[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, it relates to an electronic device comprising an optical layer including a plurality of view regions and a display including a plurality of display regions corresponding to the plurality of view regions, and a method of operating the electronic device.

[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed and distributed. Electronic devices, including display devices that display images, have been developing rapidly in recent years.

[0003] As electronic devices have advanced, the types of images displayed on electronic devices have also become more diverse. Electronic devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.

[0004] Recently, electronic devices and methods for displaying 3D images have been proposed by utilizing the refractive properties of optical layers, such as lenticular lenses, to display 3D images. Electronic devices are being developed that provide different images to the user's eyes using optical layers to provide a stereoscopic image to the user.

[0005] One embodiment of the present disclosure provides an electronic device. The electronic device may include an optical layer comprising a plurality of view regions. The electronic device may include a display comprising a plurality of display regions corresponding to each of the plurality of view regions. The electronic device may include a memory in which a program or at least one instruction is stored. The electronic device may include at least one processor. By having at least one processor execute the program or at least one instruction stored in the memory individually or collectively, the electronic device may acquire a plurality of input images, each corresponding to a plurality of display regions and comprising a plurality of pixels. The electronic device may acquire at least one of a depth map comprising depth values ​​for the plurality of input images or a color similarity map representing color differences between the plurality of input images. Based on at least one of the depth map or the color similarity map, the electronic device may acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among the pixels for each of the plurality of input images. The electronic device can correct each of the multiple input images based on a grayscale correction coefficient and display the acquired multiple corrected images in multiple display areas.

[0006] In one embodiment of the present disclosure, a method of operation of an electronic device may be provided, comprising an optical layer including a plurality of view regions and a plurality of display regions corresponding to each of the plurality of view regions. The method of operation of the electronic device may include the step of acquiring a plurality of input images, each corresponding to a plurality of display regions and including a plurality of pixels. The method of operation of the electronic device may include the step of acquiring at least one of a depth map including depth values ​​for a plurality of input images or a color similarity map indicating color differences between a plurality of input images. The method of operation of the electronic device may include the step of acquiring a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among a plurality of pixels for each of the plurality of input images, based on at least one of the depth map or the color similarity map. The method of operation of the electronic device may include the step of correcting each of the plurality of input images based on the grayscale correction coefficient and displaying the acquired plurality of corrected images in a plurality of display regions.

[0007] In one embodiment of the present disclosure, a computer-readable recording medium may be provided on which a program for performing at least one of the embodiments of the method of operating the disclosed electronic device is recorded on a computer.

[0008] The technical problems to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.

[0009] The present disclosure may be understood by the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.

[0010] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0011] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0012] FIG. 3 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0013] FIG. 4 is a drawing for explaining a plurality of input images corresponding to a plurality of display areas, respectively, according to one embodiment of the present disclosure.

[0014] FIG. 5 is a diagram illustrating an operation to correct the grayscale of a plurality of target pixels displayed in a plurality of compensation regions and a plurality of compensation regions, according to one embodiment of the present disclosure.

[0015] FIG. 6 is a flowchart for explaining the operation of obtaining a plurality of sub-depth maps and a plurality of sub-gradation correction coefficients corresponding to each of a plurality of input images according to one embodiment of the present disclosure.

[0016] FIG. 7 is a flowchart for explaining the operation of obtaining a pixel gradation correction coefficient such that the degree of gradation correction of a target pixel varies according to the depth values ​​of a plurality of target pixels according to one embodiment of the present disclosure.

[0017] FIG. 8 is a drawing for explaining that the degree of correction of the grayscale of a target pixel varies depending on the depth values ​​of a plurality of target pixels according to one embodiment of the present disclosure.

[0018] FIG. 9 is a drawing for explaining the arrangement of a plurality of view regions, a plurality of display regions and a plurality of compensation regions according to one embodiment of the present disclosure.

[0019] FIG. 10 is a flowchart for explaining the operation of obtaining a pixel gradation correction coefficient such that the gradation of a target pixel having a depth value greater than a preset reference correction value among a plurality of target pixels according to one embodiment of the present disclosure becomes "0".

[0020] FIG. 11 is a diagram illustrating that a compensation area for correcting the grayscale of a target pixel changes according to the depth values ​​of a plurality of target pixels according to one embodiment of the present disclosure.

[0021] FIG. 12 is a flowchart for explaining an operation to correct at least one luminance correction pixel among a plurality of pixels according to one embodiment of the present disclosure so that the gradation is increased.

[0022] FIG. 13 is a flowchart illustrating an operation to obtain a pixel correction coefficient such that the degree of correction of the grayscale of a target pixel varies according to the color similarity of a plurality of target pixels between a plurality of input images, according to one embodiment of the present disclosure.

[0023] FIG. 14 is a diagram illustrating an operation for obtaining color similarity of a plurality of target pixels between a plurality of input images according to one embodiment of the present disclosure.

[0024] FIG. 15 is a flowchart illustrating the operation of obtaining pixel correction coefficients such that the degree of correction of the grayscale of a target pixel varies according to the difference between a reference binocular angle and a binocular angle, according to one embodiment of the present disclosure.

[0025] FIG. 16 is a drawing for explaining that the degree of correction of the grayscale of a target pixel varies depending on the difference between the reference binocular angle and the binocular angle according to one embodiment of the present disclosure.

[0026] FIG. 17 is a drawing for explaining how the reference binocular angle changes due to the rotation of an electronic device according to one embodiment of the present disclosure.

[0027] FIG. 18 is a drawing for explaining how the degree of correction of the grayscale of a target pixel changes by reflecting the difference between the reference binocular angle and the user's binocular angle due to the rotation of an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 19 is a drawing for explaining how the angle of the user's eyes changes according to the movement of the user's head, according to one embodiment of the present disclosure.

[0029] The terms used in this disclosure will be briefly explained, and an embodiment of this disclosure will be described in detail.

[0030] Throughout this disclosure, unless specifically stated otherwise, "or" is inclusive and not exclusive. Accordingly, "A or B" may mean "A, B, or both" unless clearly indicated otherwise by the context.

[0031] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0032] The terms used in this disclosure have been selected to be as widely used and general as possible, taking into account the functions in the embodiments of this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined not merely by their names, but based on their meanings and the content throughout this disclosure.

[0033] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification.

[0034] Throughout this disclosure, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "module," etc., as used in this disclosure refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0035] The expression “configured to” as used in this disclosure may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “system configured to” may mean that the system is “capable of” together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in memory.

[0036] In addition, when a component is described in the present disclosure as being “connected” or “connected” to another component, it should be understood that the component may be directly connected to or directly connected to the other component, but unless otherwise specifically stated, it may also be connected or connected through another component in between.

[0037] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0038] All functions or operations described in this document may be processed by a single processor or a combination of multiple processors.

[0039] Functions related to artificial intelligence according to the present disclosure are operated through processors and memory. One or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are dedicated artificial intelligence processors, the dedicated artificial intelligence processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0040] The predefined rules of operation or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that a predefined rules of operation or artificial intelligence models configured to perform desired characteristics (or objectives) are created by a basic artificial intelligence model being trained using a number of training data by a learning algorithm. Such learning may be performed on the electronic device itself in which the artificial intelligence model according to the present disclosure is used, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0041] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values ​​and performs neural network operations through operations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. The artificial neural network may include a Deep Neural Network (DNN), such as a Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN), or Deep Q-Networks, but is not limited to the examples mentioned above.

[0042] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, an embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiment described herein. Furthermore, in order to clearly explain an embodiment of the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the present disclosure are denoted by similar reference numerals.

[0043] Embodiments of the present disclosure will be described in detail below with reference to the drawings.

[0044] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0045] Referring to FIG. 1, in one embodiment of the present disclosure, FIG. 1 shows an electronic device (100) that provides an image (200) to a user (300).

[0046] In one embodiment of the present disclosure, the electronic device (100) may be implemented as an electronic device of various shapes, such as a mobile device, a smartphone, a monitor, a laptop computer, a tablet PC, a wearable device, a head-mounted display (HMD) device, digital signage, etc.

[0047] In one embodiment of the present disclosure, the electronic device (100) may include a display (110) and an optical layer (120). In one embodiment of the present disclosure, the electronic device (100) may acquire a plurality of input images. The electronic device (100) may display the acquired plurality of input images on the display (110), and the plurality of input images displayed on the display (110) may be provided to a user (300) as an image (200) through the optical layer (120).

[0048] In one embodiment of the present disclosure, the electronic device (100) may control the display (110) to display a plurality of input images including a plurality of pixels. In one embodiment of the present disclosure, the plurality of pixels may be individual components constituting each of the plurality of input images. However, the present disclosure is not limited thereto, and the image displayed through the display (110) may be an image in which the plurality of input images acquired by the electronic device (100) have been preprocessed, or an image converted to be displayed through the display (110).

[0049] In one embodiment of the present disclosure, as the resolution of each input image increases, the number of pixels included in each input image may increase. In one embodiment of the present disclosure, the resolution of each input image may refer to the resolution of the pixels constituting a display area included in a display (110) in which each input image is displayed.

[0050] In one embodiment of the present disclosure, the optical layer (120) may include a plurality of view regions. In this case, a "view region" may be a region that refracts an input image provided to the corresponding region through a display (110) so that it is provided to the user (300) as a corresponding view.

[0051] In one embodiment of the present disclosure, the display (110) may include a plurality of display areas corresponding to a plurality of view areas. A plurality of input images may be images corresponding to a plurality of display areas. A plurality of input images displayed in a plurality of display areas may be refracted by an optical layer (120) and provided to a user (300) in different views.

[0052] In one embodiment of the present disclosure, the image (200) provided to the user (300) may include images provided by being refracted into two or more different views by the optical layer (120).

[0053] In one embodiment of the present disclosure, the optical layer (120) may include a lenticular lens comprising a plurality of lenses (121). In one embodiment of the present disclosure, each of the plurality of lenses (121) may include two or more view regions. A plurality of input images displayed on the display (110) may be refracted through the lenticular lens and provided to the user (300) as an image (200).

[0054] In one embodiment of the present disclosure, each of the plurality of input images may be images obtained by capturing a real object in a plurality of different views. However, the present disclosure is not limited thereto, and each of the plurality of input images may be images generated to provide images of an object in a plurality of different views.

[0055] At this time, the 'view' may correspond to a position where the user (300) can see another side of an object included in an image (200) provided through the electronic device (100). However, the present disclosure is not limited thereto, and the 'view' may correspond to the positions of the user's (300) left eye and right eye, where the user can see another side of an object included in an image (200) provided through the electronic device (100).

[0056] In one embodiment of the present disclosure, in two input images obtained from adjacent views, the position of a first pixel having a specific depth value included in one first input image within the first input image and the position of a second pixel corresponding to the first pixel included in another second input image within the second input image may be different from each other. In one embodiment of the present disclosure, the difference in position within the input images between two corresponding pixels having a specific depth value within two input images obtained from adjacent views may be defined as "disparity."

[0057] In one embodiment of the present disclosure, an image (200) provided through an electronic device (100) may be provided such that, depending on the position of the user (300) looking at the electronic device (100), the user (300) can see different sides of an object included in the image (200) in each of the plurality of views. In one embodiment of the present disclosure, the image (200) provided to the user by the electronic device (100) may vary depending on the position of the user (300). Specifically, as the position of the user (300) changes, the user is provided with a plurality of images that have disparity, so the user (300) can feel a three-dimensional effect from the image (200) provided by the electronic device (100).

[0058] In one embodiment of the present disclosure, there may be disparity between images provided to the left eye and right eye of the user (300), respectively. In one embodiment of the present disclosure, the electronic device (100) may provide images to the left eye and right eye of the user (300), respectively, that have disparity between them. In one embodiment of the present disclosure, the user (300) may perceive binocular disparity through images with disparity provided to the left eye and right eye, respectively, and may perceive a three-dimensional effect from the image (200).

[0059] Hereinafter, for the convenience of explanation, the plurality of input images are described as two input images obtained from views corresponding to the left and right eyes of the user (300). Additionally, the electronic device (100) is described as providing images (200) to the left and right eyes of the user (300) through a display (110) and an optical layer (120).

[0060] In one embodiment of the present disclosure, each of the two input images may include an object having various depth values. The object may include various things such as people, animals, objects, and natural objects, and is not limited to any one of them. The depth value of the object included in each of the two input images may be "0," or may have a value less than or greater than "0."

[0061] In one embodiment of the present disclosure, disparity between two input images may occur in an object having a depth value that is not "0". In one embodiment of the present disclosure, a user (300) may perceive a sense of depth with respect to an object with disparity among two input images provided to the left eye and the right eye, respectively.

[0062] At this time, "0" is a reference value, and for an object having a depth value of "0", there may be no disparity between the two input images. Therefore, an object having a depth value of "0" may be recognized by the user (300) in the image (200) as being located on a plane parallel to the electronic device (100).

[0063] At this time, the plane parallel to the electronic device (100) may be a plane defined by the first direction (10) and the second direction (20). The normal direction perpendicular to the plane defined by the first direction (10) and the second direction (20) may be the third direction (30).

[0064] An object having a depth value less than "0" may be perceived by the user (300) in the image (200) as being located on a surface far from the user (300) in the opposite direction of the third direction (30) from the electronic device (100).

[0065] An object having a depth value greater than "0" may be recognized by the user (300) in the image (200) as being located on a surface adjacent to the electronic device (100) in a third direction (30) from the user (300).

[0066] In one embodiment of the present disclosure, the angle at which a plurality of input images are refracted through a plurality of view regions of the optical layer (120) may be determined based on the characteristics of the display (110) (e.g., resolution, size and arrangement of a plurality of pixels), the characteristics of the optical layer (120) (refractive index, shape of a lens, arrangement of a lens), and the arrangement relationship between the display (110) and the optical layer (120).

[0067] Accordingly, the distance at which an input image corresponding to the left eye is refracted by the optical layer (120) and provided to the left eye of the user (300), and an input image corresponding to the right eye is refracted by the optical layer (120) and provided to the right eye of the user (300), can also be determined by the characteristics of the display (110), the characteristics of the optical layer (120), and the arrangement relationship between the display (110) and the optical layer (120), and such a distance can be referred to as a "viewing distance." The viewing distance may be the distance between the electronic device (100) and the user (300) in a third direction (30) for optimally viewing the image (200).

[0068] In one embodiment of the present disclosure, when a user (300) viewing an image (200) through an electronic device (100) is closer than the viewing distance in a third direction (30) or further than the viewing distance, a portion of the input image corresponding to the left eye may be refracted by the optical layer (120) and provided to the right eye of the user (300). Additionally, a portion of the input image corresponding to the right eye may be refracted by the optical layer (120) and provided to the left eye of the user (300).

[0069] However, even if the user (300) is located at a viewing distance and views the image (200), due to the wave characteristics of light, when the input image is provided to the user (300) through the optical layer (120), some of the input images corresponding to the left eye may be provided to the user (300)'s right eye, and some of the input images corresponding to the right eye may be provided to the user (300)'s left eye.

[0070] In one embodiment of the present disclosure, for an object having a depth value not of "0", there is disparity between two input images provided to the left eye and the right eye, respectively. Accordingly, the user (300) may experience a degradation in the quality of the image (200), such as crosstalk, where the boundary of the object included in the image (200) is not clear and a residual image remains, appearing blurry, due to the input images incorrectly provided to the left eye and the right eye, respectively.

[0071] In one embodiment of the present disclosure, the electronic device (100) can correct the gradation of a plurality of pixels included in an input image corresponding to the left eye and an input image corresponding to the right eye and display them respectively in a plurality of display areas of the display (110) to prevent the user (300) from experiencing crosstalk.

[0072] In one embodiment of the present disclosure, an image that may be incorrectly provided to the right eye of the user (300) may be an image corresponding to the boundary of the input image corresponding to the left eye. An image that may be incorrectly provided to the left eye of the user (300) may be an image corresponding to the boundary of the input image corresponding to the right eye. In this case, the meaning of "boundary" may refer to an outer area rather than the central area of ​​the display area where the input image is displayed.

[0073] In one embodiment of the present disclosure, an area adjacent to the boundary of each of the plurality of display areas may be referred to as a plurality of compensation areas. The electronic device (100) may correct the gradation of a plurality of target pixels displayed in the plurality of compensation areas among a plurality of pixels included in the input image corresponding to the left eye and the input image corresponding to the right eye, respectively, and display them in each of the plurality of display areas of the display (110).

[0074] In one embodiment of the present disclosure, a plurality of lenses (121) may be included in an optical layer (120) in an intersecting manner. A display area for displaying an input image corresponding to the left eye and a display area for displaying an input image corresponding to the right eye included in the display (110) are each included in a plurality of lenses (121) and may be intersected according to the plurality of lenses (121).

[0075] At this time, the plurality of compensation regions may be located adjacent to the boundaries of each of the display region displaying the input image corresponding to the left eye and the display region displaying the input image corresponding to the right eye, which are intersected and repeated. The plurality of compensation regions may be regions that include the boundaries of each of the plurality of display regions. However, the present disclosure is not limited thereto, and the arrangement and shape of the plurality of compensation regions may vary depending on the arrangement and shape of the plurality of view regions and the plurality of display regions included in the electronic device (100).

[0076] In one embodiment of the present disclosure, the electronic device (100) can correct the gradation of a plurality of target pixels so that crosstalk is not visible to the user for an object with disparity. Specifically, the electronic device (100) can correct the gradation of a plurality of target pixels so that the difference between the gradation of the boundary portion of the object and the gradation of the background is reduced.

[0077] In one embodiment of the present disclosure, the electronic device (100) can correct the grayscale of a plurality of target pixels to be lowered or correct the grayscale of a plurality of target pixels to be "0" as the grayscale of the boundary portion of the object is higher than the grayscale of the background.

[0078] However, the present disclosure is not limited thereto, and the electronic device (100) may correct the grayscale of a plurality of target pixels to be higher as the grayscale of the boundary portion of the object is equal to or lower than the grayscale of the background.

[0079] Hereinafter, for the convenience of explanation, it is described that the electronic device (100) corrects the grayscale of multiple target pixels to be lowered or to be "0", but it is obvious that in order to reduce the visibility of crosstalk, the correction may be performed to increase the grayscale of multiple target pixels depending on the case.

[0080] In one embodiment of the present disclosure, crosstalk may occur in an object with disparity among two input images. Accordingly, the electronic device (100) may correct the grayscale of at least one target pixel representing an object having a depth value greater than a preset reference correction value among a plurality of target pixels based on a depth map for two input images, so that the grayscale is lowered or the grayscale is corrected to "0". The electronic device (100) may maintain the grayscale of at least one target pixel representing an object (e.g., background, etc.) having a depth value equal to or smaller than a preset reference correction value among a plurality of target pixels.

[0081] At this time, the "reference correction value" may be a reference value pre-set to correct the gradation through the present invention in order to reduce the degree to which crosstalk is visible. It may be a value set so that gradation correction is performed, such that crosstalk may be visible due to the boundaries of objects having a depth value greater than the reference correction value or objects having a depth value lower than the reference correction value. In one embodiment of the present disclosure, the reference correction value may include a value of "0". For convenience of explanation below, the reference correction value will be described as being "0". However, it is understood that the reference correction value may be set to a value smaller or larger than "0".

[0082] In one embodiment of the present disclosure, the electronic device (100) may correct the gradation of at least one target pixel among a plurality of target pixels that displays an object with a depth value not of "0" so that the gradation is lowered, or correct the gradation so that the gradation becomes "0". The electronic device (100) may maintain the gradation of at least one target pixel among a plurality of target pixels that displays an object with a depth value of "0".

[0083] Through this, the electronic device (100) can provide the user (300) with a high-quality image (200) that does not cause crosstalk. In addition, even if the user (300) is located close to or far from the electronic device (100) while watching the image (200), crosstalk is prevented, thereby providing the user (300) with a wide viewing distance of the electronic device (100).

[0084] Additionally, the electronic device (100) lowers the gradation of pixels displaying disparity objects where crosstalk occurs, and does not lower the gradation of pixels displaying non-disparity objects, thereby providing the user (300) with an image (200) where crosstalk does not occur, and at the same time, prevents the user (300) from noticing that the overall brightness of the image (200) has been lowered.

[0085] In one embodiment of the present disclosure, as the depth value of an object becomes larger than "0" or as the depth value of an object becomes smaller than "0", the disparity increases, and thus the crosstalk occurring in the object may also become more severe.

[0086] Accordingly, the electronic device (100) can correct, based on depth maps for two input images, such that as the absolute value of the depth value of an object displayed on one of the multiple target pixels increases, the degree of lowering the gradation of the corresponding target pixel increases. The electronic device (100) can correct, such that as the absolute value of the depth value of an object displayed on one of the multiple target pixels decreases, the degree of lowering the gradation of the corresponding target pixel decreases.

[0087] However, the present disclosure is not limited thereto, and the electronic device (100) may be configured such that, based on depth maps for two input images, as the absolute value of the depth value of an object displayed on any one of a plurality of target pixels increases, the area of ​​the compensation region that displays the grayscale as "0" and includes the target pixel may be configured to increase. The electronic device (100) may be configured such that, as the absolute value of the depth value of an object displayed on any one of a plurality of target pixels decreases, the area of ​​the compensation region that displays the grayscale as "0" and includes the target pixel may be configured to decrease.

[0088] In addition, in one embodiment of the present disclosure, the greater the similarity between the color of the object where crosstalk occurs and the color of other objects surrounding the object (e.g., background or other objects including the object where crosstalk occurs) due to human cognitive characteristics, the less the crosstalk may be perceived by the user (300).

[0089] Accordingly, the electronic device (100) can correct the degree to which the gradation of a target pixel is lowered as the color difference of a target pixel at a specific location among a plurality of target pixels increases, based on a color similarity map representing the color difference between a plurality of pixels included in each of two input images. The electronic device (100) can correct the degree to which the gradation of a target pixel is lowered as the color difference of a target pixel at a specific location among a plurality of target pixels decreases.

[0090] In one embodiment of the present disclosure, the electronic device (100) may further include an eye tracking sensor. The electronic device (100) may obtain two gaze directions corresponding to the left eye and the right eye of the user (300), respectively, through the eye tracking sensor.

[0091] In one embodiment of the present disclosure, an electronic device (100) may obtain the binocular angle of a user (300) viewing an image (200) based on two viewing directions. The electronic device (100) may determine the degree to which crosstalk is visible to the user (300) by comparing the reference binocular angle with the binocular angle. In this case, the "reference binocular angle" may refer to the angle between the two viewing directions of the user (300) located at the viewing distance, based on the average distance between the left and right eyes of a person using human anatomical characteristics and the viewing distance.

[0092] In one embodiment of the present disclosure, the greater the difference between the reference binocular angle and the binocular angle, the greater the degree to which crosstalk is visible to the user (300). The smaller the difference between the reference binocular angle and the binocular angle, the less the degree to which crosstalk is visible to the user (300). The binocular angle may increase as the distance between the user (300) and the electronic device (100) becomes closer, and decrease as the distance between the user (300) and the electronic device (100) becomes farther. Additionally, the binocular angle may change even when the user (300) watches the image (200) while moving their head at the same position (e.g., tilting the head to the left or right, or rotating the head).

[0093] Accordingly, the electronic device (100) can be corrected so that the greater the difference between the reference binocular angle and the binocular angle, the greater the degree to which the gradation of multiple target pixels is lowered. The electronic device (100) can be corrected so that the less the difference between the reference binocular angle and the binocular angle, the smaller the degree to which the gradation of multiple target pixels is lowered.

[0094] In one embodiment of the present disclosure, the electronic device (100) can adjust the degree of adjustment of the gradation of a plurality of target pixels by comprehensively considering the degree to which crosstalk is visible to the user (300). Accordingly, the electronic device (100) can minimize the visibility of crosstalk in the image (200) to the user (300), and minimize the decrease in brightness or change in color tone of the image (200) by lowering the gradation of a plurality of target pixels or displaying the gradation as "0".

[0095] Additionally, the present disclosure is not limited thereto, and the electronic device (100) may provide to the user (300) a correction such that the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among a plurality of target pixels whose grayscale has been corrected based on a grayscale correction coefficient is increased.

[0096] Specifically, the electronic device (100) can correct at least one target pixel among a plurality of target pixels so that its grayscale is lowered or becomes "0", and correct at least one luminance correction pixel adjacent to the said at least one target pixel among the plurality of pixels so that its grayscale is raised. At this time, "at least one luminance correction pixel" may mean a pixel located adjacent to the at least one target pixel corrected so that its grayscale is lowered or becomes "0".

[0097] At this time, the degree to which the gradation of at least one luminance correction pixel is increased can be determined by the degree to which the gradation of at least one target pixel is lowered or by the size of the compensation area that displays the gradation as "0".

[0098] However, the present disclosure is not limited thereto, and the electronic device (100) of the present disclosure may correct at least one target pixel among a plurality of target pixels so that the gradation is higher in order to prevent crosstalk of the gradation from being visible, taking into account the difference in gradation between an object and a background, and thus correct at least one luminance correction pixel adjacent to the said at least one target pixel among the plurality of pixels so that the gradation is lowered.

[0099] Through this, an image (200) in which no crosstalk occurs is provided to the user (300), and at the same time, the user (300) is prevented from seeing that the grayscale of the target pixel displaying the disparity object has been lowered.

[0100] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood from the present disclosure by those skilled in the art to which the present disclosure pertains.

[0101] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0102] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an electronic device (100) may include a display (110), an optical layer (120), an eye-tracking sensor (130), a memory (140), at least one processor (150), an input / output interface (160), and a communication interface (170).

[0103] However, not all of the components shown in FIG. 2 are essential components. The electronic device (100) may be implemented with more components than those shown in FIG. 2, or with fewer components.

[0104] A display (110), an optical layer (120), an eye-tracking sensor (130), a memory (140), at least one processor (150), an input / output interface (160), and a communication interface (170) included in an electronic device (100) can each be electrically connected to one another.

[0105] In one embodiment of the present disclosure, at least one processor (150) controls the display (110), so that the electronic device (100) can display each of a plurality of input images through the display (110).

[0106] In one embodiment of the present disclosure, the display (110) may include any one of a liquid crystal display, a plasma display, an organic light emitting diode display, and an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the display (110) may include other types of displays capable of displaying a plurality of input images.

[0107] In one embodiment of the present disclosure, a plurality of input images displayed on a display (110) may be provided to the optical layer (120). The plurality of input images passing through the optical layer (120) may be refracted according to the shape, refractive index, thickness, or arrangement of the optical layer (120) and provided to the user (300).

[0108] In one embodiment of the present disclosure, the optical layer (120) may include a plurality of lenses. In one embodiment of the present disclosure, the optical layer (120) may include a lenticular lens composed of lenticular-shaped lenses. Hereinafter, for convenience of explanation, the optical layer (120) will be described as a lenticular lens.

[0109] In one embodiment of the present disclosure, the optical layer (120) may be slanted with respect to a plurality of pixels included in the display (110). In this case, being slanted means that each of the plurality of lenses included in the optical layer (120) does not overlap with pixels located in a certain row or a certain column among the plurality of pixels included in the display (110), but rather overlaps with pixels located in different rows or columns.

[0110] In one embodiment of the present disclosure, the display (110) includes a plurality of display areas, and the electronic device (100) can display a plurality of input images corresponding to each of the plurality of display areas of the display (110).

[0111] In one embodiment of the present disclosure, when each of the plurality of lenses included in the optical layer (120) includes two view regions for providing an image to a user (300) in two different views, the display (110) may include two display regions corresponding to each of the two view regions. However, the present disclosure is not limited thereto, and when each of the plurality of lenses includes n view regions, the display (110) may also include n display regions. In this case, n may be a natural number greater than or equal to 3.

[0112] In one embodiment of the present disclosure, the gaze tracking sensor (130) can obtain the gaze direction of the user (300). In one embodiment of the present disclosure, the gaze tracking sensor (130) can track the gaze direction of the user (300) by detecting an image of the user's (300) eyeball or pupil, or by detecting the direction or amount of reflected light, such as near-infrared light, reflected from the cornea.

[0113] In one embodiment of the present disclosure, the eye tracking sensor (130) may include a first eye tracking sensor and a second eye tracking sensor. The first eye tracking sensor may be obtained by tracking the direction of gaze of the user (300)'s left eye. The second eye tracking sensor may be obtained by tracking the direction of gaze of the user (300)'s right eye. However, the present disclosure is not limited thereto, and the electronic device (100) may include one eye tracking sensor or three or more eye tracking sensors.

[0114] In one embodiment of the present disclosure, the eye tracking sensor (130) may include a light source that irradiates light toward the eyes of a user (300) and a sensor that receives reflected light reflected from the eyes of a user (300). At this time, the light irradiated toward the eyes of a user (300) and the reflected light reflected from the eyes of a user (300) may each be infrared rays (IR).

[0115] In one embodiment of the present disclosure, the depth map acquisition module (141) may be composed of instructions or program code regarding an operation or function of acquiring a depth map based on a plurality of input images.

[0116] In one embodiment of the present disclosure, the depth map acquisition module (141) may be composed of instructions or program code regarding an operation or function to acquire a depth map based on the disparity between a plurality of input images, the focal length of a plurality of cameras that captured the plurality of input images, and the distance between the plurality of cameras.

[0117] However, the present disclosure is not limited thereto, and the depth map acquisition module (141) may be composed of various commands or program codes capable of performing the operation of acquiring a depth map based on a plurality of input images.

[0118] In one embodiment of the present disclosure, the depth map acquisition module (141) may include an artificial intelligence model. The artificial intelligence model included in the depth map acquisition module (141) may include a machine learning or deep learning model. In one embodiment of the present disclosure, the artificial intelligence model included in the depth map acquisition module (141) may include a CNN (Convolutional Neural Network) or a transformer, and may be an artificial intelligence model trained to infer a depth map containing depth information by receiving a plurality of input images as input.

[0119] In one embodiment of the present disclosure, the depth map may include a plurality of sub-depth maps corresponding to each of a plurality of input images. The depth map may include a first sub-depth map corresponding to a first input image and a second sub-depth map corresponding to a second input image. The depth map acquisition module (141) may be composed of instructions or program code regarding an operation or function of acquiring a plurality of sub-depth maps corresponding to each of a plurality of input images based on a plurality of input images.

[0120] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a depth map acquisition module (141), the electronic device (100) can acquire depth maps corresponding to a plurality of input images. The electronic device (100) can acquire a plurality of sub-depth maps corresponding to each of the plurality of input images.

[0121] However, in one embodiment of the present disclosure, the electronic device (100) may acquire a plurality of input images and a depth map corresponding to the plurality of input images through an input / output interface (160) or a communication interface (170).

[0122] In one embodiment of the present disclosure, the compensation area determination module (142) may include instructions or program code regarding an operation or function of determining a plurality of compensation areas from each of a plurality of display areas. In one embodiment of the present disclosure, the compensation area determination module (142) may determine a plurality of compensation areas adjacent to the boundary of each of the plurality of display areas among the plurality of display areas included in the display (110) based on a depth map.

[0123] In one embodiment of the present disclosure, the compensation area determination module (142) may include instructions or program code regarding an operation or function of determining a plurality of compensation areas adjacent to the boundary of each of a plurality of display areas based on each of a plurality of sub-depth maps.

[0124] In this case, determining multiple compensation areas may mean determining the width or area of ​​the compensation area included within each display area.

[0125] However, the present disclosure is not limited thereto. The compensation area determination module (142) may include instructions or program code regarding an operation or function of determining a plurality of compensation areas adjacent to the boundaries of each of the plurality of display areas based on a color similarity map obtained through the color similarity map acquisition module (143).

[0126] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a compensation area determination module (142), the electronic device (100) can determine a plurality of compensation areas adjacent to the boundaries of each of the plurality of display areas based on a color similarity map obtained through a color similarity map acquisition module (143).

[0127] Additionally, in one embodiment of the present disclosure, the compensation area determination module (142) may include instructions or program code regarding an operation or function of determining a plurality of compensation areas adjacent to the boundary of each of the plurality of display areas based on the difference between a preset reference binocular angle and the binocular angle of the user (300) obtained through the eye tracking sensor (130).

[0128] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a compensation area determination module (142), the electronic device (100) can determine a plurality of compensation areas adjacent to the boundaries of each of the plurality of display areas based on a preset reference binocular angle and the binocular angle of the user (300) obtained through the eye tracking sensor (130).

[0129] The present disclosure is not limited thereto, and the compensation area determination module (142) may include instructions or program code regarding an operation or function of determining a plurality of compensation areas adjacent to the boundary of each of the plurality of display areas based on at least one of a depth map, a color similarity map, or the difference between a preset reference binocular angle and the binocular angle of the user (300).

[0130] However, the present disclosure is not limited thereto, and the width or area of ​​the plurality of compensation regions included in each of the plurality of display regions may already be determined. The optical layer (120) may include a plurality of lenses arranged to intersect each other. Each of the plurality of lenses may include a plurality of view regions. The plurality of display regions included in the display (110) may intersect to correspond to each of the plurality of view regions. The width of each of the plurality of compensation regions may be predetermined in the direction in which the plurality of view regions intersect.

[0131] The operation of the compensation area determination module (142) will be described later in FIGS. 7 to 19.

[0132] In one embodiment of the present disclosure, the color similarity map acquisition module (143) may include instructions or program code regarding an operation or function to acquire a color similarity map representing the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input image, based on a plurality of input images.

[0133] In one embodiment of the present disclosure, when a plurality of input images include a first input image and a second input image, the color similarity map acquisition module (143) may include instructions or program code regarding an operation or function of acquiring an overall color similarity map that indicates the color difference between a plurality of pixels by comparing the grayscale of each of a plurality of pixels included in the first input image with the grayscale of each of a plurality of pixels included in the second input image.

[0134] In one embodiment of the present disclosure, the grayscale of one pixel existing at a specific location among a plurality of pixels included in a first input image is R 1, Let G1 and B1 be the Red, Green, and Blue gradations of a single pixel located at the same specific position as a single pixel in the first input image among a plurality of pixels included in the second input image, R 2, When referred to as G2 and B2, the color similarity map acquisition module (143) may include instructions or program code for calculating the color similarity d at a specific location in the color similarity map using the following mathematical formula 1.

[0135] Mathematical formula 1:

[0136]

[0137] However, the present disclosure is not limited thereto, and the color similarity map acquisition module (143) may include instructions or program code for calculating the color similarity d at the corresponding specific location using the following mathematical formula 2.

[0138] Mathematical formula 2:

[0139]

[0140] At this time, , and may be a coefficient determined based on the degree to which Red, Green, and Blue gradations contribute to human-perceived brightness. In one embodiment of the present disclosure, 0.3, is 0.59, It may be 0.11, but is not limited to this.

[0141] In one embodiment of the present disclosure, the color similarity map acquisition module (143) may include instructions or program code regarding an operation or function of acquiring a map corresponding to a compensation area in the entire color similarity map as a color similarity map.

[0142] However, the present disclosure is not limited thereto, and the color similarity map acquisition module (143) may include instructions or program code regarding an operation or function to acquire a color similarity map indicating the color difference between a plurality of target pixels by comparing the grayscale of each of a plurality of target pixels included in a compensation area in a first input image with the grayscale of each of a plurality of target pixels included in a compensation area in a second input image.

[0143] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a color similarity map acquisition module (143), the electronic device (100) can acquire a color similarity map representing the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images, based on a plurality of input images.

[0144] In one embodiment of the present disclosure, the angle identification module (144) may include instructions or program code regarding an operation or function to acquire the binocular angle of a user (300) viewing an image (200) through an electronic device (100).

[0145] In one embodiment of the present disclosure, the angle identification module (144) may include instructions or program code regarding an operation or function of identifying the angle between two gaze directions as a binocular angle based on two gaze directions corresponding to each of the two eyes of the user (300) obtained through the gaze tracking sensor (130).

[0146] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of an angle identification module (144), the electronic device (100) can obtain the binocular angle of a user (300) viewing an image (200) through the electronic device (100).

[0147] In one embodiment of the present disclosure, the grayscale correction coefficient acquisition module (145) may include instructions or program code regarding an operation or function of acquiring a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of a plurality of display regions among a plurality of pixels for each of a plurality of input images based on a depth map.

[0148] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of sub-grayscale correction coefficients corresponding to each of a plurality of input images.

[0149] In one embodiment of the present disclosure, the grayscale correction coefficient acquisition module (145) may include instructions or program code regarding an operation or function of acquiring a plurality of sub-grainscale correction coefficients for correcting the grayscale of a plurality of target pixels included in each of a plurality of input images based on each of a plurality of sub-depth maps.

[0150] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a grayscale correction coefficient acquisition module (145), the electronic device (100) can acquire a plurality of sub-grainscale correction coefficients for correcting the grayscale of a plurality of target pixels included in each of a plurality of input images based on each of a plurality of sub-depth maps. Hereinafter, the grayscale correction coefficient is described as including a plurality of sub-grainscale correction coefficients corresponding to each of the plurality of input images in order to correct the grayscale of a plurality of target pixels included in each of the plurality of input images.

[0151] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. In one embodiment of the present disclosure, each of the plurality of sub-grayscale correction coefficients may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels included in each input image.

[0152] Hereinafter, each of the plurality of sub-gradation correction coefficients is described as including a plurality of sub-gradation correction coefficients corresponding to each of the plurality of input images in order to correct the gradation of a plurality of target pixels included in each of the plurality of input images.

[0153] However, the present disclosure is not limited thereto. The grayscale correction coefficient acquisition module (145) may include instructions or program code regarding an operation or function of acquiring a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels based on a color similarity map acquired through the color similarity map acquisition module (143).

[0154] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a grayscale correction coefficient acquisition module (145), the electronic device (100) can acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels based on a color similarity map acquired through a color similarity map acquisition module (143).

[0155] Additionally, in one embodiment of the present disclosure, the grayscale correction coefficient acquisition module (145) may include instructions or program code regarding an operation or function to acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels based on the difference between a preset reference binocular angle and the binocular angle of the user (300) acquired through the eye tracking sensor (130).

[0156] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a grayscale correction coefficient acquisition module (145), the electronic device (100) can acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels based on a preset reference binocular angle and the binocular angle of the user (300) acquired through the eye tracking sensor (130).

[0157] The present disclosure is not limited thereto, and the grayscale correction coefficient acquisition module (145) may include instructions or program code regarding an operation or function to acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels based on at least one of a depth map, a color similarity map, or the difference between a preset reference binocular angle and the binocular angle of the user (300).

[0158] Hereinafter, the operation of the grayscale correction coefficient acquisition module (145) will be described later in FIGS. 7 to 19.

[0159] In one embodiment of the present disclosure, the grayscale correction module (146) may include instructions or program code regarding an operation or function of correcting the grayscale of each of a plurality of input images based on a grayscale correction coefficient to obtain a plurality of corrected images.

[0160] In one embodiment of the present disclosure, the grayscale correction module (146) may include instructions or program code regarding an operation or function of obtaining a plurality of corrected images by multiplying a plurality of sub-grayscale correction coefficients corresponding to each of a plurality of input images by the grayscale of a plurality of target pixels included in each of the plurality of input images.

[0161] In one embodiment of the present disclosure, by having at least one processor (150) execute instructions or program code of a grayscale correction module (146), the electronic device (100) can obtain a plurality of corrected images by correcting the grayscale of each of a plurality of input images based on a grayscale correction coefficient. The electronic device (100) can obtain a plurality of corrected images by multiplying a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of input images by the grayscale of a plurality of target pixels included in each of a plurality of input images.

[0162] In one embodiment of the present disclosure, at least one processor (150) may be configured to control a series of processes to operate an electronic device (100) according to the embodiments described below, and may be composed of one or more processors.

[0163] In one embodiment of the present disclosure, at least one processor (150) may be composed of at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), a Communication Processor (CP), a Neural Processing Unit, or an AI-dedicated processor designed with a hardware structure specialized for the learning and processing of an artificial intelligence model (AI), but is not limited thereto.

[0164] In one embodiment of the present disclosure, if one or more processors included in at least one processor (150) are artificial intelligence dedicated processors, said artificial intelligence dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0165] In one embodiment of the present disclosure, at least one processor (150) may be composed of a circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC).

[0166] In one embodiment of the present disclosure, at least one processor (150) can execute various types of modules stored in memory (140). At least one processor (150) can execute at least one instruction constituting various types of modules stored in memory (140). By executing a program or at least one instruction stored in memory (140), at least one processor (150) can process data according to a predefined operation rule or artificial intelligence model.

[0167] In one embodiment of the present disclosure, at least one processor (150) may include a plurality of processors. In one embodiment of the present disclosure, at least one of a plurality of modules in memory (140) may be executed by any one of the plurality of processors. The remaining modules among the plurality of modules stored in memory (140) may be executed by another of the plurality of processors.

[0168] In one embodiment of the present disclosure, at least one processor (150) controls an input / output interface (160), so that the electronic device (100) can acquire a plurality of input images and a depth map from an external electronic device, etc., through the input / output interface (160).

[0169] Additionally, the electronic device (100) may provide a plurality of corrected images to an external electronic device through an input / output interface (160).

[0170] In one embodiment of the present disclosure, the input / output interface (160) may perform input / output operations with an external electronic device using at least one of an input / output method including an HDMI port (High-Definition Multimedia Interface port), DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-mentioned input / output methods.

[0171] In one embodiment of the present disclosure, at least one processor (150) controls a communication interface (170), so that the electronic device (100) can perform data communication with an external server or an external electronic device.

[0172] The communication interface (170) can perform data communication with an external server or an external electronic device using at least one of the data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, Zigbee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet), WiMAX (World Interoperability for Microwave Access), SWAP (Shared Wireless Access Protocol), WiGig (Wireless Gigabit Alliance), and RF communication.

[0173] Additionally, the electronic device (100) can acquire a plurality of input images from an external electronic device or an external server through a communication interface (170). The electronic device (100) can provide a plurality of corrected images to an external electronic device or an external server through the communication interface (170).

[0174] In one embodiment of the present disclosure, the electronic device (100) may obtain a pre-trained artificial intelligence model included in the depth map acquisition module (141) or a pre-trained artificial intelligence model included in the color similarity map acquisition module (143) from an external server or an external electronic device through a communication interface (170).

[0175] FIG. 3 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0176] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of acquiring a plurality of input images, each corresponding to a plurality of display areas and including a plurality of pixels.

[0177] In step S100, the electronic device (100) may acquire a plurality of input images from an external electronic device through an input / output interface (160), or acquire a plurality of input images from an external electronic device or an external server through a communication interface (170).

[0178] In one embodiment of the present disclosure, the method of operation of an electronic device (100) may include the step (S200) of obtaining a depth map including depth values ​​for a plurality of input images or a color similarity map indicating color differences between a plurality of input images.

[0179] In step S200, the electronic device (100) can acquire a depth map including depth values ​​for a plurality of input images through a depth map acquisition module (141). In one embodiment of the present disclosure, the electronic device (100) can acquire a depth map including depth values ​​of a plurality of pixels included in each of the plurality of input images by providing a plurality of input images as input data to the depth map acquisition module (141).

[0180] However, the present disclosure is not limited thereto, and the electronic device (100) may acquire a depth map including depth values ​​for a plurality of input images together with a plurality of input images in step S100.

[0181] In step S200, the electronic device (100) can acquire a color similarity map that indicates the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images based on a plurality of input images through a color similarity map acquisition module (143).

[0182] In one embodiment of the present disclosure, the operation of the electronic device (100) acquiring a depth map and the operation of acquiring a color similarity map may be performed at different stages.

[0183] In one embodiment of the present disclosure, the method of operation of an electronic device (100) may include the step (S300) of obtaining a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of a plurality of display regions among a plurality of pixels for each of a plurality of input images, based on at least one of a depth map or a color similarity map.

[0184] In step S300, the electronic device (100) can obtain a grayscale correction coefficient based on a depth map. The electronic device (100) can obtain a grayscale correction coefficient based on a color similarity map. The electronic device (100) can obtain a grayscale correction coefficient based on a depth map and a color similarity map.

[0185] In step S300, the electronic device (100) can determine multiple compensation areas adjacent to the boundaries of each of the multiple display areas among the multiple display areas of the display (110) through the compensation area determination module (142). The electronic device (100) can determine the width or area of ​​the multiple compensation areas adjacent to the boundaries of each of the multiple display areas among the multiple display areas of the display (110) through the compensation area determination module (142).

[0186] However, the present disclosure is not limited thereto, and the widths or areas of the plurality of compensation regions may already be determined. The ratio between the width of each display region in the direction in which each of the plurality of display regions intersects and the width of the compensation region included in each display region may already be determined.

[0187] Hereinafter, the description of the multiple compensation areas will be described in FIGS. 7 to 19.

[0188] In step S300, the electronic device (100) can obtain a grayscale correction coefficient to correct the grayscale of a plurality of target pixels displayed in a plurality of compensation regions through a grayscale correction coefficient acquisition module (145).

[0189] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to a plurality of target pixels included in each of a plurality of input images.

[0190] In one embodiment of the present disclosure, a plurality of pixel gradation correction coefficients may include at least one of a pixel gradation correction coefficient set to lower the gradation of a specific target pixel among a plurality of target pixels, a pixel gradation correction coefficient set to maintain the gradation of a specific target pixel among a plurality of target pixels, a pixel gradation correction coefficient set to make the gradation of a specific target pixel among a plurality of target pixels become "0", or a pixel gradation correction coefficient set to raise the gradation of a specific target pixel among a plurality of target pixels.

[0191] In one embodiment of the present disclosure, the grayscale of a corresponding target pixel may be corrected to be lowered, maintained, or raised according to the value of each of the plurality of pixel grayscale correction coefficients.

[0192] In one embodiment of the present disclosure, the method by which a pixel gradation correction coefficient corrects the gradation of a target pixel may be determined according to the depth value of the target pixel, the color difference between the target pixel and adjacent pixels, or the binocular angle of a user (300) viewing the electronic device (100).

[0193] Hereinafter, the grayscale correction coefficients will be described in FIGS. 5 to 19.

[0194] In one embodiment of the present disclosure, step S300 is illustrated as performing both the operation of determining a plurality of compensation regions among a plurality of display regions and the operation of obtaining a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels, but the present disclosure is not limited thereto. It is obvious that the operation of determining a plurality of compensation regions among a plurality of display regions and the operation of obtaining a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels may be performed in separate steps.

[0195] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S400) of correcting each of the plurality of input images based on a grayscale correction coefficient and displaying the obtained plurality of corrected images in a plurality of display areas.

[0196] In step S400, the electronic device (100) can obtain a plurality of corrected images by correcting each of the plurality of input images based on a grayscale correction coefficient through the grayscale correction module (146). The electronic device (100) can display the obtained plurality of corrected images on a plurality of display areas of the display (110).

[0197] In one embodiment of the present disclosure, a plurality of correction images may have a grayscale of a plurality of target pixels included in a plurality of compensation regions that has been changed compared with a plurality of input images.

[0198] In one embodiment of the present disclosure, in step S400, each of the plurality of input images is corrected based on a grayscale correction coefficient to obtain a plurality of corrected images, and the obtained plurality of corrected images are each displayed in a plurality of display areas of the display (110), but the present disclosure is not limited thereto.

[0199] Of course, the operation of correcting each of the multiple input images based on a grayscale correction coefficient to obtain multiple corrected images, and the operation of displaying the obtained multiple corrected images in each of the multiple display areas of the display (110) may be performed in separate steps.

[0200] FIG. 4 is a drawing for explaining a plurality of input images corresponding to each of a plurality of display areas according to an embodiment of the present disclosure. FIG. 5 is a drawing for explaining an operation to correct the grayscale of a plurality of target pixels displayed in a plurality of compensation areas and a plurality of compensation areas according to an embodiment of the present disclosure.

[0201] Referring to FIGS. 1, FIGS. 2 and FIGS. 4, in one embodiment of the present disclosure, FIG. 4 shows a first input image (400) corresponding to the left eye and a second input image (410) corresponding to the right eye.

[0202] In one embodiment of the present disclosure, the first input image (400) may include a first object (401), a second object (402), and a third object (403). In this case, the third object (403) may have a depth value of "0". The third object (403) may represent the background of the first input image (400).

[0203] In one embodiment of the present disclosure, the first object (401) and the second object (402) may have a non-zero value. The first object (401) may have a depth value greater than zero, and the depth value of the second object (402) may be greater than the depth value of the first object (401).

[0204] In one embodiment of the present disclosure, the second input image (410) may include a fourth object (411), a fifth object (412), and a sixth object (413). In this case, the sixth object (413) may have a depth value of "0". The sixth object (413) may represent the background of the second input image (410).

[0205] In one embodiment of the present disclosure, the fourth object (411) and the fifth object (412) may have a non-zero value. The fourth object (411) may have a depth value greater than zero, and the depth value of the fifth object (412) may be greater than the depth value of the fourth object (411).

[0206] In one embodiment of the present disclosure, the first object (401) and the fourth object (411) may represent the same object. The depth value of the first object (401) and the depth value of the fourth object (411) may be the same. The second object (402) and the fifth object (412) may represent the same object. The depth value of the second object (402) and the depth value of the fifth object (412) may be the same. The third object (403) and the sixth object (413) may represent the same object. Both the third object (403) and the sixth object (413) may have a depth value of "0".

[0207] In one embodiment of the present disclosure, the position of the first object (401) in the first input image (400) and the position of the second object (411) in the second input image (410) may be different. When comparing the first input image (400) and the second input image (410), the first object (401) in the first input image (400) may be positioned by moving relatively to the right compared to the position of the object represented by the first object (401) and the fourth object (411). The fourth object (411) in the second input image (410) may be positioned by moving relatively to the left compared to the position of the object represented by the first object (401) and the fourth object (411).

[0208] In one embodiment of the present disclosure, a user (300) can acquire a first object (401) that is relatively to the right within a first input image (400) through the left eye, and acquire a second object (411) that is relatively to the left within a second input image (410) through the right eye. Through this, the user (300) can perceive the three-dimensionality of the objects represented by the first object (401) and the fourth object (411) through binocular parallax. The user (300) can perceive that the objects represented by the first object (401) and the fourth object (411) are located closer to the user (300) than to the display (110).

[0209] In one embodiment of the present disclosure, the position of the second object (402) in the first input image (400) and the position of the fifth object (412) in the second input image (410) may be different. When comparing the first input image (400) and the second input image (410), the second object (402) in the first input image (400) may be positioned by moving relatively to the right compared to the position of the object represented by the second object (402) and the fifth object (412). The fifth object (412) in the second input image (410) may be positioned by moving relatively to the left compared to the position of the object represented by the second object (402) and the fifth object (412).

[0210] In one embodiment of the present disclosure, a user (300) can acquire a second object (402) that is relatively to the right within a first input image (400) through the left eye, and acquire a fifth object (412) that is relatively to the left within a second input image (410) through the right eye. Through this, the user (300) can perceive the three-dimensionality of the objects represented by the second object (402) and the fifth object (412) through binocular parallax. The user (300) can perceive that the objects represented by the second object (402) and the fifth object (412) are located closer to the user (300) than to the display (110).

[0211] In one embodiment of the present disclosure, the degree to which the first object (401) and the second object (402) are each shifted to the right within the first input image (400) may vary depending on the depth value of the first object (401) and the depth value of the second object (402). Since the depth value of the second object (402) is greater than the depth value of the first object (401), the degree to which the second object (402) is shifted to the right within the first input image (400) may be greater than the degree to which the first object (401) is shifted to the right.

[0212] In one embodiment of the present disclosure, the degree to which the fourth object (411) and the fifth object (412) are each shifted to the left within the second input image (410) may vary depending on the depth value of the fourth object (411) and the depth value of the fifth object (412). Since the depth value of the fifth object (412) is greater than the depth value of the fourth object (411), the degree to which the fifth object (412) is shifted to the right within the second input image (410) may be greater than the degree to which the fourth object (411) is shifted to the right.

[0213] Accordingly, the three-dimensionality of the objects represented by the second object (402) and the fifth object (412) perceived by the user (300) may be greater than the three-dimensionality of the objects represented by the first object (401) and the fourth object (411). The user (300) may perceive that the objects represented by the second object (402) and the fifth object (412) are closer to the user (300) than the objects represented by the first object (401) and the fourth object (411).

[0214] In FIG. 4, the first object (401), the second object (402), the fourth object (411), and the fifth object (412) are described as having depth values ​​greater than "0", but the present disclosure is not limited thereto. The first object (401), the second object (402), the fourth object (411), and the fifth object (412) may each have depth values ​​less than "0". In this case, the greater the absolute value of the object's depth value, the greater the degree of displacement to the right in the first input image (400) and the degree of displacement to the left in the second input image (410). The greater the absolute value of the object's depth value, the user (300) may perceive that the object is located further away from the user (300) than from the display (110).

[0215] For the sake of convenience of explanation, multiple input images will be described as containing objects with a depth value of "0" or objects with a depth value greater than "0".

[0216] Referring to FIGS. 2, FIGS. 4 and FIGS. 5, in one embodiment of the present disclosure, FIG. 5 illustrates an optical layer (120) and a display (110). In one embodiment of the present disclosure, the electronic device (100) may further include a light transmission layer (111). In one embodiment of the present disclosure, the light transmission layer (111) may be located between the optical layer (120) and the display (110).

[0217] In one embodiment of the present disclosure, the display (110), the light transmission layer (111), and the optical layer (120) may be arranged sequentially in a third direction (30).

[0218] In one embodiment of the present disclosure, the light transmission layer (111) can transmit a plurality of input images displayed on the display (110) to the optical layer (120). In one embodiment of the present disclosure, the light transmission layer (111) may include an optically transparent insulating material. The light transmission layer (111) may include glass, a polymer, or an optical fiber, and is not limited to any one of these. The light transmission layer (111) may have a single layer or a multilayer structure.

[0219] In one embodiment of the present disclosure, FIG. 5 shows a light transmission layer (111) as a layer separated from the display (110) and the optical layer (120). However, the present disclosure is not limited thereto, and the light transmission layer (111) may be formed as a single layer with the display (110) or as a single layer with the optical layer (120). Furthermore, the light transmission layer (111) may be omitted.

[0220] In one embodiment of the present disclosure, the optical layer (120) may include a plurality of lenses (121). Each of the plurality of lenses (121) may include two view regions.

[0221] In one embodiment of the present disclosure, the display (110) may include a first display area (520) and a second display area (530) corresponding to two view areas, respectively. The display (110) may include the first display area (520) and the second display area (530) alternately. Each of the first display area (520) and the second display area (530) may include a plurality of pixels.

[0222] In one embodiment of the present disclosure, a first input image (400) may be displayed in a first display area (520). A first input image (541) refracted through a lens included in an optical layer (120) via a light transmission layer (111) may be provided to the user's left eye (540).

[0223] In one embodiment of the present disclosure, a second input image (410) may be displayed in a second display area (530). A second input image (551) refracted through a lens included in an optical layer (120) via a light transmission layer (111) may be provided to the user's right eye (550).

[0224] In one embodiment of the present disclosure, a portion of the refracted first input image (541) may be provided to the user's right eye (550). Specifically, an image displayed in a boundary area of ​​the first display area (520) of the first input image (400) may be refracted through a lens included in the optical layer (120) and then unintentionally provided to the user's right eye (550).

[0225] In one embodiment of the present disclosure, a portion of the refracted second input image (551) may be provided to the user's left eye (540). Specifically, an image displayed in a boundary area of ​​the first display area (530) of the second input image (410) may be refracted through a lens included in the optical layer (120) and then unintentionally provided to the user's left eye (540).

[0226] Crosstalk may be perceived by the user (300) by a portion of the refracted first input image (541) provided to the user's right eye (550) and a portion of the refracted second input image (551) provided to the user's left eye (540).

[0227] Accordingly, the electronic device (100) of the present disclosure may lower the grayscale of an image displayed in a boundary area of ​​a first display area (520) of a first input image (400), or correct the grayscale of the image to "0". The electronic device (100) may lower the grayscale of an image displayed in a boundary area of ​​a second display area (530) of a second input image (410), or correct the grayscale of the image to "0".

[0228] In one embodiment of the present disclosure, the electronic device (100) may set a boundary area among the first display area (520) as a first compensation area (521). Here, "boundary" may refer to the outer edge of each display area, which is an area that touches other adjacent display areas. The first compensation area (520) may be an area adjacent to the boundary of the first display area (520). The first compensation area (520) may be an area that includes the boundary of the first display area (520).

[0229] In one embodiment of the present disclosure, the electronic device (100) may set a boundary area of ​​the second display area (530) as a second compensation area (531). The second compensation area (531) may be an area adjacent to the boundary of the second display area (530). The second compensation area (531) may be an area including the boundary of the second display area (530).

[0230] In one embodiment of the present disclosure, the first input image (400) may include a plurality of pixels. Among the plurality of pixels included in the first input image (400), the pixels displayed in the first compensation area (521) may be referred to as a plurality of target pixels. The electronic device (100) may lower the gradation of the plurality of target pixels in the first input image (400) or correct the gradation to "0" and display them.

[0231] In one embodiment of the present disclosure, the second input image (410) may include a plurality of pixels. Among the plurality of pixels included in the second input image (410), the pixels displayed in the second compensation area (531) may be referred to as a plurality of target pixels. The electronic device (100) may lower the gradation of the plurality of target pixels in the second input image (410) or correct the gradation to "0" and display them.

[0232] By doing so, the electronic device (100) can reduce the gradation of the image that may be incorrectly provided to the user's left eye (540) and right eye (550), respectively, or correct it to "0" and provide it, thereby minimizing crosstalk visible to the user (300) due to the incorrectly provided image.

[0233] FIG. 6 is a flowchart illustrating an operation for obtaining a plurality of sub-depth maps and a plurality of sub-gradation correction coefficients corresponding to each of a plurality of input images according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.

[0234] Referring to FIGS. 2, FIGS. 3 and FIGS. 6, in one embodiment of the present disclosure, the step (S200) of obtaining at least one of a depth map or a color similarity map may include the step (S210) of obtaining a plurality of sub-depth maps corresponding to each of a plurality of input images.

[0235] In step S210, the electronic device (100) can acquire a plurality of sub-depth maps corresponding to each of a plurality of input images through a depth map acquisition module (141). Each of the plurality of sub-depth maps may include depth values ​​of a plurality of pixels included in a corresponding input image among the plurality of input images.

[0236] However, the present disclosure is not limited thereto, and the electronic device (100) may acquire a plurality of sub-depth maps corresponding to each of a plurality of input images through an input / output interface (160) and a communication interface (170).

[0237] In one embodiment of the present disclosure, a plurality of input images may include a first input image and a second input image, and a plurality of sub-depth maps may include a first sub-depth map corresponding to the first input image and a second sub-depth map corresponding to the second input image.

[0238] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S310) of obtaining a plurality of sub-grainscale correction coefficients for correcting the grayscales of a plurality of target pixels included in each of a plurality of input images based on each of a plurality of sub-depth maps.

[0239] In step S310, the electronic device (100) can acquire a plurality of sub-gradation correction coefficients for correcting the gradations of a plurality of target pixels included in each of a plurality of input images based on each of a plurality of sub-depth maps through a gradation correction coefficient acquisition module (145).

[0240] In one embodiment of the present disclosure, a plurality of sub-gradation correction coefficients may include a first sub-gradation correction coefficient corresponding to a first sub-depth map and a second sub-gradation correction coefficient corresponding to a second sub-depth map. The first sub-gradation correction coefficient may include a plurality of first pixel gradation correction coefficients corresponding to each of a plurality of target pixels included in a first input image. The second sub-gradation correction coefficient may include a plurality of second pixel gradation correction coefficients corresponding to each of a plurality of target pixels included in a second input image.

[0241] In one embodiment of the present disclosure, the step (S400) of displaying a plurality of corrected images in a plurality of display areas may include the step (S410) of obtaining a plurality of corrected images by correcting each of a plurality of input images based on each of a plurality of sub-gradation correction coefficients.

[0242] In step S410, the electronic device (100) can obtain multiple corrected images by correcting each of the multiple input images based on each of the multiple sub-gradation correction coefficients through the gradation correction module (146).

[0243] In one embodiment of the present disclosure, the step (S400) of displaying a plurality of correction images in a plurality of display areas may include the step (S420) of displaying a plurality of correction images in a plurality of display areas.

[0244] In step S420, the electronic device (100) can control the display (110) to display a plurality of correction images in a plurality of display areas.

[0245] However, the present disclosure is not limited thereto, and the operation of step S410 and the operation of step S420 may be performed in a single step.

[0246] FIG. 7 is a flowchart illustrating an operation to obtain a pixel gradation correction coefficient such that the degree of gradation correction of a target pixel varies according to the depth values ​​of a plurality of target pixels according to an embodiment of the present disclosure. FIG. 8 is a diagram illustrating that the degree of gradation correction of a target pixel varies according to the depth values ​​of a plurality of target pixels according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.

[0247] Referring to FIGS. 2, FIGS. 3 and FIGS. 7, in one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step of identifying the depth value of any one of a plurality of target pixels included in each input image based on a depth map.

[0248] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S320) of obtaining a plurality of pixel grayscale correction coefficients such that as the depth value of one of a plurality of target pixels increases, the degree of lowering the grayscale of the first target pixel increases based on a depth map.

[0249] In one embodiment of the present disclosure, among a plurality of target pixels, the greater the depth value of the target pixel, the greater the degree to which crosstalk is perceived by the user (300). Accordingly, the electronic device (100) may increase the degree to which the gradation of the target pixel having a large depth value among the plurality of target pixels is lowered, and decrease the degree to which the gradation of the target pixel having a small depth value among the plurality of target pixels is lowered. At this time, the magnitude of the depth value may refer to the magnitude of the absolute value of the depth value.

[0250] In one embodiment of the present disclosure, the operation of correcting the grayscale of a target pixel can be performed by multiplying the grayscale of the target pixel by a pixel grayscale correction coefficient.

[0251] Accordingly, when the magnitude of the pixel gradation correction factor is "1", the gradation of the target pixel corrected using that correction factor can be maintained. When the magnitude of the pixel gradation correction factor is less than "1", the gradation of the target pixel corrected using that correction factor may be lowered. As the magnitude of the pixel gradation correction factor approaches "0", the degree to which the gradation of the target pixel corrected using that correction factor is lowered may increase. As the magnitude of the pixel gradation correction factor increases beyond "1", the degree to which the gradation of the target pixel corrected using that correction factor is raised may increase.

[0252] In step S320, the electronic device (100) can acquire a pixel gradation correction coefficient corresponding to a first target pixel through a gradation correction coefficient acquisition module (145) such that as the depth value of one of the plurality of target pixels increases, the degree of lowering the gradation of the first target pixel increases. The electronic device (100) can acquire a pixel gradation correction coefficient corresponding to a first target pixel through a gradation correction coefficient acquisition module (145) such that as the depth value of one of the plurality of target pixels decreases, the degree of lowering the gradation of the first target pixel decreases.

[0253] Accordingly, the size of the pixel gradation correction coefficient corresponding to one of the multiple target pixels with a large depth value may be smaller than the size of the pixel gradation correction coefficient corresponding to one of the target pixels with a small depth value.

[0254] However, the present disclosure is not limited thereto, and the electronic device (100) may perform a correction to increase the grayscale of a target pixel based on the difference in grayscale between an object and a background, so that when the grayscale of the object is equal to or lower than the grayscale of the background, the degree to which crosstalk is perceived by the user (300) is reduced.

[0255] In this case, the electronic device (100) may obtain a pixel gradation correction coefficient such that the degree to which the gradation of the target pixel is increased increases as the depth value of the target pixel among the plurality of target pixels increases.

[0256] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S330) of obtaining a plurality of pixel grayscale correction coefficients such that the grayscale of a second target pixel is maintained as the depth value of any one of a plurality of target pixels is identified to be less than or equal to a reference correction value based on a depth map.

[0257] In step S330, the electronic device (100) can acquire a pixel gradation correction coefficient corresponding to the second target pixel through the gradation correction coefficient acquisition module (145) so that the gradation of the second target pixel is maintained without change, as the depth value of any one of the plurality of target pixels is identified as being equal to the reference correction value or as being smaller than the reference correction value.

[0258] In one embodiment of the present disclosure, steps S320 and S330 may be performed after step S200. Although steps S320 and S330 are illustrated as distinct operations, the present disclosure is not limited thereto. It is understood that the operation of step S320 and the operation of step S330 may be performed in a single step. In one embodiment of the present disclosure, the operation of step S400 may be performed after steps S320 and S330.

[0259] Referring to FIGS. 4, FIGS. 5, FIGS. 7 and FIGS. 8, in one embodiment of the present disclosure, FIG. 8 shows an input image (800), a display (110), a light transmission layer (111), and an optical layer (120).

[0260] In one embodiment of the present disclosure, the optical layer (120) includes a plurality of lenses, and each of the plurality of lenses may include two view regions.

[0261] In one embodiment of the present disclosure, the display (110) may include a first display area (520) corresponding to a first view area and a second display area (530) corresponding to a second view area. In one embodiment of the present disclosure, the first display area (520) may include a first compensation area (521), and the second display area (530) may include a second compensation area (531).

[0262] In one embodiment of the present disclosure, the input image (800) shown in FIG. 8 may be one of a plurality of input images.

[0263] In one embodiment of the present disclosure, FIG. 8 is illustrated as showing an input image (800) displayed in a first display area (520) and a second display area (530) for convenience of explanation, but the present disclosure is not limited thereto. It is obvious that a first input image (400) may be displayed in the first display area (520) and a second input image (410) may be displayed in the second display area (530).

[0264] In one embodiment of the present disclosure, FIG. 8 illustrates that, based on a depth map, the degree to which the gradation of a compensation pixel displayed in a compensation area included in each display area is corrected varies according to the depth value of each of the plurality of target pixels included in the input image (800).

[0265] In one embodiment of the present disclosure, the input image (800) includes a first target pixel (810), a second target pixel (820), and a third target pixel (830). The first target pixel (810), the second target pixel (820), and the third target pixel (830) may each be a pixel included in the image displayed in the compensation area of ​​the input image (800).

[0266] In one embodiment of the present disclosure, the first target pixel (810) may have a depth value less than or equal to a reference correction value, for example, "0". Accordingly, the gradation of the corrected first target pixel (840) displayed in the first compensation area (521) and the second compensation area (531), respectively, may be the same as the gradation of the first target pixel (810).

[0267] In one embodiment of the present disclosure, the second target pixel (820) may have a depth value greater than the reference correction value, for example, a value greater than "0". Accordingly, the gradation of the corrected second target pixel (841) displayed in the first compensation area (521) and the second compensation area (531), respectively, may be corrected to be lower than the gradation of the second target pixel (820).

[0268] In one embodiment of the present disclosure, the third target pixel (820) may have a depth value greater than a reference correction value, for example, a value greater than "0". The depth value of the third target pixel (820) may be greater than the depth value of the second target pixel (820). Accordingly, the grayscale of the corrected third target pixel (842) displayed in the first compensation area (521) and the second compensation area (531), respectively, may be corrected to be lower than the grayscale of the third target pixel (830).

[0269] At this time, the degree to which the gradation of the corrected third target pixel (842) is lower than the gradation of the third target pixel (830) may be greater than the degree to which the gradation of the corrected second target pixel (841) is lower than the gradation of the second target pixel (820).

[0270] Accordingly, the electronic device (100) of the present disclosure can minimize crosstalk visibility to the user (300) by varying the degree of correction of the grayscale of the target pixels according to the depth values ​​of the target pixels included in the compensation area where crosstalk can be visible.

[0271] In addition, the electronic device (100) of the present disclosure can prevent the brightness or color tone of the overall image (200) from being unnecessarily changed by not lowering the gradation of pixels where crosstalk does not occur.

[0272] At this time, the width and area of ​​the first compensation area (521) within the first display area (520) and the width and area of ​​the second compensation area (531) within the second display area (530) may be predetermined. However, the present disclosure is not limited thereto, and it is understood that the width and area of ​​each of the first compensation area (521) and the second compensation area (531) may also be set differently depending on the depth value of the target pixel being displayed.

[0273] FIG. 9 is a drawing for explaining the arrangement of a plurality of view regions, a plurality of display regions and a plurality of compensation regions according to one embodiment of the present disclosure.

[0274] Referring to FIGS. 1, FIGS. 5 and FIGS. 9, in one embodiment of the present disclosure, FIG. 9 shows an optical layer (900) viewed from a third direction (30) and a display (110) placed below the optical layer (900).

[0275] In one embodiment of the present disclosure, the optical layer (900) may include a plurality of lenses arranged obliquely with respect to the display (110). In one embodiment of the present disclosure, the first region (910) is a region indicated to describe one of the plurality of lenses.

[0276] In one embodiment of the present disclosure, the second region (920) is a region indicated to describe two view regions included in each lens. Each lens includes two view regions, and the two view regions may also be positioned obliquely with respect to the display (110).

[0277] In one embodiment of the present disclosure, two view regions may be arranged to intersect each other across a plurality of lenses. In one embodiment of the present disclosure, since each of the plurality of lenses is arranged obliquely, the two view regions may also be arranged to intersect each other in a first direction (10) or a second direction (20).

[0278] In one embodiment of the present disclosure, a plurality of display regions corresponding to each view region may include a plurality of compensation regions. A compensation region included in any one display region may be a region set to be adjacent to the boundary of the corresponding display region. In this case, "boundary" may refer to the part where the corresponding display region and other surrounding display regions corresponding to the second view region meet when the corresponding display region is a display region corresponding to the first view region.

[0279] In one embodiment of the present disclosure, a first display area corresponding to a first view area included in one lens may each come into contact with a second display area corresponding to a second view area included in the lens and a third display area corresponding to a second view area included in another lens.

[0280] In one embodiment of the present disclosure, the first display area may include a first compensation area (911) set as an area adjacent to the part where the first display area and the second display area meet, and a second compensation area (921) set as an area adjacent to the part where the first display area and the third display area meet.

[0281] In one embodiment of the present disclosure, each of the plurality of display areas may include two compensation areas.

[0282] In one embodiment of the present disclosure, the width or area of ​​the first compensation area (911) and the second compensation area (921) within each display area may be pre-set.

[0283] In this case, "width" may refer to the diameter of the hemispherical cross-section when each of the plurality of lenses has a cylindrical shape with a hemispherical cross-section. However, the present disclosure is not limited thereto, and the distance between the center points of two adjacent lenses may also be referred to as the width.

[0284] In one embodiment of the present disclosure, when the width of a display area in the second direction (20) is referred to as the reference width (930), the sum of the width of the first compensation area (911) and the width of the second compensation area (921) in the second direction (20) included in the display area may be set to 0.2 times the reference width (930).

[0285] In one embodiment of the present disclosure, the first compensation area (911) and the second compensation area (921) may be set to have the same width in the second direction (20), in which case the width of each compensation area in the second direction (20) may be set to 0.1 times the reference width (930).

[0286] Additionally, the present disclosure is not limited thereto, but when the area of ​​any one display area is referred to as the reference area, the sum of the area of ​​the first compensation area and the area of ​​the second compensation area included in the one display area may be set to 0.2 times the reference area. At this time, the first compensation area (911) and the second compensation area (921) may be set to have the same area, and in this case, the area of ​​each compensation area may be set to 0.1 times the reference area.

[0287] However, at this time, 0.2 times is an arbitrarily set value, and it goes without saying that it may be set differently, such as 0.1 times, 0.3 times, etc., depending on the size and resolution of the display (110), the size and shape of the lens included in the optical layer (900), and the brightness of the input image to be displayed on the display (110).

[0288] FIG. 10 is a flowchart illustrating an operation to obtain a pixel gradation correction coefficient such that the gradation of a target pixel having a depth value greater than a preset reference correction value among a plurality of target pixels becomes 0, according to an embodiment of the present disclosure. FIG. 11 is a diagram illustrating that a compensation area for correcting the gradation of a target pixel changes according to the depth values ​​of a plurality of target pixels according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps and configurations identical to those described in FIG. 3 and FIG. 8, and redundant descriptions are omitted.

[0289] Referring to FIGS. 2, FIGS. 3, FIGS. 7 and FIGS. 10, in one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step of identifying the depth value of any one of a plurality of target pixels included in each input image based on a depth map.

[0290] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S340) of obtaining a plurality of pixel grayscale correction coefficients such that the grayscale of one target pixel becomes "0" as the depth value of one of a plurality of target pixels is identified as greater than a preset reference correction value based on a depth map.

[0291] In step S340, the electronic device (100) can obtain a pixel gradation correction coefficient to correct the gradation of a target pixel to "0" through the gradation correction coefficient acquisition module (145) as the depth value of one of the target pixels is identified as being greater than the reference correction value.

[0292] In one embodiment of the present disclosure, the electronic device (100) can obtain a pixel gradation correction coefficient corresponding to a target pixel, which is set to have a size of "0", as the depth value of any one of a plurality of target pixels is identified as being greater than a reference correction value.

[0293] In one embodiment of the present disclosure, as the depth value of any one of a plurality of target pixels is identified as being equal to or smaller than a reference correction value based on a depth map, the method of operation of the electronic device (100) can perform step S330.

[0294] In one embodiment of the present disclosure, step S340 may be performed after step S200. In one embodiment of the present disclosure, the operation of step S400 may be performed after step S340.

[0295] Referring to FIGS. 8, FIGS. 9, FIGS. 10 and FIGS. 11, in one embodiment of the present disclosure, FIG. 11 shows an input image (800), a display (110), a light transmission layer (111), and an optical layer (120).

[0296] In one embodiment of the present disclosure, a plurality of lenses included in the optical layer (120) may each include a first view area and a second view area. The display (110) may include a first display area (520) and a second display area (530).

[0297] In one embodiment of the present disclosure, FIG. 11 illustrates that, based on a depth map, it is determined whether the grayscale of a compensation pixel displayed in a compensation area included in each display area is corrected to "0" according to the depth value of each of the plurality of target pixels included in the input image (800). FIG. 11 also illustrates that the width or area of ​​a compensation area included in each display area varies according to the depth value of each of the plurality of target pixels included in the input image (800).

[0298] In one embodiment of the present disclosure, the first target pixel (810) may have a depth value equal to or smaller than the reference correction value, for example, "0". Accordingly, the first target pixel (810) may be displayed as is in the first display area (520) and the second display area (530) without the grayscale being corrected.

[0299] Accordingly, the first display area (520) and the second display area (530) may each not include a compensation area. As the depth value of the first target pixel (810) is equal to or smaller than the reference correction value, for example, "0", the display area may not include a compensation area.

[0300] In one embodiment of the present disclosure, the second target pixel (820) may have a depth value greater than the reference correction value, for example, a value greater than "0". Accordingly, the grayscale of the corrected second target pixel (1113) displayed in each of the first compensation area (1111) included in the first display area (520) and the second compensation area (1112) included in the second display area (530) may be "0".

[0301] In one embodiment of the present disclosure, the third target pixel (830) may have a depth value greater than the reference correction value, for example, a value greater than "0". The depth value of the third target pixel (830) may be greater than the depth value of the second target pixel (820). Accordingly, the grayscale of the corrected third target pixel (1114) displayed in the third compensation area (1121) included in the first display area (520) and the fourth compensation area (1122) included in the second display area (530), respectively, may be "0".

[0302] At this time, the width of each of the third compensation area (1121) and the fourth compensation area (1122) may be greater than the width of each of the first compensation area (1111) and the second compensation area (1112). In one embodiment of the present disclosure, the sum of the widths of the compensation areas in the second direction (20) included in any one display area may be set to increase as the depth value of the target pixel displayed in the corresponding compensation area increases. At this time, the magnitude of the depth value may refer to the magnitude of the absolute value of the depth value.

[0303] Additionally, the present disclosure is not limited thereto, and the area of ​​each of the third compensation area (1121) and the fourth compensation area (1122) may be larger than the area of ​​each of the first compensation area (1111) and the second compensation area (1112).

[0304] Accordingly, the electronic device (100) of the present disclosure can minimize crosstalk visibility to the user (300) by correcting the grayscale of the target pixels included in the compensation area to "0" when the target pixels included in the compensation area have a value greater than the reference correction value, for example, a depth value other than "0", so that crosstalk can be visible.

[0305] Additionally, the electronic device (100) can increase the width or area of ​​the compensation region that corrects the gradation to "0" as the absolute value of the depth value of the target pixels increases, thereby minimizing the visibility of crosstalk while preventing unnecessary changes in the brightness or color tone of the overall image (200).

[0306] FIG. 12 is a flowchart illustrating an operation to correct the grayscale of at least one luminance correction pixel among a plurality of target pixels according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.

[0307] Referring to FIGS. 2, FIGS. 3 and FIGS. 12, in one embodiment of the present disclosure, the method of operation of an electronic device (100) may include the step (S411) of obtaining a plurality of corrected images by correcting the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among a plurality of target pixels whose grayscale is corrected based on a grayscale correction coefficient so as to increase the grayscale of the at least one target pixel.

[0308] In step S411, the electronic device (100) can obtain a plurality of corrected images by correcting the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among a plurality of target pixels whose grayscale has been corrected based on a grayscale correction coefficient, through a grayscale correction module (146).

[0309] In one embodiment of the present disclosure, the overall brightness of an image (200) displayed through an electronic device (100) may be lowered by lowering the gradation of at least one target pixel among a plurality of target pixels having a depth value greater than a reference correction value, for example, having a depth value greater than "0", or by correcting it to "0".

[0310] The electronic device (100) of the present disclosure can obtain a plurality of corrected images by performing a correction that raises the grayscale of at least one luminance correction pixel adjacent to at least one target pixel with a corrected grayscale among a plurality of pixels included in a plurality of input images to prevent this.

[0311] In one embodiment of the present disclosure, at least one luminance correction pixel may be selected from among the remaining pixels that are not included in the plurality of target pixels among the plurality of pixels. That is, among the plurality of pixels included within the plurality of compensation regions, the at least one luminance correction pixel may refer to pixels adjacent to the at least one target pixel with a corrected grayscale.

[0312] At this time, adjacent pixels may refer to pixels included within a preset adjacent distance from at least one target pixel with a grayscale corrected, for example, a distance set to 0.02 times the reference width (930). However, it goes without saying that such adjacent distance may be set differently. At this time, the degree to which the grayscale of at least one luminance-corrected pixel is raised may be determined based on the degree to which the grayscale of the remaining target pixels having a depth value greater than the reference correction value among the plurality of target pixels is lowered, or the degree to which it is corrected to "0".

[0313] In one embodiment of the present disclosure, the electronic device (100) can obtain a difference between the brightness before correction, considering the grayscale before correction of all of the plurality of target pixels, and the brightness after correction, after the grayscale of at least one target pixel is lowered or corrected to "0".

[0314] In one embodiment of the present disclosure, the electronic device (100) may determine the value of a pixel gradation correction coefficient for raising the gradation of at least one luminance correction pixel based on the difference between the brightness before correction and the brightness after correction. At this time, the electronic device (100) may determine that the pixel gradation correction coefficient for raising the gradation of at least one luminance correction pixel has a larger value as the difference between the brightness before correction and the brightness after correction increases.

[0315] Through this, the electronic device (100) can prevent crosstalk from being visible to the user (300) in the image (200) and prevent the brightness of the image (200) from decreasing.

[0316] In one embodiment of the present disclosure, step S411 may be performed after step S300.

[0317] FIG. 13 is a flowchart illustrating an operation for obtaining pixel correction coefficients such that the degree of grayscale correction of a target pixel varies according to the color similarity of a plurality of target pixels between a plurality of input images according to an embodiment of the present disclosure. FIG. 14 is a diagram illustrating an operation for obtaining color similarity of a plurality of target pixels between a plurality of input images according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.

[0318] Referring to FIGS. 2, FIGS. 3, FIGS. 4 and FIGS. 13, in one embodiment of the present disclosure, the step (S200) of obtaining at least one of a depth map or a color similarity map may include the step (S220) of obtaining a color similarity map representing a color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images based on a plurality of input images.

[0319] In step S220, the electronic device (100) can acquire a color similarity map that indicates the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images based on a plurality of input images through a color similarity map acquisition module (143).

[0320] In one embodiment of the present disclosure, when a plurality of input images include a first input image (400) and a second input image (410), the electronic device (100) can compare the grayscale of each of the plurality of pixels included in the first input image (400) with the grayscale of each of the plurality of pixels included in the second input image (410) to obtain an overall color similarity map having the same resolution as the first input image (400) and the second input image (410).

[0321] In one embodiment of the present disclosure, the electronic device (100) can obtain a color similarity map having the same resolution as a plurality of target pixels included in a compensation area among the entire color similarity map.

[0322] However, the present disclosure is not limited thereto, and the electronic device (100) may compare the grayscale of each of the plurality of target pixels included in the first input image (400) with the grayscale of each of the plurality of target pixels included in the second input image (410) to obtain a color similarity map having the same resolution as the plurality of target pixels.

[0323] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S360) of obtaining a plurality of pixel grayscale correction coefficients such that, based on a color similarity map, as the color difference of one of the plurality of target pixels at a specific location increases, the degree of lowering the grayscale of one target pixel increases.

[0324] In step S360, the electronic device (100) can acquire a plurality of pixel gradation correction coefficients through a gradation correction coefficient acquisition module (145) based on a color similarity map, such that as the color difference of one of the multiple target pixels at a specific location increases, the degree to which the gradation of one target pixel is lowered increases.

[0325] In one embodiment of the present disclosure, the color similarity map may include a plurality of color similarity values ​​corresponding to a plurality of target pixels.

[0326] In one embodiment of the present disclosure, the greater the difference between the grayscale of a target pixel at a specific location included in the first input image (400) and the grayscale of a target pixel at a specific location included in the second input image (410), the smaller the color similarity value included at a specific location of the color similarity map may be.

[0327] In one embodiment of the present disclosure, the smaller the difference between the grayscale of a target pixel at a specific location included in the first input image (400) and the grayscale of a target pixel at a specific location included in the second input image (410), the larger the color similarity value included at a specific location of the color similarity map may be.

[0328] Referring to FIG. 14, in one embodiment of the present disclosure, FIG. 14 shows a portion (1400) of a first input image corresponding to the left eye and a portion (1410) of a second input image corresponding to the right eye.

[0329] In one embodiment of the present disclosure, the color similarity map may include a first color similarity value (1420) based on the grayscale of a target pixel included at a first position in the first input image (400) and the grayscale of a target pixel included at a first position in the second input image (410). The color similarity map may include a second color similarity value (1430) based on the grayscale of a target pixel included at a second position in the first input image (400) and the grayscale of a target pixel included at a second position in the second input image (410).

[0330] In one embodiment of the present disclosure, the color similarity map may include a first color similarity value (1420) at a first position and a second color similarity value (1430) at a second position.

[0331] In one embodiment of the present disclosure, the image displayed at the target pixel included at the first position of the first input image (400) and the image displayed at the target pixel included at the first position of the second input image (410) may be the same image. In one embodiment of the present disclosure, the image displayed at the first position of the first input image (400) and the second input image (410) may be an image with a depth value of "0". Accordingly, the first color similarity value (1420) may have "1".

[0332] In one embodiment of the present disclosure, the image displayed at a target pixel included at a second position of the first input image (400) and the image displayed at a target pixel included at a second position of the second input image (410) may be different images. In one embodiment of the present disclosure, the image displayed at the second position of each of the first input image (400) and the second input image (410) may be an image containing disparity for displaying an object having a depth value other than "0".

[0333] Accordingly, the second color similarity value (1420) may have a value smaller than "1". At this time, the greater the difference between the grayscale of the image displayed at the second position of the first input image (400) and the grayscale of the image displayed at the second position of the second input image (410), the smaller the second color similarity value (1430) may have.

[0334] In one embodiment of the present disclosure, the electronic device (100) can identify that the color difference of one of the target pixels at a specific location in each of the plurality of input images is greater as the color similarity value corresponding to each of the plurality of target pixels included in the color similarity map is smaller.

[0335] In one embodiment of the present disclosure, the electronic device (100) can obtain a pixel gradation correction coefficient corresponding to a target pixel such that the greater the color difference of a target pixel at a specific location among a plurality of input images, the greater the degree of lowering the gradation of the target pixel. The electronic device (100) can obtain a pixel gradation correction coefficient corresponding to a target pixel such that the smaller the color difference of a target pixel at a specific location among a plurality of input images, the smaller the degree of lowering the gradation of the target pixel.

[0336] By doing so, considering human perception characteristics such that the greater the similarity between the color of the object where crosstalk occurs and the colors of other objects around the object, the greater the degree to which crosstalk is visible, the electronic device (100) can lower the gradation of the target pixel so that crosstalk of the image (200) is minimized to be visible to the user (300), while simultaneously minimizing the decrease in brightness or change in color tone of the image (200).

[0337] FIG. 15 is a flowchart illustrating an operation to obtain pixel correction coefficients such that the degree of grayscale correction of a target pixel varies depending on the difference between a reference binocular angle and a binocular angle, according to an embodiment of the present disclosure. FIG. 16 is a diagram illustrating that the degree of grayscale correction of a target pixel varies depending on the difference between a reference binocular angle and a binocular angle, according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.

[0338] Referring to FIGS. 2, FIGS. 3 and FIGS. 15, in one embodiment of the present disclosure, a method of operation of an electronic device (100) may include a step (S230) of obtaining a binocular angle between two gaze directions based on two gaze directions corresponding to each of the two eyes of a user (300) obtained through a gaze tracking sensor (130).

[0339] In step S230, the electronic device (100) can obtain a binocular angle between two gaze directions based on two gaze directions corresponding to each of the user's (300) two eyes obtained through the gaze tracking sensor (130) via the angle identification module (144).

[0340] In one embodiment of the present disclosure, the step of obtaining a grayscale correction coefficient (S300) may include the step (S370) of obtaining a grayscale correction coefficient such that, as the difference between the reference angle and the angle increases, the degree to which the grayscale of a plurality of target pixels displayed in a plurality of compensation regions is lowered increases.

[0341] In step S370, the electronic device (100) can obtain a grayscale correction coefficient by comparing a preset reference binocular angle and a binocular angle through a grayscale correction coefficient acquisition module (145), such that the degree to which the grayscale of a plurality of target pixels displayed in a plurality of compensation regions is lowered increases as the difference between the reference binocular angle and the binocular angle increases.

[0342] Referring to FIGS. 2, FIGS. 4, FIGS. 5 and FIGS. 16, in one embodiment of the present disclosure, FIG. 16 illustrates a first case (1600) in which the distance to a third direction (30) between a user and an electronic device (100) is a first distance (1630), a second case (1610) in which the distance to a third direction (30) between a user and an electronic device (100) is a second distance (1631) longer than the first distance (1630), and a third case (1620) in which the distance to a third direction (30) between a user and an electronic device (100) is the second distance (1631) and a plurality of corrected images in which the gradation of a plurality of target pixels is corrected are displayed on a display (110).

[0343] In one embodiment of the present disclosure, the electronic device (100) may include a display (110) and an optical layer (120). Although a light transmission layer is not shown in FIG. 16, the electronic device (100) may include a light transmission layer disposed between the display (110) and the optical layer (120).

[0344] In one embodiment of the present disclosure, a first input image (400) displayed on a display (110) is refracted through a first view area (500) included in an optical layer (120), and the refracted first input image (1601) may be provided to the user's left eye (310). A second input image (410) displayed on a display (110) is refracted through a second view area (510) included in an optical layer (120), and the refracted second input image (1602) may be provided to the user's right eye (320).

[0345] In one embodiment of the present disclosure, the angle at which the first input image (400) and the second input image (410) are refracted through each of the first view area (500) and the second view area (510) can be determined according to the characteristics of the display (110) (e.g., the resolution of a plurality of pixels or the size of the pixels) and the characteristics of the optical layer (120) (e.g., the refractive index of the optical layer (120), the shape of a plurality of lenses included in the optical layer (120), and the arrangement between a plurality of lenses and a plurality of pixels).

[0346] Accordingly, the angle between the direction in which the refracted first input image (1601) moves and the direction in which the refracted second input image (1602) moves may be pre-set according to the characteristics of the display (110) and the optical layer (120), and such an angle may be referred to as the "reference binocular angle."

[0347] In one embodiment of the present disclosure, a refracted first input image (1601) and a refracted second input image (1602), respectively, may be propagated from an electronic device (100) toward the user's left eye (310) and right eye (320).

[0348] In one embodiment of the present disclosure, the average distance between two eyes in human ergonomics may be 6.5 cm. The viewing distance of the electronic device (100) may be a distance in a third direction (30) between the electronic device (100) and the user (300) for providing a refracted first input image (1601) to the user's left eye (310) and a refracted second input image (1602) to the user's right eye (320), calculated based on a reference binocular angle and the average distance between two eyes of a person.

[0349] In one embodiment of the present disclosure, FIG. 16 illustrates a first reference (1640) and a second reference (1650). The first reference (1640) and the second reference (1650) may be lines indicating the degree to which a refracted input image is provided to the user's eye.

[0350] In one embodiment of the present disclosure, the first reference (1640) may be a line indicating a case where no refracted input image is provided to the user's eye. The second reference (1650) may be a line indicating a case where all components of the refracted input image are provided to the user's eye. In one embodiment of the present disclosure, when a refracted image between the first reference (1640) and the second reference (1650) is provided to the user's eye, only some components of the refracted image may be provided to the user's eye.

[0351] In one embodiment of the present disclosure, the component of the input image may refer to the grayscale information of the input image. In one embodiment of the present disclosure, as the grayscale of each of the plurality of pixels increases, the luminance of each of the plurality of pixels may increase. Accordingly, the luminance of the input image may be proportional to the component of the input image.

[0352] Accordingly, the first criterion (1640) and the second criterion (1650) may represent the magnitude of the luminance of the refracted input image. The first criterion (1640) may represent the luminance when the refracted input image is not provided to the user's eye. The second criterion (1650) may represent the luminance when all components of the refracted input image are not provided to the user's eye. The range between the first criterion (1640) and the second criterion (1650) may represent the luminance when some components of the refracted input image are provided to the user's eye.

[0353] For the sake of convenience of explanation, it will be described below that when correcting the grayscale of an input image, the brightness of the input image changes.

[0354] In one embodiment of the present disclosure, the first case (1600) may be a case where the user (300) is located at a distance of a third direction (30) from the electronic device (100).

[0355] In one embodiment of the present disclosure, the electronic device (100) can track and obtain the gaze direction of the user's left eye (310) and right eye (320), respectively, through an eye tracking sensor (130). Based on the two obtained gaze directions, the electronic device (100) can obtain a first binocular angle (1603) between the two gaze directions.

[0356] In one embodiment of the present disclosure, the first distance (1630) may be the same as the viewing distance. In the first case (1600), the first binocular angle (1603) of the user (300) may be the same as the reference binocular angle.

[0357] In one embodiment of the present disclosure, in the first case (1600), a refracted first input image (1601) may be provided to the user's left eye (310) by a first height (1651). In one embodiment of the present disclosure, the first height (1651) may be the value of the difference between a second reference (1650) and a first reference (1640). A refracted second input image (1602) may not be provided to the user's left eye (310).

[0358] In one embodiment of the present disclosure, in the first case (1600), a refracted second input image (1602) may be provided to the user's right eye (320) by a first height (1651). A refracted first input image (1601) may not be provided to the user's right eye (320).

[0359] In one embodiment of the present disclosure, in a first case (1600) where there is no difference between the reference binocular angle and the binocular angle of the user (300), crosstalk may not be visible to the user (300). Accordingly, the electronic device (100) can obtain a grayscale correction coefficient so that the grayscale of a plurality of target pixels is maintained.

[0360] However, the present disclosure is not limited thereto, and if a minimum correction ratio is preset such that the grayscale of a plurality of target pixels is lowered, the electronic device (100) may acquire a grayscale correction coefficient such that in the first case (1600), the grayscale of a plurality of target pixels is lowered only by the minimum correction ratio. Accordingly, even if the user (300) is located at a viewing distance, crosstalk can be prevented from being visible even if another input image is provided that is refracted during the propagation process due to the characteristics of light.

[0361] In one embodiment of the present disclosure, the second case (1610) may be a case where the user (300) is located further away from the electronic device (100) in a third direction (30) than the viewing distance. In the second case (1601), the second binocular angle (1613) of the user (300) may be smaller than the reference binocular angle.

[0362] In one embodiment of the present disclosure, in the second case (1610), a refracted first input image (1601) may be provided to the user's left eye (310) by a second height (1652). A refracted second input image (1602) may be provided to the user's left eye (310) by a third height (1653). In one embodiment of the present disclosure, the second height (1652) and the third height (1653) may be values ​​between the second reference (1650) and the first reference (1640).

[0363] In one embodiment of the present disclosure, in the second case (1610), a refracted second input image (1602) may be provided to the user's right eye (320) by a second height (1652). A refracted first input image (1601) may be provided to the user's right eye (320) by a third height (1653).

[0364] In one embodiment of the present disclosure, in the second case (1610), a refracted second input image (1602) of a third height (1653) is provided to the user's left eye (310) together with a refracted first input image (1601), and a refracted first input image (1601) of a third height (1653) is provided to the user's right eye (320) together with a refracted second input image (1602), so that crosstalk can be perceived by the user (300).

[0365] In one embodiment of the present disclosure, when the distance to the third direction (30) between the electronic device (100) and the user (300) differs from the viewing distance, there may be a difference between the reference binocular angle and the binocular angle of the user (300). In one embodiment of the present disclosure, when the distance to the third direction (30) between the electronic device (100) and the user (300) is closer than the viewing distance or farther than the viewing distance, there may be a difference between the reference binocular angle and the binocular angle of the user (300).

[0366] In one embodiment of the present disclosure, as the difference between the distance to the third direction (30) and the viewing distance between the electronic device (100) and the user (300) increases, the difference between the reference binocular angle and the binocular angle of the user (300) may increase.

[0367] In one embodiment of the present disclosure, as the difference between the reference binocular angle and the binocular angle of the user (300) increases, the component of the refracted second input image provided to the user's left eye (310) and the component of the refracted first input image provided to the user's right eye (320) may increase. Accordingly, the degree of crosstalk perceived by the user (300) may also increase.

[0368] The electronic device (100) of the present disclosure can perform a correction that lowers the gradation of a plurality of target pixels included in a first compensation area (521) and a plurality of target pixels included in a second compensation area (531) when there is a difference between the reference binocular angle and the binocular angle of the user (300). The electronic device (100) can display a plurality of corrected target pixels in the first compensation area (521) and display a plurality of corrected target pixels in the second compensation area (522).

[0369] Accordingly, the components of the refracted second input image provided to the user's left eye (310) and the components of the refracted first input image provided to the user's right eye (320) are reduced, and the degree of crosstalk perceived by the user (300) can also be reduced.

[0370] In one embodiment of the present disclosure, the third case (1620) is a case where the distance to the third direction (30) between the user and the electronic device (100) is a second distance (1631), and the first corrected image in which the gradation of the first input image (400) is corrected by the electronic device (100) and the second corrected image in which the gradation of the second input image (410) is corrected are displayed on the display (110).

[0371] In one embodiment of the present disclosure, in the third case (1620), a refracted first corrected image (1611) may be provided to the user's left eye (310) by a second height (1652). A refracted second corrected image (1612) may not be provided to the user's left eye (310).

[0372] In one embodiment of the present disclosure, in the third case (1620), a refracted second corrected image (1612) may be provided to the user's right eye (320) by a second height (1652). A refracted first corrected image (1611) may not be provided to the user's right eye (320).

[0373] In one embodiment of the present disclosure, the refracted first corrected image (1611) may be an image in which the brightness is lowered by a third height (1653) compared to the refracted first input image (1601). The refracted second corrected image (1612) may be an image in which the brightness is lowered by a third height (1653) compared to the refracted second input image (1602).

[0374] Accordingly, even if the user (300) is located at a distance different from the viewing distance in the third direction (30) from the electronic device (100) and views the image (200), crosstalk may not be visible to the user (300).

[0375] FIG. 17 is a drawing for explaining that the reference binocular angle changes due to the rotation of an electronic device according to one embodiment of the present disclosure. FIG. 18 is a drawing for explaining that the degree of correction of the grayscale of a target pixel changes by reflecting the difference between the reference binocular angle and the user's binocular angle changes due to the rotation of an electronic device according to one embodiment of the present disclosure.

[0376] Referring to FIG. 1, FIG. 5 and FIG. 17, in one embodiment of the present disclosure, FIG. 17 illustrates a first viewing mode (1700) in which a plurality of lenses (1702) included in an optical layer (1701) are arranged obliquely in a direction having a difference of a first angle (1704) compared to a reference direction (1703). FIG. 17 illustrates a second viewing mode (1710) in which a plurality of lenses (1702) included in an optical layer (1701) are arranged obliquely in a direction having a difference of a second angle (1705) different from the first angle (1704) compared to a reference direction (1703).

[0377] In one embodiment of the present disclosure, the optical layer (1701) may include a plurality of lenses (1702). In one embodiment of the present disclosure, the plurality of lenses (1702) may be arranged side by side in a direction different from the reference direction (1703).

[0378] In one embodiment of the present disclosure, the first direction (10) may be a column direction in which a plurality of pixels included in the display (110) are arranged. The second direction (20) may be a row direction in which a plurality of pixels included in the display (110) are arranged. In one embodiment of the present disclosure, the reference direction (1730) may be a direction parallel to the first direction (10).

[0379] In one embodiment of the present disclosure, the first viewing mode (1700) may mean a case where the user (300) uses the electronic device (100) in a state where the length of the electronic device (100) in the second direction (20) is longer than the length of the electronic device (100) in the first direction (10). The second viewing mode (1710) may mean a case where the user (300) uses the electronic device (100) in a state where the length of the electronic device (100) in the first direction (10) is longer than the length of the electronic device (100) in the second direction (20).

[0380] However, the present disclosure is not limited thereto, and the first viewing mode (1700) and the second viewing mode (1710) may refer to viewing modes in which the angle between the reference direction (1703) and the direction in which the plurality of lenses (1702) are arranged is different from each other.

[0381] In one embodiment of the present disclosure, even when the horizontal and vertical lengths of the electronic device (100) are the same, if a user (300) rotates the electronic device (100) clockwise or counterclockwise to view an image (200), the angle between the direction in which the plurality of lenses (1702) included in the electronic device (100) are arranged and the reference direction (1703) before and after rotation may be different. In this case, the state of the electronic device (100) before rotation may be referred to as the first viewing mode (1700), and the state of the electronic device (100) after rotation may be referred to as the second viewing mode (1710).

[0382] In one embodiment of the present disclosure, a user (300) can use the electronic device (100) in a clockwise or counter-clockwise direction to use it in a first viewing mode (1700) or a second viewing mode (1710). That is, while the user (300) is watching an image (200) using the electronic device (100) in the first viewing mode (1700), the user (300) can rotate the electronic device (100) in a clockwise or counter-clockwise direction to watch the image (200) in the second viewing mode (1710).

[0383] In one embodiment of the present disclosure, when a user (300) rotates the electronic device (100) clockwise or counterclockwise, a plurality of input images may also be rotated clockwise or counterclockwise and displayed on the display (110). Accordingly, the user (300) can view the images (200) without moving their head to correspond to the rotation of the electronic device (100).

[0384] However, in one embodiment of the present disclosure, the widths of each of the plurality of lenses (1702) in each of the first viewing mode (1700) and the second viewing mode (1710) may differ from each other.

[0385] In one embodiment of the present disclosure, width may refer to the length of each of the plurality of lenses (1702) in either the first direction (10) or the second direction (20). Hereinafter, the present disclosure describes the length of each of the plurality of lenses (1702) in the second direction (20).

[0386] In one embodiment of the present disclosure, the length of the first width (1705) in the first viewing mode (1700) and the length of the second width (1707) in the second viewing mode (1710) may be different from each other. As the length of the first width (1705) and the length of the second width (1707) are different from each other, the length of the plurality of view regions included in each of the plurality of lenses (1702) in the first viewing mode (1700) to the second direction (20) and the length of the plurality of view regions included in each of the plurality of lenses (1702) in the second viewing mode (1710) to the second direction (20) may be different from each other.

[0387] Accordingly, through each of the multiple view areas, the angle at which the multiple input images displayed in the multiple display areas are refracted may differ between the first viewing mode (1700) and the second viewing mode (1710).

[0388] Specifically, as the second angle (1706) is greater than the first angle (1704), the length of the second width (1707) may be longer than the length of the first width (1705). In the second viewing mode (1710), the length to the second direction (20) of each of the plurality of view areas may be longer than the length to the second direction (20) of each of the plurality of view areas in the first viewing mode (1700).

[0389] In one embodiment of the present disclosure, depending on the light refraction characteristics, the angle between input images refracted in different directions in the second viewing mode (1710) may be greater than the angle between input images refracted in different directions in the first viewing mode (1700). Accordingly, as the electronic device (100) providing the image (200) rotates, the reference binocular angle of the electronic device (100) may change.

[0390] Referring to FIGS. 1, FIGS. 4, FIGS. 16, FIGS. 17 and FIGS. 18, in one embodiment of the present disclosure, FIG. 18 illustrates a fourth case (1800) in which a user (300) uses an electronic device (100) in a first viewing mode (1700), a fifth case (1810) in which a user (300) uses an electronic device (100) in a second viewing mode (1710), and a sixth case (1820) in which a plurality of corrected images, in which the gradation of a plurality of target pixels is corrected, are displayed on a display (110). Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 16, and redundant descriptions are omitted.

[0391] In one embodiment of the present disclosure, the electronic device (100) may include a display (110) and an optical layer (120). Although a light transmission layer is not shown in FIG. 18, the electronic device (100) may include a light transmission layer disposed between the display (110) and the optical layer (120).

[0392] In one embodiment of the present disclosure, the fourth case (1800) may be a case where the user (300) is located at a first distance (1630) and uses the electronic device (100) in a first viewing mode (1700). In the fourth case (1800), a refracted first input image (1801) may be provided to the user's left eye (310) by a first height (1651), and a refracted second input image (1802) may not be provided. Accordingly, in the fourth case (1800), crosstalk may not be visible to the user (300).

[0393] In one embodiment of the present disclosure, the fifth case (1810) may be a case where the user (300) is located at the first distance (1630) and uses the electronic device (100) in the second viewing mode (1710).

[0394] In one embodiment of the present disclosure, the reference binocular angle (1830) of the electronic device (100) in the second viewing mode (1710) may be different from the reference binocular angle (1603) of the electronic device (100) in the first viewing mode (1700). The reference binocular angle (1830) of the electronic device (100) in the second viewing mode (1710) may be larger than the reference binocular angle (1603) of the electronic device (100) in the first viewing mode (1700).

[0395] In one embodiment of the present disclosure, in the fifth case (1810), a refracted first input image (1811) may be provided to the user's left eye (310) by a fourth height (1840), and a refracted second input image (1812) may be provided by a fifth height (1841). The fourth height (1840) and the fifth height (1841) may be values ​​between the second reference (1650) and the first reference (1640). In the fifth case (1810), a refracted second input image (1812) may be provided to the user's right eye (320) by a fourth height (1840), and a refracted first input image (1811) may be provided by a fifth height (1841).

[0396] In one embodiment of the present disclosure, the position of the user (300) in the fifth case (1810) is the same as in the fourth case (1800), and the binocular angle (1603) of the user (300) may also be the same as in the fourth case (1800). However, as the reference binocular angle (1830) changes as the electronic device (100) is rotated, a difference occurs between the user's binocular angle (1603) and the reference binocular angle (1830), so that crosstalk may be visible to the user (300) in the fifth case (1810).

[0397] In one embodiment of the present disclosure, the sixth case (1820) may be a case where a user (300) is located at a first distance (1630), uses an electronic device (100) in a second viewing mode (1720), and a first corrected image in which the gradation of a first input image (400) is corrected by the electronic device (100) and a second corrected image in which the gradation of a second input image (410) is corrected are displayed on a display (110).

[0398] In one embodiment of the present disclosure, in the sixth case (1820), a refracted first corrected image (1821) may be provided to the user's left eye (310) by a fourth height (1840). A refracted second corrected image (1822) may not be provided to the user's left eye (310).

[0399] In one embodiment of the present disclosure, in the sixth case (1820), a refracted second corrected image (1822) may be provided to the user's right eye (320) by a fourth height (1840). A refracted first corrected image (1821) may not be provided to the user's right eye (320).

[0400] In one embodiment of the present disclosure, the refracted first corrected image (1821) may be an image with a brightness lowered by a fifth height (1841) compared to the refracted first input image (1811). The refracted second corrected image (1822) may be an image with a brightness lowered by a fifth height (1841) compared to the refracted second input image (1821).

[0401] Accordingly, crosstalk may not be visible even if the user (300) rotates the electronic device (100) while viewing an image (200) through the electronic device (100). In one embodiment of the present disclosure, when the user (300) rotates the electronic device (100) while using it (e.g., in a first viewing mode (1700) or a second viewing mode (1710)), the electronic device (100) of the present disclosure can prevent crosstalk from being visible to the user (300) by performing a correction that lowers the gradation of a plurality of target pixels included in a plurality of input images, without the user (300) needing to adjust the distance to a third direction (30) from the electronic device (100).

[0402] FIG. 19 is a drawing illustrating how the angle of the user's eyes changes according to the movement of the user's head, according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 16, and redundant descriptions are omitted.

[0403] Referring to FIGS. 1, FIGS. 5, FIGS. 16 and FIGS. 19, in one embodiment of the present disclosure, FIG. 19 shows an electronic device (100) and a user (300).

[0404] In one embodiment of the present disclosure, the head of a user (300) viewing an electronic device (100) may move on a plane consisting of a first direction (10) and a second direction (20). Accordingly, the distance between the eyes of the user (300) in the second direction (20) may change.

[0405] In one embodiment of the present disclosure, the distance between the eyes of the user (300) toward the second direction (20) when the head of the user (300) is positioned in a direction parallel to the first direction (10) may be referred to as the first eye distance (1900). The distance between the eyes of the user (300) toward the second direction (20) when the head of the user (300) is positioned in a direction between the first direction (10) and the second direction (20) or in a direction opposite to the first direction (10) and the second direction (20) may be referred to as the second eye distance (1910).

[0406] In one embodiment of the present disclosure, the first binocular distance (1900) may be greater than the second binocular distance (1910). Even if the distance between the third direction (30) between the user (300) and the electronic device (100) is constant, the distance between the eyes of the user (300) viewing the electronic device (100) in the second direction (20) may vary.

[0407] In one embodiment of the present disclosure, when the distance between the eyes of the user (300) is a first eye distance (1900), the angle between the gaze directions of each of the user's (300) eyes may be a first eye angle (1901). When the distance between the eyes of the user (300) is a second eye distance (1910), the angle between the gaze directions of each of the user's (300) eyes may be a second eye angle (1911). In one embodiment of the present disclosure, the second eye angle (1911) may be smaller than the first eye angle (1901).

[0408] In one embodiment of the present disclosure, even if the distance between the third direction (30) between the user (300) and the electronic device (100) is constant, the binocular angle of the user (300) may vary depending on the movement of the head of the user (300) viewing the electronic device (100). Accordingly, a difference may occur between the reference binocular angle of the electronic device (100) and the binocular angle of the user (300), so that crosstalk may be visible to the user (300).

[0409] To prevent this, in one embodiment of the present disclosure, the electronic device (100) may display a plurality of corrected images on the display (110), wherein the gradations of a plurality of target pixels included in each of the plurality of input images are corrected based on the difference between the reference binocular angle and the binocular angle of the user (300). The electronic device (100) may correct the plurality of input images and display them on the display (110) such that the degree to which the gradations of the plurality of target pixels are lowered increases as the difference between the reference binocular angle and the binocular angle of the user (300) increases.

[0410] Through this, the electronic device (100) of the present disclosure can prevent crosstalk of the image (200) from being seen by the user (300) according to the movement of the user's (300) head.

[0411] However, the present disclosure is not limited thereto. In one embodiment of the present disclosure, the angle between the eyes of the user (300) may change even when the head of the user (300) watching the image (200) moves along with the first direction (10) and the second direction (20), and also moves in the third direction (30) or the opposite direction of the third direction (30).

[0412] Additionally, when the electronic device (100) is rotated clockwise or counterclockwise in a plane consisting of a first direction (10) and a second direction (20), or when it is rotated clockwise or counterclockwise in a plane consisting of a first direction (10) and a second direction (20) and moved in a third direction (30) or the opposite direction of the third direction (30) (for example, when the electronic device (100) is a device that includes a movement or rotation function, or when the user (300) moves the electronic device (100) while watching an image (200), the angle between the two eyes of the user (300) may change.

[0413] Even in such cases, in one embodiment of the present disclosure, the electronic device (100) can correct a plurality of input images based on the difference between the reference binocular angle and the binocular angle of the user (300), such that as the difference between the reference binocular angle and the binocular angle of the user (300) increases, the degree to which the gradation of a plurality of target pixels is lowered increases, and display them on the display (110).

[0414] In order to solve the technical problem described above, an electronic device is provided in one embodiment of the present disclosure. The electronic device may include an optical layer including a plurality of view regions. The electronic device may include a display including a plurality of display regions corresponding to each of the plurality of view regions. The electronic device may include a memory in which a program or at least one instruction is stored. The electronic device may include at least one processor. By having at least one processor execute the program or at least one instruction stored in the memory individually or collectively, the electronic device may acquire a plurality of input images, each corresponding to a plurality of display regions and including a plurality of pixels. The electronic device may acquire at least one of a depth map including depth values ​​for the plurality of input images or a color similarity map indicating color differences between the plurality of input images. Based on at least one of the depth map or the color similarity map, the electronic device may acquire a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among the pixels for each of the plurality of input images. The electronic device can correct each of the multiple input images based on a grayscale correction coefficient and display the acquired multiple corrected images in multiple display areas.

[0415] In one embodiment of the present disclosure, the depth map may include a plurality of sub-depth maps corresponding to each of a plurality of input images. The grayscale correction coefficients may include a plurality of sub-grainscale correction coefficients for correcting the grayscale of a plurality of target pixels included in each of the plurality of input images based on each of the plurality of sub-depth maps. An electronic device may correct each of the plurality of input images based on each of the plurality of sub-grainscale correction coefficients to obtain a plurality of corrected images.

[0416] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. The electronic device may acquire a plurality of pixel grayscale correction coefficients based on a depth map such that as the absolute value of the depth value of a first target pixel among a plurality of target pixels increases, the degree of lowering the grayscale of the first target pixel increases.

[0417] In one embodiment of the present disclosure, the electronic device may acquire a plurality of pixel gradation correction coefficients based on a depth map, such that the gradation of a second target pixel is maintained as the depth value of any one of a plurality of target pixels is identified to be less than or equal to a preset reference correction value.

[0418] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The plurality of display regions may intersect to correspond to each of the plurality of view regions. Each of the plurality of compensation regions may be a region set to be adjacent to the boundary of each of the intersecting plurality of display regions. The width of each of the plurality of compensation regions in the direction in which the plurality of view regions intersect may be predetermined.

[0419] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. The electronic device may acquire a plurality of pixel grayscale correction coefficients such that the grayscale of one target pixel becomes "0" when, based on a depth map, the depth value of any one of the plurality of target pixels is identified as being greater than a preset reference correction value.

[0420] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The plurality of display regions may intersect to correspond to each of the plurality of view regions. Each of the plurality of compensation regions may be a region set to be adjacent to the boundary of each of the intersecting plurality of display regions. The electronic device may be set such that, based on a depth map, as the absolute value of the depth value of one of the plurality of target pixels increases, the width of each of the plurality of compensation regions in the direction in which the plurality of view regions intersect increases.

[0421] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. Based on a plurality of input images, the electronic device may acquire a color similarity map representing the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images. Based on the color similarity map, the electronic device may acquire a plurality of pixel grayscale correction coefficients such that as the color difference of a target pixel at a specific location among the plurality of target pixels increases, the degree to which the grayscale of a single target pixel is lowered increases.

[0422] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. An electronic device may obtain a plurality of corrected images by correcting the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among a plurality of target pixels whose grayscale has been corrected based on the grayscale correction coefficient among the plurality of pixels so as to increase the grayscale.

[0423] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The electronic device may further include an eye-tracking sensor that acquires two gaze directions corresponding to each of the user's two eyes. Based on the two gaze directions, the electronic device may acquire a binocular angle between the two gaze directions. The electronic device may acquire a grayscale correction coefficient by comparing a preset reference binocular angle with the binocular angle, such that the degree to which the grayscale of a plurality of target pixels displayed in a plurality of compensation regions is lowered increases as the difference between the reference binocular angle and the binocular angle increases.

[0424] To solve the technical problem described above, in one embodiment of the present disclosure, a method of operation of an electronic device may be provided, comprising an optical layer including a plurality of view regions and a plurality of display regions corresponding to each of the plurality of view regions. The method of operation of the electronic device may include the step of acquiring a plurality of input images, each corresponding to a plurality of display regions and including a plurality of pixels. The method of operation of the electronic device may include the step of acquiring at least one of a depth map including depth values ​​for a plurality of input images or a color similarity map indicating color differences between a plurality of input images. The method of operation of the electronic device may include the step of acquiring a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among a plurality of pixels for each of the plurality of input images, based on at least one of the depth map or the color similarity map. The method of operation of the electronic device may include the step of correcting each of the plurality of input images based on the grayscale correction coefficient and displaying the acquired plurality of corrected images in a plurality of display regions.

[0425] In one embodiment of the present disclosure, the step of acquiring at least one of a depth map or a color similarity map may include the step of acquiring a plurality of sub-depth maps corresponding to each of a plurality of input images. The step of acquiring a grayscale correction coefficient may include the step of acquiring a plurality of sub-grainscale correction coefficients for correcting the grayscale of a plurality of target pixels included in each of a plurality of input images based on each of a plurality of sub-depth maps. The method of operation of an electronic device may further include the step of acquiring a plurality of corrected images by correcting each of a plurality of input images based on each of a plurality of sub-grainscale correction coefficients.

[0426] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. The step of obtaining the grayscale correction coefficient may include obtaining a plurality of pixel grayscale correction coefficients based on a depth map such that the degree of lowering the grayscale of the first target pixel increases as the absolute value of the depth value of any one of the plurality of target pixels increases, and the grayscale of the second target pixel is maintained as the depth value of any one of the plurality of target pixels is identified to be below a preset reference correction value.

[0427] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The plurality of display regions may intersect to correspond to each of the plurality of view regions. Each of the plurality of compensation regions may be a region set to be adjacent to the boundary of each of the intersecting plurality of display regions. The width of each of the plurality of compensation regions in the direction in which the plurality of view regions intersect may be predetermined.

[0428] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. The step of obtaining the grayscale correction coefficient may include obtaining a plurality of pixel grayscale correction coefficients such that the grayscale of one target pixel becomes "0" when, based on a depth map, the depth value of any one of the plurality of target pixels is identified as being greater than a preset reference correction value.

[0429] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The plurality of display regions may intersect to correspond to each of the plurality of view regions. Each of the plurality of compensation regions may be a region set to be adjacent to the boundary of each of the intersecting plurality of display regions. The method of operation of the electronic device may further include the step of setting the width of each of the plurality of compensation regions in the direction in which the plurality of view regions intersect to increase as the absolute value of the depth value of one of the plurality of target pixels increases based on a depth map.

[0430] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. The step of acquiring at least one of a depth map or a color similarity map may further include the step of acquiring a color similarity map representing the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images, based on a plurality of input images. The step of acquiring the grayscale correction coefficient may include the step of acquiring a plurality of pixel grayscale correction coefficients such that, based on the color similarity map, the degree to which the grayscale of one target pixel is lowered increases as the color difference of one target pixel at a specific location among the plurality of target pixels increases.

[0431] In one embodiment of the present disclosure, the grayscale correction coefficient may include a plurality of pixel grayscale correction coefficients corresponding to each of a plurality of target pixels displayed in a plurality of compensation regions. A method of operating an electronic device may include the step of obtaining a plurality of corrected images by correcting the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among a plurality of target pixels whose grayscale has been corrected based on the grayscale correction coefficient, so as to increase the grayscale of the at least one target pixel.

[0432] In one embodiment of the present disclosure, the optical layer may include a lenticular lens that includes a plurality of intersecting view regions. The method of operation of the electronic device may further include the step of obtaining a binocular angle between two gaze directions based on two gaze directions corresponding to each of the user's two eyes obtained through an eye-tracking sensor. The step of obtaining a grayscale correction coefficient may include the step of obtaining a grayscale correction coefficient such that, by comparing a preset reference binocular angle with the binocular angle, the degree to which the grayscale of a plurality of target pixels displayed in a plurality of compensation regions is lowered increases as the difference between the reference binocular angle and the binocular angle increases.

[0433] In order to solve the aforementioned technical problem, a computer-readable recording medium may be provided on which a program for performing at least one method of an embodiment of the method of operating an electronic device disclosed in the present disclosure is recorded on a computer.

[0434] A program executed by an electronic device described in this disclosure may be implemented by hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0435] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively.

[0436] Software can be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable recording media include magnetic storage media (e.g., ROM (read-only memory), RAM (random-access memory), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). Computer-readable recording media can be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. The recording medium is readable by a computer, stored in memory, and can be executed by a processor.

[0437] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.

[0438] In addition, the program according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0439] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) that is distributed electronically through a manufacturer of an electronic device or an electronic market (e.g., Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer of the electronic device, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0440] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, appropriate results can be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or module are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

Claims

An optical layer (120) including multiple view regions; A display (110) including a plurality of display areas corresponding to each of the plurality of view areas; Memory (140) where a program or at least one instruction is stored; and It includes at least one processor (150), By having the above at least one processor (150) execute the above program or the above at least one instruction stored in the memory (140) individually or collectively, the electronic device (100) Acquiring a plurality of input images each corresponding to the plurality of display areas and including a plurality of pixels, and At least one of a depth map including depth values ​​for the plurality of input images or a color similarity map indicating color differences between the plurality of input images is obtained, Based on at least one of the depth map or the color similarity map, a grayscale correction coefficient is obtained for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among the plurality of pixels for each of the plurality of input images, and An electronic device (100) that corrects each of the plurality of input images based on the above grayscale correction coefficient and displays the obtained plurality of corrected images in the plurality of display areas. In Article 1, The depth map includes a plurality of sub-depth maps corresponding to each of the plurality of input images, and The above grayscale correction coefficient includes a plurality of sub-grainscale correction coefficients for correcting the grayscale of the plurality of target pixels included in each of the plurality of input images based on each of the plurality of sub-depth maps, and The above electronic device (100) is, An electronic device (100) that obtains the plurality of corrected images by correcting each of the plurality of input images based on each of the plurality of sub-gradation correction coefficients. In either Article 1 or Article 2, The above grayscale correction coefficient includes a plurality of pixel grayscale correction coefficients corresponding to each of the plurality of target pixels displayed in the plurality of compensation regions, and The above electronic device (100) is, An electronic device (100) that obtains the plurality of pixel gradation correction coefficients based on the depth map, such that as the absolute value of the depth value of one of the plurality of target pixels increases, the degree of lowering the gradation of the first target pixel increases. In Paragraph 3, The above electronic device (100) is, An electronic device (100) that acquires the plurality of pixel gradation correction coefficients so that the gradation of the second target pixel is maintained, based on the depth map above, as the depth value of any one of the plurality of target pixels is identified as being less than or equal to a preset reference correction value. In any one of paragraphs 1 to 4, The optical layer (120) includes a lenticular lens in which the plurality of view regions intersect, and The plurality of display areas are intersected to correspond to each of the plurality of view areas, and Each of the above plurality of compensation regions is a region set to be adjacent to the boundary of each of the above intersecting plurality of display regions, and The width of each of the plurality of compensation regions in the direction where the plurality of view regions intersect is a predetermined electronic device (100). In any one of paragraphs 1 to 5, The above grayscale correction coefficient includes a plurality of pixel grayscale correction coefficients corresponding to each of the plurality of target pixels displayed in the plurality of compensation regions, and The above electronic device (100) is, An electronic device (100) that acquires the plurality of pixel grayscale correction coefficients such that, based on the depth map, the grayscale of one of the plurality of target pixels is identified as being greater than a preset reference correction value, and the grayscale of the one target pixel becomes "0". In Article 6, The optical layer (120) includes a lenticular lens in which the plurality of view regions intersect, and The plurality of display areas are intersected to correspond to each of the plurality of view areas, and Each of the above plurality of compensation regions is a region set to be adjacent to the boundary of each of the above intersecting plurality of display regions, and The above electronic device (100) is, A method of operation of an electronic device (100) based on the depth map, wherein as the absolute value of the depth value of one of the plurality of target pixels increases, the width of each of the plurality of compensation regions in the direction in which the plurality of view regions intersect increases. In any one of paragraphs 1 through 7, The above grayscale correction coefficient includes a plurality of pixel grayscale correction coefficients corresponding to each of the plurality of target pixels displayed in the plurality of compensation regions, and The above electronic device (100) is, Based on the above multiple input images, a color similarity map is obtained that indicates the color difference between a plurality of target pixels included in one input image and a plurality of target pixels included in the remaining input images. An electronic device (100) that obtains the plurality of pixel gradation correction coefficients based on the color similarity map above, such that as the color difference of one of the plurality of target pixels at a specific location increases, the degree of lowering the gradation of the one target pixel increases. In any one of paragraphs 1 through 8, The above grayscale correction coefficient includes a plurality of pixel grayscale correction coefficients corresponding to each of the plurality of target pixels displayed in the plurality of compensation regions, and The above electronic device (100) is, An electronic device (100) that obtains the plurality of corrected images by correcting the grayscale of at least one luminance correction pixel adjacent to at least one target pixel among the plurality of target pixels whose grayscale is corrected based on the grayscale correction coefficient, so as to increase the grayscale of the at least one target pixel. In any one of paragraphs 1 through 9, The optical layer (120) includes a lenticular lens in which the plurality of view regions intersect, and The above electronic device (100) further includes an eye tracking sensor (130) that acquires two gaze directions corresponding to each of the user's two eyes, and The above electronic device (100) is, Based on the two above-mentioned viewing directions, the binocular angle between the two above-mentioned viewing directions is obtained, and An electronic device (100) that obtains a grayscale correction coefficient by comparing a preset reference angle with the angle of sight, such that the degree to which the grayscale of multiple target pixels displayed in the multiple compensation regions is lowered increases as the difference between the reference angle and the angle of sight increases. A method of operation of an electronic device (100) comprising an optical layer (120) including a plurality of view regions and a plurality of display regions corresponding to each of the plurality of view regions, A step (S100) of acquiring a plurality of input images each corresponding to the plurality of display areas and including a plurality of pixels; A step (S200) of obtaining at least one of a depth map including depth values ​​for the plurality of input images or a color similarity map indicating color differences between the plurality of input images; A step (S300) of obtaining a grayscale correction coefficient for correcting the grayscale of a plurality of target pixels displayed in a plurality of compensation regions adjacent to the boundary of each of the plurality of display regions among the plurality of pixels for each of the plurality of input images, based on at least one of the depth map or the color similarity map; and A method of operation of an electronic device (100) comprising the step (S400) of correcting each of the plurality of input images based on the above grayscale correction coefficient and displaying the obtained plurality of corrected images in the plurality of display areas. In Article 11, The step (S200) of obtaining at least one of the depth map or the color similarity map includes the step of obtaining a plurality of sub-depth maps corresponding to each of the plurality of input images. The step (S300) of obtaining the above grayscale correction coefficient is, The method includes the step of obtaining a plurality of sub-gradation correction coefficients for correcting the gradation of the plurality of target pixels included in each of the plurality of input images based on each of the plurality of sub-depth maps. The method of operation of the above electronic device (100) is, A method of operation of an electronic device (100) further comprising the step of obtaining the plurality of corrected images by correcting each of the plurality of input images based on each of the plurality of sub-gradation correction coefficients. In either Article 11 or Article 12, The above grayscale correction coefficient includes a plurality of pixel grayscale correction coefficients corresponding to each of the plurality of target pixels displayed in the plurality of compensation regions, and The step (S300) of obtaining the above grayscale correction coefficient is, A method of operation of an electronic device (100) comprising the step of acquiring the plurality of pixel gradation correction coefficients such that, based on the depth map, the degree to which the gradation of the first target pixel is lowered increases as the absolute value of the depth value of any one of the plurality of target pixels increases, and the gradation of the second target pixel is maintained as the depth value of any one of the plurality of target pixels is identified to be less than or equal to a preset reference correction value. In any one of paragraphs 11 to 13, The optical layer (120) includes a lenticular lens in which the plurality of view regions intersect, and The plurality of display areas are intersected to correspond to each of the plurality of view areas, and Each of the above plurality of compensation regions is a region set to be adjacent to the boundary of each of the above intersecting plurality of display regions, and The width of each of the plurality of compensation regions in the direction where the plurality of view regions intersect is a predetermined method of operation of the electronic device (100). A computer-readable recording medium having a program recorded thereon for performing the method of operation described in any one of claims 11 to 14 on a computer.

Images