Electronic device and operating method thereof

Abstract

This electronic device for providing a 3D image can acquire a depth map corresponding to an input image, segment the depth map into a plurality of depth regions, determine, on the basis of principles of optical lenses, focal lengths of a plurality of lenses corresponding to the respective depth regions, acquire, on the basis of the determined focal lengths of the plurality of lenses, a voltage value to be applied to the respective lenses, and apply the voltage to the respective lenses on the basis of the voltage value to be applied to the respective lenses, so as to control, for the respective lenses, the degree of refraction of light passing through the plurality of lenses, thereby providing an image represented with multiple depths across a plurality of different focal planes.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device, a method of operating the electronic device, and a computer-readable recording medium having a program for executing the method of operation on a computer. Specifically, it relates to an electronic device capable of providing a 3D image, a method of operating the electronic device, and a computer-readable recording medium having a program for executing the method of operation on a computer.

[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed and distributed. Electronic devices, including display devices that display images, have been developing rapidly in recent years.

[0003] As electronic devices have advanced, the types of images displayed on electronic devices have also become more diverse. Electronic devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.

[0004] Recently, electronic devices and methods for displaying 3D images have been proposed using the refractive properties of liquid crystal lenses, including lenticular lenses, to display 3D images. Electronic devices are being developed that provide different images to the user's eyes using liquid crystal lenses to provide a three-dimensional image to the user.

[0005] An electronic device according to one embodiment of the present disclosure may include a display. An electronic device according to one embodiment of the present disclosure may include a lens array comprising a plurality of lenses. An electronic device according to one embodiment of the present disclosure may include at least one processor. An electronic device according to one embodiment of the present disclosure may include a memory for storing a plurality of instructions.

[0006] An electronic device according to one embodiment of the present disclosure can acquire a depth map corresponding to an input image by executing a plurality of instructions individually or collectively by at least one processor.

[0007] An electronic device according to one embodiment of the present disclosure can segment a depth map into a plurality of depth regions by executing a plurality of instructions individually or collectively by at least one processor.

[0008] An electronic device according to one embodiment of the present disclosure can determine the focal lengths of a plurality of lenses corresponding to each of a plurality of depth regions based on the lens law by executing a plurality of instructions individually or collectively by at least one processor.

[0009] An electronic device according to one embodiment of the present disclosure can obtain a voltage value to be applied to each of a plurality of lenses based on the focal lengths of a plurality of lenses determined by executing a plurality of instructions individually or collectively by at least one processor.

[0010] An electronic device according to one embodiment of the present disclosure can provide an image with multiple depths across multiple different focal planes by controlling the degree of refraction of light passing through the lenses for each of the lenses by applying a voltage to each of the lenses based on a voltage value to be applied to each of the lenses, by executing a plurality of instructions individually or collectively by at least one processor.

[0011] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of acquiring a depth map corresponding to an input image.

[0012] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of segmenting a depth map into a plurality of depth regions based on a plurality of depth intervals.

[0013] A method of operation of an electronic device according to one embodiment of the present disclosure may include the step of determining the focal lengths of a plurality of lenses corresponding to each of a plurality of depth regions based on the law of lenses.

[0014] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of obtaining a voltage value to be applied to each of a plurality of lenses based on the focal lengths of a plurality of lenses determined.

[0015] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of applying a voltage to each of a plurality of lenses based on a voltage value to be applied to each of a plurality of lenses, thereby controlling the degree of refraction of light passing through the plurality of lenses for each of the plurality of lenses, and providing an image expressed with multiple depths across a plurality of different focal planes.

[0016] In one embodiment of the present disclosure, a computer-readable recording medium may be provided on which a program for executing at least one method of the method of operating the disclosed electronic device is recorded on a computer.

[0017] The technical problems to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.

[0018] The present disclosure may be understood from the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.

[0019] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0020] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0021] FIG. 3 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0022] FIG. 4a is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure to derive a depth map and segment it into a plurality of depth regions.

[0023] FIG. 4b is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure segmenting a depth map into a plurality of depth regions.

[0024] FIG. 5 is a diagram illustrating the operation of determining the focal length of a plurality of lenses of an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 6a is a drawing for explaining the configuration of a lens array of an electronic device according to one embodiment of the present disclosure.

[0026] FIG. 6b is a drawing for explaining the configuration of a lens array of an electronic device according to one embodiment of the present disclosure.

[0027] FIG. 6c is a diagram illustrating the operation of obtaining a voltage value to be applied to a plurality of lenses of an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 6d is a diagram illustrating the operation of obtaining voltage values ​​to be applied to a plurality of lenses of an electronic device according to one embodiment of the present disclosure.

[0029] FIG. 7 is a diagram illustrating the operation of providing an image expressed in multiple depths across a plurality of different focal planes of an electronic device according to one embodiment of the present disclosure.

[0030] FIG. 8 is a flowchart for explaining the operation of displaying a corrected image of an electronic device according to one embodiment of the present disclosure.

[0031] FIG. 9 is a drawing for explaining the operation of displaying a correction image of an electronic device according to one embodiment of the present disclosure.

[0032] FIG. 10 is a flowchart illustrating a method for changing the range of depth regions of an electronic device according to one embodiment of the present disclosure.

[0033] FIG. 11a is a drawing illustrating an example of consecutive frames included in an input image according to one embodiment of the present disclosure.

[0034] FIG. 11b is a drawing for explaining the operation of changing the range of depth regions of an electronic device according to one embodiment of the present disclosure.

[0035] FIG. 12 is a flowchart for explaining the operation of changing a depth region corresponding to a range or reference point of depth regions of an electronic device according to one embodiment of the present disclosure.

[0036] FIG. 13 is a drawing for explaining the operation of changing the range of depth regions of an electronic device according to one embodiment of the present disclosure.

[0037] FIG. 14a is a drawing for explaining the operation of changing a depth region corresponding to a reference point of an electronic device according to one embodiment of the present disclosure.

[0038] FIG. 14b is a drawing for explaining the operation of changing a depth region corresponding to a reference point of an electronic device according to one embodiment of the present disclosure.

[0039] FIG. 15 is a flowchart for explaining the operation of correcting the focal length of a lens based on the angle of incidence of an electronic device according to one embodiment of the present disclosure.

[0040] FIG. 16 is a diagram illustrating an operation to correct the focal lengths of a plurality of lenses based on the angle of incidence at a plurality of lenses of an electronic device according to one embodiment of the present disclosure.

[0041] FIG. 17 is a flowchart for explaining the operation of applying voltage to a plurality of divided electrodes included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0042] FIG. 18a is a drawing for illustrating a plurality of divided electrodes included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0043] FIG. 18b is a drawing for explaining the operation of applying voltage to a plurality of divided electrodes of an electronic device according to one embodiment of the present disclosure.

[0044] FIG. 19a is a drawing for illustrating a plurality of divided electrodes included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0045] FIG. 19b is a drawing for illustrating a plurality of divided electrodes included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0046] FIG. 20a is a drawing for illustrating a plurality of lenticular lenses included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0047] FIG. 20b is a drawing for illustrating a plurality of lenticular lenses included in a lens array of an electronic device according to one embodiment of the present disclosure.

[0048] FIG. 21 is a flowchart illustrating the operation of displaying corrected images based on time multiplexing of an electronic device according to one embodiment of the present disclosure.

[0049] FIG. 22a is a diagram illustrating the operation of displaying corrected images based on time multiplexing of an electronic device according to one embodiment of the present disclosure.

[0050] FIG. 22b is a diagram illustrating the operation of displaying corrected images based on time multiplexing of an electronic device according to one embodiment of the present disclosure.

[0051] FIG. 23 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0052] FIG. 24a is a drawing for explaining the operation of providing an image of an electronic device according to one embodiment of the present disclosure.

[0053] FIG. 24b is a drawing illustrating an example of an image displayed through an electronic device according to one embodiment of the present disclosure.

[0054] FIG. 25a is a drawing for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0055] FIG. 25b is a drawing for explaining the configuration of a polarization control array of an electronic device according to one embodiment of the present disclosure.

[0056] FIG. 25c is a drawing for explaining voltage control of a polarization control array and a lens array of an electronic device according to one embodiment of the present disclosure.

[0057] FIG. 26 is a drawing for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0058] The terms used in this disclosure will be briefly explained, and an embodiment of this disclosure will be described in detail.

[0059] Throughout this disclosure, unless specifically stated otherwise, “or” is inclusive and not exclusive. Accordingly, “A or B” may mean “A, B, or both” unless clearly indicated otherwise by the context.

[0060] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0061] The terms used in this disclosure have been selected to be as widely used as possible, taking into account the functions in the embodiments of this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined not merely by their names, but based on their meanings and the content throughout this disclosure.

[0062] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification.

[0063] Throughout this disclosure, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "module," etc., as used in this disclosure refer to a unit that processes at least one function or operation, and may be implemented in hardware or software, or as a combination of hardware and software.

[0064] The expression “configured to” as used in this disclosure may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “system configured to” may mean that the system is “capable of” together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in memory.

[0065] In addition, when a component is described in the present disclosure as being “connected” or “connected” to another component, it should be understood that the component may be directly connected to or directly connected to the other component, but unless otherwise specifically stated, it may also be connected or connected through another component in between.

[0066] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0067] This specification uses terms including “substantially” or “about.” In one or more examples, when it is specified that parameter X may be substantially identical to parameter Y, the term “substantially” may be understood as X being within 10% of Y. In one or more examples, when it is specified that parameter is about X, the term “about” may be understood as X being within 10% of X.

[0068] All functions or operations described in this document may be processed by a single processor or a combination of multiple processors.

[0069] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, an embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiment described herein. Furthermore, in order to clearly explain an embodiment of the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the present disclosure are denoted by similar reference numerals.

[0070] Embodiments of the present disclosure will be described in detail below with reference to the drawings.

[0071] FIG. 1 is a drawing for explaining the operation of an electronic device (1000) according to one embodiment of the present disclosure.

[0072] Referring to FIG. 1, an electronic device (1000) according to one embodiment of the present disclosure may be a device that provides an image (200) to a user (300).

[0073] In one embodiment of the present disclosure, the electronic device (1000) may be implemented as an electronic device (1000) of various shapes, such as a mobile device, a smartphone, a monitor, a laptop computer, a tablet PC, a wearable device, a head-mounted display (HMD) device, digital signage, etc.

[0074] In one embodiment of the present disclosure, the electronic device (1000) may include a display (110) and a lens array (120). In one embodiment of the present disclosure, the electronic device (1000) may display an image (200) through the display (110). In one embodiment of the present disclosure, the image (200) provided by the electronic device (1000) may be an image capable of providing a three-dimensional effect to a user (300) using the electronic device (1000). Hereinafter, an image capable of providing a three-dimensional effect to a user (300) may be referred to as a three-dimensional image.

[0075] In one embodiment of the present disclosure, the image (200) provided to the user (300) may include images provided by being refracted into two or more different views by the lens array (120).

[0076] In one embodiment of the present disclosure, the lens array (120) may include a lenticular lens comprising a plurality of lenses. In one example, the lenticular lens may be an array of lenses designed to show different parts of an image when viewed from different angles. In one embodiment of the present disclosure, each of the plurality of lenses may provide images refracted into two or more different views. A plurality of input images displayed on the display (110) may be refracted through the lenticular lens and provided to the user (300) as an image (200).

[0077] In one embodiment of the present disclosure, each of the plurality of input images may be images obtained by capturing a real object in a plurality of different views. However, the present disclosure is not limited thereto, and each of the plurality of input images may be images generated to provide images of an object in a plurality of different views.

[0078] At this time, the 'view' may correspond to a position where the user (300) can see another side of an object included in an image (200) provided through the electronic device (1000). However, the present disclosure is not limited thereto, and the 'view' may correspond to the positions of the user's (300) left eye and right eye, where the user can see another side of an object included in an image (200) provided through the electronic device (1000).

[0079] In one embodiment of the present disclosure, in two input images obtained from adjacent views, the position of a first pixel having a specific depth value included in one first input image within the first input image and the position of a second pixel corresponding to the first pixel included in another second input image within the second input image may be different from each other. In one embodiment of the present disclosure, the difference in position within the input images between two corresponding pixels having a specific depth value within two input images obtained from adjacent views may be defined as "disparity."

[0080] In one embodiment of the present disclosure, an image (200) provided through an electronic device (1000) may be provided such that, depending on the position of the user (300) looking at the electronic device (1000), the user (300) can see different sides of an object included in the image (200) in each of the plurality of views. In one embodiment of the present disclosure, the image (200) provided by the electronic device (1000) to the user (300) may vary depending on the position of the user (300). In one example, as the position of the user (300) changes, the user (300) is provided with a plurality of images having disparity, so the user (300) can feel a three-dimensional effect from the image (200) provided by the electronic device (1000).

[0081] In one embodiment of the present disclosure, there may be disparity between images provided to the left eye and right eye of the user (300). In one embodiment of the present disclosure, the electronic device (1000) may provide images to the left eye and right eye of the user (300) that have disparity between them. In one embodiment of the present disclosure, the user (300) may perceive binocular disparity through images with disparity provided to the left eye and right eye, and may perceive a three-dimensional effect from the image (200).

[0082] Hereinafter, for the convenience of explanation, the plurality of input images are described as two input images obtained from views corresponding to the left and right eyes of the user (300). Additionally, the electronic device (1000) is described as providing images (200) to the left and right eyes of the user (300) through a display (110) and a lens array (120).

[0083] In one embodiment of the present disclosure, each of the two input images may include at least one object having various depth values. The object may include various things such as people, animals, objects, and natural objects, and is not limited to any one of them. The depth value of the object included in each of the two input images may be a reference value (e.g., "0"), or may have a value smaller than the reference value or larger than the reference value.

[0084] An object (11) having a reference depth can be perceived by the user (300) as being located in a plane parallel to the electronic device (1000) (e.g., the screen of the electronic device (1000)) in the image (200). At this time, the plane parallel to the electronic device (1000) may be a plane defined by a first direction (D1) and a second direction (D2). The normal direction perpendicular to the plane defined by the first direction (D1) and the second direction (D2) may be a third direction (D3).

[0085] An object (12) having a depth smaller than the reference value depth may be recognized as being located closer to the user (300) than to the electronic device (1000) in the image (200). Each of the objects (13a, 13b, 13c) having a depth larger than the reference value may be recognized by the user (300) as being located further away from the user (300) than to the electronic device (1000) in the image (200).

[0086] In one embodiment of the present disclosure, the angle at which a plurality of input images are refracted through a plurality of view regions of a lens array (120) may be determined based on the characteristics of the display (110) (e.g., resolution, size and arrangement of a plurality of pixels, etc.), the characteristics of the lens array (120) (refractive index, shape of the lens, arrangement of the lens), the arrangement relationship between the display (110) and the lens array (120), or other suitable characteristics known to a person skilled in the art.

[0087] In one embodiment of the present disclosure, the lens array (120) may provide a plurality of focal planes (21, 22, 23) located at different depths (also referred to as first, second, and third focal planes (21, 22, 23)). A 'focal plane' refers to a plane where light converges or gathers after passing through a lens, and an image of an object can be clearly formed on said plane (focal plane).

[0088] In one embodiment of the present disclosure, a plurality of lenses included in a lens array (120) may provide different focal planes (21, 22, 23). In the present disclosure, different focal planes (21, 22, 23) may mean focal planes (21, 22, 23) formed at different depths. For example, different focal planes (21, 22, 23) may mean focal planes (21, 22, 23) that have different distances from a user (300) toward an electronic device (1000) in a third direction (D3). A plurality of lenses included in the lens array (120) may be capable of electrically changing their focal lengths. For example, a plurality of lenses included in the lens array (120) may be arranged differently depending on the voltage. Accordingly, the plurality of lenses included in the lens array (120) may have different focal lengths to provide different focal planes (21, 22, 23).

[0089] In one embodiment of the present disclosure, some of the plurality of lenses may form a first focal plane (21). An object (11) having a depth of reference value may be displayed on the first focal plane (21).

[0090] In one embodiment of the present disclosure, some of the plurality of lenses may form a second focal plane (22). The second focal plane (22) may be formed closer to the user (300) than to the display (110). For example, the second focal plane (22) may be formed closer to the user (300) than to the first focal plane (21). An object (12) having a depth smaller than a reference value may be displayed on the second focal plane (22).

[0091] FIG. 1 illustrates, by way of example, that the second focal plane (22) is formed at a single depth. However, as will be understood by those skilled in the art, embodiments of the present disclosure are not limited to this configuration. For example, the second focal plane (22) may be formed by a plurality of focal planes located at different depths.

[0092] In one embodiment of the present disclosure, some of the plurality of lenses may form a third focal plane (23). The third focal plane (23) may be formed further away from the user (300) than the display (110). That is, the third focal plane (23) may be formed further away from the user (300) than the first focal plane (21). Objects (13a, 13b, 13c) having a depth greater than a reference value may be displayed on the third focal plane (23).

[0093] FIG. 1 illustrates, by way of example, that the third focal plane (23) is formed by three focal planes (23a, 23b, 23c) located at different depths, but the embodiment is not limited thereto. For example, the third focal plane (23) may be formed at a single depth, and the number of multiple focal planes located at different depths may also be varied.

[0094] According to one embodiment of the present disclosure, an electronic device (1000) may provide focal planes (21, 22, 23) of different depths to display a multi-depth image (200) across a plurality of focal planes (21, 22, 23). Accordingly, the electronic device (1000) may improve resolution over an overall depth range, and images of objects at all depths within the image (200) may be provided relatively clearly.

[0095] FIG. 2 is a block diagram for explaining the configuration of an electronic device (1000) according to one embodiment of the present disclosure.

[0096] Referring to FIG. 2, in one embodiment of the present disclosure, an electronic device (1000) may include a display (110), a lens array (120), a memory (130), and a processor (140). The electronic device (1000) may be implemented by more components than those shown in FIG. 2, or by fewer components. The display (110), the lens array (120), the memory (130), and the processor (140) may each be electrically and / or physically connected to each other.

[0097] The display (110) can display various content such as text, images, videos, icons, or symbols. According to one embodiment of the present disclosure, the display (110) may include any one of a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a micro light emitting diode (Micro LED) display, a digital micromirror device (DMD), and a chemical liquid crystal display (LCoS). However, the present disclosure is not limited thereto, and the display (110) may include other types of displays capable of providing an output image to a user.

[0098] The lens array (120) may include a viewing area separation unit, such as a liquid crystal lens, that allows the user to view different images depending on the viewing position. The liquid crystal lens may include a plurality of lenses. For example, the plurality of lenses may be a plurality of lenticular lenses. The lens array (120) may include a plurality of lenticular lenses having different pattern angles to realize fine parallax.

[0099] In one embodiment of the present disclosure, a plurality of lenses included in a lens array (120) may include a liquid crystal material aligned in a specific direction. The arrangement of the liquid crystal material included in the plurality of lenses may change according to a voltage applied to the lens array (120). Accordingly, the refractive index of the plurality of lenses may change based on the applied voltage. Thus, the focal length of the plurality of lenses may change based on the applied voltage.

[0100] In one embodiment of the present disclosure, lenses to which no voltage is applied may provide a 2D image to a user. In the present disclosure, a 2D image (two-dimensional image) may mean an image that is perceived by the user as being located in a plane parallel to the electronic device (1000) (e.g., a screen of the electronic device (1000)). The liquid crystal lens may further include a resin layer covering a plurality of lenses. The refractive index of the lenses to which no voltage is applied may be substantially the same as the refractive index of the resin layer. Accordingly, light passing through the lenses to which no voltage is applied is unrefracted within the lens array (120) and may provide a 2D image to the user.

[0101] In one embodiment of the present disclosure, voltage-applied lenses can provide a 3D image to a user. The refractive index of the voltage-applied lenses can be changed differently from the refractive index of the resin layer. Accordingly, light passing through the voltage-applied lenses is refracted within the lens array (120) to provide a 3D image to a user.

[0102] In one embodiment of the present disclosure, the electronic device (1000) can control the voltage applied to the plurality of lenses for each of the plurality of lenses. The electronic device (1000) can set the focal lengths of the plurality of lenses differently for each lens according to the output image. Accordingly, the electronic device (1000) can provide an image that is expressed in multiple depths across focal planes located at different depths.

[0103] Meanwhile, in one embodiment of the present disclosure, the liquid crystal lens may further include a resin layer covering a plurality of lenses, and a liquid crystal material may be included in the resin layer. The arrangement of the liquid crystal material included in the resin layer may change according to the voltage applied to the lens array (120). Accordingly, the refractive index of the resin layer may vary based on the voltage applied to each region of the resin layer. Therefore, as the degree of refraction of light passing through the plurality of lenses varies based on the voltage applied to each region of the resin layer, the focal length of the plurality of lenses may also vary by region.

[0104] In one embodiment of the present disclosure, the memory (130) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid-state drive (SSD). Instructions or program code for performing functions or operations of an electronic device (1000) may be stored in the memory (130). Instructions, algorithms, data structures, program code, and application programs stored in the memory (130) may be implemented in a programming or scripting language such as, for example, C, C++, Java, assembler, etc.

[0105] In one embodiment of the present disclosure, the memory (130) may store various types of modules that can be used to provide an output image to a user through a display (110). For example, the memory (130) may store a depth map acquisition module, a depth region segment module, a focal length determination module, and a lens voltage determination module. However, the modules illustrated in FIG. 2 are not essential modules. More modules than those illustrated in FIG. 2 may be stored in the memory (130).

[0106] A 'module' included in memory (130) may refer to a unit that processes a function or operation performed by a processor (140). A 'module' included in memory (130) may be implemented as software such as instructions, algorithms, data structures, or program code. In one example, a 'module' may be hardware equipped with a circuitry configured to perform the function of the module.

[0107] In one embodiment of the present disclosure, the depth map acquisition module (131) may be composed of instructions or program code regarding an operation or function of acquiring a depth map based on an input image. For example, the depth map acquisition module (131) may be composed of instructions or program code regarding an operation or function of acquiring a depth map based on a plurality of input images corresponding to a plurality of viewpoints. For example, the depth map acquisition module (131) may be composed of instructions or program code regarding an operation or function of acquiring a depth map based on a plurality of input images corresponding to a single viewpoint. However, the present disclosure is not limited thereto, and the depth map acquisition module (131) may be composed of various instructions or program code configured to perform an operation of acquiring a depth map based on an input image.

[0108] In one embodiment of the present disclosure, the depth map acquisition module (131) may include an artificial intelligence model. The artificial intelligence model included in the depth map acquisition module (131) may include a machine learning or deep learning model. In one embodiment of the present disclosure, the artificial intelligence model included in the depth map acquisition module (131) may include a CNN (Convolutional Neural Network) or a transformer, and may be an artificial intelligence model trained to infer a depth map containing depth information by receiving a plurality of input images as input.

[0109] However, in one embodiment of the present disclosure, the electronic device (1000) may receive a depth map corresponding to an input image through an input / output interface or a communication interface.

[0110] In one embodiment of the present disclosure, the depth region segment module (132) may include instructions or program code regarding an operation or function of segmenting a depth map into a plurality of depth regions. For example, the depth region segment module (132) may determine a plurality of depth intervals based on the depth map. The depth region segment module (132) may segment the depth map into a plurality of depth regions based on the determined plurality of depth intervals.

[0111] In one embodiment of the present disclosure, the focal length determining module (133) may include instructions or program code regarding an operation or function of determining the focal lengths of a plurality of lenses corresponding to each of a plurality of depth regions. For example, the focal length determining module (133) may determine the focal length of a lens corresponding to each depth region based on the lens law.

[0112] The lens law provides a mathematical relationship between the focal length of the lens, the distance between the object and the lens, and the distance between the image and the lens. The focal length determination module (133) may include instructions or program code for calculating the focal length of the lens using the following mathematical formula 1.

[0113] Mathematical formula 1:

[0114]

[0115] In the above formula, f represents the focal length of the lens, d0 represents the distance between the object and the lens (or also referred to as the object distance), and d i represents the distance between the image and the lens (also referred to as the image distance).

[0116] In one embodiment of the present disclosure, the lens voltage determination module (134) may include instructions or program code regarding an operation or function of determining voltage values ​​to be applied to each of the plurality of lenses based on the focal lengths of the plurality of lenses. For example, the lens voltage determination module (134) may determine voltage values ​​to be applied to the plurality of lenses for each lens so that each lens has a determined focal length. For example, the lens voltage determination module (134) may determine voltages to be applied to the plurality of lenses by considering the change in the refractive index of the lens according to the applied voltage or the change in the refractive index of the resin layer according to the applied voltage.

[0117] The processor (140) may be composed of at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), and a Neural Processing Unit or an AI-dedicated processor designed with a hardware structure specialized for the learning and processing of an artificial intelligence model (AI), but is not limited thereto.

[0118] In one embodiment of the present disclosure, the processor (140) can execute various types of modules stored in memory (130). In one embodiment of the present disclosure, the processor (140) can execute a depth map acquisition module (131), a depth region segment module (132), a focal length determination module (133), and a lens voltage determination module (134) stored in memory (130). In one embodiment of the present disclosure, the processor (140) can execute at least one instruction constituting various types of modules stored in memory (130).

[0119] The processor (140) can control the overall operation of the electronic device (1000) by executing at least one instruction stored in memory (130).

[0120] FIG. 3 is a flowchart for explaining the operation of an electronic device (1000) according to one embodiment of the present disclosure.

[0121] Referring to FIG. 3, a method for an electronic device (1000) to provide a 3D image may include steps S310 to S350. In one embodiment of the present disclosure, steps S310 to S350 may be executed by at least one processor included in the electronic device (1000). The method for an electronic device (1000) to provide a 3D image is not limited to that illustrated in FIG. 3, and in one or more embodiments, additional steps not illustrated in FIG. 3 may be included, or some steps may be omitted.

[0122] In step S310 of FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure may obtain a depth map for an input image (e.g., a depth map corresponding to the input image). For example, the input image may be an RGB image. An RGB image is a digital image format that expresses color by combining red, green, and blue, and each pixel may be composed of values ​​representing the intensity of the three colors. For example, the intensity of each color may be allocated 8 bits and have a value from 0 to 255.

[0123] In one embodiment of the present disclosure, the electronic device (1000) can obtain a depth map during a rendering process. The rendering process may refer to a process of converting a 3D scene into a 2D image. The electronic device (1000) can obtain a depth map for an input image by projecting the 3D scene onto a 2D plane and calculating and storing the depth values ​​of the pixels.

[0124] In one embodiment of the present disclosure, an electronic device (1000) may acquire a plurality of input images corresponding to a plurality of viewpoints. For example, the electronic device (1000) may acquire an image corresponding to the left eye and an image corresponding to the right eye. The electronic device (1000) may generate a depth map based on the disparity between the plurality of input images, the focal length of the plurality of cameras that captured the plurality of input images, and the distance between the plurality of cameras.

[0125] According to one embodiment of the present disclosure, an electronic device (1000) receives a stereo image as an input image and can determine depth information based on the stereo image. The stereo image includes different viewpoint images (e.g., a left image and a right image) acquired through two or more cameras. The viewpoint images are images taken at different locations (or viewpoints) at the same time. The stereo image may be acquired, for example, by a stereo camera.

[0126] Meanwhile, according to one embodiment of the present disclosure, the electronic device (1000) may determine depth information based on a multi-view image including three or more viewpoint images. However, for convenience of explanation, the following description will focus on an embodiment in which depth information is obtained based on a stereo image composed of two viewpoint images.

[0127] The electronic device (1000) can find feature points in a stereo image and perform matching between corresponding feature points. For example, the electronic device (1000) can find feature points in a stereo image and perform matching between corresponding feature points based on a neural network model. The electronic device (1000) can calculate the depth value of each pixel based on the disparity, which is the positional difference between corresponding feature points. The electronic device (1000) can determine that the feature points are located closer to the user as the disparity value increases.

[0128] According to one embodiment of the present disclosure, an electronic device (1000) can infer a depth map from a plurality of input images corresponding to a plurality of time points using an artificial intelligence model. In this case, the artificial intelligence model may include a machine learning or deep learning model. The artificial intelligence model may be an artificial intelligence model trained to infer a depth map by receiving a plurality of input images corresponding to a plurality of time points as input.

[0129] For example, an artificial intelligence model can infer a depth map during the ray tracing process by using a deep learning-based NeRF (Neural Radiance Fields) method, receiving multiple input images and camera parameters of said input images as input.

[0130] In one embodiment of the present disclosure, the electronic device (1000) can acquire an input image corresponding to a single point in time. The electronic device (1000) can generate a depth map by estimating the depth from the input image at a single point in time.

[0131] According to one embodiment of the present disclosure, an electronic device (1000) can infer a depth map from an input image corresponding to a single point in time using an artificial intelligence model. In this case, the artificial intelligence model may include a machine learning or deep learning model. The artificial intelligence model may be an artificial intelligence model trained to infer a depth map by receiving an input image corresponding to a single point in time as input.

[0132] For example, an artificial intelligence model can infer the relative depth of an object within an input image by receiving a single viewpoint input image using a deep learning-based monocular depth estimation method. Examples of monocular depth estimation methods that the artificial intelligence model can use include monodepth estimation techniques, densedepth estimation techniques, or fastdepth estimation techniques.

[0133] The monodepth estimation technique can utilize a model pre-trained using a neural network-based learning method (e.g., self-supervised learning) based on data from stereo image pairs. Through the monodepth estimation technique, the artificial intelligence model can estimate a depth map from an input image at a single viewpoint.

[0134] Dense depth estimation techniques can utilize a model pre-trained using a neural network-based learning method (e.g., self-supervised learning) based on image-depth pair data. Through dense depth estimation techniques, an artificial intelligence model can estimate a dense depth map from an input image at a single viewpoint. A dense depth map refers to a depth map that contains depth information for every pixel.

[0135] Fast depth estimation techniques can utilize relatively lightweight neural network models. Through fast depth estimation techniques, artificial intelligence models can estimate depth maps in real time from input images at a single viewpoint. For example, models for mono depth estimation, density depth estimation, and fast depth estimation techniques may differ from each other and may be trained separately. For example, at least two of the mono depth estimation, density depth estimation, or fast depth estimation techniques may use the same model.

[0136] According to one embodiment of the present disclosure, an electronic device (1000) can extract a depth map from an input image corresponding to a single viewpoint by using a Depth from Defocus (DfD) technique that utilizes the blurring of the focus. A camera lens may focus only at a specific distance, and a phenomenon (or blurring phenomenon) may occur where the focus becomes blurry at other distances. In this case, the degree of blurring depends on the distance between the object and the camera, and more specifically, the degree of blurring may vary depending on how far the object is from the focus plane. The electronic device (1000) can estimate the depth information of an object based on the degree of blurring in an input image corresponding to a single viewpoint.

[0137] According to one embodiment of the present disclosure, an electronic device (1000) can generate a depth map from an input image corresponding to a single point in time using a structured light technique. The electronic device (1000) can receive an image captured with an optical pattern projected as an input image. The electronic device (1000) can extract depth information based on the degree of distortion of the optical pattern projected onto an object.

[0138] Meanwhile, in one embodiment of the present disclosure, the electronic device (1000) may receive a depth map corresponding to an input image through an input / output interface or a communication interface. For example, the electronic device (1000) may receive a grayscale depth map or a color depth map acquired through a Time of Flight (ToF) camera. Alternatively, for example, the electronic device (1000) may receive a depth map acquired through a structured light technique. Alternatively, for example, the electronic device (1000) may acquire an RGB-D image in which depth information is written on an RGB image through a Time of Flight (ToF) camera and receive the RGB-D image as an input image.

[0139] According to one embodiment of the present disclosure, an electronic device (1000) can generate a depth map for each frame of 3D content. Here, each frame of 3D content may be an input image. For frames of a continuous scene, the electronic device (1000) can generate a depth map of the current frame by correcting the depth value of the previous frame.

[0140] In step S320 of FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure can segment a depth map into a plurality of depth regions.

[0141] In one embodiment of the present disclosure, the electronic device (1000) may set a plurality of depth intervals based on the depth value of each pixel obtained through a depth map. The electronic device (1000) may segment the depth map into a plurality of depth regions according to each depth interval based on the plurality of depth intervals.

[0142] In one embodiment of the present disclosure, a plurality of depth regions may include two or more of a first depth region, a second depth region, and a third depth region. In the present disclosure, the first depth region may be a region having a depth of a reference value in a depth map. In the present disclosure, the second depth region may be a region having a depth smaller than the reference value in a depth map. In the present disclosure, the third depth region may be a region having a depth greater than the reference value in a depth map.

[0143] The second depth region may be provided as a single depth region defined along a single depth interval, or as multiple depth regions defined along multiple depth intervals. The third depth region may be provided as a single depth region defined along a single depth interval, or as multiple depth regions defined along multiple depth intervals.

[0144] In one embodiment of the present disclosure, the electronic device (1000) can adjust the number of depth segments or the number of depth regions divided according to the bit depth of the depth map. The bit depth of the depth map refers to a value representing depth information that can be expressed by each pixel in an image in bit units. As the bit depth of the depth map increases, the number of depths that can be expressed by each pixel may increase. For example, if the bit depth of the depth map is 2 bits, 4 depths can be expressed by each pixel, and if the bit depth of the depth map is 3 bits, 8 depths can be expressed by each pixel. The intervals between depth segments may be set to equal intervals or unequal intervals.

[0145] In one embodiment of the present disclosure, the electronic device (1000) may change the range of a plurality of depth regions based on the movement of at least one object within consecutive frames included in an input image.

[0146] In one embodiment of the present disclosure, the electronic device (1000) may change the range of a plurality of depth regions or change the depth region corresponding to a reference point based on user input.

[0147] The operation of the electronic device (1000) changing the range of multiple depth regions or changing the depth region corresponding to the reference point will be examined in detail later with reference to FIG. 10 and FIG. 12.

[0148] In step S330 of FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure can determine the focal lengths of a plurality of lenses corresponding to each of a plurality of depth regions based on the lens law. The lens law provides a mathematical relationship between the focal length of a lens, the distance between an object and a lens, and the distance between an image and a lens. The electronic device (1000) can calculate the focal length of a lens from the distance between an object and a lens and the distance between an image and a lens through Equation 1 described above.

[0149] In one embodiment of the present disclosure, a plurality of lenses may include two or more of a first lens (or first lens region) corresponding to a first depth region, a second lens (or second lens region) corresponding to a second depth region, and a third lens (or third lens region) corresponding to a third depth region.

[0150] In one embodiment of the present disclosure, the electronic device (1000) may determine the focal length of one or more first lenses (or first lens regions) corresponding to a first depth region. An image in which an object included in the first depth region is displayed may be provided to a user by passing through one or more first lenses. The electronic device (1000) may determine the focal length of the first lenses such that the focal plane of the first lenses is positioned on the display (110).

[0151] In one embodiment of the present disclosure, the electronic device (1000) may determine the focal length of one or more second lenses (or second lens regions) corresponding to a second depth region. An image in which an object included in the second depth region is displayed may be provided to a user by passing through one or more second lenses. The electronic device (1000) may determine the focal length of the second lenses such that the focal plane of the second lenses is positioned closer to the user than to the display (110).

[0152] In one embodiment of the present disclosure, the electronic device (1000) may determine the focal length of one or more third lenses (or third lens regions) corresponding to a third depth region. An image in which an object included in the third depth region is displayed may be provided to a user by passing through one or more third lenses. The electronic device (1000) may determine the focal length of the third lenses such that the focal plane of the third lenses is located further away from the user than the display (110).

[0153] In step S340 of FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure can obtain a voltage value to be applied to each of the plurality of lenses based on the focal lengths of the plurality of lenses determined.

[0154] In one embodiment of the present disclosure, the electronic device (1000) may determine a voltage value to be applied to two or more of a first lens (or first lens region), a second lens (or second lens region), or a third lens (or third lens region). The electronic device (1000) may determine a voltage value to be applied per lens or per lens region so that each lens or each lens region may have a corresponding focal length.

[0155] According to one embodiment of the present disclosure, the electronic device (1000) may determine to apply a first voltage value to the first lens such that the focal plane of the first lens is positioned on the display (110).

[0156] According to one embodiment of the present disclosure, the electronic device (1000) may determine to apply a second voltage value to the second lens such that the focal plane at the second lens is positioned closer to the viewer than the display (110).

[0157] According to one embodiment of the present disclosure, the electronic device (1000) may decide to apply a third voltage value different from a second voltage value to the third lens such that the focal plane at the third lens is located further away from the viewer than the display (110).

[0158] For example, the electronic device (1000) may decide not to apply voltage to the first lens. That is, the electronic device (1000) may determine the first voltage value to be 0V. When voltage is not applied to the first lens, the focal plane of the first lens may be located on the display (110). The electronic device (1000) may determine the second voltage value to be a voltage value greater than the third voltage value.

[0159] Alternatively, for example, the electronic device (1000) may determine the first voltage value as a voltage value such that the liquid crystal array of the first lens is arranged at a maximum orientation angle. The electronic device (1000) may determine the second voltage value and the third voltage value, respectively, as voltage values ​​smaller than the first voltage value. The electronic device (1000) may determine the second voltage value as a voltage value smaller than the third voltage value.

[0160] The electronic device (1000) can determine a second voltage value to apply to the second lens so that the second lens can have a focal length shorter than the distance between the display (110) and the lens array (120). By applying a relatively lower voltage value to the second lens compared to the third lens, the degree of refraction of light passing through the second lens can be reduced. Accordingly, the second lens can have a relatively longer focal length compared to the third lens.

[0161] The electronic device (1000) can determine a third voltage value to apply to the third lens so that the third lens can have a focal length longer than the distance between the display (110) and the lens array (120). By applying a voltage value relatively higher than that of the second lens to the third lens, the degree of refraction of light passing through the third lens can be greater. Accordingly, the third lens can have a relatively shorter focal length than that of the second lens.

[0162] In step S350 of FIG. 3, an electronic device (1000) according to one embodiment of the present disclosure can provide an image that is expressed in multiple depths across multiple different focal planes by applying a voltage to each of the multiple lenses based on a voltage value to be applied to each of the multiple lenses, thereby controlling the degree of refraction of light passing through the multiple lenses for each of the multiple lenses.

[0163] When different voltages are applied to each of the multiple lenses, the liquid crystal arrangement of each of the multiple lenses can change according to the applied voltage value. Therefore, the degree of refraction of light passing through each of the multiple lenses can vary.

[0164] In one embodiment of the present disclosure, the electronic device (1000) may not apply voltage to the first lens (or the first lens region). Accordingly, as the liquid crystal arrangement within the first lens is maintained, the refractive index of the first lens may be maintained. Accordingly, light passing through the first lens passes through without refracting and maintains a straight path, thereby providing a 2D image to the user.

[0165] In one embodiment of the present disclosure, the electronic device (1000) may apply a third voltage value determined in step S340 to the second lens (or second lens region). Accordingly, as the liquid crystal arrangement within the second lens changes, the refractive index of the second lens may change. Accordingly, light passing through the second lens is refracted, and a 3D image may be provided to the user.

[0166] As a third voltage value is applied to the second lens, the focal length of the second lens can be set to be shorter than the distance between the display (110) and the lens array (120). Accordingly, the focal plane of the second lens can be set to be located closer to the user than the display (110). At this time, an image corresponding to a second depth region among the input images can be displayed on the focal plane of the second lens. For example, an object having a depth smaller than a reference value can be displayed on the focal plane of the second lens. The electronic device (1000) can increase the clarity of the object having a depth smaller than a reference value by displaying the object having a depth smaller than a reference value close to the focal plane.

[0167] In one embodiment of the present disclosure, the electronic device (1000) may apply a second voltage value determined in step S304 to the third lens. Accordingly, as the liquid crystal arrangement within the third lens is changed, the refractive index of the third lens may also be changed. Accordingly, light passing through the third lens is refracted, and a 3D image may be provided to the user.

[0168] As a second voltage value is applied to the third lens, the focal length of the third lens can be set to be longer than the distance between the display (110) and the lens array (120). Accordingly, the focal plane of the third lens can be set to be located further away from the user than the display (110). At this time, an image corresponding to the third depth region among the input images can be displayed on the focal plane of the third lens. In other words, an object having a depth greater than a reference value can be displayed on the focal plane of the third lens. The electronic device (1000) can increase the clarity of the object having a depth greater than a reference value by displaying the object having a depth greater than a reference value close to the focal plane.

[0169] According to one embodiment of the present disclosure, an electronic device (1000) can display a multi-depth image across a plurality of focal planes by providing focal planes of different depths. Accordingly, the electronic device (1000) can improve resolution over an overall depth range, and objects at all depths within the image can be provided relatively clearly.

[0170] Hereinafter, each step will be described in detail with reference to FIGS. 4a to 7.

[0171] FIG. 4a is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure deriving a depth map and segmenting it into a plurality of depth regions. FIG. 4b is a diagram illustrating the operation of an electronic device (1000) according to one embodiment of the present disclosure segmenting a depth map into a plurality of depth regions.

[0172] Referring to FIG. 4a, in one embodiment of the present disclosure, an electronic device (1000) may acquire an input image (410). The input image (410) may be an RGB image. FIG. 4a illustrates, by way of example, that the electronic device (1000) acquires an input image (410) corresponding to a single point in time, but the electronic device (1000) may acquire a plurality of input images corresponding to a plurality of points in time.

[0173] The input image (410) may contain one or more objects. For example, the input image (410) may include a table (411), a sofa (412), a bookshelf (413), a vase (414) placed on the table (411), ceramics (415, 416), and a candle (417), cushions (418) placed on the sofa (412), and books (419) placed on the bookshelf (413). Part of the sofa (412) and the cushions (418) placed on the sofa (412) may be located behind the table (411). The bookshelf (413) and the books (419) placed on the bookshelf (413) may be located behind the sofa (412) and the cushions (418) placed on the sofa (412).

[0174] In one embodiment of the present disclosure, an electronic device (1000) may generate a depth map (420) for an input image (410) from an input image (410). The depth map (420) may represent depth information in grayscale. In the depth map (420), objects located at a close distance (or small depth) may be represented in a color close to white, and objects located at a distant distance (or large depth) may be represented in a color close to black. According to one embodiment of the present disclosure, the electronic device (1000) may obtain the depth map (420) for an input image (410) from an external device (e.g., a server). For example, the electronic device (1000) may request the depth map (420) while transmitting the input image (410) to a server, and receive the depth map (420) generated from the input image (410) from the server.

[0175] In one embodiment of the present disclosure, the electronic device (1000) may segment a depth map (420) into a plurality of depth regions (411, 412, 433a, 433b, 433c). FIGS. 4a and 4b illustrate, by way of example, that the depth map (420) is divided into five depth regions (411, 412, 433a, 433b, 433c), but is not limited thereto.

[0176] First, as illustrated in FIG. 4b, in one embodiment of the present disclosure, the electronic device (1000) may set a plurality of depth sections (S1, S2, S3, S4, S5). For example, the electronic device (1000) may set five depth sections from the first section to the fifth section (S1, S2, S3, S4, S5). When the depth map (420) is represented in the range of a first depth (d1) to a sixth depth (d6) (e.g., 0 to 255), the electronic device (1000) can divide the depth of the depth map (420) into a first section (S1) greater than the first depth (d1) and less than the second depth (d2), a second section (S2) greater than the second depth (d2) and less than the third depth (d3), a third section (S3) greater than the third depth (d3) and less than the fourth depth (d4), a fourth section (S4) greater than the fourth depth (d4) and less than the fifth depth (d5), and a fifth section (S5) greater than the fifth depth (d5) and less than the sixth depth (d6).

[0177] In one embodiment of the present disclosure, the electronic device (1000) may divide a plurality of depth sections (S1, S2, S3, S4, S5) into equal intervals. In this case, the depth sections (S1, S2, S3, S4, S5) may be divided into equal intervals based on diopter units. Alternatively, the depth sections (S1, S2, S3, S4, S5) may be divided into equal intervals based on meter units.

[0178] In one embodiment of the present disclosure, the electronic device (1000) may divide a plurality of depth sections (S1, S2, S3, S4, S5) into unequal intervals. In this case, the electronic device (1000) may divide the plurality of depth sections into intervals that minimize visual fatigue by considering the cognitive characteristics of the viewer. Alternatively, the electronic device (1000) may divide the plurality of depth sections into intervals that enhance the viewer's three-dimensional immersion.

[0179] The electronic device (1000) can determine the area corresponding to the depth of the first section (S1) in the depth map (420) as the first area (D1). The electronic device (1000) can determine the area corresponding to the depth of the second section (S2) in the depth map (420) as the second area (D2). The electronic device (1000) can determine the area corresponding to the depth of the third section (S3) in the depth map (420) as the third area (D3). The electronic device (1000) can determine the area corresponding to the depth of the fourth section (S4) in the depth map (420) as the fourth area (D4). The electronic device (1000) can determine the area corresponding to the depth of the fifth section (S5) in the depth map (420) as the fifth area (D5).

[0180] As illustrated in FIG. 4a, the electronic device (1000) can segment the depth map (420) into multiple regions (D1, D2, D3, D4, D5) based on multiple depth intervals (S1, S2, S3, S4, S5). For example, the electronic device (1000) can segment the depth map (420) into first to fifth regions (D1, D2, D3, D4, D5) corresponding to each of the first to fifth intervals (S1, S2, S3, S4, S5).

[0181] The first area (D1) corresponding to the first section (S1) may include a portion of the table (411) located at a close distance and a vase (414) placed on the table (411). The second area (D2) corresponding to the second section (S2) may include another portion of the table (411) located at a medium distance and a small ceramic piece (415) placed on the table (411). The third area (D3) corresponding to the third section (S3) may include the remainder of the table (411) located at a distant distance, a large ceramic piece (416) and a candle (417) placed on the table (411), and a portion of the sofa (412) located at a close distance. The fourth area (D4) corresponding to the fourth section (S4) may include the remainder of the sofa (412) located at a distant distance and cushions (418) placed on the sofa (412). The fifth area (D5) corresponding to the fifth section (S5) may include a bookshelf (413) and books (419) placed on the bookshelf (413).

[0182] In one embodiment of the present disclosure, the electronic device (1000) may determine each of the first to fifth regions (D1, D2, D3, D4, D5) segmented from the depth map (420) as a corresponding depth region among the first depth region (431), the second depth region (432), and the third depth region (433).

[0183] The electronic device (1000) may determine the region containing the depth of the reference value as the first depth region (431). The depth of the reference value may be determined as the depth at which the focus is formed in the input image (410). For example, if the input image (410) is an image captured through a camera, the depth of the reference value may be determined as the depth at which the camera is focused. For example, the electronic device (1000) may determine the second region (D2) as the first depth region (431) as the depth of the reference value is included in the second section (s2).

[0184] The electronic device (1000) may determine a region having a depth smaller than a reference value as a second depth region (432). A depth smaller than the reference value may correspond to a depth closer than the depth of the reference value. For example, the electronic device (1000) may determine a first region (D1) having a depth smaller than the second region (D2) as the second depth region (432).

[0185] The electronic device (1000) may determine a region having a depth greater than a reference value as a third depth region (433). A depth greater than the reference value may correspond to a depth located farther away than the depth of the reference value. According to an embodiment, the third depth region (433) may be provided as a plurality of depth regions (433a, 433b, 433c) corresponding to different depth intervals. For example, the electronic device (1000) may determine a third region (D3), a fourth region (D4), and a fifth region (D5) having a depth greater than that of the second region (D2) as the third depth region (433). In the present disclosure, the third depth region (433) corresponding to the third region (D3) may be referred to as the third-1 depth region (433a), the third depth region (433) corresponding to the fourth region (D4) may be referred to as the third-2 depth region (433b), and the third depth region (433) corresponding to the fifth region (D5) may be referred to as the third-3 depth region (433c).

[0186] In one embodiment of the present disclosure, the electronic device (1000) may set a plurality of depth intervals (S1, S2, S3, S4, S5) and, based thereon, segment depth regions (411, 412, 433a, 433b, 433c) to provide the same depth of focus. The electronic device (1000) may represent objects (or parts of objects) corresponding to similar depth ranges in the input image (410) with the same depth of focus in the output image. Through this, the electronic device (1000) can output an image of multiple depths across a plurality of focal planes. Hereinafter, with reference to FIGS. 5 to 6b, an operation to determine the focal lengths of a plurality of lenses and voltage values ​​to be applied to a plurality of lenses based on the segmented depth regions (411, 412, 433a, 433b, 433c) will be described in detail.

[0187] FIG. 5 is a diagram illustrating the operation of determining the focal lengths of a plurality of lenses of an electronic device (1000) according to one embodiment of the present disclosure.

[0188] Referring together to FIG. 4a and FIG. 5, in one embodiment of the present disclosure, an electronic device (1000) can determine a focal length for each of a plurality of lenses of a liquid crystal lens. The electronic device (1000) can determine a focal length for each of the plurality of lenses based on divided depth regions (431, 432, 433a, 433b, 433c) of a depth map (420). Meanwhile, in one embodiment of the present disclosure, the plurality of lenses may have a different size and / or different arrangement from the pixels in the display (110). In this case, one lens may overlap with a plurality of pixels, and the electronic device (1000) may determine a different focal length depending on the region even within a single lens.

[0189] In one embodiment of the present disclosure, the liquid crystal lens (520) may include a first lens region (521) corresponding to a first depth region (431), a second lens region (522) corresponding to a second depth region (432), and a third lens region (523) corresponding to a third depth region (433). Among the plurality of lenses, the lens corresponding to the first lens region (521) may be referred to as the first lens. Among the plurality of lenses, the lens corresponding to the second lens region (522) may be referred to as the second lens. Among the plurality of lenses, the lens corresponding to the third lens region (523) may be referred to as the third lens.

[0190] In one embodiment of the present disclosure, as the third depth region (433) is provided as a plurality of depth regions (433a, 433b, 433c), the third lens region (523) may include a third-1 lens region (523a) corresponding to the third-1 depth region (433a), a third-2 lens region (523b) corresponding to the third-2 depth region (433b), and a third-3 lens region (523c) corresponding to the third-3 depth region (433c).

[0191] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length of a lens corresponding to each of a plurality of depth regions (431, 432, 433a, 433b, 433c). The electronic device (1000) can determine a first focal length (f1) in a first lens region (521) corresponding to a first depth region (431). The electronic device (1000) can determine a second focal length (f2) in a second lens region (522) corresponding to a second depth region (432). The electronic device (1000) can determine a third focal length (f3) in a third lens region (523) corresponding to a third depth region (433). For example, the electronic device (1000) can determine a third-1 focal length (f) in a third-1 lens region (523a) corresponding to a third-1 depth region (433a). 3a) can be determined. The electronic device (1000) can determine the third-2 focal length (f) in the third-2 lens area (523b) corresponding to the third-2 depth area (433b). 3b ) can be determined. The electronic device (1000) can determine the third-third focal length (f) of the third-third lens area (523c) corresponding to the third-third depth area (433c). 3c ) can be determined.

[0192] The electronic device (1000) can determine the first focal length (f1) as the focal length at which the focal plane (i.e., the first focal plane (511)) in the first lens area (521) is formed on the display (110). At this time, the electronic device (1000) may also be described as determining the first focal length (f1) to be infinite.

[0193] The electronic device (1000) can determine the second focal length (f2) as a focal length such that the focal plane (i.e., the second focal plane (512)) in the second lens area (522) is formed in front of the display (110) (i.e., the first focal plane (511)). In other words, the electronic device (1000) can determine the second focal length (f2) as a focal length such that the second focal plane (512) is formed closer to the user (300) than to the display (110).

[0194] The electronic device (1000) can determine the depth (or position) of the second focal plane (512) based on the depth at which an image corresponding to the second depth region (432) is to be displayed. For example, if an object included in the second depth region (432) is displayed with a relatively small depth difference from a reference value, the electronic device (1000) can determine the second focal length (f2) such that the position of the second focal plane (512) is also formed at a depth relatively close to the first focal plane (511). On the other hand, if an object included in the second depth region (432) is displayed with a relatively large depth difference from a reference value, the electronic device (1000) can determine the second focal length (f2) such that the position of the second focal plane (512) is also formed at a depth relatively far from the first focal plane (511). For example, a relatively small depth difference may be smaller than or equal to a difference threshold, and a relatively large depth difference may be greater than a difference threshold. For example, a relatively close depth may be less than or equal to the distance threshold, and a relatively far depth may be greater than the distance threshold.

[0195] The electronic device (1000) can determine the third focal length (f3) as a focal length such that the focal plane in the third lens area (523) (i.e., the third focal plane (513)) is formed behind the display (110) (i.e., the first focal plane (511)). In other words, the electronic device (1000) can determine the third focal length (f3) as a focal length such that the third focal plane (513) is formed further away from the user (300) than the display (110).

[0196] The electronic device (1000) can determine the depth (or position) of the third focal plane (513) based on the depth at which an image corresponding to the third depth region (433) is to be displayed. For example, if an object included in the third depth region (433) is displayed with a relatively small depth difference from a reference value, the electronic device (1000) can determine the third focal length (f3) such that the position of the third focal plane (513) is also formed at a depth relatively close to the first focal plane (511). On the other hand, if an object included in the third depth region (433) is displayed with a relatively large depth difference from a reference value, the electronic device (1000) can determine the third focal length (f3) such that the position of the third focal plane (513) is also formed at a depth relatively far from the first focal plane (511).

[0197] The third-1 depth region (433a), the third-2 depth region (433b), and the third-3 depth region (433c) may have depths that are sequentially further away from a reference value. The electronic device (1000) has a third-1 focal length (f) such that the third-1 focal plane (513a), the third-2 focal plane (513b), and the third-3 focal plane (513c) are sequentially further away from the first focal plane (511). 3a ), 3-2 focal length (f 3b ), and third-third focal length (f 3c ) Each can be determined.

[0198] According to one embodiment of the present disclosure, an electronic device (1000) can control a liquid crystal lens (520) to set a plurality of focal planes (511, 512, 513a, 513b, 513c) located at different depths depending on the region. At this time, the electronic device (1000) can set a plurality of focal planes (511, 512, 513a, 513b, 513c) corresponding to the depth of each of the objects to be displayed.

[0199] Hereinafter, with reference to FIGS. 6a and 6b, a liquid crystal lens (520) in which the focal lengths of a plurality of lenses change according to the voltage applied to the plurality of lenses will be described in detail, and with reference to FIGS. 6c and 6d, an operation for determining the voltage value to be applied to a plurality of lenses corresponding to the focal lengths of the plurality of lenses will be described in detail.

[0200] FIG. 6a is a drawing for explaining the configuration of a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 6b is a drawing for explaining the configuration of a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure.

[0201] Referring to FIG. 6a, in one embodiment of the present disclosure, the lens array (120) may include a first base substrate (121), a first electrode layer (122), a liquid crystal lens (123), a second electrode layer (124), and a second base substrate (125). The first electrode layer (122), the liquid crystal lens (123), and the second electrode layer (124) may be disposed between the first base substrate (121) and the second base substrate (125).

[0202] In one embodiment of the present disclosure, the first base substrate (121) and the second base substrate (125) may each be a transparent insulating substrate or a transparent insulating film. For example, the first base substrate (121) and the second base substrate (125) may each include a glass material, a quartz material, or a transparent plastic material.

[0203] In one embodiment of the present disclosure, the first electrode layer may include a metal electrode. For example, the metal electrode may be composed of aluminum (Al), chromium (Cr), or gold (Au), but the material of the metal electrode is not limited thereto. In one embodiment of the present disclosure, the second electrode layer may include a transparent electrode. For example, the transparent electrode may be composed of Indium Tin Oxide (ITO), but the material of the transparent electrode is not limited thereto.

[0204] In one embodiment of the present disclosure, a liquid crystal lens (123) may be disposed between a first electrode layer (122) and a second electrode layer (124). Through the difference between the voltage applied to the first electrode layer (122) and the voltage applied to the second electrode layer (124), an electric field is formed in the liquid crystal lens (123), so that the liquid crystal orientation of the liquid crystal lens (123) can be changed.

[0205] In one embodiment of the present disclosure, the liquid crystal lens (123) may include a plurality of lenses (123a1, 123a2) and a resin layer (123b) covering the plurality of lenses (123a1, 123a2). In one embodiment of the present disclosure, the plurality of lenses (123a1, 123a2) may include a plurality of liquid crystal molecules (123c1, 123c2). The plurality of liquid crystal molecules (123c1, 123c2) included in the plurality of lenses (123a1, 123a2) may be distributed at a uniform density over the entire area of ​​the plurality of lenses (123a1, 123a2).

[0206] In one embodiment of the present disclosure, the liquid crystal lens (123) can be controlled such that the orientation of the liquid crystal molecules (123c1, 123c2) constituting the plurality of lenses (123a1, 123a2) is changed according to the applied voltage. The degree of refraction of light incident on the liquid crystal lens (123) can be controlled according to the orientation state of the liquid crystal molecules (123c1, 123c2).

[0207] In one embodiment of the present disclosure, the electronic device (1000) can control the degree of refraction of light incident on each of the plurality of lenses (123a1, 123a2) by controlling the voltage applied to each of the plurality of lenses (123a1, 123a2). Alternatively, the electronic device (1000) can control the degree of refraction of light incident on each of the plurality of lenses (123a1, 123a2) according to the region of the plurality of lenses (123a1, 123a2) by controlling the voltage applied according to the region of the plurality of lenses (123a1, 123a2).

[0208] In one embodiment of the present disclosure, the liquid crystal alignment shape of a lens (123a1) to which any first voltage value (hereinafter referred to as the first voltage value (V1)) is applied and the liquid crystal alignment shape of a lens (123a2) to which any second voltage value (hereinafter referred to as the second voltage value (V2)) different from the first voltage value (V1) is applied may be different from each other. For example, the alignment angle of a liquid crystal molecule (123c1) within the lens (123a1) to which the first voltage value (V1) is applied may be different from the alignment angle of a liquid crystal molecule (123c2) within the lens (123a2) to which the second voltage value (V2) is applied.

[0209] Accordingly, the refractive index of the lens (123a1) to which the first voltage value (V1) is applied and the refractive index of the lens (123a2) to which the second voltage value (V2) is applied may be different from each other. The difference between the refractive index of the lens (123a1) to which the first voltage value (V1) is applied and the refractive index of the resin layer (123b) may be different from the difference between the refractive index of the lens (123a2) to which the second voltage value (V2) is applied and the refractive index of the resin layer (123b). For example, the light (LT1) passing through the lens (123a1) to which the first voltage value (V1) is applied may have a smaller degree of refraction than the light (LT2) passing through the lens (123a2) to which the second voltage value (V2) is applied. Accordingly, the focal length of the lens (123a1) to which the first voltage value (V1) is applied may be longer than the focal length of the lens (123a2) to which the second voltage value (V2) is applied.

[0210] FIG. 6a illustrates, as an example, the liquid crystal alignment shape of a lens (123a1) to which a first voltage value (V1) is applied and the liquid crystal alignment shape of a lens (123a2) to which a second voltage value (V2) is applied. Depending on the alignment method of the liquid crystal (e.g., TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, etc.) or the type of liquid crystal molecules (123c1, 123c2), the lenses (123a1, 123a2) may have various liquid crystal alignment shapes.

[0211] Referring to FIG. 6b, in one embodiment of the present disclosure, a lens array (120) may include a first base substrate (121), a first electrode layer (122), a liquid crystal lens (123), a second electrode layer (124), and a second base substrate (125). The liquid crystal lens (123) may include a plurality of lenses (123a) and a resin layer (123b1 or 123b2) covering the plurality of lenses (123a).

[0212] In one embodiment of the present disclosure, a resin layer (123b1 or 123b2) may include a plurality of liquid crystal molecules (123c1' or 123c2'). The plurality of liquid crystal molecules (123c1' or 123c2') included in the resin layer (123b1 or 123b2) may be distributed at a uniform density over the entire area of ​​the resin layer (123b1 or 123b2).

[0213] In one embodiment of the present disclosure, the liquid crystal lens (123) may be controlled such that the orientation of the liquid crystal molecules (123c1' or 123c2') constituting the resin layer (123b1 or 123b2) is changed according to the applied voltage. The liquid crystal lens (123) may be controlled such that the degree of refraction of light incident on the liquid crystal lens (123) is controlled according to the orientation state of the liquid crystal molecules (123c1' or 123c2').

[0214] In one embodiment of the present disclosure, the electronic device (1000) controls the voltage applied to each of the plurality of lenses (123a), thereby allowing the voltage applied to the resin layer (123b1 or 123b2) to be controlled by region. By controlling the voltage applied according to the region of the resin layer (123b1 or 123b2), the degree of refraction of incident light can be controlled according to the region of the liquid crystal lens (123).

[0215] In one embodiment of the present disclosure, the liquid crystal alignment shape of the resin layer (123b1) to which a first voltage value (V1) is applied and the liquid crystal alignment shape of the resin layer (123b2) to which a second voltage value (V2) different from the first voltage value (V1) is applied may be different from each other. For example, the alignment angle of the liquid crystal molecules (123c1') in the resin layer (123b1) to which the first voltage value (V1) is applied may be different from the alignment angle of the liquid crystal molecules (123c2') in the resin layer (123b2) to which the second voltage value (V2) is applied.

[0216] Accordingly, the refractive index of the resin layer (123b1) to which the first voltage value (V1) is applied and the refractive index of the resin layer (123b2) to which the second voltage value (V2) is applied may be different from each other. The difference between the refractive index of the resin layer (123b1) to which the first voltage value (V1) is applied and the refractive index of the lens (123a) may be different from the difference between the refractive index of the resin layer (123b2) to which the second voltage value (V2) is applied and the refractive index of the lens (123a). For example, light (LT1') passing through the lens (123a) to which the first voltage value (V1) is applied may have a smaller degree of refraction than light (LT2') passing through the lens (123a) to which the second voltage value (V2) is applied. Accordingly, the focal length of the lens (123a) to which the first voltage value (V1) is applied may be longer than the focal length of the lens (123a) to which the second voltage value (V2) is applied.

[0217] FIG. 6b illustrates, for example, the liquid crystal alignment shape of a resin layer (123b1) to which a first voltage value (V1) is applied and the liquid crystal alignment shape of a resin layer (123b2) to which a second voltage value (V2) is applied. Depending on the alignment method of the liquid crystal (e.g., TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, etc.) or the type of liquid crystal molecules (123c1', 123c2'), the lenses (123a1, 123a2) may have various liquid crystal alignment shapes.

[0218] FIG. 6c is a diagram illustrating an operation to obtain a voltage value to be applied to a plurality of lenses of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 6d is a diagram illustrating an operation to obtain a voltage value to be applied to a plurality of lenses of an electronic device (1000) according to one embodiment of the present disclosure.

[0219] Referring to FIG. 6c and FIG. 6d, in one embodiment of the present disclosure, an electronic device (1000) comprises determined focal lengths (f1, of a plurality of lenses f2, f 3a , f 3b , f 3c Based on ), voltage values ​​(V1, to be applied to multiple lenses V2, V 3a , V 3b , V 3c ) can be determined.

[0220] In one embodiment of the present disclosure, the electronic device (1000) may obtain a graph regarding voltage value-focal length. Based on the obtained graph, the electronic device (1000) may determine a voltage value to be applied to the lens according to the focal length of the lens. Alternatively, in one embodiment of the present disclosure, the electronic device (1000) may obtain a lookup table of voltage value-focal length pairs. Based on the obtained lookup table, the electronic device (1000) may determine a voltage value to be applied to the lens according to the focal length of the lens.

[0221] Referring to FIG. 6c, in one embodiment of the present disclosure, the voltage value applied to the lens and the focal length of the lens may have an inverse relationship. That is, as the voltage value applied to the lens increases, the focal length of the lens may become shorter. More specifically, as the voltage value applied to the lens increases, the difference between the refractive index of the lens and the refractive index of the resin layer increases, thereby increasing the degree of refraction of light passing through the lens.

[0222] Referring to FIG. 5 and FIG. 6c together, the electronic device (1000) may decide to apply a first voltage value (V1) to the first lens area (521) to form a first focal length (f1) of infinity. For example, the electronic device (1000) may decide not to apply voltage to the first lens area (521). That is, the electronic device (1000) may decide the first voltage value (V1) to be 0V.

[0223] The electronic device (1000) may determine to apply a second voltage value (V2) to the second lens area (522) such that the second focal plane (512) is formed closer to the user (300) than to the display (110). To this end, the electronic device (1000) may determine to apply a second voltage value (V2) to the second lens area (522) such that the second focal length (f2) is formed shorter than the distance between the display (110) and the liquid crystal lens.

[0224] The electronic device (1000) may determine to apply a third voltage value (V3) to the third lens area (523) such that the third focal plane (513) is formed further away from the user (300) than the display (110). To this end, the electronic device (1000) may determine to apply a third voltage value (V3) to the third lens area (523) such that the third focal length (f3) is formed longer than the distance between the display (110) and the liquid crystal lens. The electronic device (1000) may form the third focal length (f3) longer than the second focal length (f2).

[0225] In one embodiment of the present disclosure, the electronic device (1000) can determine, based on the graph of voltage value-focal length of FIG. 6c, that the second voltage value (V2) to be applied to the second lens area (522) is greater than the third voltage value (V3) to be applied to the third lens area (523).

[0226] The electronic device (1000) has a third-1 voltage value (V) formed such that the third-1 focal plane (513a), the third-2 focal plane (513b), and the third-3 focal plane (513c) are sequentially moved away from the first focal plane (511) in the third-1 lens region (523a), the third-2 lens region (523b), and the third-3 lens region (523c). 3a ), 3-2 Voltage Value (V 3b ), and the 3-3 voltage value (V 3c It can be determined by applying ) respectively. To this end, the electronic device (1000) has a third-1 focal length (f 3a ), 3-2 focal length (f 3b ), and third-third focal length (f 3c The 3-1 voltage value (V) that sequentially lengthens to form ) 3a ), 3-2 Voltage Value (V 3b ), 3-3 Voltage Value (V 3c ) can be determined.

[0227] In one embodiment of the present disclosure, based on the graph regarding voltage value-focal length of FIG. 6c, the electronic device (1000) applies a third-1 voltage value (V) to a third-1 lens area (523a). 3a ), the third-2 voltage value (V) to be applied to the third-2 lens area (523b) 3b ), and the third-3 voltage value (V) to be applied to the third-3 lens area (523c). 3c ) can be determined by sequentially decreasing values.

[0228] Referring to FIG. 6d, in one embodiment of the present disclosure, the voltage value applied to the lens and the focal length of the lens may have a proportional relationship. That is, as the voltage value applied to the lens increases, the focal length of the lens may become longer. More specifically, as the voltage value applied to the lens increases, the difference between the refractive index of the lens and the refractive index of the resin layer decreases, thereby reducing the degree of refraction of light passing through the lens.

[0229] Referring together to FIG. 5 and FIG. 6d, the electronic device (1000) may determine to apply a first voltage value (V1) capable of forming an infinite first focal length (f1) to the first lens region (521). For example, the electronic device (1000) may determine to apply a first voltage value (V1) that aligns liquid crystal molecules to the maximum alignment angle in the first lens region (521). In the present disclosure, the alignment of liquid crystal molecules to the maximum alignment angle may also be described as the alignment state of the liquid crystal molecules being set to a maximumly aligned state.

[0230] The electronic device (1000) can form a third focal length (f3) longer than the second focal length (f2). In one embodiment of the present disclosure, the electronic device (1000) can determine a second voltage value (V2) to be applied to the second lens area (522) to be smaller than a third voltage value (V3) to be applied to the third lens area (523), based on the graph of voltage value-focal length of FIG. 6d.

[0231] The electronic device (1000) has a third-first focal length (f 3a ), 3-2 focal length (f 3b ), and third-third focal length (f 3c) can be formed to be sequentially elongated. In one embodiment of the present disclosure, based on the graph of voltage value-focal length of FIG. 6d, the electronic device (1000) applies a third-1 voltage value (V) to the third-1 lens region (523a). 3a ), the third-2 voltage value (V) to be applied to the third-2 lens area (523b) 3b ), and the third-3 voltage value (V) to be applied to the third-3 lens area (523c). 3c ) can be determined by sequentially increasing values.

[0232] The graphs in FIGS. 6c and 6d are illustrated as examples, and the relationship between voltage value and focal length may vary depending on the alignment method of the liquid crystal (e.g., TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, etc.) or the type of liquid crystal molecule.

[0233] FIG. 7 is a diagram illustrating an operation for providing an image expressed in multiple depths across a plurality of different focal planes of an electronic device (1000) according to one embodiment of the present disclosure.

[0234] FIG. 7 is a drawing for explaining images provided through each of the first lens (L1) corresponding to the first lens region (521, see FIG. 5), the second lens (L2) corresponding to the second lens region (522, see FIG. 5), and the third lens (L3) corresponding to the third lens region (523, see FIG. 5) among a plurality of lenses. FIG. 7 briefly illustrates only one first lens (L1), one second lens (L2), and one third lens (L3) among the configurations of the liquid crystal lens (123).

[0235] In one embodiment of the present disclosure, an electronic device (1000) can provide an image corresponding to a first depth region (431, see FIG. 5) through a first lens (L1). Hereinafter, the image corresponding to the first depth region (431, see FIG. 5) will be referred to as a first depth image (701). Light displaying the first depth image (701) can pass through the first lens (L1) and be visible to a user.

[0236] The electronic device (1000) can apply a first voltage value (V1, see FIG. 6c or FIG. 6d) to the first lens (L1) to set the first focal length (f1) to infinity. In other words, the electronic device (1000) can apply a first voltage value (V1, see FIG. 6c or FIG. 6d) to the first lens (L1) to form a first focal plane (511) located on the display (110). The refractive index of the first lens (L1) and the refractive index of the resin layer are the same, so that light passing through the first lens (L1) may not be refracted. The electronic device (1000) can provide the first depth image (701) as a 2D image. The electronic device (1000) can provide the 2D image to the user exactly as the image displayed on the display (110). Additionally, the electronic device (1000) can provide a 2D image as a focused image on the display (110). Accordingly, the electronic device (1000) can provide a 2D image with high resolution and high clarity.

[0237] In one embodiment of the present disclosure, the electronic device (1000) can provide an image corresponding to a second depth region (432, see FIG. 5) through a second lens (L2). Hereinafter, the image corresponding to the second depth region (432, see FIG. 5) will be referred to as a second depth image (702). Light displaying the second depth image (702) can pass through the second lens (L2) and be visible to the user.

[0238] The electronic device (1000) can apply a second voltage value (V2, see FIG. 6c or FIG. 6d) to the second lens (L2) to form a second focal length (f2) shorter than the distance between the liquid crystal lens (123) and the display (110). In other words, the electronic device (1000) can apply a second voltage value (V2, see FIG. 6c or FIG. 6d) to the second lens (L2) to form a second focal plane (512) located closer than the display (110). Light passing through the second lens (L2) can be refracted due to the difference between the refractive index of the second lens (L2) and the refractive index of the resin layer. The electronic device (1000) can provide the second depth image (702) as a 3D image. At this time, the light passing through the second lens (L2) can provide the second depth image (702) as a real image.

[0239] A second lens (L2) providing a second depth image (702) located at a depth closer than the display (110) can be controlled to form a second focal plane (512) located at a depth closer than the display (110). Accordingly, the electronic device (1000) can increase the clarity of the image displayed at a depth closer than the display (110).

[0240] In one embodiment of the present disclosure, the electronic device (1000) can provide an image corresponding to a third depth region (433, see FIG. 5) through a third lens (L3). Hereinafter, the image corresponding to the third depth region (433, see FIG. 5) will be referred to as a third depth image (703). Light displaying the third depth image (703) can pass through the third lens (L3) and be visible to the user.

[0241] The electronic device (1000) may apply a third voltage value (V3, see FIG. 6c or FIG. 6d) to the third lens (L3) to form a third focal length (f3) that is longer than the distance between the liquid crystal lens (123) and the display (110). In other words, the electronic device (1000) may apply a third voltage value (V3, see FIG. 6c or FIG. 6d) to the third lens (L3) to form a third focal plane (513) located further away from the display (110). Light passing through the third lens (L3) may be refracted due to the difference between the refractive index of the third lens (L3) and the refractive index of the resin layer. The electronic device (1000) may provide the third depth image (703) as a 3D image. At this time, the light passing through the third lens (L3) may provide the third depth image (703) as a virtual image.

[0242] A third lens (L3) providing a third depth image (703) located at a depth further than the display (110) can be controlled to form a third focal plane (513) located at a depth further than the display (110). Accordingly, the electronic device (1000) can increase the clarity of the image displayed at a depth further than the display (110).

[0243] Meanwhile, when the focal length of the lens is set to the distance between the liquid crystal lens (123) and the display (110), light passing through one lens can display only one pixel. On the other hand, according to one embodiment of the present disclosure, as the second focal length (f2) and the third focal length (f3) are set to be shorter or longer than the distance between the liquid crystal lens (123) and the display (110), light passing through one second lens (L2) and one third lens (L3) can display multiple pixels together. Accordingly, the electronic device (1000) can increase the resolution of the 3D image.

[0244] According to one embodiment of the present disclosure, an electronic device (1000) may provide focal planes (511, 512, 513) of different depths to display a multi-depth image across a plurality of focal planes (511, 512, 513). Accordingly, the electronic device (1000) may improve resolution over an overall depth range and may provide objects at all depths within the image relatively clearly.

[0245] FIG. 8 is a flowchart for explaining the operation of displaying a corrected image of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 9 is a diagram for explaining the operation of displaying a corrected image of an electronic device (1000) according to one embodiment of the present disclosure.

[0246] Referring to FIG. 8, the method of an electronic device (1000) providing a 3D image may further include step S810. In one embodiment of the present disclosure, step S810 may be executed by at least one processor included in the electronic device (1000).

[0247] After the operation of step S810 illustrated in FIG. 8 is performed, the operation of step S350 illustrated in FIG. 3 may be performed. Meanwhile, the operation of step S810 illustrated in FIG. 8 may be performed while the operations of steps S310 to S340 illustrated in FIG. 3 are being performed, or it may be performed before or after the operations of steps S310 to S340 are being performed.

[0248] In step S810 of FIG. 8, an electronic device (1000) according to one embodiment of the present disclosure may display a corrected image obtained by performing a correction that inverts the image corresponding to the second depth region in the input image left and right. The image corresponding to the second depth region may correspond to an area displayed at a depth closer to the display (110). Hereinafter, the image corresponding to the second depth region will be referred to as the second depth image. The second depth image may be provided through a second lens (or second lens area) in which a second focal plane is formed at a depth closer to the display (110).

[0249] The image corresponding to the first depth region is provided from light passing through a lens having an infinite focal length, so that the image displayed on the display (110) is unrefracted as it passes through the lens and can be seen by the user as is. The image corresponding to the third depth region is provided from light passing through a lens having a focal length longer than the distance from the display (110), so that it can be provided as a virtual image. Accordingly, the image corresponding to the third depth region can be seen by the user as is, without the image corresponding to the optical focal area of ​​the corresponding lens among the images displayed on the display (110) being inverted.

[0250] On the other hand, the image corresponding to the second depth region can be provided as a real image by being provided from light passing through a lens having a focal length shorter than the distance from the display (110). Accordingly, the image corresponding to the second depth region can be perceived by the user as an image in which the image corresponding to the optical focal area of ​​the corresponding lens among the images displayed on the display (110) is flipped horizontally.

[0251] Accordingly, in one embodiment of the present disclosure, the electronic device (1000) may perform a correction that flips only the image corresponding to the second depth region horizontally, and may not perform a correction that flips the image corresponding to the first depth region and the third depth region in the input image horizontally. That is, in step S810, the electronic device (1000) may display a corrected image in which the image corresponding to the first depth region and the third depth region is not corrected, and only the image corresponding to the second depth region is flipped horizontally.

[0252] Referring together with FIG. 9, in one embodiment of the present disclosure, the second depth image (910) may be an image provided through light passing through the second lens (L2). The second focal length (f2) of the second lens (L2) may be shorter than the distance between the display (110) and the liquid crystal lens (123). The second focal plane (512) of the second lens (L2) may be formed at a depth (or position) closer to the user than the display (110).

[0253] Light passing through the second lens (L2) can provide a real image. Light passing through the second lens (L2) can provide a left-right reversed image from the image displayed on the display (110) depending on the optical characteristics of the second lens (L2).

[0254] In one embodiment of the present disclosure, the electronic device (1000) may perform a correction to invert the second depth image (910) in the input image in the left-right direction in advance, thereby obtaining a corrected image (920) in which the second depth image (910) is inverted in the left-right direction (also referred to as the corrected second depth image (920)). For example, the second depth image (910) may include a first pixel (901), a second pixel (902), and a third pixel (903) arranged side by side in the right direction. In the second depth image (910), the first pixel (901) may display blue, the second pixel (902) may display red, and the third pixel (903) may display green. That is, in the second depth image (910), blue, red, and green may be displayed sequentially in the right direction.

[0255] The electronic device (1000) can generate a corrected image by performing a correction that inverts the first pixel (901), the second pixel (902), and the third pixel (903) in the second depth image (910) among the input images. The corrected second depth image (920) among the corrected images includes the first pixel (901'), the second pixel (902'), and the third pixel (903') arranged side by side in the right direction, wherein the first pixel (901') displays green, the second pixel (902') displays red, and the third pixel (903') displays blue. That is, in the corrected second depth image (920), green, red, and blue can be displayed sequentially in the right direction.

[0256] According to one embodiment of the present disclosure, even if an image displayed on the display (110) is provided in a left-right inverted manner due to the optical characteristics of the second lens (L2) at the second focal plane (512), the electronic device (1000) displays a left-right inverted corrected image on the display (110) in advance, so that the image (930) finally recognized by the user can be the same as (or correspond to) the input image (910).

[0257] FIG. 10 is a flowchart illustrating an operation to change the range of depth regions of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 11a is a diagram illustrating an example of consecutive frames included in an input image according to one embodiment of the present disclosure. FIG. 11b is a flowchart illustrating a method for an electronic device (1000) according to one embodiment of the present disclosure to change the range of depth regions.

[0258] Referring to FIG. 10, the method of an electronic device (1000) providing a 3D image may further include step S1010. In one embodiment of the present disclosure, step S1010 may be executed by at least one processor included in the electronic device (1000).

[0259] The operation of step S1010 illustrated in FIG. 10 can be performed after the operation of S310 illustrated in FIG. 3 has been performed. After the operation of step S1010 illustrated in FIG. 10 has been performed, the operation of S320 illustrated in FIG. 3 can be performed.

[0260] In step S1010 of FIG. 10, an electronic device (1000) according to one embodiment of the present disclosure may change the range of a plurality of depth regions in some of the consecutive frames based on the movement of at least one object in consecutive frames included in an input image.

[0261] FIG. 11a exemplarily illustrates that the input image includes a first frame (1110), a second frame (1120), and a third frame (1130) that are consecutive. Referring together with FIG. 11a, for example, each of the first to third frames (1110, 1120, 1130) may include a first object (1111) located at a relatively small depth (i.e., close distance), a second object (1112) located at a medium depth (i.e., medium distance), and a third object (1113) located at a relatively large depth (i.e., far distance). FIG. 11a exemplarily illustrates that the first object (1111) and the second object (1112) are each birds, and the third object (1113) is a mountain. The second object (1112) is located at the depth of the reference value and is included in the first depth area, the first object (1111) is located closer than the depth of the reference value and is included in the second depth area, and the third object (1113) is located further than the depth of the reference value and can be included in the third depth area.

[0262] In one embodiment of the present disclosure, in consecutive first frame (1110), second frame (1120), and third frame (1130), the first object (1111), second object (1112), and third object (1113) can all be moved. Accordingly, the depth values ​​of each of the first object (1111), second object (1112), and third object (1113) can be changed in the first frame (1110), second frame (1120), and third frame (1130).

[0263] For example, as moving from the first frame (1110) to the third frame (1130), the first object (1111) can be moved closer to the user. That is, the first object (1111) can be moved to be located at a smaller depth.

[0264] For example, as moving from the first frame (1110) to the third frame (1130), the second object (1112) may move further away from the user. That is, the second object (1112) may be moved to be located at a greater depth.

[0265] For example, as moving from the first frame (1110) to the third frame (1130), the third object (1113) may move further away from the user. That is, the third object (1113) may be moved to be located at a greater depth.

[0266] For example, as moving from the first frame (1110) to the third frame (1130), the depth difference between the first object (1111), the second object (1112), and the third object (1113) may increase. The first object (1111) may quickly move closer to the user and pop out quickly. The second object (1112) and the third object (1113) may quickly move away from the user and go back quickly.

[0267] Referring together with FIG. 11b, the electronic device (1000) can change the range of multiple depth regions in some of the consecutive frames based on the movement of at least one object within the consecutive frames. FIG. 11b exemplarily illustrates the change in the range of multiple depth regions in the third frame (1130) of FIG. 11a.

[0268] The electronic device (1000) can identify that, in the third frame (1130), the distance difference between the first to third objects (1111, 1112, 1113) changes significantly depending on the movement of the first to third objects (1111, 1112, 1113). The electronic device (1000) can determine that as the distance difference between the first to third objects (1111, 1112, 1113) increases rapidly, if the distance difference is expressed as is in the output image, it will provide a severe sense of depth to the extent that it causes visual fatigue, such as dizziness, to the user.

[0269] The electronic device (1000) can compress the range of depth intervals in the third frame (1130). For example, the electronic device (1000) can represent the depth value as an integer value between 0 and 255 and the reference value as 125 in the depth map corresponding to the first frame (1110) and the second frame (1120). The electronic device (1000) can compress the range of depth intervals to an integer value between 100 and 150 while maintaining the reference value as 125 in the depth map corresponding to the third frame (1130).

[0270] Accordingly, the depth difference (1141') between the first object (1111') and the second object (1112) according to the compressed depth map may be smaller than the depth difference (1141) between the first object (1111) and the second object (1112) according to the original depth map of the input image (1130). The depth difference (1142') between the second object (1112) and the third object (1113') according to the compressed depth map may be smaller than the depth difference (1142) between the second object (1112) and the third object (1113) according to the original depth map. The depth difference (1143') between the first object (1111') and the third object (1113') according to the compressed depth map may be smaller than the depth difference (1143) between the first object (1111) and the third object (1113) according to the original depth map.

[0271] The electronic device (1000) can compress the depth representation in the final image (1130') based on the compressed depth map. Accordingly, the electronic device (1000) can provide a final image (1130') in which the degree to which the first object (1111') protrudes forward from the display (110) is reduced compared to the input image (1130). Additionally, the electronic device (1000) can provide a final image (1130') in which the degree to which the third object (1113') recedes backward from the display (110) is reduced compared to the input image (1130).

[0272] According to one embodiment of the present disclosure, the electronic device (1000) can control the stereoscopic effect of the image actually provided by controlling the range of depth intervals. For example, as shown in FIG. 11b, the electronic device (1000) can provide a 3D image that does not cause visual fatigue, such as dizziness, to the user by providing a final image (1130') with reduced stereoscopic effect overall.

[0273] In one embodiment of the present disclosure, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses based on a depth map in which the depth range is changed.

[0274] For example, the electronic device (1000) can determine the focal length (e.g., first focal length) of a corresponding lens (e.g., first lens) and the voltage value to be applied to the corresponding lens (e.g., first voltage value) so that a first focal plane (1131) is formed corresponding to the depth at which a second object (1112) is displayed in the final image (1130').

[0275] For example, the electronic device (1000) can determine the focal length (e.g., second focal length) of a corresponding lens (e.g., second lens) and the voltage value (e.g., second voltage value) to be applied to the corresponding lens so that a second focal plane (1132) is formed corresponding to the depth at which the first object (1111') is displayed in the final image (1130').

[0276] For example, the electronic device (1000) can determine the focal length (e.g., third focal length) of a corresponding lens (e.g., third lens) and the voltage value to be applied to the corresponding lens (e.g., third voltage value) so that a third focal plane (1133) is formed corresponding to the depth at which a third object (1113') is displayed in the final image (1130').

[0277] According to one embodiment of the present disclosure, an electronic device (1000) may provide focal planes (1131, 1132, 1133) of different depths to provide a multi-depth final image (1130') expressed across a plurality of focal planes (1131, 1132, 1133). In this case, the electronic device (1000) may determine the depth of the plurality of focal planes (1131, 1132, 1133) by reflecting a corrected depth expression. Accordingly, the electronic device (1000) may improve the resolution in the overall depth range within the image even when correcting the depth expression to control the stereoscopic effect of the image. Additionally, the electronic device (1000) may provide objects at all depths within the image clearly even when correcting the depth expression to control the stereoscopic effect of the image.

[0278] In FIG. 11b, a correction that compresses the depth range is illustrated as an example, but the electronic device (1000) may perform a correction that expands the depth range to enhance the three-dimensional effect, or may perform a correction that changes the depth range corresponding to the reference point.

[0279] FIG. 12 is a flowchart illustrating an operation to change a depth region corresponding to a range of depth regions or a reference point of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 13 is a diagram illustrating an operation to change a range of depth regions of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 14a is a diagram illustrating an operation to change a depth region corresponding to a reference point of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 14b is a diagram illustrating an operation to change a depth region corresponding to a reference point of an electronic device (1000) according to one embodiment of the present disclosure.

[0280] Referring to FIG. 12, the method of an electronic device (1000) providing a 3D image may further include step S1210. In one embodiment of the present disclosure, step S1210 may be executed by at least one processor included in the electronic device (1000).

[0281] The operation of step S1210 illustrated in FIG. 12 can be performed after the operation of S310 illustrated in FIG. 3 has been performed. After the operation of step S1210 illustrated in FIG. 12 has been performed, the operation of S320 illustrated in FIG. 3 can be performed.

[0282] In step S1210 of FIG. 12, an electronic device (1000) according to one embodiment of the present disclosure may change a depth area corresponding to a range of depth areas or a reference point based on user input that adjusts the intensity of the stereoscopic effect or the degree of depth of a 3D image.

[0283] For example, when the electronic device (1000) receives user input to adjust the intensity of the stereoscopic effect of a 3D image, it can change the range of multiple depth regions based on the user input. The operation regarding this will be described in detail below with reference to FIG. 13.

[0284] For example, when the electronic device (1000) receives user input to adjust the depth of a 3D image, it can change the depth area corresponding to the reference point based on the user input. The operation regarding this will be described in detail below with reference to FIG. 14a and FIG. 14b.

[0285] Referring to FIG. 13, in one embodiment of the present disclosure, an electronic device (1000) may provide a user interface (1410) capable of adjusting the intensity of the stereoscopic effect of a 3D image. For example, the electronic device (1000) may provide a user interface (1410) capable of reducing the depth expression to reduce the intensity of the stereoscopic effect or expanding the depth expression to increase the intensity of the stereoscopic effect.

[0286] In one embodiment of the present disclosure, the electronic device (1000) may obtain input from a user requesting adjustment of the intensity of the three-dimensional effect through a user interface (1410). For example, the electronic device (1000) may obtain input from a user requesting a reduction in depth expression to reduce the intensity of the three-dimensional effect. Or, for example, the electronic device (1000) may obtain input from a user requesting an expansion in depth expression to increase the intensity of the three-dimensional effect.

[0287] In one embodiment of the present disclosure, the electronic device (1000) may change the range of a plurality of depth regions according to input from a user requesting adjustment of the intensity of the stereoscopic effect. For example, the electronic device (1000) may change the range of depth sections during the process of generating a depth map for an input image. Based on the depth map in which the depth sections have been changed, the electronic device (1000) may provide an image in which the corrected depth sections are reflected.

[0288] For example, the electronic device (1000) can compress the range of depth intervals in the process of generating a depth map for an input image as it obtains input from a user requesting a reduction in depth representation. That is, the electronic device (1000) can provide an image in which the depth difference between objects is reduced.

[0289] For example, the electronic device (1000) can expand the range of depth intervals in the process of generating a depth map for an input image as it acquires input from a user requesting an expansion of the depth representation. That is, the electronic device (1000) can provide an image in which the depth difference between objects is increased.

[0290] An example of providing a final image based on the range of multiple changed depth regions has been described above with reference to FIG. 11b, so a detailed explanation thereof will be omitted.

[0291] In one embodiment of the present disclosure, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses based on a depth map in which the depth range has been changed. For example, when the range of the depth range is compressed by obtaining input from a user requesting a reduction in the depth representation, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses such that the position of the second focal plane becomes closer to the first focal plane or the position of the third focal plane becomes closer to the first focal plane. For example, when the range of the depth range is expanded by obtaining input from a user requesting an enlargement of the depth representation, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses such that the position of the second focal plane becomes further away from the first focal plane or the position of the third focal plane becomes further away from the first focal plane.

[0292] According to one embodiment of the present disclosure, an electronic device (1000) can determine the depths of a plurality of focal planes by reflecting a corrected depth representation. Accordingly, the electronic device (1000) can improve the resolution in the overall depth range within the image even when correcting the depth representation to adjust the stereoscopic effect of the image according to user input. Additionally, the electronic device (1000) can provide objects at all depths within the image clearly even when correcting the depth representation to adjust the stereoscopic effect of the image according to user input.

[0293] Referring to FIG. 14a, in one embodiment of the present disclosure, an electronic device (1000) may provide a user interface (1420) capable of adjusting the depth of a 3D image. For example, the electronic device (1000) may provide a user interface (1420) capable of moving a depth representation forward to reduce the depth or moving a depth representation backward to increase the depth.

[0294] In one embodiment of the present disclosure, the electronic device (1000) may receive input from a user requesting adjustment of the depth level. For example, the electronic device (1000) may receive input from a user corresponding to a request to move a depth representation forward to reduce the depth level. Or, for example, the electronic device (1000) may receive input from a user corresponding to a request to move a depth representation backward to increase the depth level.

[0295] In one embodiment of the present disclosure, the electronic device (1000) can change a depth area corresponding to a reference point among a plurality of depth areas according to input from a user requesting adjustment of depth. That is, the electronic device (1000) can change an area corresponding to a first depth area among a plurality of segmented areas based on a plurality of depth intervals.

[0296] For example, the electronic device (1000) can change a third depth region located at a depth greater than the first depth region in the original depth map according to the input image to the first depth region in response to user input responding to a request to move the depth representation forward. At this time, the electronic device (1000) can reduce the depth of all depth regions overall. The electronic device (1000) can provide a final image in which objects appear to be located close together overall when compared with the input image.

[0297] For example, the electronic device (1000) can change a second depth region located at a depth smaller than the first depth region in the original depth map according to the input image to the first depth region in response to a user input requesting to move the depth representation backward. At this time, the electronic device (1000) can increase the depth of all depth regions overall. The electronic device (1000) can provide a final image in which objects appear to be located farther away overall when compared with the input image.

[0298] According to one embodiment of the present disclosure, an electronic device (1000) may provide focal planes of different depths to provide a multi-depth image expressed across a plurality of focal planes. In this case, the electronic device (1000) may determine the depth of the plurality of focal planes based on a depth expression corrected according to user input. Accordingly, the electronic device (1000) may improve the resolution in the overall depth range within the image even when correcting the depth expression to adjust the depth of the image according to user input. The electronic device (1000) may provide objects at all depths within the image clearly even when correcting the depth expression to adjust the depth of the image according to user input.

[0299] Referring together with FIG. 14b, for example, the original depth map according to the input image (1430) may include a first region (1441) corresponding to a first depth interval, a second region (1442) corresponding to a second depth interval, and a third region (1443) corresponding to a third depth interval. The first region (1441) may include a first object (1431), the second region (1442) may include a second object (1432), and the third region (1443) may include a third object (1433). FIG. 14b exemplarily illustrates that the first object (1431) and the second object (1432) are each birds, and the third object (1433) is a mountain.

[0300] In the original depth map according to the input image (1430), the second region (1442) containing the second object (1432) can be determined as the first depth region. That is, the depth at which the second object (1432) is located can be the reference value. In the original depth map according to the input image (1430), the first region (1441) containing the first object (1431) can be determined as the second depth region because it is located at a depth smaller than that of the second object (1432). In the original depth map according to the input image (1430), the third region (1443) containing the third object (1433) can be determined as the third depth region because it is located at a depth larger than that of the second object (1432).

[0301] For example, the electronic device (1000) may receive user input corresponding to a request to move the depth representation backward to increase the depth level. The electronic device (1000) may change the first depth area to the first area (1441') containing the first object (1431') according to the received user input. That is, the electronic device (1000) may change the first area (1441') from the second depth area to the first depth area. The electronic device (1000) may change the depth where the first object (1431') is located to a reference value. The depth (1450') of the first object (1431') in the changed depth map may be greater than the depth (1450) of the first object (1431) in the original depth map according to the input image (1430).

[0302] The electronic device (1000) can change the second region (1442') containing the second object (1432') into a third-1 depth region, and change the third region (1443') containing the third object (1433') into a third-2 depth region. That is, the electronic device (1000) can change the second region (1442') from a first depth region to a third-1 depth region, and change the third region (1443') from the existing third depth region to a third-2 depth region located at a greater depth. The depth of the second object (1432') and the depth of the third object (1433') in the changed depth map can be greater than the depth of the second object (1432) and the depth of the third object (1433) in the original depth map according to the input image (1430), respectively.

[0303] Accordingly, according to the input image (1430), the first object (1431) is located closer to the display (110), the second object (1432) is located on the display (110), and the third object (1433) is located further away from the display (110). However, according to the final image (1430') corrected based on user input, the first object (1431') is located on the display (110), the second object (1432') is located further away from the display (110), and the third object (1433') is located further away from the display (110) but further away from the second object (1432').

[0304] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length of each of the plurality of lenses and the voltage value to be applied to each of the plurality of lenses based on a depth map in which the depths of the depth regions are changed overall. That is, the electronic device (1000) can determine the focal length of the corresponding lens and the voltage value to be applied to the corresponding lens so that focal planes corresponding to the depths of the depth regions are formed in the final image (1430').

[0305] For example, the electronic device (1000) can determine the focal length (e.g., first focal length) of a corresponding lens (e.g., first lens) and the voltage value to be applied to the corresponding lens (e.g., first voltage value) so that a first focal plane (1451) located on the display (110) in an area displaying a first object (1431') is formed. For example, the electronic device (1000) can determine the focal length (e.g., third focal length) of corresponding lenses (e.g., third lens) and the voltage value to be applied to the corresponding lenses (e.g., third voltage value) so that a third-1 focal plane (1452) located further away from the display (110) in an area displaying a second object (1432') is formed, and a third-2 focal plane (1453) located further away from the third-1 focal plane in an image displaying a third object (1433') is formed.

[0306] According to one embodiment of the present disclosure, an electronic device (1000) may provide focal planes (1451, 1452, 1453) of different depths to provide a multi-depth image (1430') expressed across a plurality of focal planes (1451, 1452, 1453). In this case, the electronic device (1000) may determine the depth of the plurality of focal planes (1451, 1452, 1453) based on a corrected depth representation. Accordingly, the electronic device (1000) may improve the resolution in the overall depth range within the image, even when the degree of depth is adjusted according to user input. Additionally, the electronic device (1000) may provide objects at all depths within the image clearly, even when the degree of depth is adjusted according to user input.

[0307] FIG. 15 is a flowchart for explaining the operation of correcting the focal length of a lens based on the angle of oblique incidence of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 16 is a diagram for explaining the operation of correcting the focal length of a plurality of lenses based on the angle of oblique incidence of a plurality of lenses of an electronic device (1000) according to one embodiment of the present disclosure.

[0308] Referring to FIG. 15, the method of an electronic device (1000) providing a 3D image may further include steps S1510 to S1530. In one embodiment of the present disclosure, steps S1510 to S1530 may be executed by at least one processor included in the electronic device (1000).

[0309] The operation of step S1510 illustrated in FIG. 15 can be performed after the operation of S330 illustrated in FIG. 3 has been performed. After the operation of step S1530 illustrated in FIG. 15 has been performed, the operation of S340 illustrated in FIG. 3 can be performed.

[0310] In step S1510 of FIG. 15, an electronic device (1000) according to one embodiment of the present disclosure can obtain the viewing position of a viewer through an eye-tracking sensor.

[0311] In one embodiment of the present disclosure, the electronic device (1000) may further include an eye tracking sensor. The electronic device (1000) can track the viewing position of a user (i.e., a viewer) in real time through the eye tracking sensor. For example, the electronic device (1000) can obtain the user's viewing position in 3D space through the eye tracking sensor.

[0312] In step S1520 of FIG. 15, an electronic device (1000) according to one embodiment of the present disclosure can obtain the off-axis angle of incidence at a plurality of lenses for a ray reaching a plurality of lenses from a viewing position, based on a viewing position. In the present disclosure, the off-axis angle refers to the angle at which a ray is incident on a lens, which is an optical axe that is the central axis of the lens.

[0313] In one embodiment of the present disclosure, the electronic device (1000) can derive the angle of incidence at each of the plurality of lenses through distance information between the user's viewpoint on the screen and the lenses, and distance information between the user's viewing position and the lenses. The angle of incidence may be larger for lenses located further away from the user's line of sight. For example, when the user's line of sight is directed toward the center of the screen of the electronic device (1000), the angle of incidence may be larger as it moves toward the outer edge of the screen.

[0314] In step S1530 of FIG. 15, an electronic device (1000) according to one embodiment of the present disclosure can correct the focal lengths of a plurality of lenses based on the angle of incidence at a plurality of lenses.

[0315] In one embodiment of the present disclosure, the position of the focal point formed by a ray passing through the edge of the lens may differ from the position of the focal point formed by a ray passing through the center of the lens. Accordingly, the depth of focus formed by a ray passing through the edge of the lens may also differ from the depth of focus formed by a ray passing through the center of the lens. In this case, the electronic device (1000) may provide an image with reduced clarity near the outer edge of the screen away from the user's line of sight.

[0316] Generally, the focal length of a lens can be determined based on a ray passing through the center of the lens. An electronic device (1000) according to one embodiment of the present disclosure corrects the focal length of each of the plurality of lenses based on the angle of incidence of the plurality of lenses, thereby allowing the focal points of the plurality of lenses to be formed at a more accurate position, and thereby providing an image with improved clarity.

[0317] Hereinafter, with reference to FIG. 16, the operation of correcting the focal length of a lens based on the angle of incidence will be explained in detail.

[0318] Referring to FIG. 16, in one embodiment of the present disclosure, an electronic device (1000) can obtain a user's viewing position through an eye-tracking sensor. For example, the electronic device (1000) can obtain a viewing position in 3D space. The viewing position in 3D space may include two-dimensional coordinate information corresponding to the user's viewpoint on a plane formed by the screen and distance information between the user and the screen.

[0319] In one embodiment of the present disclosure, the electronic device (1000) can obtain the angle of incidence at each of the plurality of lenses (1651, 1652, 1653) for light reaching from the user's eyeball (1610) to the plurality of lenses (1651, 1652, 1653) based on the viewing position. In FIG. 16, a process of correcting the focal length of a lens (hereinafter referred to as the first peripheral lens (1652)) located at a first distance (1621) from the user's viewpoint and a lens (hereinafter referred to as the second peripheral lens (1653)) located at a second distance (1622) from the user's viewpoint among the plurality of lenses (1651, 1652, 1653) included in the liquid crystal lens (123) is described representatively.

[0320] The lens located in the direction of the user's gaze (hereinafter referred to as the center lens (1651)) corresponds to the lens through which the light emitted from the user's eyeball (1610) passes, so the angle of incidence at the center lens (1651) is 0 degrees.

[0321] The angle of incidence (1641) at the first peripheral lens (1652) (hereinafter referred to as the first angle of incidence (1641)) can be determined from the first distance (1621) from the user's viewpoint to the first peripheral lens (1652) and the distance (1630) between the user's eyeball (1610) and the first peripheral lens (1652) based on the normal direction of the screen. The first angle of incidence (1641) at the first peripheral lens (1652) can be calculated from the two distance information using an arctangent function.

[0322] The angle of incidence (1642) at the second peripheral lens (1653) (hereinafter referred to as the second angle of incidence (1642)) can be determined from the second distance (1622) from the user's viewpoint to the second peripheral lens (1653) and the distance (1630) between the user's eyeball (1610) and the second peripheral lens (1653) based on the normal direction of the screen. The second angle of incidence (1642) at the second peripheral lens (1653) can be calculated from the two distance information using an arctangent function. The second angle of incidence (1642) at the second peripheral lens (1653) may be greater than the first angle of incidence (1641) at the first peripheral lens (1652).

[0323] It can be assumed that the focal length of the first peripheral lens (1652) is set to be equal to the distance between the liquid crystal lens (123) and the display (110) so that the focal point of the first peripheral lens (1652) is formed at a single pixel within the display (110). In this case, a ray passing through the center of the first peripheral lens (1652) is transmitted in a straight line and is accurately formed at the position where the focal point is set (e.g., depth), whereas a ray (1671) incident at the first oblique incidence angle (1641) is incident at the edge of the first peripheral lens (1652), so that the focal point may be formed at a different position (e.g., depth). For example, a ray passing through the center of the first peripheral lens (1652) is accurately focused on a single pixel within the display (110), whereas a ray (1671) incident at the first angle of incidence (1641) is incident at the edge of the first peripheral lens (1652), so that the focus may be formed at a depth closer to the display (110). Accordingly, the light provided through the first peripheral lens (1652) may provide a distorted or blurry image.

[0324] Likewise, it can be assumed that the focal length of the second peripheral lens (1653) is set to be equal to the distance between the liquid crystal lens (123) and the display (110) so that the focal point of the second peripheral lens (1653) is formed at a single pixel within the display (110). In this case, a ray passing through the center of the second peripheral lens (1653) is transmitted in a straight line and is accurately formed at the position where the focal point is set (e.g., depth), whereas a ray (1681) incident at the second oblique incidence angle (1642) is incident at the edge of the second peripheral lens (1653), so that the focal point may be formed at a different position (e.g., focal depth). For example, a ray passing through the center of the second peripheral lens (1653) is accurately focused on a single pixel within the display (110), whereas a ray (1681) incident at the second oblique angle (1642) is incident at the edge of the second peripheral lens (1653), so that a focus may be formed at a depth closer to the display (110). Accordingly, the light provided through the second peripheral lens (1653) may provide a distorted or blurry image. In this case, as the oblique angle increases, the difference in the depth of focus formed by the ray may increase compared to the ray passing through the center of the lens. That is, the light provided through the second peripheral lens (1653) may provide a more distorted or blurrier image than the light provided through the first peripheral lens (1652).

[0325] In one embodiment of the present disclosure, the electronic device (1000) can correct the focal length of each of the plurality of lenses (1651, 1652, 1653) based on the angle of oblique incidence at the plurality of lenses (1651, 1652, 1653). According to one embodiment of the present disclosure, the electronic device (1000) can perform a correction that increases the focal length for a lens to which a ray emitted from the user's eye (1610) is incident with an angle of oblique incidence. According to one embodiment of the present disclosure, the electronic device (1000) can perform a correction that increases the focal length more significantly for a lens to which the angle of oblique incidence of the ray incident from the user's eye (1610) is larger.

[0326] For example, the focal length of the first peripheral lens (1652) can be determined based on the ray being incident on the center of the first peripheral lens (1652), and can be determined to be equal to the distance between the liquid crystal lens (123) and the display (110) so that the focus is formed on a single pixel within the display (110). At this time, the electronic device (1000) can correct the focal length of the first peripheral lens (1652) by considering the first oblique incidence angle (1641) of the ray incident on the first peripheral lens (1652). For example, the electronic device (1000) can perform a correction to increase the focal length so that the ray incident at the first oblique incidence angle (1641) passes through the first peripheral lens (1652) and forms a focus on a single pixel of the display (110). Hereinafter, the corrected focal length of the first peripheral lens (1652) will be referred to as the first corrected distance (1662).

[0327] For example, the focal length of the second peripheral lens (1653) can be determined based on the fact that a light ray is incident on the center of the second peripheral lens (1653), and can be determined to be equal to the distance between the liquid crystal lens and the display (110) so that the focal point is formed in one pixel within the display (110). At this time, the electronic device (1000) can correct the focal length of the second peripheral lens (1653) by considering the second oblique incidence angle (1642) of the light ray incident on the second peripheral lens (1653). For example, the electronic device (1000) can perform a correction to increase the focal length so that the light ray incident at the second oblique incidence angle (1642) passes through the second peripheral lens (1653) and forms a focal point in one pixel of the display (110). Hereinafter, the corrected focal length of the second peripheral lens (1653) will be referred to as the second corrected distance (1663).

[0328] At this time, as the second oblique incidence angle (1642) of the light ray incident on the second peripheral lens (1653) is greater than the first oblique incidence angle (1641) of the light ray incident on the first peripheral lens (1652), the depth of focus that needs to be corrected at the second peripheral lens (1653) may be greater than the depth of focus that needs to be corrected at the first peripheral lens (1652). Accordingly, the electronic device (1000) can correct the second correction distance (1663) to be longer than the first correction distance (1662).

[0329] In one embodiment of the present disclosure, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses (1651, 1652, 1653) based on focal lengths (1662, 1663) of a plurality of lenses (1652, 1653) corrected by taking into account the angle of incidence. For example, the voltage value (V) to be applied to the center lens (1651) can be determined as a voltage value that sets the focal length of the center lens (1651) to a distance to the display (110). For example, the voltage value (V') to be applied to the first peripheral lens (1652) can be determined as a voltage value that sets the focal length of the first peripheral lens (1652) to a first corrected distance (1662) that is increased compared to the focal length (1661) of the center lens (1651). For example, the voltage value (V'') to be applied to the second peripheral lens (1653) can be determined as a voltage value that sets the focal length of the second peripheral lens (1653) to a second correction distance (1663) that is increased compared to the focal length (1661) of the center lens (1651).

[0330] According to one embodiment of the present disclosure, by applying a voltage value (V') corresponding to a first correction distance (1662) to a first peripheral lens (1652), a light ray (1672) incident on the first peripheral lens (1652) can form a focus on a pixel of the display (110). Accordingly, the image provided by the electronic device (1000) through the first peripheral lens (1652) can have reduced distortion and increased clarity. According to one embodiment of the present disclosure, by applying a voltage value (V'') corresponding to a second correction distance (1663) to a second peripheral lens (1653), a light ray (1682) incident on the second peripheral lens (1653) can form a focus on a pixel of the display (110). Accordingly, the image provided by the electronic device (1000) through the second peripheral lens (1653) can have reduced distortion and increased clarity.

[0331] At the outer edge of the screen where the angle of oblique incidence increases, lens aberration may occur, which forms image distortion because light passing through the lens does not converge accurately on the focal plane. In this case, due to input images incorrectly provided to the left and right eyes respectively, an image of degraded quality may be provided, such as crosstalk, where the boundaries of objects are unclear and afterimages remain, appearing blurry. However, according to one embodiment of the present disclosure, the electronic device (1000) can prevent quality degradation caused by crosstalk at the outer edge of the screen by correcting the focal lengths of the lenses by taking into account each angle of oblique incidence.

[0332] Meanwhile, FIG. 16 illustrates the depth at which focus is formed in each lens as an example, and the position (or depth) at which focus is formed in each lens may vary depending on the depth of the image to be displayed (e.g., 2D image or 3D image) and the object to be displayed. Additionally, FIG. 16 illustrates the focus of all lenses being formed at the same depth as an example for convenience of explanation, but the depth of focus may be formed differently depending on the position of the lenses to provide focal planes of different depths.

[0333] FIG. 17 is a flowchart illustrating the operation of applying voltage to a plurality of divided electrodes included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 18a is a diagram illustrating a plurality of divided electrodes included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 18b is a diagram illustrating the operation of applying voltage to a plurality of divided electrodes of an electronic device (1000) according to one embodiment of the present disclosure.

[0334] Referring to FIG. 17, the method of an electronic device (1000) providing a 3D image may further include step S1710. In one embodiment of the present disclosure, step S1710 may be executed by at least one processor included in the electronic device (1000).

[0335] The operation of step S1710 illustrated in FIG. 17 is an embodiment of the operation of S350 illustrated in FIG. 3. The operation of step S1710 illustrated in FIG. 17 can be performed after the operation of S340 illustrated in FIG. 3 has been performed.

[0336] In step S1710 of FIG. 17, an electronic device (1000) according to one embodiment of the present disclosure may apply an intermediate value of a plurality of voltage values ​​corresponding to two or more lenses to at least one split electrode that overlaps with two or more lenses determined to have different focal lengths among a plurality of split electrodes.

[0337] In one embodiment of the present disclosure, at least one of the first electrode layer or the second electrode layer included in the lens array (120) may include a plurality of divided electrodes. For example, the first electrode layer may be composed of divided electrodes and the second electrode layer may be composed of an electrode formed on the entire surface of the liquid crystal lens. In this case, a common voltage may be applied to the second electrode layer, and a voltage value to be applied to each of the divided electrodes may be controlled for the first electrode layer. Or, for example, the first electrode layer may be composed of an electrode formed on the entire surface of the liquid crystal lens, and the second electrode layer may be composed of divided electrodes. In this case, a common voltage may be applied to the first electrode layer, and a voltage value to be applied to each of the divided electrodes may be controlled for the second electrode layer. Or, for example, both the first electrode layer and the second electrode layer may be composed of divided electrodes.

[0338] FIG. 18a exemplarily illustrates a liquid crystal lens (1810) with a plurality of lens regions (1811, 1812, 1813) defined and a first electrode layer (1820) composed of divided electrodes (1821, 1822). FIG. 18a exemplarily illustrates the first electrode layer (1820) composed of divided electrodes (1821, 1822) arranged in 5 rows and 4 columns. However, the embodiment is not limited thereto, and the arrangement and number of divided electrodes (1821, 1822) constituting the first electrode layer (1820) can be set in various ways.

[0339] In one embodiment of the present disclosure, a plurality of divided electrodes (1821, 1822) may include electrodes divided into equal sizes. That is, the width and height of the plurality of divided electrodes (1821, 1822) may be the same as each other.

[0340] In one embodiment of the present disclosure, one or more of the plurality of divided electrodes (1821, 1822) may overlap with two or more of the first lens region (1811), the second lens region (1812), or the third lens region (1813).

[0341] For example, the split electrode (1821) located in the 2nd row of the 4th column comprises a first lens area (1811) that must have a first focal length (f1), a second lens area (1812) that must have a second focal length (f2), and a third-first focal length (f 3a It can overlap with the third-1 lens area (1813a) that must have ). The electronic device (1000) has, to the dividing electrode (1821) located in the second row of the fourth column, a first voltage value to be applied to the first lens area (1811) to have a first focal length (f1), a second voltage value to be applied to the second lens area (1812) to have a second focal length (f2), and a third-1 focal length (f 3aIt can be determined by applying an intermediate value (e.g., average value) of the third-1 voltage value to be applied to the third lens region (1813a) to have ).

[0342] In one embodiment of the present disclosure, one or more of the second lens region (1812) or the third lens region (1813) may be provided as a plurality of lens regions having different focal lengths. For example, assuming that the third lens region (1813) is provided as third-1 to third-3 lens regions (1813a, 1813b, 1813c) having different focal lengths, one or more of the plurality of split electrodes (1821, 1822) may overlap with two or more of the third-1 to third-3 lens regions (1813a, 1813b, 1813c).

[0343] For example, the split electrode (1822) located in the second column, second row is at the third-second focal length (f 3b The third-2 lens region (1813b) and third-3 focal length (f) that must have ) 3c It can overlap with the third-third lens area (1813c) that must have ). The electronic device (1000) has a third-second focal length (f) at the dividing electrode (1822) located in the second column, second row. 3b A third-2 voltage value to be applied to the third-2 lens area (1813b) to have ) and a third-3 focal length (f 3c It can be determined by applying an intermediate value (e.g., an average value) of the third-third voltage values ​​to be applied to the third-third lens area (1813c) to have ).

[0344] Meanwhile, according to another embodiment of the present disclosure, the electronic device (1000) may determine to apply a voltage value to a lens region with a high area ratio in a split electrode that overlaps with two or more different lens regions.

[0345] Meanwhile, referring to FIG. 18b, in one embodiment of the present disclosure, an electronic device (1000) can obtain the oblique incidence angle of a plurality of lenses for a light ray reaching a plurality of lenses from a viewing position based on a user's viewing position, and correct the focal length of the plurality of lenses based thereon. For example, the electronic device (1000) can correct the focal length of the plurality of lenses to a focal length in which the error in the depth of focus can be eliminated. Since the process of correcting the focal length of the lenses based on the oblique incidence angle has been explained with reference to FIG. 16, a detailed explanation will be omitted.

[0346] The left graph illustrated in FIG. 18b represents the error in depth of focus that occurs depending on the position in a specific direction of the display (110), assuming that the user's gaze is directed toward the center of the screen. As the outer edge of the screen moves away from the user's viewpoint, the angle of incidence of the light rays reaching the screen from the user's gaze position may increase. Among the plurality of lenses within the liquid crystal lens, the light rays may pass through the edge of the lens located at the outer edge of the screen. As the angle of incidence of the light rays at the lens increases as it moves toward the outer edge of the screen, the error in depth of focus may increase. In the present disclosure, the error in depth of focus may refer to the difference between the depth of focus formed by a light ray passing through the edge of the lens with a specific angle of incidence and the depth of focus formed by a light ray passing through the center of the lens. As illustrated in the left graph, the error in depth of focus may increase rapidly as it moves toward the outer edge of the screen.

[0347] In one embodiment of the present disclosure, the electronic device (1000) can determine a voltage value to be applied to a plurality of lenses based on the corrected focal lengths of the lenses. For example, a first electrode layer and / or a second electrode layer may be composed of a plurality of divided electrodes, and the focal lengths of the lenses can be controlled by controlling the voltage value applied to each of the divided electrodes. In this case, a plurality of lenses may be superimposed on a single divided electrode. According to one embodiment of the present disclosure, the electronic device (1000) can determine the voltage value to be applied to the divided electrode as an intermediate value of the voltage values ​​derived from the corrected focal lengths of the lenses superimposed on the divided electrode.

[0348] The right graph illustrated in FIG. 18b represents the error in depth of focus that occurs depending on the position in a specific direction when an electronic device (1000) provides five divided electrodes arranged in a specific direction of a display (e.g., a column direction) and applies a median value of the voltage values ​​of the superimposed lenses to each divided electrode. As illustrated in the right graph, according to one embodiment of the present disclosure, a voltage value capable of correcting the median of the depth of focus error occurring in the superimposed lenses may be applied to each divided electrode. By controlling the voltage value applied to each of the divided electrodes, the electronic device (1000) can minimize the error in depth of focus that occurs in each of the divided electrodes. Accordingly, the electronic device (1000) can provide an image with reduced distortion and high clarity across the entire front of the screen, regardless of the user's viewing position.

[0349] FIG. 19a is a drawing for explaining a plurality of divided electrodes included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 19b is a drawing for explaining a plurality of divided electrodes included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure.

[0350] Referring to FIG. 19a, in one embodiment of the present disclosure, at least one of the first electrode layer or the second electrode layer included in the lens array (120) may include a plurality of divided electrodes. FIG. 19a exemplarily illustrates a first electrode layer (1910) composed of divided electrodes (1911, 1912). FIG. 19a exemplarily illustrates the first electrode layer (1910) composed of 5 rows and 4 columns of divided electrodes (1911, 1912).

[0351] In one embodiment of the present disclosure, a plurality of divided electrodes (1911, 1912) may include electrodes divided into non-uniform sizes. That is, the horizontal width (w1) and vertical width (w2) of the plurality of divided electrodes (1911, 1912) may vary depending on the position of the divided electrodes.

[0352] In one embodiment of the present disclosure, a plurality of divided electrodes (1911, 1912) may have a horizontal width (w1) and / or a vertical width (w2) that decreases from the center to the outer edge. Divided electrodes (1911) arranged in the same row may have a horizontal width (w1) that decreases from the center to the outer edge. Divided electrodes (1912) arranged in the same column may have a vertical width (w2) that decreases from the center to the outer edge. A plurality of divided electrodes (1911, 1912) may have a smaller size that decreases from the center to the outer edge.

[0353] As one moves toward the outer edge of the screen, the error in the depth of focus caused by the angle of incidence may increase rapidly. According to one embodiment of the present disclosure, the electronic device (1000) can more finely correct the error in the depth of focus at the outer edge by providing divided electrodes (1911, 1912) that become smaller in size as they move toward the outer edge of the screen. Accordingly, the error in the depth of focus at the outer edge can be further reduced compared to divided electrodes that are divided into uniform sizes.

[0354] Referring to FIG. 19b, in one embodiment of the present disclosure, at least one of the first electrode layer or the second electrode layer included in the lens array (120) may include a plurality of divided electrodes. FIG. 19b exemplarily illustrates a first electrode layer (1920) composed of a plurality of divided electrodes (1921, 1922).

[0355] In one embodiment of the present disclosure, a plurality of divided electrodes (1921, 1922) may include electrodes divided into a concentric arrangement. In one embodiment of the present disclosure, in the concentric arrangement of the plurality of divided electrodes (1921, 1922), the difference in radius between two circles formed by adjacent divided electrodes (1921, 1922) may decrease towards the outer edge.

[0356] As one moves toward the outer edge of the screen, the error in the depth of focus caused by the angle of incidence may increase rapidly. According to one embodiment of the present disclosure, the electronic device (1000) can more finely correct the error in the depth of focus at the outer edge by providing divided electrodes (1921, 1922) that become smaller in size as they move toward the outer edge of the screen. Accordingly, the error in the depth of focus at the outer edge can be further reduced compared to divided electrodes that are divided into uniform sizes.

[0357] FIG. 20a is a drawing for explaining a plurality of lenticular lenses included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 20b is a drawing for explaining a plurality of lenticular lenses included in a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure.

[0358] Referring to FIG. 20a, in one embodiment of the present disclosure, a plurality of lenses (2020) included in a liquid crystal lens (2010) may include a plurality of lenticular lenses composed of lenticular-shaped lenses. FIG. 20a exemplarily illustrates a plurality of lens regions (2011, 2012, 2013a, 2013b, 2013c) defined in the liquid crystal lens (2010) and a plurality of lenses (2021, 2022) included in the liquid crystal lens (2010).

[0359] In one embodiment of the present disclosure, a plurality of lenses (2020) may include lenses (2021, 2022) arranged in a row direction. However, the embodiment is not limited thereto, and the plurality of lenses (2020) may include lenses arranged in a column direction.

[0360] In one embodiment of the present disclosure, a plurality of lenses (2020) may be slanted relative to a plurality of pixels included in a display (110). In this case, being slanted means that each of the plurality of lenses (2020) does not overlap with pixels located in a certain row or column among the plurality of pixels included in the display (110), but rather overlaps with pixels located in different rows or columns.

[0361] For example, when multiple lenses (2020) are arranged in a row direction, each of the multiple lenses (2020) may overlap not only with pixels located in a certain column among the multiple pixels, but also with pixels located in different columns. When multiple lenses (2020) are arranged in a row direction, each of the multiple lenses (2020) may extend in a direction oblique to a predetermined angle with respect to the column direction.

[0362] In one embodiment of the present disclosure, one or more lenses (2020) may include two or more of a first lens region (2011), a second lens region (2012), or a third lens region (2013). In one embodiment of the present disclosure, the third lens region (2013) may be provided as a plurality of lens regions (e.g., a third-1 lens region (2013a), a third-2 lens region (2013b), and a third-3 lens region (2013c)), and one or more lenses (2020) may include two or more of a third-1 lens region (2013a), a third-2 lens region (2013b), and a third-3 lens region (2013c).

[0363] In one embodiment of the present disclosure, the electronic device (1000) comprises a plurality of lens regions (2011, 2012, 2013a, 2013b, 2013c) with respective focal lengths (f1, f2, f 3a , f 3b , f 3c The electronic device (1000) can determine the voltage value to be applied to each of the plurality of lens regions (2011, 2012, 2013a, 2013b, 2013c) based thereon. The electronic device (1000) can control the voltage value applied according to the region of the lens, even within a lens that includes the plurality of lens regions (2011, 2012, 2013a, 2013b, 2013c). Accordingly, the electronic device (1000) can control the focal length for each lens region even within a single lens.

[0364] Referring to FIG. 20b, in one embodiment of the present disclosure, a plurality of lenses (2030) included in a liquid crystal lens (2010) may include a plurality of lenticular lenses composed of lenticular-shaped lenses. FIG. 20b exemplarily illustrates a plurality of lens regions (2011, 2012, 2013a, 2013b, 2013c) defined in the liquid crystal lens (2010) and a plurality of lenses (2031, 2032) included in the liquid crystal lens (2010).

[0365] In one embodiment of the present disclosure, a plurality of lenses (2030) may include lenses (2031) arranged in a first direction (10) and lenses (2032) arranged in a second direction (20) intersecting the first direction (10). For example, the first direction (10) may correspond to a row direction, and the second direction (20) may correspond to a direction oblique to the row direction by a predetermined angle. Or, for example, the first direction (10) may correspond to a column direction, and the second direction (20) may correspond to a direction oblique to the column direction by a predetermined angle.

[0366] In one embodiment of the present disclosure, by providing a plurality of lenses (2030) in a two-dimensional array, the electronic device (1000) can provide not only left-right parallax but also up-down parallax. Accordingly, the electronic device (1000) can provide more diverse view images compared to the case where lenses in a one-dimensional array are provided. Therefore, the electronic device (1000) can provide different images depending on the up-down view as well as the left-right view, thereby providing 3D images with enhanced stereoscopic effect.

[0367] FIG. 21 is a flowchart illustrating an operation of displaying corrected images based on time multiplexing of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 22a is a diagram illustrating an operation of displaying corrected images based on time multiplexing of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 22b is a diagram illustrating an operation of displaying corrected images based on time multiplexing of an electronic device (1000) according to one embodiment of the present disclosure.

[0368] Referring to FIG. 21, the method of an electronic device (1000) providing a 3D image may further include steps S2110 to S2130. In one embodiment of the present disclosure, steps S2110 to S2130 may be executed by at least one processor included in the electronic device (1000).

[0369] Each of the operations of steps S2110 to S2130 illustrated in FIG. 21 may be performed while the operations of steps S310 to S350 illustrated in FIG. 3 are being performed, or may be performed before or after the operations of steps S310 to S350 are being performed.

[0370] In step S2110 of FIG. 21, an electronic device (1000) according to one embodiment of the present disclosure can identify a first adjacent depth region and a second adjacent depth region that are adjacent to each other and have a depth interval difference greater than or equal to a preset depth interval difference among a plurality of depth regions.

[0371] In one embodiment of the present disclosure, the first electrode layer and / or the second electrode layer included in the lens array (120) may be composed of a plurality of divided electrodes. The first adjacent depth region and the second adjacent depth region may have a voltage applied by one divided electrode in at least a portion.

[0372] In step S2120 of FIG. 21, an electronic device (1000) according to one embodiment of the present disclosure may display a first corrected image obtained by performing a correction that excludes an image corresponding to a first adjacent depth region from an input image. For example, the electronic device (1000) may obtain a first corrected image by performing a correction that excludes an object included in a first adjacent depth region from an input image, thereby excluding an object included in a first adjacent depth region and including an object included in a second adjacent depth region.

[0373] In step S2130 of FIG. 21, an electronic device (1000) according to one embodiment of the present disclosure may display a second corrected image obtained by performing a correction that excludes an image corresponding to a second adjacent depth region from an input image. For example, the electronic device (1000) may obtain a second corrected image in which an object included in the second adjacent depth region is excluded and an object included in the first adjacent depth region is included by performing a correction that excludes an object included in the second adjacent depth region from an input image.

[0374] According to one embodiment of the present disclosure, the electronic device (1000) can display an input image by separating it into a first correction image and a second correction image, thereby separating and displaying an object included in a first adjacent depth area and an object included in a second adjacent depth area. Accordingly, even if there is a large difference in depth between an object included in the first adjacent depth area and an object included in the second adjacent depth area, a 3D image can be provided in which both objects are clearly displayed.

[0375] Referring to FIG. 22a and FIG. 22b, in one embodiment of the present disclosure, an input image may include a plurality of frames. FIG. 22a illustrates an example of the nth frame (2210) among the plurality of frames (n is a natural number). For example, the nth frame (2210) may include a first object (2211) located closer to the user than the reference point (2201) and a second object (2212) located further away from the user than the reference point (2201). FIG. 22a illustrates an example where both the first object (2211) and the second object (2212) are automobiles.

[0376] The first object (2211) may be included in the second depth area (2202) of the depth map as it is located closer to the reference point (2201) than to the user. The second object (2212) may be included in the third depth area (2203) of the depth map as it is located further away from the reference point (2201) than to the user. In the nth frame (2210), the first object (2211) and the second object (2212) may be located adjacent to each other. The electronic device (1000) may determine the second depth area (2202) where the first object (2211) is displayed in the depth map as the first adjacent depth area, and determine the third depth area (2203) where the second object (2212) is displayed in the depth map as the second adjacent depth area. Hereinafter, when describing the first adjacent depth area, the same reference numeral as that of the second depth area (2202) will be used for description, and when describing the second adjacent depth area, the same reference numeral as that of the third depth area (2203) will be used for description.

[0377] The electronic device (1000) can obtain (or generate) a first corrected image (2221) in which the second object (2212) is excluded and the first object (2211) is included by performing a correction that excludes the second adjacent depth region (2203), i.e., the second object (2212), from the nth frame (2210). The electronic device (1000) can obtain (or generate) a second corrected image (2222) in which the first object (2211) is excluded and the second object (2212) is included by performing a correction that excludes the first adjacent depth region (2202), i.e., the first object (2211), from the nth frame (2210).

[0378] In one embodiment of the present disclosure, the electronic device (1000) has a first time (t) that displays the nth frame (2210). nIn the image, a first corrected image (2221) corrected from the nth frame (2210) can be displayed. At this time, the electronic device (1000) can apply a voltage value to the lenses corresponding to the first adjacent depth region (2202) among the plurality of lenses to form a focal plane at a depth closer than the display (110). As a focal plane located closer than the display (110) is formed in the image displaying the first object (2211), the electronic device (1000) can provide the first object (2211) that is clearly displayed through the first corrected image (2221).

[0379] In one embodiment of the present disclosure, the electronic device (1000) has a second time (t) that displays the n+1th frame. n+1 In the image, a second corrected image (2222) corrected from the nth frame (2210) can be displayed. At this time, the electronic device (1000) can apply a voltage value to the lenses corresponding to the second adjacent depth region (2203) among the plurality of lenses to form a focal plane at a depth further than the display (110). As a focal plane located further than the display (110) is formed in the image displaying the second object (2212), the electronic device (1000) can provide the second object (2212) that is clearly displayed through the second corrected image (2222). Meanwhile, the electronic device (1000) may omit the display of the image corresponding to the n+1th frame among the acquired input images.

[0380] As illustrated in FIG. 22b, in one embodiment of the present disclosure, a first time (t n The first correction image (2221) and the second time (t) provided in ) n+1Through the second corrected image (2222) provided in the display (110) (or, first focal plane (2301)), the user (300) can perceive an image containing a first object (2211) located at a depth closer than the display (110) (or, first focal plane (2301)) and a second object (2212) located at a depth further than the display (110) (or, first focal plane (2301)). At this time, the user (300) can perceive an image in which the first object (2211) is displayed across the second focal plane (2302) located closer than the display (110), and the second object (2212) is displayed across the third focal plane (2303) located further than the display (110).

[0381] According to one embodiment of the present disclosure, even if there is a large difference in depth between adjacent objects in an input image, the electronic device (1000) can display the two objects separately through consecutive images. Accordingly, the electronic device (1000) can provide a final image with enhanced sharpness and improved depth perception between the two objects by forming a focal plane corresponding to the depth of each of the two objects in each of the consecutive images. On the other hand, unlike one embodiment of the present disclosure, if the electronic device (1000) displays adjacent objects all at once and applies an intermediate value of voltage values ​​that form appropriate focal planes for adjacent objects to the corresponding split electrode, it can provide an image with reduced sharpness by forming the same focal plane for adjacent objects with a large difference in depth.

[0382] Meanwhile, in one embodiment of the present disclosure, both the first object (2211) and the second object (2212) may be included in the n+1th frame as well as in the nth frame (2210). At this time, the electronic device (1000) may acquire (or generate) a first corrected image (2221) in which the second object (2212) is excluded from the nth frame (2210) and the first object (2211) is included, and may acquire (or generate) a second corrected image (2222) in which the first object (2211) is excluded from the n+1th frame and the second object (2212) is included. The electronic device (1000) may have a first time (t) that displays the nth frame (2210). n Displaying the first corrected image (2221) corrected from the n-th frame (2210) at ), and the second time (t) displaying the n+1-th frame. n+1 A second corrected image (2222) corrected from the n+1th frame can be displayed in ).

[0383] Meanwhile, in one embodiment of the present disclosure, both the first object (2211) and the second object (2212) are displayed in frames after the n+1th frame, and if the depth difference between the first object (2211) and the second object (2212) is large, the first corrected image (2221) with the second object (2212) excluded and the second corrected image (2222) with the first object (2211) excluded may be displayed alternately.

[0384] FIG. 23 is a block diagram for explaining the configuration of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 24a is a diagram for explaining the operation of providing an image of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 24b is a diagram illustrating an example of an image displayed through an electronic device (1000) according to one embodiment of the present disclosure.

[0385] Referring to FIG. 23, in one embodiment of the present disclosure, an electronic device (1000) may include a display (110), a lens array (120), a polarization control array (150), a memory (130), and a processor (140). The electronic device (1000) may be implemented by more components than those shown in FIG. 23, or by fewer components. The display (110), lens array (120), polarization control array (150), memory (130), and processor (140) may each be electrically and / or physically connected to one another. Since the display (110), lens array (120), memory (130), and processor (140) have been described above with reference to FIG. 2, a redundant description will be omitted.

[0386] The electronic device (1000) can control the polarization angle of polarization incident on the polarization control array (150). According to one embodiment of the present disclosure, the electronic device (1000) can control the polarization angle by varying the polarization angle variation for each region of the polarization control array (150) where the polarization is incident.

[0387] In one embodiment of the present disclosure, an electronic device (1000) can generate a polarization information map based on a received input image. The electronic device (1000) can control a polarization control array (150) based on the polarization information map. The electronic device (1000) can control the polarization control array (150) such that a voltage is applied or not applied to each cell of the polarization control array (150) in accordance with the polarization information map.

[0388] For example, the electronic device (1000) can change the polarization angle incident on the second control area (for example, an area to display a 3D image) of the polarization control array (150) by a predetermined polarization angle without changing the polarization angle incident on the first control area (for example, an area to display a 2D image) of the polarization control array (150). The electronic device (1000) can control the polarization control array (150) so that the first control area and the second control area of ​​the polarization control array (150) have different liquid crystal orientations. In the present disclosure, the first control area may also be referred to as a two-dimensional control area, and the second control area may also be referred to as a three-dimensional control area.

[0389] In one embodiment of the present disclosure, the polarization control array (150) may refer to a liquid crystal spatial light modulator (LCSLM). Alternatively, the polarization control array (150) may be created by removing a color filter and a black matrix from a liquid crystal display, but is not limited thereto.

[0390] In one embodiment of the present disclosure, the polarization control array (150) may include a liquid crystal layer driven by a vertical alignment (VA) method. Alternatively, in one embodiment of the present disclosure, the polarization control array (150) may include a liquid crystal layer driven by a twisted nematic (TN) method. However, the embodiments are not limited thereto.

[0391] In one embodiment of the present disclosure, the memory (130) may store various types of modules that can be used to provide an output image to a user through a display (110). For example, the memory (130) may store a depth map acquisition module (131), a depth region segment module (132), a focal length determination module (133), a lens voltage determination module (134), and a polarization information map generation module (135). However, the modules illustrated in FIG. 23 are not mandatory modules. More modules than those illustrated in FIG. 23 may be stored in the memory (130). Since the depth map acquisition module (131), the depth region segment module (132), the focal length determination module (133), and the lens voltage determination module (134) have been described above with reference to FIG. 2, a redundant description will be omitted.

[0392] In one embodiment of the present disclosure, a polarization information map generation module (135) may store instructions for generating a polarization information map containing polarization information required for each region (e.g., each cell) to control the polarization control array (150) for each region (e.g., each cell). The polarization information map generation module (135) may receive an input image. The polarization information map generation module (135) may generate a polarization information map based on the received input image.

[0393] A polarization information map according to one embodiment of the present disclosure may include a two-dimensional area corresponding to an area of ​​an input image that is to be perceived as a 2D image by a user, and a three-dimensional area corresponding to an area of ​​an input image that is to be perceived as a 3D image by a user.

[0394] In one embodiment of the present disclosure, the electronic device (1000) may, based on a polarization information map, not apply voltage to a three-dimensional control region (or a second control region) corresponding to a three-dimensional region of the polarization control array (150), and apply voltage to a two-dimensional control region (or a first control region) corresponding to a two-dimensional region of the polarization control array (150).

[0395] In one embodiment of the present disclosure, the electronic device (1000) may, based on a polarization information map, not apply voltage to a two-dimensional control region (or a first control region) corresponding to a two-dimensional region of the polarization control array (150), and apply voltage to a three-dimensional control region (or a second control region) corresponding to a three-dimensional region of the polarization control array (150). Whether to apply voltage to a two-dimensional control region or to a three-dimensional control region may vary depending on the liquid crystal alignment method of the polarization control array (150).

[0396] According to one embodiment of the present disclosure, an electronic device (1000) can control the degree of refraction of light in a lens array (120) by controlling the polarization direction of light in a polarization control array (150). In a two-dimensional control region of the polarization control array (150), the polarization direction of light can be controlled so that light is not refracted in the lens array (120). In a three-dimensional control region of the polarization control array (150), the polarization direction of light can be controlled so that light is refracted in the lens array (120).

[0397] According to one embodiment of the present disclosure, the electronic device (1000) may apply voltage to a three-dimensional control region without applying voltage to a two-dimensional control region. Alternatively, according to one embodiment of the present disclosure, the electronic device (1000) may apply voltage to a two-dimensional control region and not apply voltage to a three-dimensional control region. This may vary depending on the alignment method of the liquid crystal constituting the polarization control array (e.g., TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, etc.) or the type of liquid crystal molecule, etc.

[0398] At this time, according to one embodiment of the present disclosure, the electronic device (1000) can provide a 2D image by controlling the lens array (120) so that light passing through the two-dimensional control area of ​​the polarization control array (150) maintains a straight path without being refracted within the lens array (120). The electronic device (1000) can provide a multi-depth 3D image expressed across multiple focal planes of different depths by controlling the lens array (120) so that the degree of refraction of light passing through the three-dimensional control area of ​​the polarization control array (150) within the lens array (120) is set differently depending on the area. That is, the electronic device (1000) can form multiple focal planes of different depths by controlling the focal length for each of the multiple lenses included in the lens array (120) and controlling the depth (or position) of the focal plane for each of the multiple lenses. At this time, the electronic device (1000) can control the focal length and the depth (or position) of the focal plane for each of the plurality of lenses by adjusting the voltage value applied to the lens array (120) according to each of the plurality of lenses.

[0399] According to one embodiment of the present disclosure, the electronic device (1000) may not apply voltage to the lenses corresponding to the two-dimensional control area of ​​the polarization control array (150). At this time, the electronic device (1000) may apply a relatively high voltage to the lenses that are to form a short focal length among the lenses corresponding to the three-dimensional control area of ​​the polarization control array (150) compared to the lenses that are to form a long focal length, and apply a relatively low voltage to the lenses that are to form a long focal length compared to the lenses that are to form a short focal length. Alternatively, according to one embodiment of the present disclosure, the electronic device (1000) may apply a voltage that can be arranged at a maximum orientation angle to the lenses corresponding to the two-dimensional control area of ​​the polarization control array (150). At this time, the electronic device (1000) may apply a relatively high voltage to lenses that are to form a long focal length among the lenses corresponding to the three-dimensional control area of ​​the polarization control array (150), and apply a relatively low voltage to lenses that are to form a short focal length. For example, the relatively low voltage is less than or equal to the voltage threshold, and the relatively high voltage is greater than the voltage threshold.

[0400] According to one embodiment of the present disclosure, depending on whether the polarization direction of light is maintained or changed (e.g., rotated 90 degrees) in the polarization control array (150), a 2D image may be provided without being refracted in the lens array (120) or a 3D image may be provided with light being refracted in the lens array (120). That is, light passing through the polarization control array (150) may be determined to provide either a 2D image or a 3D image depending on whether voltage is applied in the polarization control array (150).

[0401] Accordingly, in one embodiment of the present disclosure, the electronic device (1000) determines whether to represent 2D or 3D within an image by controlling whether to change the polarization direction of light in the polarization control array (150) according to a region, and by controlling the focal length for each of the lenses in the lens array (120), the focal planes on which the image is projected are provided as a plurality of focal planes having different depths, thereby providing an image with depth representation across the plurality of focal planes. That is, the electronic device (1000) can control whether to change the liquid crystal orientation in the polarization control array (150) according to a region of the polarization control array (150) so that whether to represent 2D or 3D within an image is determined. In addition, the electronic device (1000) can control the focal length of the plurality of lenses in the lens array (120) for each of the plurality of lenses so that the depth of each of the plurality of focal planes on which the image is projected is determined.

[0402] Meanwhile, a relatively high amount of power may be consumed in the process of changing the refractive index of a lens by changing only the liquid crystal orientation of a liquid crystal lens in a lens array (120) without changing the polarization direction of light in a polarization control array (150). That is, a method of converting 2D images and 3D images by controlling the liquid crystal orientation of a liquid crystal lens may consume relatively high power. On the other hand, according to one embodiment of the present disclosure, a relatively low amount of power may be consumed in the process of maintaining or changing the polarization direction of light by maintaining or changing the liquid crystal orientation in a polarization control array (150), so a method of converting 2D images and 3D images through a polarization control array (150) may consume relatively low power. For example, in the process of changing the refractive index of a lens by changing only the liquid crystal orientation of a liquid crystal lens in a lens array (120) without changing the polarization direction of light in a polarization control array (150), about 5W of power is consumed, whereas in the process of maintaining or changing the polarization direction of light by maintaining or changing the liquid crystal orientation in a polarization control array (150), only about 0.5W of power may be consumed.

[0403] Additionally, according to one embodiment of the present disclosure, the electronic device (1000) can provide a final image with improved resolution and clarity by controlling the voltage in the polarization control array (150) to display a 2D image or a 3D image, and controlling the voltage in the lens array (120) to display the 3D image across focal planes of different depths.

[0404] Referring to FIG. 24a and FIG. 24b, an electronic device (1000) according to one embodiment of the present disclosure may display an output image (2410) through a display (110). In one embodiment of the present disclosure, the output image (2410) provided by the electronic device (1000) may be an image capable of providing a three-dimensional effect to a user (300) using the electronic device (1000).

[0405] In one embodiment of the present disclosure, the output image (2410) provided by the electronic device (1000) may be an image capable of providing a three-dimensional effect to the user (300) for only a portion of the area. As illustrated in FIG. 24b, the output image (2410) provided by the electronic device (1000) may be a mixture of a three-dimensional area (2411) and a two-dimensional area (2412).

[0406] In one embodiment of the present disclosure, the electronic device (1000) provides different output images (2421, 2422) to the left eye and right eye of the user (300), respectively, so that the user (300) can perceive binocular disparity. The user (300) can perceive binocular disparity because the output images (2421, 2422) provided to the right eye and the left eye are different from each other, and through this, can perceive the three-dimensionality of an object.

[0407] In one embodiment of the present disclosure, the electronic device (1000) provides the same output image (2423) to the left eye and the right eye, respectively, so that the user (300) can see a planar shape. That is, the electronic device (1000) can provide a 2D image having a depth value corresponding to a reference value.

[0408] For example, the electronic device (1000) may provide a 3D image only for the areas of the output image (2410) that require a sense of depth, and provide a 2D image for areas that do not require a sense of depth or require high resolution, such as text. In this case, the electronic device (1000) may provide small-sized text at a relatively high resolution, thereby providing high resolution for areas where information is required.

[0409] Meanwhile, the embodiments are not limited thereto, and the output image (2410) provided by the electronic device (1000) may be a 3D image over the entire area, or the output image (2420) provided by the electronic device (1000) may be a 2D image over the entire area.

[0410] FIG. 25a is a drawing for explaining the configuration of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 25b is a drawing for explaining the configuration of a polarization control array (150) of an electronic device (1000) according to one embodiment of the present disclosure. FIG. 25c is a drawing for explaining voltage control of a polarization control array (150) and a lens array (120) of an electronic device (1000) according to one embodiment of the present disclosure.

[0411] Referring to FIG. 25a, an electronic device (1000) according to one embodiment of the present disclosure may include a backlight unit (2510), a display (110), a polarization control array (150), and a lens array (120).

[0412] A backlight unit (2510) may be positioned at the bottom of the display (110). The backlight unit (2510) may provide light to the display (110). The light emitted by the backlight unit (2510) may have a specific wavelength band. For example, the light emitted by the backlight unit (2510) may be ultraviolet (UV) or blue light. When light is emitted from the side of the backlight unit (2510), the electronic device (1000) may further include a light guide plate that guides the light to one side (e.g., the side) of the backlight unit (2510).

[0413] A display (110) can form an image by modulating light emitted from a backlight unit (2510). In one embodiment of the present disclosure, the display (110) may be a liquid crystal display (LCD). A display (110) according to one embodiment of the present disclosure may include a first polarizer (111), a first liquid crystal cell (112), and a second polarizer (113). The first liquid crystal cell (112) may be disposed between the first polarizer (111) and the second polarizer (113). In the present disclosure, the first polarizer (111) may be referred to as a lower polarizer, and the second polarizer (113) may be referred to as an upper polarizer. In the present disclosure, the first liquid crystal cell (112) may be referred to as a main cell or a lower cell.

[0414] The first polarizer (111) transmits light of the first polarization and absorbs light of the other polarization, and the second polarizer (113) transmits light of the second polarization and absorbs light of the other polarization. The optical axes of the first polarizer (111) and the second polarizer (113) may be orthogonal to each other. For example, the optical axis of the first polarizer (111) may be the vertical direction of the liquid crystal panel, i.e., the Y direction in the drawing, and the optical axis of the second polarizer (113) may be the horizontal direction of the liquid crystal panel, i.e., the X direction in the drawing.

[0415] In one embodiment of the present disclosure, the first liquid crystal cell (112) may include a first electrode layer (112a) (or a first upper electrode), a first liquid crystal layer (112b), and a second electrode layer (112c) (or a first lower electrode). The first liquid crystal layer (112b) may be disposed between the first electrode layer (112a) and the second electrode layer (112c). An electric field is formed in the first liquid crystal layer (112b) through a voltage difference applied to the first electrode layer (112a) and the second electrode layer (112c), so that the liquid crystal orientation of the first liquid crystal layer (112b) may be changed.

[0416] In one embodiment of the present disclosure, the first electrode layer (112a) may include a plurality of driving electrodes spaced apart from each other. The driving electrodes may receive a driving voltage. The first electrode layer (112a) may include a transparent conductive material. The second electrode layer (112c) may be an electrode formed on the entire surface of the display (110). The second electrode layer (112c) may receive a common voltage. The second electrode layer (112c) may include a transparent conductive material.

[0417] The first liquid crystal layer (112b) may include a plurality of liquid crystal molecules. The plurality of liquid crystal molecules included in the first liquid crystal layer (112b) may be distributed at a uniform density over the entire area of ​​the first liquid crystal layer (112b).

[0418] The first liquid crystal layer (112b) can be controlled so that the orientation of the liquid crystal molecules constituting the first liquid crystal layer (112b) is changed according to the voltage applied to the first liquid crystal cell (112). The first liquid crystal layer (112b) can control the light incident on the first liquid crystal layer (112b) according to the orientation state of the liquid crystal molecules. For example, the first liquid crystal layer (112b) may or may not change the polarization direction of the light incident on the first liquid crystal layer (112b) according to the orientation state of the liquid crystal molecules.

[0419] In one embodiment of the present disclosure, the first liquid crystal layer (112b) may be arranged in a normally white mode. The first liquid crystal layer (112b) may allow incident light to pass through when no voltage is applied and may not allow incident light to pass through when voltage is applied. For example, the first liquid crystal layer (112b) may be arranged in a Twisted Nematic (TN) mode. When no voltage is applied to the first liquid crystal cell (112), the liquid crystal molecules of the first liquid crystal layer (112b) are positioned parallel to the first polarizer (111) and the second polarizer (113), and may be arranged in a state that is gradually twisted (or tangled) as they move toward the direction from the first polarizer (111) toward the second polarizer (113). When voltage is applied to the first liquid crystal cell (112), the liquid crystal molecules of the first liquid crystal layer (112b) can change their orientation direction so that they are arranged in a direction perpendicular to the first polarizer (111) and the second polarizer (113).

[0420] In one embodiment of the present disclosure, the first liquid crystal layer (112b) may be arranged in a normally black background mode. The first liquid crystal layer (112b) may not allow incident light to pass through when no voltage is applied, and may allow incident light to pass through when voltage is applied. For example, the first liquid crystal layer (112b) may be arranged in a VA (Vertical Alignment) mode. When no voltage is applied to the first liquid crystal cell (112), the liquid crystal molecules of the first liquid crystal layer (112b) may be arranged perpendicularly to the first polarizer (111) and the second polarizer (113). When voltage is applied to the first liquid crystal cell (112), the orientation direction of the liquid crystal molecules of the first liquid crystal layer (112b) may change so as to be arranged parallel to the first polarizer (111) and the second polarizer (113).

[0421] Although not illustrated, the display (110) may further include a color filter disposed on the second polarizer (113). Although not illustrated, the display (110) may further include a thin film transistor (TFT) for driving individual pixels.

[0422] In one embodiment of the present disclosure, the polarization control array (150) may include a first base substrate (151) (or a first lower base substrate), a second liquid crystal cell (152), and a second base substrate (153) (or a first upper base substrate).

[0423] In one embodiment of the present disclosure, the first base substrate (151) and the second base substrate (153) may each be a transparent insulating substrate or a transparent insulating film. For example, the first base substrate (151) and the second base substrate (153) may each include a glass material, a quartz material, or a transparent plastic material.

[0424] A second liquid crystal cell (152) may be disposed between a first base substrate (151) and a second base substrate (153). In the present disclosure, the second liquid crystal cell (152) may be referred to as a first upper liquid crystal cell or a polarization switching cell.

[0425] In one embodiment of the present disclosure, the second liquid crystal cell (152) may further include a first electrode layer (152a) (or a second lower electrode layer), a second liquid crystal layer (152b), and a second electrode layer (152c) (or a second upper electrode layer). The second liquid crystal layer (152b) may be disposed between the first electrode layer (152a) and the second electrode layer (152c). An electric field is formed in the second liquid crystal layer (152b) through the difference between the voltage applied to the first electrode layer (152a) and the voltage applied to the second electrode layer (152c), so that the liquid crystal orientation of the second liquid crystal layer (152b) may be changed.

[0426] Referring to FIG. 25b, in one embodiment of the present disclosure, the first electrode layer (152a) may include a plurality of lower electrodes arranged in the X direction. Each of the plurality of lower electrodes may extend in the Y direction orthogonal to the X direction. The second electrode layer (152c) may include a plurality of upper electrodes arranged in the Y direction. Each of the plurality of upper electrodes may extend in the X direction.

[0427] The second liquid crystal layer (152b) may include a plurality of liquid crystal molecules. The plurality of liquid crystal molecules included in the second liquid crystal layer (152b) may be distributed at a uniform density over the entire area of ​​the second liquid crystal layer (152b).

[0428] The second liquid crystal layer (152b) can be controlled so that the orientation of the liquid crystal molecules constituting the second liquid crystal layer (152b) is changed according to the applied voltage. The second liquid crystal layer (152b) can control the light incident on the second liquid crystal layer (152b) according to the orientation state of the liquid crystal molecules. For example, the second liquid crystal layer (152b) may or may not change the polarization direction of the light incident on the second liquid crystal layer (152b) according to the orientation state of the liquid crystal molecules.

[0429] In one embodiment of the present disclosure, the second liquid crystal layer (152b) may allow incident light to pass through when no voltage is applied and may not allow incident light to pass through when voltage is applied. For example, the second liquid crystal layer (152b) may be arranged in a Twisted Nematic (TN) mode. When no voltage is applied to the second liquid crystal cell (152), the liquid crystal molecules of the second liquid crystal layer (152b) are positioned parallel to the first base substrate (151) and the second base substrate (153), and may be arranged in a state that is gradually twisted (or tangled) as they move toward the direction from the first base substrate (151) toward the second base substrate (153). When voltage is applied to the second liquid crystal cell (152), the orientation direction of the liquid crystal molecules of the second liquid crystal layer (152b) may change so that they are arranged in a direction perpendicular to the first base substrate (151) and the second base substrate (153).

[0430] In one embodiment of the present disclosure, the second liquid crystal layer (152b) may not allow incident light to pass through when no voltage is applied, and may allow incident light to pass through when voltage is applied. For example, the second liquid crystal layer (152b) may be arranged in a VA (Vertical Alignment) mode. When no voltage is applied to the second liquid crystal cell (152), the liquid crystal molecules of the second liquid crystal layer (152b) may be arranged perpendicularly to the first base substrate (151) and the second base substrate (153). When voltage is applied to the second liquid crystal cell (152), the orientation direction of the liquid crystal molecules of the second liquid crystal layer (152b) may change so as to be arranged parallel to the first base substrate (151) and the second base substrate (153).

[0431] In one embodiment of the present disclosure, the polarization control array (150) may further include a first high-resistance film disposed between a first electrode layer (152a) and a second liquid crystal layer (152b), and a second high-resistance film disposed between a second electrode layer (152c) and a second liquid crystal layer (152b). The first high-resistance film may be disposed on the upper part of a first base substrate (151) to cover the first electrode layer (152a). The second high-resistance film may be disposed on the lower part of a second base substrate (153) to cover the second electrode layer (152c). Through the first high-resistance film and the second high-resistance film, the voltage difference between cells can be precisely adjusted.

[0432] Referring again to FIG. 25a, in one embodiment of the present disclosure, the lens array (120) may include a first base substrate (121) (or a third lower base substrate), a first electrode layer (122) (or a third lower electrode layer), a liquid crystal lens (123), a second electrode layer (124) (or a third upper electrode layer), and a second base substrate (125) (or a third upper base substrate). The liquid crystal lens (123) may be disposed between the first electrode layer (122) and the second electrode layer (124).

[0433] In one embodiment of the present disclosure, the liquid crystal lens (123) may include lenses (123a) and a resin layer (123b). The resin layer (123b) may cover the lenses (123a).

[0434] In one embodiment of the present disclosure, the lenses (123a) may comprise a material having birefringence properties. For example, each of the lenses (123a) may comprise a plurality of liquid crystal molecules. The plurality of liquid crystal molecules contained in each of the lenses (123a) may be distributed at a uniform density over the entire area of ​​the lenses (123a). The lenses (123a) may be anisotropic. The liquid crystal molecules contained in the lenses (123a) may be aligned in a specific direction. The lenses (123a) may have different refractive indices in the direction of the long axis of the liquid crystal molecules and in directions other than the long axis. The refractive index of the lenses (123a) may vary depending on the polarization direction of the incident light.

[0435] The refractive index of the lenses (123a) may be the same as the refractive index of the resin layer (123b) depending on the polarization direction of the incident light, in which case the light passing through the lenses (123a) may not be refracted. The refracted light (2510) can provide a 2D image to the user. The refractive index of the lenses (123a) may be different from the refractive index of the resin layer (123b) depending on the polarization direction of the incident light, in which case the light passing through the lenses (123a) may be refracted. The refracted light (2520) can provide a 3D image to the user.

[0436] Accordingly, in one embodiment of the present disclosure, the electronic device (1000) can determine whether to represent an image in 2D or 3D by controlling whether to change the polarization direction of light in the polarization control array (150).

[0437] Referring together with FIG. 25c, light incident on the polarization control array (150) after passing through the display (110) may have a first polarization direction (PD1) corresponding to the polarization direction of the upper polarization plate (113) as it passes through the upper polarization plate (113) of the display (110).

[0438] In one embodiment of the present disclosure, depending on the liquid crystal alignment of the polarization control array (150), a 2D image may be provided when a voltage is applied to the polarization control array (150) and a 3D image may be provided when no voltage is applied. Conversely, in one embodiment of the present disclosure, depending on the liquid crystal alignment of the polarization control array (150), a 3D image may be provided when a voltage is applied to the polarization control array (150) and a 2D image may be provided when no voltage is applied. Each embodiment will be described in detail below.

[0439] First, in one embodiment of the present disclosure, when no voltage is applied to the second liquid crystal cell (152) of the polarization control array (150), the polarization direction of the light incident on the polarization control array (150) can be maintained. For example, the polarization direction of the light (L11) that has passed through the polarization control array (150) can be maintained as the first polarization direction (PD1).

[0440] In one embodiment of the present disclosure, when a voltage is applied to the polarization control array (150), the polarization direction of the light incident on the polarization control array (150) may be changed. For example, the polarization direction of the light (L21) passing through the polarization control array (150) may be changed to a second polarization direction (PD2) that is orthogonal to the first polarization direction (PD1) on a plane parallel to the first and second base substrates (151, 153).

[0441] At this time, the polarization control array (150) according to one embodiment of the present disclosure may have a liquid crystal alignment in a VA (Vertical Alignment) mode.

[0442] Meanwhile, in one embodiment of the present disclosure, when no voltage is applied to the second liquid crystal cell (152) of the polarization control array (150), the polarization direction of the light incident on the polarization control array (150) may be changed. For example, the polarization direction of the light (L21) that has passed through the polarization control array (150) may be changed to a second polarization direction (PD2) that is orthogonal to the first polarization direction (PD1) on a plane parallel to the first and second base substrates (151, 153).

[0443] In one embodiment of the present disclosure, when a voltage is applied to the polarization control array (150), the polarization direction of the light incident on the polarization control array (150) may be maintained. For example, the polarization direction of the light (L11) that has passed through the polarization control array (150) may be maintained as a first polarization direction (PD1).

[0444] At this time, the polarization control array (150) according to one embodiment of the present disclosure may have a liquid crystal orientation in a TN (Twisted Nematic) mode.

[0445] The lens (123a) may have birefringent properties. The lens (123a) may include an optically anisotropic material. The refractive index of the lens (123a) may vary depending on the polarization direction of the light incident inside the lens (123a). For example, the refractive index of the lens (123a) in the direction of the long axis of the liquid crystal molecules (123c) (axial refractive index (n_e)) and the refractive index of the lens (123a) in a direction other than the long axis of the liquid crystal molecules (123c) (e.g., a direction perpendicular to the long axis) (orthotropic refractive index (n_o)) may be different from each other.

[0446] The refractive index of the lens (123a) may vary depending on the polarization direction of the incident light. For example, the refractive index of the lens (123a) may have an axial refractive index (n_e) or an orthotropic refractive index (n_o) depending on the polarization direction of the incident light.

[0447] First, according to one embodiment of the present disclosure, when light (L11) incident on a lens array (120) has a first polarization direction (PD1), the polarization direction of the light (L11) incident on the lens array (120) may be orthogonal to the long axis direction of the liquid crystal molecules (123c). Accordingly, the lens (123a) may have an orthotropic refractive index (n_o) as light (L11) polarized perpendicular to the long axis direction of the liquid crystal molecules (123c) is incident.

[0448] According to one embodiment of the present disclosure, the refractive index of the resin layer (123b) may be substantially the same as the orthotropic refractive index (n_o) of the lens (123a). Accordingly, when light (L11) incident on the lens array (120) has a first polarization direction (PD1), the lens (123a) has an orthotropic refractive index (n_o), so the lens (123a) has the same refractive index as the resin layer (123b), and thus the light (L11) passing through the lens (123a) may not be refracted. That is, light passing through the polarization control array (150) to which no voltage is applied to the second liquid crystal cell (152) may not be refracted while passing through the liquid crystal lens (123). The light (L11) that is not refracted while passing through the liquid crystal lens (123) can provide a 2D image to the user.

[0449] According to one embodiment of the present disclosure, when light (L21) incident on a lens array (120) has a second polarization direction (PD2), the polarization direction of the light (L21) incident on the lens array (120) may be parallel to the long axis direction of the liquid crystal molecules (123c). Accordingly, the lens (123a) may have an axial refractive index (n_e) as light polarized parallel to the long axis direction of the liquid crystal molecules (123c) is incident.

[0450] According to one embodiment of the present disclosure, the refractive index of the resin layer (123b) may be substantially the same as the orthotropic refractive index (n_o) of the lens (123a). Accordingly, when light (L21) incident on the lens array (120) has a second polarization direction (PD2), the lens (123a) has an axial refractive index (n_e), so the lens (123a) has a different refractive index from the resin layer (123b), and thus the light (L21) passing through the lens (123a) can be refracted. That is, light passing through the polarization control array (150) to which voltage is applied to the second liquid crystal cell (152) can be refracted while passing through the liquid crystal lens (123). The light (L21) refracted while passing through the liquid crystal lens (123) can provide a 3D image to the user. Meanwhile, the refractive index of the lens (123a) may vary depending on the voltage applied to the lens (123a), and accordingly, the degree to which light (L21) having a second polarization direction (PD2) is refracted as it passes through the lens array (120) may vary. Therefore, the lens array (120) can control the focal length of each of the lenses (123a) by controlling the voltage value applied to each of the lenses (123a).

[0451] Meanwhile, unlike as illustrated in FIG. 25c, according to one embodiment of the present disclosure, when light incident on the lens array (120) has a second polarization direction (PD2), the lens (123a) may have an orthotropic refractive index (n_o). Accordingly, the lens (123a) has the same refractive index as the resin layer (123b), so that light passing through the lens (123a) may not be refracted. Light that is not refracted while passing through the liquid crystal lens (123) can provide a 2D image to the user.

[0452] Alternatively, unlike as illustrated in FIG. 25c, according to one embodiment of the present disclosure, when light incident on the lens array (120) has a first polarization direction (PD1), the lens (123a) may have an axial refractive index (n_e). Accordingly, the lens (123a) has a refractive index different from that of the resin layer (123b), so that light passing through the lens (123a) can be refracted. The light refracted while passing through the liquid crystal lens (123) can provide a 3D image to the user.

[0453] In one embodiment of the present disclosure, the refractive index of the lens (123a) may vary depending on the voltage applied to the lens (123a). When a voltage is applied to the lens (123a), the axial refractive index (n_e) and the orthotropic refractive index (n_o) may change as the liquid crystal orientation of the lens (123a) changes. Depending on the voltage value applied to the lens (123a), the axial refractive index (n_e) and the orthotropic refractive index (n_o) of the lens (123a) may vary.

[0454] According to one embodiment of the present disclosure, an electronic device (1000) can control the degree of refraction of light passing through each of the plurality of lenses (123a) by controlling a voltage value applied to each of the plurality of lenses (123a). Through this, the electronic device (1000) can control the focal length and the depth (or position) of the focal plane for each of the plurality of lenses (123a). Accordingly, the electronic device (1000) can provide a multi-depth 3D image displayed across a plurality of focal planes of different depths.

[0455] In one embodiment of the present disclosure, the electronic device (1000) determines whether to represent 2D or 3D within an image by controlling whether to change the polarization direction of light in a polarization control array (150) according to a region, and by controlling the focal length for each of the lenses in a lens array (120), the focal planes on which the image is projected are provided as a plurality of focal planes having different depths, thereby providing an image with depth representation across a plurality of focal planes.

[0456] FIG. 26 is a drawing for explaining the configuration of an electronic device (1000) according to one embodiment of the present disclosure.

[0457] Referring to FIG. 26, an electronic device (1000) according to one embodiment of the present disclosure may include a display (110-1), a polarization control array (150), and a lens array (120). Since the polarization control array (150) and the lens array (120) have been described above with reference to FIG. 25a, a redundant description will be omitted.

[0458] In one embodiment of the present disclosure, the display (110-1) may be an organic light emitting diode (OLED) display. The display (110-1) may include a base layer (111-1), a circuit element layer (112-1) disposed on the base layer (111-1), a display element layer (113-1) disposed on the circuit element layer (112-1), and an upper polarizer (114-1) disposed on the display element layer (113-1).

[0459] The base layer (111-1) may include a synthetic resin film. A synthetic resin layer may be formed on a working substrate used during the manufacture of the display (110-1). Subsequently, a conductive layer and an insulating layer, etc., may be formed on the synthetic resin layer. When the working substrate is removed, the synthetic resin layer may correspond to the base layer (111-1). The synthetic resin layer may be a polyimide-based resin layer, and the material is not particularly limited. In addition, the base layer (111-1) may include a glass substrate, a metal substrate, or an organic / inorganic composite material substrate, etc.

[0460] The circuit element layer (112-1) may include at least one insulating layer and a circuit element. Hereinafter, the insulating layer included in the circuit element layer (112-1) is referred to as an intermediate insulating layer. The intermediate insulating layer may include at least one inorganic film and / or at least one organic film. The circuit element may include a signal line, a pixel driving circuit, etc. The circuit element layer (112-1) may be formed through a process of forming an insulating layer, a semiconductor layer, and a conductive layer by coating, deposition, etc., and a patterning process of an insulating layer, a semiconductor layer, and a conductive layer by photolithography.

[0461] The display element layer (113-1) may include a light-emitting element. The display element layer (113-1) may include organic light-emitting diodes as the light-emitting element. The display element layer (113-1) may further include an organic film such as a pixel defining film.

[0462] In one embodiment of the present disclosure, an upper insulating layer may be further included on the display element layer (113-1). The upper insulating layer may include a thin film encapsulation layer that seals the pixel element layer. The upper insulating layer may further include functional layers such as a capping layer, an anti-reflective layer, a refractive index adjustment layer, etc.

[0463] The upper polarizer (114-1) transmits light of a specific polarization and can absorb light of other polarizations. Accordingly, light polarized in a specific direction can be incident on the polarization control array (150).

[0464] In order to solve the technical problem described above, an electronic device is provided in one embodiment of the present disclosure.

[0465] In one embodiment of the present disclosure, by executing a plurality of instructions individually or collectively by at least one processor (140), the electronic device (1000) can obtain a depth map for an input image (e.g., a depth map corresponding to the input image). The electronic device (1000) can segment the depth map into a plurality of depth regions. The electronic device (1000) can determine the focal lengths of a plurality of lenses corresponding to each of the plurality of depth regions based on the lens law. The electronic device (1000) can obtain a voltage value to be applied to each of the plurality of lenses based on the determined focal lengths of the plurality of lenses. The electronic device (1000) can provide an image that is expressed in multiple depths across different focal planes by applying a voltage to each of the plurality of lenses based on the voltage value to be applied to each of the plurality of lenses, thereby controlling the degree of refraction of light passing through the plurality of lenses for each of the plurality of lenses.

[0466] In one embodiment of the present disclosure, a plurality of depth regions may include at least two of a first depth region corresponding to a reference point, a second depth region having a depth smaller than the reference point, or a third depth region having a depth larger than the reference point.

[0467] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length in a first lens region of a first lens corresponding to a first depth region so that the focal plane in the first lens region is set on the display (110).

[0468] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length in the second lens region of the second lens corresponding to the second depth region such that the focal plane in the second lens region is set closer to the viewer than the display.

[0469] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length in the third lens region of the third lens corresponding to the third depth region such that the focal plane in the third lens region is set further away from the viewer than the display.

[0470] In one embodiment of the present disclosure, the electronic device (1000) can display a corrected image obtained by performing a correction that inverts the image corresponding to a second depth region in the input image left and right.

[0471] In one embodiment of the present disclosure, the electronic device (1000) may further include an eye-tracking sensor. The electronic device (1000) can obtain the viewing position of a viewer through the eye-tracking sensor. Based on the viewing position, the electronic device (1000) can obtain the angle of incidence at a plurality of lenses for a light ray reaching a plurality of lenses from the viewing position. Based on the angle of incidence at the plurality of lenses, the electronic device (1000) can correct the focal lengths of the plurality of lenses.

[0472] In one embodiment of the present disclosure, the electronic device (1000) can perform a correction based on the angle of incidence of a plurality of lenses, increasing the focal length of the plurality of lenses as the corresponding angle of incidence increases.

[0473] In one embodiment of the present disclosure, the electronic device (1000) can change the range of a plurality of depth regions in one or more of the consecutive frames based on the movement of at least one object in the consecutive frames included in the input image.

[0474] In one embodiment of the present disclosure, the electronic device (1000) can change the range of a plurality of depth regions or change a depth region corresponding to a reference point based on user input that adjusts the intensity of the stereoscopic effect or the degree of depth of a 3D image.

[0475] In one embodiment of the present disclosure, the lens array (120) may further include a first electrode layer and a second electrode layer facing each other with a plurality of lenses in between. Each of the first electrode layer and the second electrode layer may include a plurality of divided electrodes. In one embodiment of the present disclosure, the electronic device (1000) may apply an intermediate value of a plurality of voltage values ​​corresponding to two or more lenses to at least one divided electrode that overlaps with two or more lenses determined to have different focal lengths among the plurality of divided electrodes.

[0476] In one embodiment of the present disclosure, an electronic device (1000) can identify a first adjacent depth region and a second adjacent depth region that are adjacent to each other and have a depth interval difference greater than or equal to a preset depth interval difference among a plurality of depth regions. The electronic device (1000) can display a first corrected image obtained by performing a correction that excludes an image corresponding to the first adjacent depth region from an input image. The electronic device (1000) can display a second corrected image obtained by performing a correction that excludes an image corresponding to the second adjacent depth region from an input image.

[0477] In one embodiment of the present disclosure, the electronic device (1000) may further include a polarization control array (150) disposed between a display (110) and a lens array (120) and controlling the polarization direction of light provided from the display (110). The electronic device (1000) may control whether the liquid crystal orientation in the polarization control array (150) is changed according to the area of ​​the polarization control array (150) so that whether a 2D or 3D representation is determined within the image. The electronic device (1000) may control the focal length of a plurality of lenses in the lens array (120) for each of the plurality of lenses so that the depth of each of the plurality of focal planes on which the image is projected is determined.

[0478] In one embodiment of the present disclosure, a plurality of lenses may be arranged along each of a first direction and a second direction intersecting the first direction.

[0479] In one embodiment of the present disclosure, the electronic device (1000) can determine the focal length of one or more lenses corresponding to each of a plurality of depth regions based on the lens law. The electronic device (1000) can obtain a voltage value to be applied to one or more lenses based on the focal length of one or more lenses. The electronic device (1000) can apply a voltage to each of the plurality of lenses based on the voltage value to be applied to one or more lenses.

[0480] In order to solve the above-described technical problem, in one embodiment of the present disclosure, a method of operating an electronic device (1000) is provided.

[0481] In one embodiment of the present disclosure, the method of operating an electronic device (1000) may include the step (S310) of obtaining a depth map for an input image (e.g., a depth map corresponding to the input image).

[0482] In one embodiment of the present disclosure, the method of operation of the electronic device (1000) may include the step (S320) of segmenting a depth map into a plurality of depth regions based on a plurality of depth intervals.

[0483] In one embodiment of the present disclosure, the method of operation of an electronic device (1000) may include the step (S330) of determining the focal lengths of a plurality of lenses corresponding to each of a plurality of depth regions based on the lens law.

[0484] In one embodiment of the present disclosure, the method of operation of the electronic device (1000) may include the step (S340) of obtaining a voltage value to be applied to each of the plurality of lenses based on the focal lengths of the plurality of lenses determined.

[0485] In one embodiment of the present disclosure, the method of operation of an electronic device (1000) may include the step (S350) of applying a voltage to each of a plurality of lenses based on a voltage value to be applied to each of a plurality of lenses, thereby controlling the degree of refraction of light passing through the plurality of lenses for each of the plurality of lenses, so as to provide an image expressed in multiple depths across a plurality of different focal planes.

[0486] In one embodiment of the present disclosure, the step (S330) of determining the focal lengths of a plurality of lenses may include the step of determining the focal length of a first lens in a first lens region corresponding to a first depth region such that the focal plane in the first lens region is set on the display (110).

[0487] In one embodiment of the present disclosure, the step of determining the focal lengths of a plurality of lenses (S330) may include the step of determining the focal length of a second lens in a second lens region corresponding to a second depth region such that the focal plane in the second lens region is set closer to the viewer than the display (110).

[0488] In one embodiment of the present disclosure, the step of determining the focal lengths of a plurality of lenses (S330) may include determining the focal length of a third lens in a third lens region corresponding to a third depth region such that the focal plane in the third lens region is set further away from the viewer than the display (110).

[0489] In one embodiment of the present disclosure, the method of operation of an electronic device (1000) may include the step (S810) of performing a correction that inverts an image corresponding to a second depth region in an input image left and right and displaying the obtained correction image.

[0490] In one embodiment of the present disclosure, the method of operation of the electronic device (1000) may include the step (S1510) of obtaining the viewing position of a viewer through an eye-tracking sensor.

[0491] In one embodiment of the present disclosure, a method of operation of an electronic device (1000) may include a step (S1520) of obtaining the angle of incidence at a plurality of lenses for a light ray reaching a plurality of lenses from a viewing position based on a viewing position.

[0492] In one embodiment of the present disclosure, the method of operation of the electronic device (1000) may include the step (S1530) of correcting the focal lengths of the plurality of lenses based on the angle of incidence at the plurality of lenses.

[0493] In one embodiment of the present disclosure, a method of operating an electronic device (1000) may include a step (S1010) of changing the range of a plurality of depth regions in one or more of the consecutive frames based on the movement of at least one object in the consecutive frames included in the input image.

[0494] In one embodiment of the present disclosure, the lens array (120) may further include a first electrode layer and a second electrode layer facing each other with a plurality of lenses in between. In one embodiment of the present disclosure, at least one of the first electrode layer or the second electrode layer may include a plurality of divided electrodes.

[0495] In one embodiment of the present disclosure, the step (S350) of providing an image expressed in multiple depths across multiple focal planes by applying a voltage to each of the multiple lenses based on a voltage value to be applied to each of the multiple lenses may include the step (S1710) of applying an intermediate value of multiple voltage values ​​corresponding to two or more lenses to at least one split electrode that overlaps with two or more lenses determined to have different focal lengths among the multiple split electrodes.

[0496] In one embodiment of the present disclosure, the electronic device (1000) may further include a polarization control array (150) disposed between a display (110) and a lens array (120) and controlling the polarization direction of light provided from the display (110).

[0497] In one embodiment of the present disclosure, the method of operating an electronic device (1000) may include the step of controlling whether to change the liquid crystal orientation in a polarization control array (150) according to an area of ​​the polarization control array (150) so that whether to represent 2D or 3D in an image is determined.

[0498] In one embodiment of the present disclosure, the method of operating an electronic device (1000) may include the step of controlling the focal lengths of a plurality of lenses in a lens array (120) for each of the plurality of lenses so that the depth of each of the plurality of focal planes on which an image is projected is determined.

[0499] In order to solve the aforementioned technical problem, a computer-readable recording medium may be provided on which a program for performing at least one method of an embodiment of the method of operating an electronic device disclosed in the present disclosure is recorded on a computer.

[0500] A program executed by an electronic device described in this disclosure may be implemented by hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0501] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively.

[0502] Software can be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable recording media include magnetic storage media (e.g., ROM (read-only memory), RAM (random-access memory), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). Computer-readable recording media can be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. The recording medium is readable by a computer, stored in memory, and can be executed by a processor.

[0503] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.

[0504] In addition, the program according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0505] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) that is distributed electronically through a manufacturer of an electronic device or an electronic market (e.g., Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer of the electronic device, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0506] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, appropriate results can be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or module are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

Claims

1. In an electronic device (1000) that provides a 3D image, Display (110); A lens array (120) including a plurality of lenses; At least one processor (140); and It includes a memory (130) that stores multiple instructions, By executing the above plurality of instructions individually or collectively by the at least one processor (140), the electronic device (1000) is, Acquire a depth map corresponding to the input image, and The above depth map is segmented into multiple depth regions, and Based on the law of lenses, the focal lengths of the plurality of lenses corresponding to each of the plurality of depth regions are determined, and Based on the focal lengths of the plurality of lenses determined above, a voltage value to be applied to each of the plurality of lenses is obtained, and An electronic device (1000) that provides an image expressed in multiple depths across multiple different focal planes by applying a voltage to each of the plurality of lenses based on a voltage value to be applied to each of the plurality of lenses, thereby controlling the degree of refraction of light passing through the plurality of lenses for each of the plurality of lenses.

2. In Paragraph 1, The above plurality of depth regions are, It includes at least two of a first depth region corresponding to a reference point, a second depth region having a depth smaller than the reference point, or a third depth region having a depth larger than the reference point. By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, The focal length in the first lens region of the first lens corresponding to the first depth region is determined so that the focal plane in the first lens region is set on the display (110), and The focal length in the second lens area of ​​the second lens corresponding to the second depth area is determined such that the focal plane in the second lens area is set closer to the viewer than the display (110), and An electronic device (1000) that determines the focal length in the third lens region of the third lens corresponding to the third depth region such that the focal plane in the third lens region is set further away from the viewer than the display (110).

3. In Paragraph 2, By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, An electronic device (1000) that displays a corrected image obtained by performing a correction that flips the image corresponding to the second depth region in the input image left and right.

4. In any one of paragraphs 1 to 3, The above electronic device (1000) further includes an eye-tracking sensor, By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, Through the above eye-tracking sensor, the viewer's viewing position is obtained, and Based on the above viewing position, the angle of incidence at the plurality of lenses for a ray reaching the plurality of lenses from the above viewing position is obtained, and An electronic device (1000) that corrects the focal length of the plurality of lenses based on the angle of incidence in the plurality of lenses.

5. In any one of paragraphs 1 through 4, By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, An electronic device (1000) that changes the range of the plurality of depth regions in one or more of the consecutive frames based on the movement of at least one object in the consecutive frames included in the input image.

6. In any one of paragraphs 1 through 5, By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, An electronic device (1000) that changes the range of the plurality of depth regions or changes the depth region corresponding to the reference point based on user input that adjusts the intensity of the stereoscopic effect or the degree of depth of the above 3D image.

7. In any one of paragraphs 1 through 6, The above lens array (120) further includes a first electrode layer and a second electrode layer facing each other with the plurality of lenses in between, and At least one of the first electrode layer or the second electrode layer comprises a plurality of divided electrodes, and By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, An electronic device (1000) that applies an intermediate value of a plurality of voltage values ​​corresponding to the two or more lenses to at least one split electrode that overlaps with two or more lenses determined to have different focal lengths among the plurality of split electrodes.

8. In any one of paragraphs 1 through 7, By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, Identifying mutually adjacent first adjacent depth regions and second adjacent depth regions having a depth interval difference greater than or equal to a preset depth interval difference among the plurality of depth regions above, and A first corrected image obtained by performing a correction that excludes an image corresponding to the first adjacent depth region from the input image is displayed, and An electronic device (1000) that displays a second corrected image obtained by performing a correction that excludes an image corresponding to the second adjacent depth region from the input image.

9. In any one of paragraphs 1 through 8, The electronic device (1000) further includes a polarization control array (150) disposed between the display (110) and the lens array (120) and controlling the polarization direction of light provided from the display (110). By executing the above plurality of instructions individually or in combination by the at least one processor (140), the electronic device (1000) is, In order to determine whether a 2D or 3D representation is made within the above image, the change in liquid crystal orientation in the polarization control array (150) is controlled according to the area of ​​the polarization control array (150), and An electronic device (1000) that controls the focal lengths of the plurality of lenses in the lens array (120) for each of the plurality of lenses so as to determine the depth of each of the plurality of focal planes on which the above image is projected. A method of operation of an electronic device (1000) that provides 10.3D images and includes a display (110) and a lens array (120) including a plurality of lenses, Step of obtaining a depth map for an input image (S310); A step (S320) of segmenting the depth map into multiple depth regions based on multiple depth intervals; A step (S330) of determining the focal lengths of the plurality of lenses corresponding to each of the plurality of depth regions based on the law of lenses; A step of obtaining a voltage value to be applied to each of the plurality of lenses based on the focal lengths of the plurality of lenses determined above (S340); and A method of operation of an electronic device (1000), comprising the step (S350) of applying a voltage to each of the plurality of lenses based on a voltage value to be applied to each of the plurality of lenses, thereby controlling the degree of refraction of light passing through the plurality of lenses for each of the plurality of lenses, so as to provide an image expressed in multiple depths across different plurality of focal planes.

11. In Paragraph 10, The above plurality of depth regions are, It includes at least two of a first depth region corresponding to a reference point, a second depth region having a depth smaller than the reference point, or a third depth region having a depth larger than the reference point. The step (S330) of determining the focal lengths of the plurality of lenses is, A step of determining the focal length in the first lens region of the first lens corresponding to the first depth region so that the focal plane in the first lens region is set on the display (110); A step of determining the focal length in the second lens area of ​​the second lens corresponding to the second depth area such that the focal plane in the second lens area is set closer to the viewer than the display (110); and A method of operation of an electronic device (1000), comprising the step of determining the focal length in the third lens area of ​​a third lens corresponding to the third depth area such that the focal plane in the third lens area is set further away from the viewer than the display (110).

12. In Paragraph 11, The method of operation of the above electronic device (1000) is, A method of operation of an electronic device (1000), further comprising the step (S810) of performing a correction that inverts the image corresponding to the second depth region in the input image horizontally and displaying the obtained correction image.

13. In any one of paragraphs 10 to 12, The above electronic device (1000) further includes an eye-tracking sensor, The method of operation of the above electronic device (1000) is, A step of obtaining the viewer's viewing position through the above-mentioned eye-tracking sensor (S1510); Based on the above-mentioned viewing position, a step (S1520) of obtaining the angle of incidence at the plurality of lenses for a ray reaching the plurality of lenses from the above-mentioned viewing position; and A method of operation of an electronic device (1000), further comprising the step (S1530) of correcting the focal length of the plurality of lenses based on the angle of incidence in the plurality of lenses.

14. In any one of paragraphs 10 through 13, The method of operation of the above electronic device (1000) is, A method of operation of an electronic device (1000), further comprising the step (S1010) of changing the range of the plurality of depth regions in one or more of the consecutive frames based on the movement of at least one object in the consecutive frames included in the input image.

15. A computer-readable recording medium having a program for executing the method of operation of any one of claims 10 to 14 on a computer.

Images