Electronic device for displaying hologram content, and operating method of electronic device

Abstract

In an electronic device for displaying hologram content, and an operating method, the electronic device comprises: a spatial light modulator for displaying a plurality of phase modulation images; an optical layer for receiving the plurality of hologram images reproduced by the spatial light modulator; a memory; and at least one processor, wherein the at least one processor can: acquire a plurality of view images each corresponding to a plurality of views; generate a plurality of hologram images by using depth information about the plurality of view images; calculate a plurality of diffraction angles for diffracting each of the plurality of holographic images from the optical layer toward each of the plurality of views; generate a plurality of phase delay patterns corresponding to the plurality of diffraction angles; and generate a plurality of phase modulation images by multiplying the plurality of holographic images and the plurality of phase delay patterns corresponding to each of the plurality of holographic images.

Description

Electronic devices displaying holographic content and methods of operating the electronic devices

[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, the present disclosure relates to an electronic device displaying holographic content and a method of operating the electronic device.

[0002] With the advancement of electronic device technology, various electronic devices that provide users with content such as videos and images are being developed and distributed.

[0003] Additionally, with the advancement of optical technology, electronic devices in the form of projectors are being developed and distributed to provide content to users by projecting images onto a screen or a specific space.

[0004] As electronic devices advance, the types of images they display have diversified. Devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.

[0005] Recently, electronic devices have been developed to display 3D images by providing the user with images that include binocular disparity, thereby allowing the user to experience a three-dimensional effect through the vergence movement of the user's left and right eyes.

[0006] One embodiment of the present disclosure provides an electronic device for displaying holographic content. The electronic device may include a spatial light modulator (SLM) for displaying a plurality of phase-modulated images. The electronic device may include an optical layer for receiving a plurality of holographic images reproduced by the spatial light modulator. The electronic device may include a memory for storing at least one instruction. The electronic device may include at least one processor including a processing circuit. By having the at least one processor individually or collectively execute at least one instruction stored in the memory, the electronic device may acquire a plurality of view images corresponding to a plurality of views. The electronic device may generate a plurality of holographic images using depth information regarding the acquired plurality of view images. The electronic device may calculate a plurality of diffraction angles for diffracting each of the generated plurality of holographic images from the optical layer toward each of the plurality of views. The electronic device may generate a plurality of phase delay patterns corresponding to the calculated plurality of diffraction angles. The electronic device can generate a plurality of phase modulation images by multiplying a plurality of holographic images and a plurality of phase delay patterns corresponding to each of the plurality of holographic images.

[0007] One embodiment of the present disclosure may provide an operating method of an electronic device that displays holographic content. The operating method of the electronic device may include a step of acquiring a plurality of view images, each corresponding to a plurality of views. The operating method of the electronic device may include a step of generating a plurality of holographic images using depth information about the acquired plurality of view images. The operating method of the electronic device may include a step of calculating a plurality of diffraction angles that diffract the plurality of holographic images, such that each of the plurality of holographic images faces each of the plurality of views, from an optical layer that receives the plurality of holographic images reproduced by a spatial light modulator (SLM). The operating method of the electronic device may include a step of generating a plurality of phase delay patterns corresponding to the calculated plurality of diffraction angles. The operating method of the electronic device may include a step of generating a plurality of phase-modulated images by multiplying the plurality of holographic images by the plurality of phase delay patterns, each corresponding to the plurality of holographic images. The operating method of the electronic device may include a step of displaying the plurality of phase-modulated images generated through the spatial light modulator.

[0008] As one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one method of the method of operating the disclosed electronic device on a computer may be provided.

[0009] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0010] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.

[0011] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0012] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0013] FIG. 3 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0014] FIG. 4 is a flowchart illustrating an operation of calculating a content position for displaying holographic content according to one embodiment of the present disclosure.

[0015] FIG. 5 is a drawing for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0016] FIG. 6 is a diagram for explaining an operation of displaying a plurality of phase modulated images through a spatial light modulator according to one embodiment of the present disclosure.

[0017] FIG. 7 is a flowchart illustrating an operation for generating a final modulated image according to one embodiment of the present disclosure.

[0018] FIG. 8 is a diagram for explaining an operation of calculating a plurality of diffraction angles and content positions according to one embodiment of the present disclosure.

[0019] FIG. 9 is a flowchart illustrating an operation for calculating a content location of holographic content according to one embodiment of the present disclosure.

[0020] FIG. 10 is a drawing for explaining a phase delay pattern according to one embodiment of the present disclosure.

[0021] FIG. 11 is a flowchart illustrating an operation of generating a plurality of phase modulated images using a modulated image generation module according to one embodiment of the present disclosure.

[0022] FIG. 12 is a block diagram illustrating an operation of generating a plurality of phase modulated images using a modulated image generation module according to one embodiment of the present disclosure.

[0023] FIG. 13 is a block diagram illustrating an operation of training an artificial intelligence model included in a modulated image generation module according to one embodiment of the present disclosure.

[0024] FIG. 14A is a diagram for explaining an operation of displaying holographic contents having two or more different depth values ​​according to one embodiment of the present disclosure.

[0025] FIG. 14b is a diagram for explaining an operation of displaying holographic contents having continuous depth values ​​according to one embodiment of the present disclosure.

[0026] FIG. 15 is a diagram for explaining an operation of displaying holographic content using a spatial light modulator including a plurality of sub-spatial light modulators according to one embodiment of the present disclosure.

[0027] FIG. 16 is a block diagram illustrating an operation of displaying holographic content by providing different sub-holographic contents to the two eyes of a user according to one embodiment of the present disclosure.

[0028] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.

[0029] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.

[0030] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0031] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0032] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.

[0033] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.

[0034] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.

[0035] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0036] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0037] Referring to FIG. 1, in one embodiment of the present disclosure, an electronic device (100) may provide content (380) to a user. Specifically, the content (380) may be provided such that the user can view different sides of an object included in the content (380) depending on the position of the user looking at the electronic device (100). In one embodiment of the present disclosure, the content (380) may be an image that may provide a three-dimensional effect to a user using the electronic device (100).

[0038] In one embodiment of the present disclosure, the electronic device (100) may acquire a plurality of view images, each corresponding to a plurality of different views. In this case, a 'view' may correspond to a location where a user can view different sides of an object included in content (380) provided through the electronic device (100).

[0039] In one embodiment of the present disclosure, the multiple view images may be images obtained by photographing a real-world object from multiple different views. However, the present disclosure is not limited thereto, and the multiple view images may also be images generated to provide images of an object from multiple different views.

[0040] In one embodiment of the present disclosure, the electronic device (100) can provide different content (380) to the user's left eye and right eye, respectively. The electronic device (100) can use multiple view images to generate content (380) to be provided to the user's left eye and right eye, respectively. The content (380) provided by the electronic device (100) to the user's left eye and right eye, respectively, can include binocular disparity.

[0041] "Binocular disparity" can refer to the difference in position between a specific region of an object in content presented to the left eye and a specific region of an object in content presented to the right eye. The smaller the depth value of a specific region of an object, the greater the binocular disparity in that region.

[0042] The user can experience the three-dimensionality of the content (380) provided to the user through the vergence and accommodation movements of the left and right eyes. At this time, the three-dimensionality of the content (380) may include depth information such as the depth value of the content (380).

[0043] In one embodiment of the present disclosure, a vergence operation of the user's left and right eyes may be performed depending on the size of the binocular disparity included in the content (380) provided to the left and right eyes, respectively. In one embodiment of the present disclosure, an accommodation operation of the user's left and right eyes may be performed to focus on the electronic device (100) on which the content (380) is displayed.

[0044] At this time, as illustrated in FIG. 1, the depth value by the depth information of the content (380) including binocular disparity may be different from the depth value of the electronic device (100) displaying the content (380).

[0045] Accordingly, when a user looks at an electronic device (100) providing content (380), the three-dimensionality of the content (380) felt through the convergence motion and the three-dimensionality of the content (380) felt through the accommodation motion may differ from each other. The user may feel dizziness or fatigue due to this convergence-accommodation conflict (VAC).

[0046] In one embodiment of the present disclosure, the electronic device (100) may provide a plurality of generated images (350, 360, 370) corresponding to a plurality of views (210, 220, 230) to each of the user's left and right eyes, respectively. The content (380) provided to the user may be an image provided by the plurality of generated images (350, 360, 370) provided by the electronic device (100).

[0047] In one embodiment of the present disclosure, each of the plurality of views (210, 220, 230) may be a view spaced apart by a distance equal to or less than the diameter of the pupil of each eye (200). The generated images (350, 360, 370) that the electronic device (100) provides to the user's left and right eyes, respectively, may be images provided using a plurality of view images generated using images acquired by photographing a real object in the plurality of views (210, 220, 230).

[0048] “Content (380)” may be an image provided to a user by combining generated images (350, 360, 370) that are aligned with each other and formed into a single image.

[0049] The point where two or more generated images (350, 360, 370) coincide with each other and form a single image can be referred to as a “content location.”

[0050] An accommodation operation of the user's left and right eyes can be performed to focus on content (380) formed as a single image at a content location from two or more generated images (350, 360, 370) provided to the left and right eyes, respectively.

[0051] The three-dimensionality of content (380) perceived by the user through the adjustment motion may be identical to the three-dimensionality of content (380) perceived through the convergence motion. Through this, the electronic device (100) can prevent the user from feeling dizzy or tired due to convergence-adjustment mismatch.

[0052] Hereinafter, for convenience of explanation, it will be described that the electronic device (100) of the present disclosure provides content (380) to one pupil (200) of the user's left or right eye. In addition, it will be described that the multiple view images acquired by the electronic device (100) are images acquired by photographing a real object through two or more cameras spaced apart by an interval equal to the interval between two or more views (210, 220, 230) spaced apart by a distance equal to or less than the diameter of the pupil of each eye.

[0053] In one embodiment of the present disclosure, an electronic device (100) may include a spatial light modulator (SLM), an optical layer, and a light source. The electronic device (100) may generate a plurality of holographic images (300, 310, 320).

[0054] In one embodiment of the present disclosure, the plurality of holographic images (300, 310, 320) may be images generated so that each of the plurality of view images is formed into a single image at a content location and provided to the user's pupil (200). The plurality of holographic images (300, 310, 320) may be images generated by performing inversion-optical propagation on each of the plurality of view images by the distance between the electronic device (100) and the content location.

[0055] In one embodiment of the present disclosure, the electronic device (100) can generate a plurality of phase delay patterns (330, 340). Each of the plurality of phase delay patterns (330, 340) can be a pattern for delaying the phase of light provided to the spatial light modulator. The light provided to the spatial light modulator can be modulated by the plurality of phase delay patterns (330, 340) and diffracted and propagated in different directions from the spatial light modulator.

[0056] “Multiple diffraction angles” may be angles at which the plurality of holographic images (300, 310, 320) reconstructed from the spatial light modulator (112) are diffracted such that each of the plurality of holographic images (300, 310, 320) faces each of the plurality of views (210, 220, 230).

[0057] Each of the "multiple phase delay patterns (330, 340)" may be a pattern that modulates the phase of light so that light provided to the spatial light modulator is refracted and propagated at multiple diffraction angles.

[0058] In one embodiment of the present disclosure, the electronic device (100) can generate a plurality of phase modulation images by multiplying each of a plurality of holographic images (300, 310, 320) corresponding to a plurality of views (210, 220, 230) by a plurality of phase delay patterns (330, 340).

[0059] In one embodiment of the present disclosure, the electronic device (100) can control the spatial light modulator to display a plurality of phase-modulated images. In one embodiment of the present disclosure, the electronic device (100) can control the spatial light modulator to display a final modulated image generated by adding all of the plurality of phase-modulated images.

[0060] In one embodiment of the present disclosure, the electronic device (100) can provide light to a spatial light modulator via a light source. The light source can be a light source that generates coherent light. The electronic device (100) can provide coherent light to the spatial light modulator via the coherent light source.

[0061] In one embodiment of the present disclosure, a plurality of holographic images (300, 310, 320) refracted by a plurality of diffraction angles can be reconstructed into a plurality of generated images (350, 360, 370) by coherent light through a final modulated image displayed on a spatial light modulator.

[0062] The plurality of generated images (350, 360, 370) may be images in which a plurality of phase modulation images displayed on the spatial light modulator are reconstructed by coherent light provided to the spatial light modulator. The plurality of generated images (350, 360, 370) may be images in which the final modulation image displayed on the spatial light modulator is reconstructed by coherent light. In this case, the plurality of generated images (350, 360, 370) may be images in which each of the plurality of hologram images is diffracted according to a corresponding diffraction angle among the plurality of diffraction angles.

[0063] In one embodiment of the present disclosure, a plurality of generated images (350, 360, 370) reproduced in a spatial light modulator can be provided to the user's pupil (200) through an optical layer. In one embodiment of the present disclosure, a plurality of generated images (350, 360, 370) reproduced through an electronic device (100) can be optically propagated and provided toward two or more views (210, 220, 230) included within the pupil of the eye (200).

[0064] At this time, although FIG. 1 illustrates that three views are included within a pupil and that the electronic device (100) provides three generated images (350, 360, 370) toward the three views, the present disclosure is not limited thereto. In one embodiment of the present disclosure, the electronic device (100) may also provide corresponding generated images toward two views included within a pupil or four or more views.

[0065] In one embodiment of the present disclosure, a plurality of generated images (350, 360, 370) may be propagated toward the pupil (200) and formed into a single image at a content location. At this time, an adjustment operation of the pupil (200) may be performed to focus the plurality of generated images (350, 360, 370) on content (380) formed into a single image at the content location.

[0066] Content (380) formed at a content location by multiple generated images (350, 360, 370) may be referred to as “holographic content (380).”

[0067] In one embodiment of the present disclosure, the electronic device (100) can display a final modulated image on one spatial light modulator to provide a plurality of generated images (350, 360, 370) to the left or right eye.

[0068] The electronic device (100) of the present disclosure can provide a plurality of generated images (350, 360, 370) to the pupil (200) using one spatial light modulator to change the position of the focus at which the adjustment operation of the pupil (200) is performed.

[0069] Through this, the electronic device (100) of the present disclosure can prevent the user from feeling dizzy or tired due to convergence-adjustment mismatch. In addition, compared to using multiple electronic devices that each provide multiple generated images (350, 360, 370), cost savings and space utilization can be improved.

[0070] At this time, when a plurality of generated images (350, 360, 370) are optically propagated and formed into holographic content (380) at the content location, the clarity of the holographic content (380) formed at the content location may decrease as each of the plurality of generated images (350, 360, 370) goes through the optical propagation process.

[0071] In addition, when a plurality of generated images (350, 360, 370) are combined into a holographic content (380) at a content location, an interference pattern may be included in the holographic content (380) due to constructive interference and destructive interference of each of the plurality of generated images (350, 360, 370).

[0072] The electronic device (100) of the present disclosure may generate a plurality of phase modulation images using an artificial intelligence model trained to generate a plurality of phase modulation images so that the holographic content (380) provided at the content location has high definition and does not include interference patterns.

[0073] Through this, the electronic device (100) can provide holographic content (380) so that the pupil (200) focuses on the content location through a plurality of generated images (350, 360, 370). In addition, the electronic device (100) can provide holographic content (380) that has high clarity and does not include interference patterns.

[0074] The electronic device (100) may be any type of electronic device that provides holographic content (380) to a user. The electronic device (100) may be implemented as any type and form of electronic device that includes a display module (110, see FIG. 2).

[0075] In one embodiment of the present disclosure, the electronic device (100) may be a projector that projects holographic content (380) into a space containing the electronic device (100) and provides it to a user. The electronic device (100) may be a fixed projector that is fixed to a specific location within the space or a mobile projector that can be placed at a desired location within the space.

[0076] However, the present disclosure is not limited thereto. The electronic device (100) may be implemented as various types and forms of electronic devices, such as a mobile device, a smart phone, a laptop computer, a tablet PC, a desktop PC, a wearable device, a head-mounted display (HMD), or a television.

[0077] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.

[0078] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0079] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an electronic device (100) may include a display module (110), a memory (120), at least one processor (130), an input / output interface (140), and a communication interface (150).

[0080] However, not all of the components illustrated in FIG. 3 are essential components. The electronic device (100) may be implemented with more components than those illustrated in FIG. 2. Furthermore, the electronic device (100) may also be implemented with fewer components than those illustrated in FIG. 2.

[0081] The display module (110), memory (120), at least one processor (130), input / output interface (140), and communication interface (150) included in the electronic device (100) may be electrically and / or physically connected to each other.

[0082] In one embodiment of the present disclosure, the display module (110) may include a coherent light source (111), a spatial light modulator (112), and an optical layer (113).

[0083] In one embodiment of the present disclosure, the coherent light source (111) may refer to a light source that provides light having a single wavelength and whose phase remains constant. The coherent light source (111) may include a laser. In one embodiment of the present disclosure, the coherent light source (111) may provide coherent light to a spatial light modulator (112).

[0084] In one embodiment of the present disclosure, the spatial light modulator (112) may be a device used to control the spatial distribution of light in a three-dimensional space. The spatial light modulator (112) may be a device that modulates at least one of the phase or amplitude of light provided to the spatial light modulator (112).

[0085] In one embodiment of the present disclosure, light provided to the spatial light modulator (112) may be transmitted through the spatial light modulator (112) and at least one of phase or amplitude may be modulated. Additionally, light provided to the spatial light modulator (112) may be reflected by the spatial light modulator (112) and at least one of phase or amplitude may be modulated.

[0086] In one embodiment of the present disclosure, the spatial light modulator (112) may include a liquid crystal layer including liquid crystals (LC). The spatial light modulator (112) may control the arrangement direction of the liquid crystals included in the liquid crystal layer, thereby modulating at least one of the phase or amplitude of light provided through the anisotropy of the liquid crystals.

[0087] In one embodiment of the present disclosure, a spatial light modulator (112) may display a computer generated hologram (CGH).

[0088] A "computer-generated hologram" may be a holographic image created by numerically simulating the propagation of light.

[0089] A computer-generated hologram may be a holographic image calculated by simulating an interference pattern between a reference light and object light reflected from the reference light provided to the object. In the present disclosure, a plurality of holographic images (300, 310, 320) may be computer-generated holograms.

[0090] In one embodiment of the present disclosure, displaying a computer-generated hologram through a spatial light modulator (112) may mean changing the arrangement of liquid crystals included in the liquid crystal layer by applying a voltage corresponding to data of the computer-generated hologram to the liquid crystal layer included in the spatial light modulator (112).

[0091] In one embodiment of the present disclosure, the optical layer (113) can receive a plurality of holographic images (300, 310, 320) reconstructed from the spatial light modulator (112). The plurality of holographic images (300, 310, 320) reconstructed from the spatial light modulator (112) can be a plurality of generated images (350, 360, 370). The plurality of generated images (350, 360, 370) that pass through the optical layer (113) can be refracted so as to be directed into the pupil of the eye (200).

[0092] In one embodiment of the present disclosure, the optical layer (113) may include a lens. The optical layer (113) may be composed of two or more lenses. However, the present disclosure is not limited thereto, and the optical layer (113) may include a configuration for causing a plurality of generated images (350, 360, 370) reconstructed from the spatial light modulator (112) to be refracted or diffracted, etc., so that the plurality of generated images (350, 360, 370) are directed into the pupil of the eye (200).

[0093] Although FIG. 2 illustrates a configuration in which a coherent light source (111), a spatial light modulator (112), and an optical layer (113) are included in a display module (110), the present disclosure is not limited thereto. It goes without saying that the coherent light source (111), the spatial light modulator (112), and the optical layer (113) may each be included in an electronic device (100) as separate components.

[0094] In one embodiment of the present disclosure, memory (120) may store instructions, data structures, and program codes that can be read by at least one processor (130). Operations performed by at least one processor (130) may be implemented by executing instructions or codes of a program stored in memory (120). In one embodiment of the present disclosure, there may be one or more memories (120).

[0095] In one embodiment of the present disclosure, the memory (120) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a Mask ROM, a Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

[0096] In one embodiment of the present disclosure, memory (120) may store instructions or program codes for performing functions or operations of the electronic device (100). Instructions, algorithms, data structures, program codes, and application programs stored in memory (120) may be implemented in a programming or scripting language such as, for example, C, C++, Java, or an assembler.

[0097] In one embodiment of the present disclosure, the memory (120) may store various types of modules that can be used to generate a plurality of phase modulation images. The memory (120) may store an image acquisition module (121), a content position calculation module (122), a diffraction angle calculation module (123), a modulation image generation module (124), and a display control module (128). However, not all of the modules illustrated in FIG. 2 are essential modules. The memory (120) may store more or fewer modules than the modules illustrated in FIG. 2.

[0098] In one embodiment of the present disclosure, a 'module' included in the memory (120) may mean a unit that processes a function or operation performed by at least one processor (130). The 'module' included in the memory (120) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.

[0099] In one embodiment of the present disclosure, the image acquisition module (121) may be configured with commands or program codes related to an operation or function of acquiring multiple view images. The image acquisition module (221) may be configured with commands or program codes related to an operation or function of receiving multiple view images from an external server or peripheral electronic devices.

[0100] At least one processor (130) can acquire multiple view images from an external server or surrounding electronic devices by executing commands or program codes of the image acquisition module (121).

[0101] However, the present disclosure is not limited thereto. The image acquisition module (121) may be configured with commands or program codes for generating multiple view images. The image acquisition module (121) may be configured with commands or program codes for generating multiple view images from at least one view image corresponding to at least one acquired view using an interpolation algorithm.

[0102] Additionally, the image acquisition module (121) may include a generative artificial intelligence model such as a Generative Adversarial Network (GAN), a Variational Auto Encoder (VAE), or a Transformer for generating multiple view images.

[0103] At least one processor (130) may acquire multiple view images generated by executing commands or program codes of the image acquisition module (121).

[0104] In one embodiment of the present disclosure, the content location calculation module (122) may be configured with instructions or program codes for calculating a content location at which to display holographic content (380).

[0105] In one embodiment of the present disclosure, multiple view images acquired through the image acquisition module (121) may be composed of a header and a body. The header may include metadata information of the multiple view images. The header may include information such as the locations of the multiple cameras that captured the multiple view images, the distance between the objects included in the multiple view images and the multiple cameras, and the number of the multiple cameras.

[0106] At this time, the positions of the multiple cameras may correspond to the positions of the multiple views. The distance between the object included in the multiple view images and the multiple cameras may correspond to the depth information of the object included in the multiple view images.

[0107] In one embodiment of the present disclosure, the body may include captured images acquired through multiple cameras.

[0108] The content location calculation module (122) may be configured with commands or program codes for obtaining depth information for multiple view images by using information about the distance between an object included in the header of the multiple view images and a plurality of cameras. In this case, the depth information may include a depth value of an object included in the multiple view images.

[0109] However, the present disclosure is not limited thereto, and the content location calculation module (122) may be configured with commands or program codes for calculating a depth value of an object included in a plurality of view images by using the distance between adjacent views and the binocular parallax included in the adjacent view images based on the acquired plurality of view images.

[0110] In one embodiment of the present disclosure, the content location calculation module (122) may calculate the content location by comparing the depth value of an object with a preset maximum depth value. The content location calculation module (122) may calculate the content location by comparing the depth value of an object with a preset minimum depth value.

[0111] At least one processor (130) can calculate the content location by executing instructions or program code of the content location calculation module (122).

[0112] Below, the operation of calculating the content location will be described later with reference to FIGS. 8 and 9.

[0113] In one embodiment of the present disclosure, the diffraction angle calculation module (123) may be configured with commands or program codes for calculating a plurality of diffraction angles. The diffraction angle calculation module (123) may be configured with commands or program codes for calculating a plurality of diffraction angles using the positions of a plurality of cameras included in a plurality of acquired view images and the center of a lens included in an optical layer (113).

[0114] At least one processor (130) can calculate a plurality of diffraction angles by executing instructions or program codes of the diffraction angle calculation module (123).

[0115] Hereinafter, the operation of calculating multiple diffraction angles and multiple diffraction angles will be described later with reference to FIGS. 6 to 9.

[0116] In one embodiment of the present disclosure, the modulated image generation module (124) may be configured with instructions or program codes for generating a plurality of phase-modulated images using a plurality of view images, content positions, and a plurality of diffraction angles. The modulated image generation module (124) may be configured with instructions or program codes for adding the generated plurality of phase-modulated images to generate a final modulated image.

[0117] At least one processor (130) may generate a plurality of phase modulation images by using a plurality of view images, content positions, and a plurality of diffraction angles by executing instructions or program codes of the modulation image generation module (124). At least one processor (130) may also generate a final modulation image by adding the generated plurality of phase modulation images by executing instructions or program codes of the modulation image generation module (124).

[0118] In one embodiment of the present disclosure, the modulation image generation module (124) may include a hologram image generation module (125), a phase delay pattern generation module (126), and a phase modulation image generation module (127).

[0119] In one embodiment of the present disclosure, the holographic image generation module (125) may be configured with commands or program codes that generate a plurality of holographic images by using a plurality of view images and a calculated content location. The holographic image generation module (125) may be configured with commands or program codes that generate a plurality of holographic images by back-optically propagating the plurality of view images by the distance from the electronic device (100) to the content location. The holographic image generation module (125) may be configured with commands or program codes that generate a plurality of holographic images by back-optically propagating the plurality of view images by the distance from the optical layer (113) to the content location.

[0120] At least one processor (130) can generate a plurality of holographic images by executing commands or program codes of a holographic image generation module (125).

[0121] Below, the operation of generating multiple hologram images will be described later with reference to FIGS. 5 to 7.

[0122] In one embodiment of the present disclosure, the phase delay pattern generation module (126) may be configured with commands or program codes for generating a plurality of phase delay patterns based on a plurality of diffraction angles.

[0123] In one embodiment of the present disclosure, the plurality of phase delay patterns may be patterns for modulating the phase of the plurality of holographic images (300, 310, 320) reproduced in the spatial light modulator (112) by utilizing the anisotropy of the liquid crystal included in the spatial light modulator (112).

[0124] The plurality of phase delay patterns may be patterns each corresponding to a plurality of diffraction angles. The plurality of phase delay patterns may be patterns for modulating the phases of the plurality of holographic images (300, 310, 320) reproduced by the spatial light modulator (112) by a plurality of diffraction angles.

[0125] At least one processor (130) can generate a plurality of phase delay patterns by executing instructions or program codes of the phase delay pattern generation module (126).

[0126] Hereinafter, the operation of generating multiple phase delay patterns and multiple phase delay patterns will be described later with reference to FIGS. 5 to 10.

[0127] In one embodiment of the present disclosure, the phase modulation image generation module (127) may be configured with instructions or program codes that generate a plurality of phase modulation images by multiplying a plurality of holographic images and a plurality of phase delay patterns. The phase modulation image generation module (127) may generate a plurality of phase modulation images by multiplying a plurality of holographic images, each corresponding to a plurality of views, and a plurality of phase delay patterns, each corresponding to a plurality of diffraction angles directed toward the plurality of views.

[0128] At least one processor (130) can generate a plurality of phase modulation images by executing instructions or program codes of a phase modulation image generation module (127).

[0129] In one embodiment of the present disclosure, the phase modulation image generation module (127) may be configured with instructions or program codes that add together multiple phase modulation images to generate a final modulation image.

[0130] At least one processor (130) can generate a final modulated image by adding all of the plurality of phase modulated images by executing the commands or program code of the phase modulated image generation module (127).

[0131] Hereinafter, the operation of the phase modulation image generation module (127) will be described later with reference to FIGS. 6 and 7.

[0132] In one embodiment of the present disclosure, the modulated image generation module (124) may include an artificial intelligence model trained to infer a plurality of phase modulated images by receiving a plurality of view images, content locations, and a plurality of diffraction angles as inputs.

[0133] In one embodiment of the present disclosure, an artificial intelligence model learned to infer multiple phase-modulated images includes a CNN (Convolutional Neural Network), a U-net, a DNN (Deep Neural Network), an RNN (Recurrent Neural Network), a GAN (Generative Adversarial Network), a CGAN (Conditional Generative Adversarial Network), a DCGAN (Deep Convolutional Generative Adversarial Network), a VAE (Variational Auto Encoder), and a Diffusion model, and the artificial intelligence model in the present disclosure is not limited to the above-described examples.

[0134] At least one processor (130) can provide a plurality of view images, content locations and a plurality of diffraction angles as inputs to an artificial intelligence model included in a modulation image generation module (124), thereby generating a plurality of phase modulation images.

[0135] Hereinafter, the artificial intelligence model included in the modulated image generation module (124) and the learning method of the artificial intelligence model will be described later with reference to FIGS. 11 to 13.

[0136] In one embodiment of the present disclosure, at least one processor (130) may be configured as at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), a Digital Signal Processor (DSPs), a Digital Signal Processing Device (DSPDs), a Programmable Logic Device (PLDs), a Field Programmable Gate Array (FPGAs), and a Neural Processing Unit or an artificial intelligence (AI) processor designed with a hardware structure specialized for learning and processing an artificial intelligence (AI) model, but is not limited thereto.

[0137] In one embodiment of the present disclosure, at least one processor (130) may be configured as processing circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC).

[0138] In one embodiment of the present disclosure, at least one processor (130) can execute various types of modules stored in the memory (120). At least one processor (130) can execute at least one instruction that constitutes various types of modules stored in the memory (120).

[0139] In one embodiment of the present disclosure, at least one processor (130) may execute at least one module among an image acquisition module (121), a content position calculation module (122), a diffraction angle calculation module (123), a modulated image generation module (124), and a display control module (128) stored in a memory (120). At least one processor (130) may also execute a hologram image generation module (125), a phase delay pattern generation module (126), and a phase modulation image generation module (127) included in the modulated image generation module (124).

[0140] In one embodiment of the present disclosure, at least one processor (130) may include a plurality of processors.

[0141] At least one of the image acquisition module (121), the content position calculation module (122), the diffraction angle calculation module (123), the modulated image generation module (124), or the display control module (128) stored in the memory (120) may be executed by any one of the plurality of processors. The remaining modules of the image acquisition module (121), the content position calculation module (122), the diffraction angle calculation module (123), the modulated image generation module (124), or the display control module (128) stored in the memory (120) may be executed by another processor among the plurality of processors.

[0142] At least one of the hologram image generation module (125), the phase delay pattern generation module (126), or the phase modulation image generation module (127) included in the modulation image generation module (124) may be executed by any one of the plurality of processors. The remaining modules of the hologram image generation module (125), the phase delay pattern generation module (126), or the phase modulation image generation module (127) included in the modulation image generation module (124) may be executed by another processor among the plurality of processors.

[0143] In one embodiment of the present disclosure, the input / output interface (140) can receive at least one of image data or audio data from an external electronic device, etc., under the control of at least one processor (130). At least one processor (130) can obtain multiple view images from the external electronic device through the input / output interface (140).

[0144] In one embodiment of the present disclosure, the input / output interface (140) may perform input / output operations with an external electronic device using at least one of input / output methods including an HDMI port (High-Definition Multimedia Interface port), a DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-described input / output methods.

[0145] In one embodiment of the present disclosure, the communication interface (150) can perform data communication with an external server or an external electronic device under the control of at least one processor (130). The communication interface (150) can perform data communication with an external server or an external electronic device using at least one of data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.

[0146] In one embodiment of the present disclosure, at least one processor (130) may receive multiple view images from an external server or an external electronic device via a communication interface (150). At least one processor (130) may receive information on a first reference distance and a second reference distance set in advance from an external server or an external electronic device via the communication interface (150).

[0147] In one embodiment of the present disclosure, at least one processor (130) may receive parameters of a learned modulated image generation module or a modulated image generation module from an external server or an external electronic device through a communication interface (150).

[0148] FIG. 3 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0149] Referring to FIGS. 1, 2, and 3, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of acquiring a plurality of view images each corresponding to a plurality of views (210, 220, 230).

[0150] In the step (S100) of acquiring multiple view images, at least one processor (130) can acquire multiple view images through an input / output interface (140) or a communication interface (150) by executing commands or program codes of an image acquisition module (121).

[0151] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S200) of generating a plurality of holographic images (300, 310, 320) by using depth information for a plurality of acquired view images.

[0152] In the step (S200) of generating a plurality of hologram images (300, 310, 320), at least one processor (130) can generate a plurality of hologram images (300, 310, 320) by using depth information for a plurality of view images by executing commands or program codes of a hologram image generation module (125).

[0153] At least one processor (130) can perform inversion-optical propagation on each of the acquired plurality of view images using the calculated content location to generate a plurality of holographic images (300, 310, 320).

[0154] In one embodiment of the present disclosure, at least one processor (130) can generate a plurality of holographic images (300, 310, 320) from a plurality of view images using a distance-dependent light wave propagation model.

[0155] Hereinafter, the step (S200) of generating multiple hologram images (300, 310, 320) will be described later with reference to FIGS. 5 and 6.

[0156] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S300) of calculating a plurality of diffraction angles for diffracting each of the generated plurality of holographic images (300, 310, 320) from the display module (110) toward each of the plurality of views (210, 220, 230).

[0157] The step (S300) of calculating multiple diffraction angles may be a step of calculating multiple diffraction angles that diffract multiple holographic images (300, 310, 320) so that the multiple generated images (350, 360, 370) reproduced by the spatial light modulator (112) are directed toward each of the multiple views (210, 220, 230) from the optical layer (113).

[0158] At this time, the plurality of generated images (350, 360, 370) may be images in which the plurality of hologram images (300, 310, 320) are reproduced by the spatial light modulator (112).

[0159] In the step (S300) of calculating a plurality of diffraction angles, at least one processor (130) can calculate a plurality of diffraction angles by executing commands or program codes of the diffraction angle calculation module (123) to diffract each of the generated plurality of holographic images (300, 310, 320) from the display module (110) toward each of the plurality of views (210, 220, 230). At least one processor (130) can calculate a plurality of diffraction angles by executing commands or program codes of the diffraction angle calculation module (123) to diffract each of the generated plurality of holographic images (300, 310, 320) from the optical layer (113) toward each of the plurality of views (210, 220, 230).

[0160] In one embodiment of the present disclosure, in the step (S300) of calculating a plurality of diffraction angles, the angle formed by the optical axis of the lens and a plurality of lines passing through the center of the lens included in the optical layer (113) and each of the plurality of views (210, 220, 230) may be calculated as a plurality of diffraction angles.

[0161] At least one processor (130) can calculate the angles formed by the optical axis of the lens and a plurality of lines passing through the center of the lens included in the optical layer (113) and each of the plurality of views (210, 220, 230) as a plurality of diffraction angles by executing the commands or program codes of the diffraction angle calculation module (123).

[0162] Hereinafter, the step (S300) of calculating multiple diffraction angles will be described later in Fig. 8.

[0163] In one embodiment of the present disclosure, the method of operating an electronic device (100) may include a step (S400) of generating a plurality of phase delay patterns (330, 340) corresponding to a plurality of diffraction angles.

[0164] In the step (S400) of generating a plurality of phase delay patterns (330, 340), at least one processor (130) can generate a plurality of phase delay patterns (330, 340) corresponding to a plurality of diffraction angles by executing commands or program codes of the phase delay pattern generation module (126).

[0165] In one embodiment of the present disclosure, each of the plurality of phase delay patterns (330, 340) may include a plurality of grating patterns having the same period. In the step (S400) of generating the plurality of phase delay patterns (330, 340), the plurality of phase delay patterns (330, 340) including a plurality of grating patterns having the same period may be generated. At this time, the period of each of the plurality of grating patterns may be determined corresponding to each of the plurality of diffraction angles.

[0166] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S500) of generating a plurality of phase modulation images by multiplying a plurality of holographic images (300, 310, 320) and a plurality of phase delay patterns (330, 340) corresponding to each of the plurality of holographic images (300, 310, 320).

[0167] In the step (S500) of generating a plurality of phase modulation images, at least one processor (130) can generate a plurality of phase modulation images by executing commands or program codes of a phase modulation image generating module (127), thereby multiplying a plurality of hologram images (300, 310, 320) and a plurality of phase delay patterns (330, 340) corresponding to each of the plurality of hologram images (300, 310, 320).

[0168] In one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S600) of displaying a plurality of phase modulation images generated through a display module (110).

[0169] In the step (S600) of displaying a plurality of phase modulation images, at least one processor (130) can control the display module (110) to display a plurality of phase modulation images by executing commands or program codes of the display control module (128).

[0170] In one embodiment of the present disclosure, the step (S600) of displaying a plurality of phase modulated images may be a step of displaying a plurality of phase modulated images generated through a spatial light modulator (112). At least one processor (130) may also control the spatial light modulator (112) to display a plurality of phase modulated images.

[0171] In one embodiment of the present disclosure, a method of operating an electronic device (100) may include providing coherent light to a spatial light modulator (112) via a coherent light source (111). At least one processor (130) may control the coherent light source (111) to provide coherent light to the spatial light modulator (112) on which a plurality of phase modulation images are displayed.

[0172] In one embodiment of the present disclosure, FIG. 3 illustrates an operating method of an electronic device (100) as being divided into a plurality of steps and sequentially performed. However, the present disclosure is not limited thereto, and the operating method of the electronic device (100) may perform two or more operations in a single step. Furthermore, it goes without saying that the operating method of the electronic device (100) may also perform two or more operations in parallel.

[0173] FIG. 4 is a flowchart illustrating an operation for calculating a content location for displaying holographic content according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIG. 3 are assigned the same reference numerals, and any redundant descriptions are omitted.

[0174] Referring to FIGS. 2, 3, and 4, in one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S150) of calculating a content position at which to display holographic content (380) based on a depth value of an object included in a plurality of acquired view images.

[0175] In the step (S150) of calculating the content position to display the hologram content (380), at least one processor (130) can calculate the content position to display the hologram content (380) based on the depth value of the object included in the plurality of view images by executing the commands or program code of the content position calculation module (122).

[0176] At this time, the depth value of the object included in the multiple view images can be obtained based on the metadata information included in the header of the multiple view images obtained in the step (S100) of obtaining the multiple view images. Specifically, the depth value of the object can be obtained based on the distance information between the object included in the multiple view images and the multiple cameras included in the metadata information.

[0177] However, the present disclosure is not limited thereto, and the operating method of the electronic device (100) may further include a step of calculating a depth value of an object included in a plurality of view images based on the acquired plurality of view images.

[0178] In the step of calculating the depth value of an object included in multiple view images, at least one processor (130) may calculate the depth value of an object included in multiple view images by executing instructions or program code of the content location calculation module (122).

[0179] Hereinafter, the step (S150) of calculating the content location to display the hologram content (380) will be described later in FIG. 8.

[0180] In one embodiment of the present disclosure, in the step (S200) of generating a plurality of holographic images (300, 310, 320), the plurality of holographic images (300, 310, 320) can be generated using the calculated content positions.

[0181] FIG. 5 is a diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure. FIG. 6 is a diagram illustrating an operation of displaying a plurality of phase-modulated images through a spatial light modulator according to an embodiment of the present disclosure. Hereinafter, the same configurations as those described in FIGS. 1 and 2 are assigned the same reference numerals, and redundant descriptions are omitted.

[0182] Referring to FIGS. 1, 2, 5, and 6, in one embodiment of the present disclosure, an electronic device (100) may include a coherent light source (111), a spatial light modulator (112), and an optical layer (113). In this case, the coherent light source (111), the spatial light modulator (112), and the optical layer (113) may be included in a display module (110).

[0183] In one embodiment of the present disclosure, at least one processor (130) can control a spatial light modulator (112) to display a final modulated image (115). The spatial light modulator (112) can display the final modulated image (115).

[0184] In one embodiment of the present disclosure, the final modulated image (115) may be an image generated by adding together a plurality of phase modulated images. The plurality of phase modulated images may be images generated by multiplying a plurality of holographic images (300, 310, 320) and a plurality of phase delay patterns (330, 340) corresponding to each of the plurality of holographic images (300, 310, 320).

[0185] In one embodiment of the present disclosure, each of the plurality of holographic images (300, 310, 320) may be an image generated by performing reverse optical propagation on each of the plurality of view images by a distance from the content location (840, see FIG. 8) so that the plurality of view images are combined into one image at the content location (840) and provided as content (380).

[0186] At this time, reverse light propagation can be performed using a light propagation model for modeling the propagation of light. In one embodiment of the present disclosure, each of the plurality of holographic images (300, 310, 320) can be generated by performing a convolution operation of the inverse function of the light propagation model applied to each of the plurality of view images and the content location (840).

[0187] The light propagation model may be modeled using Rayleigh-Sommerfeld diffraction integrals, etc. However, the present disclosure is not limited thereto, and it is of course possible to use various reverse light propagation models to generate multiple holographic images (300, 310, 320) from multiple view images.

[0188] In one embodiment of the present disclosure, the positions or shapes of objects included in the plurality of view images may be different from each other depending on the different positions of the plurality of views (210, 220, 230) that captured the plurality of view images.

[0189] In one embodiment of the present disclosure, the plurality of holographic images (300, 310, 320) may include a first holographic image (300), a second holographic image (310), and a third holographic image (320). The plurality of views (210, 220, 230) may include a first view (210), a second view (220), and a third view (230).

[0190] In one embodiment of the present disclosure, a real-world object may have an "A" shape. A view image corresponding to a first view (210) may include "A" captured by a camera positioned in the first view (210). A view image corresponding to a second view (220) may include "A" captured by a camera positioned in the second view (220). A view image corresponding to a third view (230) may include "A" captured by a camera positioned in the third view (230).

[0191] In one embodiment of the present disclosure, the first holographic image (300) may be a holographic image generated using a view image corresponding to the first view (210). The second holographic image (310) may be a holographic image generated using a view image corresponding to the second view (220). The third holographic image (320) may be a holographic image generated using a view image corresponding to the third view (230).

[0192] In one embodiment of the present disclosure, coherent light (114) provided to a spatial light modulator (112) via a coherent light source (111) may be referred to as a “reference wave.” A plurality of holographic images (300, 310, 320) generated by back-propagating a plurality of view images by the content position (840) may be referred to as “object waves.”

[0193] In one embodiment of the present disclosure, a spatial light modulator (112) may be provided with a reference wave, and an interference pattern for reproducing an object wave may be displayed.

[0194] At this time, the "interference pattern" may be a pattern generated due to interference between the reference wave and the object wave. When the reference wave is provided to the spatial light modulator (112) on which the interference pattern of the reference wave and the object wave is displayed, the object wave can be reproduced and displayed in the spatial light modulator (112).

[0195] In one embodiment of the present disclosure, when a reference wave is provided in a direction perpendicular to the spatial light modulator (112), the object wave can be displayed as an interference pattern on the spatial light modulator (112). By displaying the object wave as an interference pattern on the spatial light modulator (112) and providing the reference wave to the spatial light modulator (112), the object wave can be reproduced from the spatial light modulator (112) and directed to a plurality of views.

[0196] At this time, the “direction perpendicular to the spatial light modulator (112)” may mean a direction perpendicular to the upper surface when the surface on which multiple hologram images (300, 310, 320) are reproduced from the spatial light modulator (112) is referred to as the upper surface.

[0197] In one embodiment of the present disclosure, coherent light (114) corresponding to a reference wave may be provided perpendicularly to a spatial light modulator (112). In this case, a plurality of holographic images (300, 310, 320) may be displayed as an interference pattern on the spatial light modulator (112).

[0198] Hereinafter, for convenience of explanation, it is described that the coherent light (114) is provided perpendicularly to the spatial light modulator (112). However, the present disclosure is not limited thereto, and if the coherent light (114) is provided at an angle other than perpendicularly to the spatial light modulator (112), it goes without saying that an interference pattern generated using the coherent light (114) and a plurality of holographic images (300, 310, 320) can be displayed on the spatial light modulator (112).

[0199] In one embodiment of the present disclosure, the plurality of phase delay patterns (330, 340) may be patterns for modulating the phase of coherent light (114) provided to the spatial light modulator (112) through the coherent light source (111).

[0200] In one embodiment of the present disclosure, each of the plurality of phase delay patterns (330, 340) may function as a phase plate, thereby adjusting the phase of the provided light to diffract the light. The plurality of phase delay patterns (330, 340) may be patterns for modulating the propagation direction of the coherent light (114) provided to the spatial light modulator (112) and emitting it at a plurality of different diffraction angles.

[0201] In one embodiment of the present disclosure, a plurality of phase delay patterns (330, 340) may be patterns applied to the spatial light modulator (112) to control the arrangement of the liquid crystal layer included in the spatial light modulator (112). The plurality of phase delay patterns (330, 340) may vary depending on the angle at which the provided light is to be diffracted.

[0202] In one embodiment of the present disclosure, the plurality of phase delay patterns (330, 340) may include a plurality of grating patterns having the same period (1010, see FIG. 10). The period (1010) of each of the plurality of grating patterns may be determined to correspond to an angle at which the provided light is to be diffracted.

[0203] Hereinafter, the plurality of grating patterns included in the plurality of phase delay patterns (330, 340) and the period (1010) and diffraction angle of each of the plurality of grating patterns will be described later in FIG. 8 and FIG. 10.

[0204] In one embodiment of the present disclosure, the plurality of phase delay patterns (330, 340) may include a first phase delay pattern (330) and a second phase delay pattern (340). The first phase delay pattern (330) may be a pattern for diffracting coherent light (114) provided to the spatial light modulator (112) so that the coherent light (114) is directed toward the first view (210). The second phase delay pattern (340) may be a pattern for diffracting coherent light (114) provided to the spatial light modulator (112) so that the coherent light (114) is directed toward the third view (230).

[0205] In one embodiment of the present disclosure, light from a spatial light modulator (112) may be directed toward the pupil (200) through an optical layer (113). The first phase delay pattern (330) may be a pattern for diffracting the coherent light (114) from the spatial light modulator (112) so that the coherent light (114) may be directed toward the first view (210) through the optical layer (113). The second phase delay pattern (340) may be a pattern for diffracting the coherent light (114) from the spatial light modulator (112) so that the coherent light (114) may be directed toward the third view (230) through the optical layer (113).

[0206] In one embodiment of the present disclosure, the second view (220) may be a view toward which light from the spatial light modulator (112) is directed, even without modulating the direction of propagation of the coherent light (114) provided to the spatial light modulator (112). The second view (220) may be a view toward which light that is not diffracted at a different angle from the spatial light modulator (112) passes through the optical layer (113).

[0207] In one embodiment of the present disclosure, the direction of propagation of coherent light (114) provided to the spatial light modulator (112) and the direction from the spatial light modulator (112) to the second view (220) may be the same. In this case, a phase delay pattern that causes the light from the spatial light modulator (112) to be directed toward the second view (220) may not be required.

[0208] In one embodiment of the present disclosure, the plurality of phase modulated images may include a first phase modulated image, a second phase modulated image, and a third phase modulated image.

[0209] The first phase modulation image may be an image generated by multiplying the first holographic image (300) and the first phase delay pattern (330). The third phase modulation image may be an image generated by multiplying the third holographic image (320) and the second phase delay pattern (340). The second phase modulation image may be the second holographic image (310).

[0210] However, the present disclosure is not limited thereto, and if a phase delay pattern is required to direct light from a spatial light modulator (112) toward a second view (220), the second phase modulation image may be an image generated by multiplying the second hologram image (310) and the corresponding phase delay pattern.

[0211] In one embodiment of the present disclosure, at least one processor (130) can control a spatial light modulator (112) to display a first phase modulated image, a second phase modulated image, and a third phase modulated image. The spatial light modulator (112) can display the first phase modulated image, the second phase modulated image, and the third phase modulated image.

[0212] In one embodiment of the present disclosure, the first phase modulated image, the second phase modulated image, and the third phase modulated image may be displayed as an interference pattern on the spatial light modulator (112). In one embodiment of the present disclosure, the spatial light modulator (112) may display a final modulated image (115) generated by adding the first phase modulated image, the second phase modulated image, and the third phase modulated image.

[0213] In one embodiment of the present disclosure, the final modulated image (115) may be displayed on the spatial light modulator (112) as an interference pattern.

[0214] In one embodiment of the present disclosure, a coherent light source (111) can provide coherent light (114) to a spatial light modulator (112) on which a final modulated image (115) is displayed. Although FIG. 5 illustrates that the coherent light (114) provided from the coherent light source (111) transmits through the spatial light modulator (112) and is directed to the optical layer (113), the present disclosure is not limited thereto. In one embodiment, the coherent light (114) provided from the coherent light source (111) may be reflected from the spatial light modulator (112) and directed to the optical layer (113).

[0215] In addition, although FIG. 5 illustrates that the coherent light source (111), the spatial light modulator (112), and the optical layer (113) are arranged in a row, the present disclosure is not limited thereto. The coherent light source (111) may be arranged on the side of the spatial light modulator (112) or between the spatial light modulator (112) and the optical layer (113).

[0216] In one embodiment of the present disclosure, a first holographic image (300), a second holographic image (310), and a third holographic image (320) can be reproduced as the final modulated image (115) is provided with coherent light (114) to the spatial light modulator (112).

[0217] In one embodiment of the present disclosure, a first holographic image (300) reproduced by coherent light (114) may be referred to as a first generated image (350). A second holographic image (310) reproduced by coherent light (114) may be referred to as a second generated image (360). A third holographic image (320) reproduced by coherent light (114) may be referred to as a third generated image (370).

[0218] At this time, the first generated image (350) can be reproduced so as to have a direction of progression toward the first view (210) as it is reproduced by the first phase modulation image. The first generated image (350) can be an image in which the first hologram image (300) is reproduced by phase modulating by the first phase delay pattern (330).

[0219] The third generated image (370) can be reproduced so as to have a direction of progression toward the third view (230) as it is reproduced by the third phase modulation image. The third generated image (370) can be an image in which the third hologram image (320) is phase modulated by the second phase delay pattern (340) and reproduced.

[0220] The second generated image (360) can be reproduced so as to have a direction of progression toward the second view (220) as it is reproduced by the second phase modulation image. The second generated image (360) can be an image in which the second hologram image (310) is reproduced without phase modulation.

[0221] Referring to FIGS. 5 and 6, the first generated image (350) reproduced in the spatial light modulator (112) can be directed to the first view (210) of the pupil (200) through the optical layer (113). The second generated image (360) reproduced in the spatial light modulator (112) can be directed to the second view (220) of the pupil (200) through the optical layer (113). The third generated image (370) reproduced in the spatial light modulator (112) can be directed to the third view (230) of the pupil (200) through the optical layer (113).

[0222] In one embodiment of the present disclosure, the period of the plurality of grating patterns included in the first phase delay pattern (330) may be determined in correspondence with the diffraction angle at which the first generated image (350) diffracts the first hologram image (300) to be reproduced so that it faces the first view (210). The period of the plurality of grating patterns included in the second phase delay pattern (340) may be determined in correspondence with the diffraction angle at which the third generated image (370) diffracts the third hologram image (320) to be reproduced so that it faces the third view (230).

[0223] Specifically, the period of the plurality of grating patterns included in the first phase delay pattern (330) can be determined based on at least one of the distance between the spatial light modulator (112) and the optical layer (113), the optical characteristics of the optical layer (113), or the shape of the optical layer (113). When the optical layer (113) includes a lens, the period of the plurality of grating patterns included in the first phase delay pattern (330) can be determined based on at least one of the thickness of the lens, the distance between the center of the lens (800, see FIG. 8) and the first view (210), or the first diffraction angle (810, see FIG. 8).

[0224] In addition, the period of the plurality of grating patterns included in the second phase delay pattern (340) can be determined based on at least one of the distance between the spatial light modulator (112) and the optical layer (113), the optical characteristics of the optical layer (113), or the shape of the optical layer (113). When the optical layer (113) includes a lens, the period of the plurality of grating patterns included in the second phase delay pattern (340) can be determined based on at least one of the thickness of the lens, the distance between the center (900) of the lens and the third view (230), or the second diffraction angle (820, see FIG. 8).

[0225] In one embodiment of the present disclosure, each of the first generated image (350), the second generated image (360), and the third generated image (370) reproduced in the spatial light modulator (112) can be provided to the first view (210), the second view (220), and the third view (230) of the pupil (200) through the optical layer (113).

[0226] In one embodiment of the present disclosure, a first generated image (350) may be optically propagated and provided to a first view (210) of the pupil (200). A second generated image (360) may be optically propagated and provided to a second view (220) of the pupil (200). A third generated image (370) may be optically propagated and provided to a third view (230) of the pupil (200).

[0227] At this time, the first generated image (350), the second generated image (360), and the third generated image (370) are reproductions of the first hologram image (300), the second hologram image (310), and the third hologram image (320), respectively, and thus can be combined into one image at the content location (840) and provided as content (380).

[0228] A display that provides two or more generated images within the pupil of the eye (200) may be referred to as a "super multi-view display." In order for a user using a super multi-view display to perceive the two or more generated images provided within the pupil of each eye (200) as a single, clear image, an adjustment operation of the eye (200) may be performed.

[0229] In one embodiment of the present disclosure, the point where two or more generated images are combined into one may correspond to a content location (840). The combined, clear image may correspond to holographic content (380). The adjustment operation of the pupil (200) may be performed to focus on the holographic content (380).

[0230] Accordingly, as the first generated image (350), the second generated image (360), and the third generated image (370) are provided toward the first view (210), the second view (220), and the third view (230) included within the pupil of the eye (200), an adjustment operation of the eye (200) can be performed to focus on the hologram content (380) formed as “A.”

[0231] Accordingly, the user can recognize the depth information of the holographic content (380) and feel the three-dimensionality of the holographic content (380).

[0232] Additionally, the content location (840) may be the point where the user's left and right eyes converge (vergence) based on the binocular disparity contained in the content provided to the user's left and right eyes. Accordingly, the user can be prevented from experiencing dizziness or fatigue due to convergence-accommodation mismatch.

[0233] FIG. 7 is a flowchart illustrating the operation of generating a final modulated image according to one embodiment of the present disclosure. Hereinafter, steps identical to those described in FIGS. 3 and 4 are assigned the same reference numerals, and redundant descriptions are omitted.

[0234] Referring to FIGS. 2, 3, 4 and 7, in one embodiment of the present disclosure, FIG. 7 illustrates a step of generating N phase modulation images each corresponding to N views and a final modulation image.

[0235] In one embodiment of the present disclosure, after the step (S150) of calculating a content position (840, see FIG. 8) at which holographic content (380) is to be displayed, the operating method of the electronic device (100) may include steps of generating N phase modulation images corresponding to N views, respectively.

[0236] Here, N may be the number of acquired multiple view images. N may be the number of multiple views corresponding to the multiple view images. The N views may be views contained within the pupil of the eye. N may be a natural number greater than or equal to 1.

[0237] Although FIG. 7 illustrates steps for generating a first phase modulation image corresponding to a first view and steps for generating an Nth phase modulation image corresponding to an Nth view, the present disclosure is not limited thereto. It goes without saying that the method of operating the electronic device (100) may include a plurality of steps for generating N phase modulation images corresponding to N views, respectively.

[0238] In one embodiment of the present disclosure, the step (S200) of generating a plurality of holographic images (300, 310, 320) may include a step (S201) of generating a first holographic image corresponding to a first view using the calculated content position (840).

[0239] In the step (S201) of generating a first hologram image, a first hologram image can be generated by performing reverse optical propagation from the content location (840) to the electronic device (100) for the first view image corresponding to the first view.

[0240] In the step (S201) of generating a first hologram image, a reverse optical propagation can be performed from the content location (840) to the optical layer (113) for the first view image to generate the first hologram image.

[0241] However, the present disclosure is not limited thereto, and a first holographic image may be generated by performing reverse optical propagation from a content location (840) to an optical layer (113) for a first view image, inverting the optical path change by the optical layer (113), and performing reverse optical propagation from the optical layer (113) to a spatial light modulator (112).

[0242] In the step of generating a first hologram image (S201), at least one processor (130) can generate a first hologram image corresponding to the first view by executing commands or program codes of a hologram image generation module (125).

[0243] In one embodiment of the present disclosure, the step (S200) of generating a plurality of holographic images (300, 310, 320) may include a step (S202) of generating an Nth holographic image corresponding to an Nth view using the calculated content location (840).

[0244] In the step (S202) of generating the Nth holographic image, the Nth holographic image may be generated by performing reverse optical propagation from the content position (840) to the optical layer (113) for the Nth view image corresponding to the Nth view. However, the present disclosure is not limited thereto, and the Nth holographic image may be generated by performing reverse optical propagation from the content position (840) to the optical layer (113) for the Nth view image, inverting the optical path change by the lens (113), and performing reverse optical propagation from the optical layer (113) to the spatial light modulator (112).

[0245] In the step (S202) of generating the Nth hologram image, at least one processor (130) can generate the Nth hologram image corresponding to the Nth view by executing commands or program codes of the hologram image generation module (125).

[0246] In one embodiment of the present disclosure, the step (S300) of calculating a plurality of diffraction angles may include the step (S301) of calculating a first diffraction angle for diffracting the first hologram image so that the first hologram image reproduced in the spatial light modulator (112) faces the first view.

[0247] In the step of calculating the first diffraction angle (S301), at least one processor (130) can calculate the first diffraction angle for diffracting the first hologram image so that the first hologram image faces the first view by executing the commands or program code of the diffraction angle calculation module (123).

[0248] In one embodiment of the present disclosure, the step (S300) of calculating a plurality of diffraction angles may include the step (S302) of calculating an Nth diffraction angle for diffracting the Nth holographic image so that the Nth holographic image reproduced in the spatial light modulator (112) faces the Nth view.

[0249] In the step of calculating the Nth diffraction angle (S302), at least one processor (130) can calculate the Nth diffraction angle for diffracting the Nth hologram image so that the Nth hologram image faces the Nth view by executing instructions or program codes of the diffraction angle calculation module (123).

[0250] In one embodiment of the present disclosure, the step (S400) of generating a plurality of phase delay patterns (330, 340) may include the step (S401) of generating a first phase delay pattern corresponding to a first diffraction angle. The first phase delay pattern may include a plurality of grating patterns having the same period and repeating. The period of each of the plurality of grating patterns may be determined corresponding to the first diffraction angle. The plurality of grating patterns may be generated such that a first holographic image to be reproduced is diffracted by the first diffraction angle.

[0251] In the step (S401) of generating a first phase delay pattern, at least one processor (130) can generate a first phase delay pattern corresponding to the first diffraction angle by executing commands or program codes of the phase delay pattern generation module (126).

[0252] In one embodiment of the present disclosure, the step (S400) of generating a plurality of phase delay patterns (330, 340) may include a step (S402) of generating an Nth phase delay pattern corresponding to an Nth diffraction angle. The Nth phase delay pattern may include a plurality of grating patterns having the same period and repeating. The period of each of the plurality of grating patterns may be determined to correspond to the Nth diffraction angle. The plurality of grating patterns may be generated such that the Nth hologram image to be reproduced is diffracted by the Nth diffraction angle.

[0253] In the step (S402) of generating the Nth phase delay pattern, at least one processor (130) can generate a first phase delay pattern corresponding to the Nth diffraction angle by executing commands or program codes of the phase delay pattern generation module (126).

[0254] In one embodiment of the present disclosure, the step (S500) of generating a plurality of phase modulation images may include the step (S501) of generating a first phase modulation image by multiplying a first phase delay pattern to a first holographic image.

[0255] In the step (S501) of generating a first phase modulation image, at least one processor (130) can generate a first phase modulation image by multiplying the first hologram image and the first phase delay pattern corresponding to the first hologram image by executing commands or program codes of the phase modulation image generation module (127).

[0256] In one embodiment of the present disclosure, the step (S500) of generating a plurality of phase modulation images may include the step (S502) of generating an Nth phase modulation image by multiplying an Nth holographic image by an Nth phase delay pattern.

[0257] In the step (S502) of generating the Nth phase modulation image, at least one processor (130) can generate the Nth phase modulation image by executing commands or program codes of the phase modulation image generation module (127) to multiply the Nth hologram image and the Nth phase delay pattern corresponding to the Nth hologram image.

[0258] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S610) of adding all of the generated plurality of phase modulation images to generate a final modulation image (115, see FIG. 5).

[0259] In one embodiment of the present disclosure, in the step (S610) of generating a final modulated image, the first to Nth phase modulated images may be added to generate a final modulated image (115).

[0260] In the step (S610) of generating the final modulated image (115), at least one processor (130) can generate the final modulated image (115) by adding all of the generated plurality of phase modulated images by executing the commands or program codes of the modulated image generation module (124). At least one processor (130) can generate the final modulated image (115) by adding all of the first to Nth phase modulated images.

[0261] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S620) of displaying a final modulated image (115) through a display module (110). In the step (S620) of displaying the final modulated image, the final modulated image (115) may be displayed through a spatial light modulator (112).

[0262] In the step (S620) of displaying the final modulated image (115), at least one processor (130) can control the spatial light modulator (112) to display the final modulated image (115).

[0263] FIG. 7 illustrates an operation for generating a phase-modulated image corresponding to each view, divided into multiple steps. However, the present disclosure is not limited thereto, and it goes without saying that the operation for generating a phase-modulated image corresponding to each view may be performed by dividing it into fewer or more steps than the steps illustrated in FIG. 7.

[0264] FIG. 8 is a diagram illustrating an operation for calculating a plurality of diffraction angles and a content position according to one embodiment of the present disclosure. FIG. 9 is a flowchart illustrating an operation for calculating a content position of holographic content according to one embodiment of the present disclosure.

[0265] Hereinafter, steps identical to those described in FIG. 3 are assigned the same drawing reference numerals, and redundant descriptions are omitted. In addition, components identical to those described in FIGS. 5 and 6 are assigned the same drawing reference numerals, and redundant descriptions are omitted. In addition, for convenience of explanation, the optical layer (113) may be referred to as a lens included in the optical layer (113).

[0266] Referring to FIGS. 5, 6 and 8, FIG. 8 illustrates a first direction axis (10), a second direction axis (20) and a third direction axis (30). The directions indicated by the first direction axis (10), the second direction axis (20) and the third direction axis (30) are relative concepts and can be converted into other directions.

[0267] Additionally, the directions indicated by the first direction axis (10), the second direction axis (20), and the third direction axis (30) may be described as the first direction, the second direction, and the third direction, respectively. In the present disclosure, the first direction axis (10) and the second direction axis (20) are directions that are orthogonal to each other, and the third direction axis (30) may be a normal direction to a plane defined by the first direction axis (10) and the second direction axis (20).

[0268] In one embodiment of the present disclosure, the display module (110) may include a spatial light modulator (112) and a lens (113). The spatial light modulator (112) and the lens (113) may be arranged in a direction parallel to the second direction axis (20). An optical axis of the lens (113) may be parallel to the second direction axis (20). In this case, the optical axis of the lens (113) may be an axis passing through two focal points of the lens (113).

[0269] In one embodiment of the present disclosure, a plurality of generated images (350, 360, 370) reconstructed from a spatial light modulator (112) can be optically propagated in the second direction axis (20) through a lens (113).

[0270] A user can view content (380) provided through a spatial light modulator (112) and a lens (113) at a position spaced apart from the lens (113) in the second direction axis (20). A user can view content (380) at a position spaced apart from the lens (113) in the second direction axis (20).

[0271] In one embodiment of the present disclosure, the user's pupil (200) may be positioned at the focus of the lens (113). The user may view content (380) provided by the electronic device (100) while the pupil (200) is positioned at the focus of the lens (113).

[0272] At this time, the distance between the electronic device (100) and the pupil (200) may be the focal length (860) of the lens (113). The focal length (860) of the lens (113) may be the distance from the center (800) of the lens (113) to the focus of the lens (113).

[0273] In one embodiment of the present disclosure, a plurality of views (210, 220, 230) included in the pupil of the eye (200) may be positioned on an imaginary line passing through the focus of the lens (113) and having a direction perpendicular to the optical axis of the lens (113).

[0274] In one embodiment of the present disclosure, a second view (220) among the plurality of views (210, 220, 230) may be positioned at the focus of the lens (113). A first view (210) among the plurality of views (210, 220, 230) may be positioned in a direction spaced apart from the second view (220) in the first direction axis (10). A third view (230) among the plurality of views (210, 220, 230) may be positioned in a direction spaced apart from the second view (220) in the opposite direction of the first direction axis (10).

[0275] In one embodiment of the present disclosure, a line passing through the center (800) of the lens (113) and the first view (210) may be referred to as a first optical path (801). A line passing through the center (800) of the lens (113) and the second view (220) may be referred to as a second optical path (802). In this case, the second optical path (802) may be in a direction parallel to the optical axis of the lens (113). A line passing through the center (800) of the lens (113) and the third view (230) may be referred to as a third optical path (803).

[0276] In one embodiment of the present disclosure, at least one processor (130) can calculate angles formed by the optical axis of the lens (113) and a plurality of lines (801, 802, 803) passing through the center (800) of the lens (113) and each of the plurality of views (210, 220, 230), as a plurality of diffraction angles (810, 820).

[0277] At least one processor (130) can calculate the angle formed by the first optical path (801) and the optical axis of the lens (113) as the first diffraction angle (810). At this time, the angle formed by the first optical path (801) and the optical axis of the lens (113) may be the angle formed by the first optical path (801) and the second optical path (802).

[0278] At least one processor (130) can calculate that the angle formed by the second optical path (802) and the optical axis of the lens (113) is 0 degrees.

[0279] At least one processor (130) can calculate the angle formed by the third optical path (803) and the optical axis of the lens (113) as the second diffraction angle (820). At this time, the angle formed by the third optical path (803) and the optical axis of the lens (113) may be the angle formed by the third optical path (803) and the second optical path (802).

[0280] In one embodiment of the present disclosure, FIG. 8 illustrates three views (210, 220, 230) and three generated images (350, 360, 370) provided through a spatial light modulator (112) and a lens (113) at two diffraction angles (810, 820) for pointing towards the three views (210, 220, 230).

[0281] However, the present disclosure is not limited thereto, and when the acquired plurality of view images include two or four or more view images, it goes without saying that at least one processor (130) can calculate a plurality of diffraction angles for pointing to the two or four views.

[0282] Additionally, if the second view (220) is located at a location other than the focus of the lens (113), at least one processor (130) may calculate a non-zero degree angle between the second optical path (802) and the optical axis of the lens (113) as the second diffraction angle.

[0283] Additionally, FIG. 8 illustrates a “first reference distance (830)”, a “second reference distance (850)”, and a “content location (840)”.

[0284] The "first reference distance (830)" may be the closest distance among the distances set to form the hologram content (380) in the direction of the second direction axis (20) from the optical layer (113). The "first reference distance (830)" may be the closest distance among the distances set to form the hologram content (380) in the direction of the second direction axis (20) from the lens (113).

[0285] The first reference distance (830) may be the minimum distance at which two lights provided from the two farthest pixels among the plurality of pixels included in the spatial light modulator (112) can overlap each other (for example, two pixels located at opposite vertices).

[0286] In one embodiment of the present disclosure, the first reference distance (830) may be set differently depending on the type of the spatial light modulator (112), the resolution of the spatial light modulator (112), the shape of the lens (113), the refractive index of the lens (113), or the distance between the spatial light modulator (112) and the lens (113).

[0287] At least one processor (130) can control the electronic device (100) so that the holographic content (380) displayed through the spatial light modulator (112) is focused at a distance from the lens (113) that is equal to or greater than the first reference distance (830).

[0288] The "second reference distance (850)" may be the longest distance among the distances set to form hologram content (380) in the direction of the second direction axis (20) from the optical layer (113). The "second reference distance (850)" may be the longest distance among the distances set to form hologram content (380) in the direction of the second direction axis (20) from the lens (113).

[0289] In one embodiment of the present disclosure, the second reference distance (850) may be set differently depending on the type of the spatial light modulator (112), the resolution of the spatial light modulator (112), the shape of the lens (113), the refractive index of the lens (113), or the distance between the spatial light modulator (112) and the lens (113).

[0290] At least one processor (130) can control the electronic device (100) so that the holographic content (380) displayed through the spatial light modulator (112) is focused at a distance from the lens (113) that is equal to or closer than the second reference distance (850).

[0291] The second reference distance (850) may be a longer distance from the optical layer (113) in the direction of the second direction axis (20) than the first reference distance (830).

[0292] In one embodiment of the present disclosure, the first reference distance (830) and the second reference distance (850) may be preset distances. At least one processor (130) may obtain information about the preset first reference distance (830) and the second reference distance (850) from an external server or an external electronic device through an input / output interface (140) or a communication interface (150).

[0293] In one embodiment of the present disclosure, a content position (840), which is a distance set so that the hologram content (380) is formed in the direction of the second direction axis (20) of the optical layer (113), may be determined based on a depth value for an object included in a plurality of acquired view images. The content position (840) may be a distance set so that the hologram content (380) is formed in the direction of the second direction axis (20) from the lens (113).

[0294] Referring to FIGS. 2, 3, 4, 8, and 9, in one embodiment of the present disclosure, the step (S150) of calculating a content location at which holographic content (380) is to be displayed may include the step (S110) of obtaining a depth value for an object included in a plurality of view images.

[0295] In one embodiment of the present disclosure, in the step (S110) of obtaining a depth value for an object included in a plurality of view images, the depth value for the object can be obtained based on metadata information included in the obtained plurality of view images.

[0296] In one embodiment of the present disclosure, in the step (S110) of obtaining a depth value for an object included in a plurality of view images, the depth value for the object may be obtained by using binocular disparity included in the obtained plurality of view images.

[0297] In the step (S110) of obtaining a depth value for an object included in multiple view images, at least one processor (130) can obtain a depth value for an object included in multiple view images by executing instructions or program codes of a content location calculation module (122).

[0298] Referring to FIGS. 8 and 9, in one embodiment of the present disclosure, the step (S150) of calculating a content position (840) at which to display holographic content (380) may include a step (S120) of determining whether the acquired depth value is less than a preset maximum depth value.

[0299] At this time, the “maximum depth value” may be a depth value set so that the hologram content of an object having a depth value greater than the depth value is displayed at the first reference distance (830).

[0300] In the step (S120) of determining whether the acquired depth value is less than the preset maximum depth value, at least one processor (130) can determine whether the acquired depth value is less than the preset maximum depth value by executing instructions or program code of the content location calculation module (122).

[0301] In the step (S150) of calculating the content position (840) for displaying the hologram content (380) as the depth value is determined to be equal to or greater than the maximum depth value, a point that is the same distance as the preset first reference distance (830) from the optical layer (113) can be calculated as the content position (840) (S140).

[0302] In the step (S120) of determining whether the depth value is smaller than the maximum depth value, if the depth value is determined to be equal to or greater than the maximum depth value (S140), at least one processor (130) can calculate a point that is a distance equal to a first reference distance (830) preset from the optical layer (113) as the content location (840) by executing instructions or program codes of the content location calculation module (122).

[0303] For example, when an object included in multiple view images is spaced apart from multiple cameras by a distance of 10 meters, the depth value of the object may be set to the maximum depth value. When an object included in multiple view images is spaced apart from multiple cameras by a distance greater than 10 meters, such as 15 meters or 20 meters, the depth value of the object may be greater than the maximum depth value. In this case, the content position (840) of the holographic content of the object may be calculated so that it is displayed at the first reference distance (830).

[0304] At this time, distances such as 10 meters, 15 meters, and 20 meters are given as examples for convenience of explanation, and it is obvious that the present disclosure is not limited thereto.

[0305] In one embodiment of the present disclosure, the step (S150) of calculating a content position (840) at which to display holographic content (380) may include a step (S130) of determining whether the acquired depth value is greater than a preset minimum depth value.

[0306] At this time, the “minimum depth value” may be a depth value set so that the hologram content of an object having a depth value smaller than the depth value is displayed at the second reference distance (850).

[0307] The step (S130) of determining whether the acquired depth value is greater than a preset minimum depth value may be performed when the depth value is determined to be less than the maximum depth value in the step (S120) of determining whether the depth value is less than the maximum depth value.

[0308] In the step (S130) of determining whether the acquired depth value is greater than the preset minimum depth value, at least one processor (130) can determine whether the acquired depth value is less than the preset minimum depth value by executing instructions or program codes of the content location calculation module (122).

[0309] In the step (S150) of calculating the content position (840) for displaying the hologram content (380) as the depth value is determined to be equal to or less than the minimum depth value, a point that is a distance equal to the preset second reference distance (950) from the optical layer (113) can be calculated as the content position (840) (S132).

[0310] In the step (S130) of determining whether the depth value is greater than the minimum depth value, if the depth value is determined to be equal to or less than the minimum depth value (S132), at least one processor (130) can calculate a point that is a distance equal to a preset second reference distance (950) from the optical layer (113) as the content location (840) by executing instructions or program codes of the content location calculation module (122).

[0311] For example, when an object included in multiple view images is spaced apart from multiple cameras by a distance of 2 meters, the depth value of the object may be set to a minimum depth value. When an object included in multiple view images is spaced apart from multiple cameras by a distance less than 2 meters, such as 1 meter, the depth value of the object may be smaller than the minimum depth value. In this case, the content position (840) of the hologram content of the object may be calculated so that it is displayed at a second reference distance (850).

[0312] At this time, distances such as 1 meter and 2 meters are given as examples for convenience of explanation, and it is obvious that the present disclosure is not limited thereto.

[0313] In the step (S150) of calculating the content position (840) for displaying the hologram content (380) as the depth value is determined to be greater than the minimum depth value, a point that is further away from the optical layer (113) by a distance that is further than the first reference distance (830) and closer than the second reference distance (850) according to the depth value can be calculated as the content position (840) (S131).

[0314] At this time, the second reference distance (850) may be a distance further from the optical layer (113) than the first reference distance (830). The second reference distance (850) may be a distance further from the lens (113) than the first reference distance (830).

[0315] In the step (S130) of determining whether the depth value is greater than the minimum depth value, if it is determined (S131) ​​that the depth value is greater than the minimum depth value, at least one processor (130) can execute instructions or program codes of the content location calculation module (122) to calculate a point that is further from the optical layer (113) by a distance that is greater than the first reference distance (930) and less than the second reference distance (950), as the content location (840).

[0316] In one embodiment of the present disclosure, at least one processor (130) may calculate a first reference distance (830) as a content location (840) when the acquired depth value is a maximum depth value, and may calculate a second reference distance (850) as a content location (840) when the acquired depth value is a minimum depth value, thereby calculating a distance corresponding to a depth value between the maximum depth value and the minimum depth value as a content location (840).

[0317] In one embodiment of the present disclosure, the step (S200) of generating a plurality of holographic images (300, 310, 320) may generate a plurality of holographic images (300, 310, 320) using the calculated content positions (840).

[0318] FIG. 10 is a drawing for explaining a phase delay pattern according to one embodiment of the present disclosure.

[0319] Referring to FIGS. 6 and 10, in one embodiment of the present disclosure, FIG. 10 illustrates a k-th phase delay pattern (1000) which is one of N phase delay patterns.

[0320] In one embodiment of the present disclosure, the phase delay pattern (1000) may include a plurality of grid patterns. Each of the plurality of grid patterns may have the same period (1010).

[0321] In one embodiment of the present disclosure, the period (1010) of each of the plurality of grating patterns can be determined corresponding to the diffraction angle of light to be diffracted through the corresponding phase delay pattern (1000).

[0322] In one embodiment of the present disclosure, the period (1010) of each of the plurality of grid patterns can be determined by the following mathematical expression 1.

[0323] , mathematical formula 1

[0324] At this time, may mean the period of the grid pattern included in the kth phase delay pattern. may refer to the wavelength of coherent light (114) provided to the spatial light modulator (112). may be a diffraction angle that diffracts the Nth holographic image toward the kth view. Here, k may be a natural number between 1 and N. N may be a natural number greater than 1.

[0325] Accordingly, the larger the angle to be diffracted through the phase delay pattern (1000), the shorter the period (1010) of each of the plurality of grating patterns may be. In one embodiment of the present disclosure, depending on the shape of each of the plurality of grating patterns included in the phase delay pattern (1000), light passing through the corresponding grating pattern may be refracted, thereby changing the direction of propagation of the light.

[0326] In addition, the present disclosure is not limited to the above mathematical expression 1, and the period (1010) of each of the plurality of grating patterns may be determined according to the distance between the lens (113) and the spatial light modulator (112), the shape of the lens (113), the refractive index of the lens (113), etc.

[0327] The phase delay pattern (1000) illustrated in FIG. 10 may be a voltage pattern applied to a liquid crystal layer included in a spatial light modulator (112). The arrangement of liquid crystals included in the liquid crystal layer may be determined by the phase delay pattern (1000). The liquid crystals included in the liquid crystal layer may be arranged in a plurality of triangular shapes corresponding to each of a plurality of grid patterns. In this case, each of the plurality of triangular shapes may be in the shape of a right triangle.

[0328] However, the present disclosure is not limited thereto, and it goes without saying that the arrangement of liquid crystals formed by the phase delay pattern (1000) can be arranged in various shapes capable of diffracting light passing through the phase plate.

[0329] FIG. 11 is a flowchart illustrating an operation of generating a plurality of phase-modulated images using a modulated image generation module according to an embodiment of the present disclosure. FIG. 12 is a block diagram illustrating an operation of generating a plurality of phase-modulated images using a modulated image generation module according to an embodiment of the present disclosure.

[0330] Hereinafter, the same configuration as that described in Fig. 2 is assigned the same drawing reference numerals, and redundant descriptions are omitted. In addition, the same steps as those described in Fig. 3 are assigned the same drawing reference numerals, and redundant descriptions are omitted.

[0331] Referring to FIGS. 2, 3, and 11, in one embodiment of the present disclosure, the method of operating the electronic device (100) may further include a step (S550) of generating a plurality of phase modulation images by applying a plurality of view images, a content location (840, see FIG. 8), and a plurality of diffraction angles (810, 820, see FIG. 8) to the modulation image generation module (124).

[0332] In the step (S550) of generating a plurality of phase modulation images by applying a plurality of view images, a content position (840), and a plurality of diffraction angles (810, 820) to the modulation image generation module (124), at least one processor (130) can generate a plurality of phase modulation images by applying a plurality of view images, a content position (840), and a plurality of diffraction angles (810, 820) to the modulation image generation module (124).

[0333] In one embodiment of the present disclosure, the modulated image generation module (124) may include an artificial intelligence model trained to infer multiple phase modulated images for displaying holographic content (380, see FIG. 9) at a calculated content location (840).

[0334] In one embodiment of the present disclosure, the artificial intelligence model included in the modulated image generation module (124) may include multiple neural network layers. Each of the multiple neural network layers may include multiple weight values. The artificial intelligence model may perform calculations of the current neural network layer by calculating the calculation results of the previous neural network layer and the multiple weight values.

[0335] In one embodiment, at least one processor (130) may train an artificial intelligence model included in the modulated image generation module (124). At least one processor (130) may also perform transfer learning and fine-tuning using a pre-trained model to train the artificial intelligence model included in the modulated image generation module (124).

[0336] Hereinafter, the training method of the artificial intelligence model included in the modulated image generation module (124) will be described later in FIG. 13.

[0337] However, the present disclosure is not limited thereto, and at least one processor (130) may receive an artificial intelligence model trained to infer a plurality of phase modulation images for displaying holographic content (380) at a calculated content location (840) using a plurality of view images, a content location (840), and a plurality of diffraction angles (810, 820) from an external server or peripheral electronic devices through a communication interface (150).

[0338] Again, referring to FIGS. 1, 8, and 12, the image acquisition module (121) can acquire a plurality of view images corresponding to each of the plurality of views (210, 220, 230). The image acquisition module (121) can provide the acquired plurality of view images to the content position calculation module (122), the diffraction angle calculation module (123), and the modulation image generation module (124).

[0339] The content location calculation module (122) can calculate a content location (840) for displaying holographic content (380) based on the depth values ​​of objects included in the acquired multiple view images. The content location calculation module (122) can provide the calculated content location (840) to the modulation image generation module (124).

[0340] The diffraction angle calculation module (123) can calculate a plurality of diffraction angles (810, 820) required to direct a plurality of generated images (350, 360, 370) reproduced in the spatial light modulator (112) toward each of the corresponding plurality of views (210, 220, 230). The diffraction angle calculation module (123) can calculate a plurality of diffraction angles (810, 820) using the positions of a plurality of cameras and the focal length (860) of the lens (113) included in the metadata of the acquired plurality of view images. The diffraction angle calculation module (123) can provide the calculated plurality of diffraction angles (810, 820) to the modulation image generation module (124).

[0341] The modulation image generation module (124) can generate a plurality of phase modulation images for displaying holographic content (380) at the content location (840) by using the provided plurality of view images, content location (840), and plurality of diffraction angles (810, 820).

[0342] The modulation image generation module (124) can generate a plurality of phase modulation images by applying a plurality of view images, a content location (840), and a plurality of diffraction angles (810, 820) to an artificial intelligence model trained to infer a plurality of phase modulation images for displaying holographic content at a provided content location.

[0343] FIG. 13 is a block diagram illustrating an operation of training an artificial intelligence model included in a modulated image generation module according to one embodiment of the present disclosure.

[0344] Referring to FIGS. 2 and 13, in one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of acquiring a plurality of training view images generated by photographing an object in a plurality of views.

[0345] In the step of acquiring multiple training view images, at least one processor (130) can acquire multiple training view images by executing commands or program codes of the image acquisition module (121).

[0346] In one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step of acquiring a plurality of training view images generated by photographing an object in a plurality of views.

[0347] In the step of acquiring multiple training view images, at least one processor (130) can acquire multiple training view images by executing commands or program codes of the image acquisition module (121).

[0348] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of calculating a content location at which to display training holographic content based on depth values ​​of objects included in a plurality of acquired training view images.

[0349] In the step of calculating the content position at which to display the training hologram content, at least one processor (130) can calculate the content position at which to display the training hologram content based on the depth values ​​of objects included in the plurality of training view images by executing the instructions or program code of the content position calculation module (122).

[0350] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of calculating a plurality of training diffraction angles required to direct a plurality of training holographic images reproduced in a spatial light modulator (112) toward each of a plurality of corresponding views.

[0351] In the step of calculating a plurality of training diffraction angles, at least one processor (130) can calculate a plurality of training diffraction angles necessary to direct a plurality of training hologram images reproduced in the spatial light modulator (112) toward each of the corresponding plurality of views by executing instructions or program codes of the diffraction angle calculation module (123).

[0352] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of generating a plurality of training hologram images based on a plurality of acquired training view images.

[0353] In the step of generating multiple training hologram images, multiple training hologram images can be generated based on the acquired multiple training view images and the calculated content positions.

[0354] In the step of generating a plurality of training hologram images, at least one processor (130) can generate a plurality of training hologram images by applying the acquired plurality of training view images to the artificial intelligence model included in the modulated image generation module (124).

[0355] In the step of generating a plurality of training hologram images, at least one processor (130) can generate a plurality of training hologram images by applying the acquired plurality of training view images and the calculated content location to the artificial intelligence model included in the modulated image generation module (124).

[0356] In one embodiment of the present disclosure, the artificial intelligence model may include a module (125) for generating a holographic image. At least one processor (130) may generate a plurality of training holographic images by applying a plurality of training view images and calculated content positions through the holographic image generation module (125) included in the artificial intelligence model.

[0357] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of generating a plurality of training phase delay patterns corresponding to a plurality of calculated training diffraction angles.

[0358] In the step of generating a plurality of training phase delay patterns, at least one processor (130) can generate a plurality of training phase delay patterns by applying a plurality of calculated diffraction angles to an artificial intelligence model included in the modulated image generation module (124).

[0359] In one embodiment of the present disclosure, the artificial intelligence model may include a module (126) for generating a phase delay pattern. At least one processor (130) may generate a plurality of training phase delay patterns through the phase delay pattern generation module (126) included in the artificial intelligence model.

[0360] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of generating a plurality of training phase modulation images by multiplying a plurality of generated training hologram images and a plurality of training phase delay patterns.

[0361] In the step of generating a plurality of training phase modulation images, at least one processor (130) can generate a plurality of training phase modulation patterns by applying a plurality of training holographic images and a plurality of training phase delay patterns generated to an artificial intelligence model included in a modulation image generation module (124).

[0362] In one embodiment of the present disclosure, the artificial intelligence model may include a module (127) for generating a phase delay image. At least one processor (130) may generate a plurality of training phase delay images by multiplying a plurality of training holographic images and a plurality of training phase delay patterns through the phase modulation image generation module (127) included in the artificial intelligence model.

[0363] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of generating training hologram content formed at a content location by optically propagating a plurality of generated training phase modulation patterns.

[0364] In the step of generating training hologram content to be formed at a content location, at least one processor (130) can generate training hologram content displayed at the content location by optically propagating a plurality of generated training phase modulation patterns by executing commands or program codes of an optical propagation module (1300) including an optical propagation algorithm.

[0365] In one embodiment of the present disclosure, a method for training an artificial intelligence model included in a modulated image generation module (124) may include a step of training the artificial intelligence model included in the modulated image generation module (124) using a loss function that compares training hologram content displayed by a plurality of training phase modulation images with object content (1320) by a plurality of training view images.

[0366] In the step of training the artificial intelligence model included in the modulated image generation module (124), the weights of the artificial intelligence model included in the modulated image generation module (124) can be updated using a loss function.

[0367] At this time, the "object content (1320)" may be content created by adding together multiple training view images acquired by photographing an object. The object content (1320) may be holographic content that serves as a target to be provided to a user from an electronic device (100) using multiple training view images.

[0368] The loss function comparing the holographic content and the object content (1320) may have a larger value as the difference between the holographic content and the object content (1320) increases. The loss function may have a smaller value as the difference between the holographic content and the object content decreases.

[0369] In one embodiment, the training holographic content generated by optically propagating multiple training phase modulation patterns to the content location may have low definition or may contain interference patterns. Accordingly, there may be a difference between the holographic content and the object content (1320).

[0370] In one embodiment, in the step of training the artificial intelligence model included in the modulated image generation module (124), the weights of the artificial intelligence model included in the modulated image generation module (124) may be updated to minimize the loss function using a forward propagation algorithm and a back propagation algorithm.

[0371] In the step of training the artificial intelligence model included in the modulated image generation module (124) using a loss function, at least one processor (130) can train the artificial intelligence model included in the modulated image generation module (124) using a loss function that compares the training hologram content and the object content (1320) by executing the commands or program code of the loss calculation module (1310).

[0372] At this time, the loss calculation module (1310) may include a loss function, a forward propagation algorithm, a backpropagation algorithm, etc.

[0373] FIG. 14A is a diagram illustrating an operation of displaying holographic contents having two or more different depth values ​​according to one embodiment of the present disclosure. FIG. 14B is a diagram illustrating an operation of displaying holographic contents having consecutive depth values ​​according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIGS. 1 and 6 are assigned the same reference numerals, and redundant descriptions are omitted.

[0374] Referring to FIGS. 2 and 14A, in one embodiment of the present disclosure, the electronic device (100) may further include a 4-f optical system (4-f optical system, 1400).

[0375] In one embodiment of the present disclosure, a 4-f optical system (1400) may be positioned between a spatial light modulator (112) and an optical layer (113). The 4-f optical system (1400) may include a first optical lens (1410) and a second optical lens (1430).

[0376] At the left focal point of the first optical lens (1410), a plurality of holographic images reproduced by the spatial light modulator (112) may be positioned. At the right focal point of the second optical lens (1430), a plurality of holographic images with noise removed through the first optical lens (1410) and the second optical lens (1430) may be displayed. The right focal point of the first optical lens (1410) and the left focal point of the second optical lens (1430) may be the same.

[0377] In one embodiment of the present disclosure, the 4-f optical system (1400) may include a slit (1420) positioned between a first optical lens (1410) and a second optical lens (1430). In this case, the slit (1420) may be positioned at a right focal position of the first optical lens (1410).

[0378] In one embodiment of the present disclosure, the 4-f optical system (1400) may be configured to remove noise included in a plurality of holographic images reproduced by the spatial light modulator (112).

[0379] In one embodiment of the present disclosure, the 4-f optical system (1400) and the optical layer (113) may be separate components. However, the present disclosure is not limited thereto, and the 4-f optical system (1400) may be a component included in the optical layer (113). In this case, the 4-f optical system (1400) and the lens (113) illustrated in FIG. 8 may be separate components. In this case, the 4-f optical system (1400) may be placed between the spatial light modulator (112) and the lens (113).

[0380] In one embodiment of the present disclosure, the acquired plurality of view images may include two or more objects. The depth values ​​of the two or more objects included in the plurality of view images may be different from each other.

[0381] In one embodiment of the present disclosure, a plurality of view images may include an object having a shape of "A" and an object having a shape of "B." The depth values ​​of "A" and "B" may be different from each other. The distances between the plurality of cameras included in the metadata of the plurality of view images and "A" and the distances between the plurality of cameras and "B" may be different. Furthermore, the binocular parallax of "A" may be different from the binocular parallax of "B."

[0382] In one embodiment of the present disclosure, since the depth value of object “A” and the depth value of object “B” are different, the content position where the hologram content (1450) corresponding to “A” calculated by at least one processor (130) is displayed and the content position where the hologram content (1440) corresponding to “B” is displayed may be different.

[0383] In one embodiment of the present disclosure, as the depth value of “B” is greater than the depth value of “A,” the distance from the lens (113) to the content location where the hologram content (1440) corresponding to “B” is displayed may be closer than the distance from the lens (113) to the content location where the hologram content (1450) corresponding to “A” is displayed.

[0384] In one embodiment of the present disclosure, at least one processor (130) can generate a plurality of holographic images (1441, 1442, 1443) corresponding to “B” by back-propagating each of a plurality of view images including “B” by a distance to a content location where holographic content (1440) corresponding to “B” is displayed.

[0385] In one embodiment of the present disclosure, at least one processor (130) can generate a plurality of holographic images (1451, 1452, 1453) corresponding to “A” by back-propagating each of a plurality of view images including “A” by a distance to a content location where holographic content (1450) corresponding to “A” is displayed.

[0386] At this time, the angles at which the plurality of holographic images (1441, 1442, 1443) corresponding to "B" and the plurality of holographic images (1451, 1452, 1453) corresponding to "A" reproduced through the spatial light modulator (112), the 4-f optical system (1400), and the lens (113) must be diffracted in order to face the plurality of views included in the pupil of the eye (200) may be the same.

[0387] Accordingly, at least one processor (130) can generate a plurality of phase delay patterns (1444, 1445) corresponding to a plurality of diffraction angles.

[0388] At least one processor (130) can generate a plurality of first phase modulation images by multiplying a plurality of holographic images (1441, 1442, 1443) corresponding to “B” and a plurality of phase delay patterns (1444, 1445) corresponding to each of the plurality of holographic images (1441, 1442, 1443) corresponding to “B”.

[0389] At least one processor (130) can generate a plurality of second phase modulation images by multiplying a plurality of holographic images (1451, 1452, 1453) corresponding to “A” and a plurality of phase delay patterns (1444, 1445) corresponding to each of the plurality of holographic images (1451, 1452, 1453) corresponding to “A”.

[0390] At least one processor (130) can add a plurality of first phase modulation images and a plurality of second phase modulation images to generate a final modulation image. At least one processor (130) can control a spatial light modulator (112) to display the final modulation image.

[0391] Through this, the electronic device (100) can provide the user with multiple hologram contents having different depth values, thereby allowing the user to experience various three-dimensional effects.

[0392] Referring to FIG. 14b, FIG. 14b illustrates a spatial light modulator (112), a 4f-optical system (1400), and a lens (113).

[0393] In one embodiment of the present disclosure, multiple view images may include an object having continuous depth values. FIG. 14B illustrates a rectangular object included in multiple view images displayed as holographic content (1460).

[0394] At least one processor (130) can calculate a plurality of consecutive content locations corresponding to consecutive depth values.

[0395] At least one processor (130) can generate a plurality of hologram images (1461, 1462, 1463) corresponding to the rectangular solid shape by retro-optically propagating each of a plurality of view images including a rectangular solid-shaped object by the distance from the lens (113) to a plurality of consecutive content locations.

[0396] At least one processor (130) can calculate a plurality of diffraction angles to provide a plurality of holographic images (1461, 1462, 1463) in the shape of a rectangular parallelepiped reproduced through a spatial light modulator (112), a 4-f optical system (1400), and a lens (113) to a plurality of views included in the pupil of the eye (200).

[0397] At least one processor (130) can generate a plurality of phase delay patterns (1464, 1465) corresponding to a plurality of diffraction angles. At least one processor (130) can generate a plurality of phase modulation images by multiplying a plurality of hologram images (1461, 1462, 1463) corresponding to a rectangular parallelepiped shape by a plurality of phase delay patterns (1464, 1465) corresponding to each of the plurality of hologram images (1461, 1462, 1463).

[0398] At least one processor can control the spatial light modulator (112) to display a plurality of phase-modulated images. At least one processor can control the spatial light modulator (112) to display a final modulated image that adds together the plurality of phase-modulated images.

[0399] Through this, the electronic device (100) can provide an object having continuous depth values ​​as holographic content (1460) to the user. Although only three holographic images and two phase delay patterns are illustrated in FIG. 14B, the present disclosure is not limited thereto. In the present disclosure, the holographic content (1460) may be displayed using multiple holographic images and multiple phase delay patterns repeated at short intervals so that the user may feel as if they are continuous.

[0400] FIG. 15 is a diagram illustrating an operation of displaying holographic content using a spatial light modulator including a plurality of sub-spatial light modulators according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIGS. 5, 6, and 14b are assigned the same reference numerals, and redundant descriptions are omitted.

[0401] In one embodiment of the present disclosure, an electronic device (100) may include a spatial light modulator (1500), a 4f-optical system (1400), and an optical layer (113).

[0402] In one embodiment of the present disclosure, a spatial light modulator (1500) may include a plurality of sub-spatial light modulators (1510) and a light splitter (1520). Each of the plurality of sub-spatial light modulators (1510) may be provided with coherent light (114) by a coherent light source (111, see FIG. 5).

[0403] A plurality of sub-hologram images can be displayed on each of the plurality of sub-spatial light modulators (1510). The plurality of sub-hologram images displayed on the plurality of sub-spatial light modulators (1510) can be reconstructed into a plurality of sub-generated images by coherent light (114).

[0404] The optical splitter (1520) can reflect or transmit a plurality of sub-generated images reproduced from each of the plurality of sub-spatial light modulators (1520) and provide them to the 4f-optical system (1400).

[0405] The generated image reflected or transmitted by the optical splitter (1520) and provided to the 4f-optical system (1400) may be an image formed by connecting multiple sub-generated images. The optical splitter (1520) may be formed so that the multiple sub-generated images are seamlessly connected and provided as a generated image without any boundaries between the multiple sub-generated images.

[0406] In one embodiment of the present disclosure, the area of ​​a sub-generated image reproduced by one sub-spatial light modulator (1520) may be a first area (1530). The second area (1540), which is an area of ​​a generated image provided by being reflected or transmitted through the light splitter (1520), may be the sum of a plurality of first areas.

[0407] In one embodiment of the present disclosure, a generated image having a relatively large second area (1540) can be reproduced using a sub-generated image having a relatively small first area (1530) through a plurality of sub-spatial light modulators (1510) and an optical splitter (1520).

[0408] At this time, a spatial light modulator (1500) that provides a seamless image can be implemented by connecting a plurality of sub-images, each having a first area (1530), without an area where the image is not displayed to generate a generated image having a second area (1540).

[0409] In addition, since the generated image having the second area (1540) is reproduced by a combination of a plurality of sub-hologram images displayed on a plurality of sub-spatial light modulators (1510), it can be an image with high resolution.

[0410] In one embodiment of the present disclosure, a generated image having a second area (1540) can be provided to the optical layer (113) as a generated image (1550) with noise removed through a 4-f optical system (1400).

[0411] The generated image (1550) with noise removed can be provided to the user's pupil (200) through the optical layer (113). At this time, the generated image reproduced by the electronic device (100) including a plurality of sub-spatial light modulators (1510) and an optical splitter (1520) has a high resolution, so that even if the position of the user using the electronic device (100) changes, the generated image (1550) with noise removed can be provided toward the user's pupil (200) through the optical layer (113).

[0412] Therefore, when the electronic device (100) provides holographic content, it can provide a wide viewing angle to the user.

[0413] FIG. 16 is a block diagram illustrating an operation of displaying holographic content by providing different sub-holographic contents to the two eyes of a user according to one embodiment of the present disclosure.

[0414] Referring to FIGS. 1, 2, 6 and 16, in one embodiment of the present disclosure, FIG. 16 illustrates an electronic device (1600) that provides holographic contents (1630, 1640) to the right eye (1660) and the left eye (1670) of a user (1650), respectively.

[0415] In one embodiment of the present disclosure, the electronic device (1600) may include a first spatial light modulator (1610), a second spatial light modulator (1611), a first lens (1620), and a second lens (1621). However, the present disclosure is not limited thereto, and the electronic device (1600) may further include a coherent light source that provides coherent light to the first spatial light modulator (1610) and the second spatial light modulator (1611).

[0416] In one embodiment of the present disclosure, the electronic device (1600) can acquire multiple view images. The multiple view images may be images acquired by photographing a real object from multiple different views.

[0417] At this time, the plurality of views may include views corresponding to the positions of the right eye (1660) and the left eye (1670) of the user (1650), respectively. The plurality of views may include views spaced apart by the distance between the right eye (1660) and the left eye (1670).

[0418] Additionally, the plurality of views may include views contained within the pupil of the right eye (1660) and the pupil of the left eye (1670). The plurality of views may include views contained within the pupil of the right eye (1660) and views contained within the pupil of the left eye (1670).

[0419] In one embodiment of the present disclosure, the plurality of view images may be images obtained by photographing a real-world object through a plurality of cameras positioned in each of the plurality of views. However, the present disclosure is not limited thereto, and the plurality of view images may be images obtained by photographing a real-world object through a camera including a micro lens array including a plurality of lenses positioned in each of the plurality of views.

[0420] In one embodiment of the present disclosure, the plurality of view images may include a plurality of first view images acquired from a view corresponding to the right eye (1660) and a plurality of second view images acquired from a view corresponding to the left eye (1670). In one embodiment of the present disclosure, binocular disparity may exist between the plurality of first view images and the plurality of second view images.

[0421] In one embodiment of the present disclosure, the electronic device (1600) can calculate a first content location to display first holographic content (1630) to be provided to the right eye (1660) based on depth values ​​included in a plurality of first view images.

[0422] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of first view holographic images (1631, 1632, 1633) by reverse-propagating a plurality of first view images using the calculated first content location.

[0423] In one embodiment of the present disclosure, the electronic device (1600) can calculate a plurality of first view diffraction angles for directing a plurality of first view holographic images (1631, 1632, 1633) reproduced by the first spatial light modulator (1610) toward views included in the pupil of the right eye (1660).

[0424] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of first view phase delay patterns (1634, 1635) corresponding to a plurality of calculated first view diffraction angles.

[0425] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of first view phase modulation images by multiplying a plurality of first view holographic images (1631, 1632, 1633) and a plurality of first view phase delay patterns (1634, 1635) corresponding to each of the plurality of first view holographic images (1631, 1632, 1633).

[0426] In one embodiment of the present disclosure, the electronic device (1600) can control the first spatial light modulator (1610) to display a plurality of generated first-view phase modulation images. The electronic device (1600) can control the first spatial light modulator (1610) to display a final first-view phase modulation image that is the sum of all of the plurality of first-view phase modulation images.

[0427] In one embodiment of the present disclosure, a plurality of first generated images (1636, 1637, 1638) can be reconstructed through a first spatial light modulator (1610) that displays a final first view image. The plurality of first generated images (1636, 1637, 1638) can be combined into a first holographic content (1630) at a first content location.

[0428] In one embodiment of the present disclosure, the electronic device (1600) can calculate a second content location to display second holographic content (1640) to be provided to the left eye (1670) based on depth values ​​included in a plurality of second view images.

[0429] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of second view holographic images (1641, 1642, 1643) by back-propagating a plurality of second view images using the calculated second content location.

[0430] In one embodiment of the present disclosure, the electronic device (1600) can calculate a plurality of second view diffraction angles for directing a plurality of second view holographic images (1641, 1642, 1643) reproduced by the second spatial light modulator (1611) toward views included in the pupil of the left eye (1670).

[0431] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of second view phase delay patterns (1644, 1645) corresponding to a plurality of calculated second view diffraction angles.

[0432] In one embodiment of the present disclosure, the electronic device (1600) can generate a plurality of second-view phase modulation images by multiplying a plurality of second-view holographic images (1641, 1642, 1643) and a plurality of second-view phase delay patterns (1644, 1645) corresponding to each of the plurality of second-view holographic images (1641, 1642, 1643).

[0433] In one embodiment of the present disclosure, the electronic device (1600) can control the second spatial light modulator (1611) to display a plurality of generated second-view phase modulation images. The electronic device (1600) can control the second spatial light modulator (1611) to display a final second-view phase modulation image that is the sum of all of the plurality of second-view phase modulation images.

[0434] In one embodiment of the present disclosure, a plurality of second generated images (1646, 1647, 1648) can be reproduced through a second spatial light modulator (1611) that displays a final second view image. The plurality of second generated images (1646, 1647, 1648) can be formed into a second holographic content (1640) at a second content location.

[0435] The electronic device (1600) can provide different holographic contents (1630, 1640) to the right eye (1660) and the left eye (1670), respectively, to the user. In addition, the electronic device can provide holographic contents (1630, 1640) formed at the content location through two or more holographic images to the right eye (1660) and the left eye (1670), respectively.

[0436] Through this, the electronic device (1600) can provide a three-dimensional image to the user and prevent the user from feeling dizzy or tired due to convergence-accommodation conflict (VAC) of the pupils.

[0437] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.

[0438] To solve the above-described technical problem, in one embodiment of the present disclosure, an electronic device for displaying holographic content is provided. The electronic device may include a spatial light modulator (SLM) for displaying a plurality of phase-modulated images. The electronic device may include an optical layer for receiving a plurality of holographic images reproduced by the spatial light modulator. The electronic device may include a memory for storing at least one instruction. The electronic device may include at least one processor including a processing circuit. By having the at least one processor individually or collectively execute at least one instruction stored in the memory, the electronic device may acquire a plurality of view images corresponding to a plurality of views. The electronic device may generate a plurality of holographic images using depth information regarding the acquired plurality of view images. The electronic device may calculate a plurality of diffraction angles for diffracting each of the generated plurality of holographic images from the optical layer toward each of the plurality of views. The electronic device may generate a plurality of phase delay patterns corresponding to the calculated plurality of diffraction angles. The electronic device can generate a plurality of phase modulation images by multiplying a plurality of holographic images and a plurality of phase delay patterns corresponding to each of the plurality of holographic images.

[0439] In one embodiment of the present disclosure, each of the plurality of phase delay patterns may include a plurality of grating patterns having the same period. The period of each of the plurality of grating patterns may be determined corresponding to each of the plurality of diffraction angles.

[0440] In one embodiment of the present disclosure, an electronic device can generate a final modulated image by adding all of the generated multiple phase-modulated images. The electronic device can control a spatial light modulator to display the generated final modulated image.

[0441] In one embodiment of the present disclosure, depth information may include depth values ​​for objects included in a plurality of acquired view images. The electronic device may calculate a point located at a distance equal to a first preset reference distance from the optical layer as a content location for displaying holographic content, when the depth value is equal to or greater than a preset maximum depth value. The electronic device may calculate a point located at a distance greater than the first preset reference distance from the optical layer as a content location, when the depth value is less than the maximum depth value.

[0442] In one embodiment of the present disclosure, the electronic device may calculate a point further from the optical layer as the content location when the depth value is smaller. The electronic device may calculate a point that is a distance equal to a second preset reference distance from the optical layer as the content location when the depth value is equal to or smaller than a preset minimum depth value. The second reference distance may be a distance further from the optical layer than the first reference distance.

[0443] In one embodiment of the present disclosure, the electronic device can generate a plurality of holographic images by performing inversion-optical propagation on each of the acquired plurality of view images using the calculated content location.

[0444] In one embodiment of the present disclosure, an electronic device can generate a plurality of phase-modulated images by applying a plurality of view images, content locations, and a plurality of diffraction angles to a modulated image generation module. The modulated image generation module can include an artificial intelligence model trained to infer a plurality of phase-modulated images for displaying holographic content at the content locations.

[0445] In one embodiment of the present disclosure, a learned artificial intelligence model can generate a plurality of training holographic images based on a plurality of training view images acquired by photographing an object from a plurality of views. The learned artificial intelligence model can generate a plurality of training phase delay patterns corresponding to a plurality of training diffraction angles. The learned artificial intelligence model can generate a plurality of training phase-modulated images by multiplying the plurality of training holographic images by the plurality of training phase-modulated patterns. The learned artificial intelligence model can be an artificial intelligence model that is learned using a loss function that compares training holographic content represented by the plurality of training phase-modulated images with object content represented by the plurality of training view images.

[0446] In one embodiment of the present disclosure, the electronic device may include a coherent light source that provides coherent light to a spatial light modulator.

[0447] In one embodiment of the present disclosure, the optical layer may include a lens. The electronic device may calculate a plurality of diffraction angles as angles formed by a plurality of lines passing through the center of the lens and each of the plurality of views and the optical axis of the lens.

[0448] In order to solve the above-described technical problem, one embodiment of the present disclosure provides an operating method of an electronic device for displaying holographic content. The operating method of the electronic device may include a step of acquiring a plurality of view images, each corresponding to a plurality of views. The operating method of the electronic device may include a step of generating a plurality of holographic images using depth information about the acquired plurality of view images. The operating method of the electronic device may include a step of calculating a plurality of diffraction angles for diffracting the plurality of holographic images such that each of the plurality of holographic images faces each of the plurality of views from an optical layer that receives the plurality of holographic images reproduced by a spatial light modulator (SLM). The operating method of the electronic device may include a step of generating a plurality of phase delay patterns corresponding to the calculated plurality of diffraction angles. The operating method of the electronic device may include a step of generating a plurality of phase-modulated images by multiplying the plurality of holographic images by the plurality of phase delay patterns, each corresponding to the plurality of holographic images. The operating method of the electronic device may include a step of displaying the plurality of phase-modulated images generated through the spatial light modulator.

[0449] In one embodiment of the present disclosure, each of the plurality of phase delay patterns may include a plurality of grating patterns having the same period. The period of each of the plurality of grating patterns may be determined corresponding to each of the plurality of diffraction angles.

[0450] In one embodiment of the present disclosure, the step of displaying a plurality of phase-modulated images generated through a spatial light modulator may include a step of adding all of the generated plurality of phase-modulated images to generate a final modulated image. The step of displaying a plurality of phase-modulated images generated through a spatial light modulator may include a step of displaying the final modulated image through the spatial light modulator.

[0451] In one embodiment of the present disclosure, depth information may include a depth value for an object included in a plurality of acquired view images. The operating method of the electronic device may further include a step of calculating a content position at which holographic content is to be displayed based on the depth value. In the step of calculating the content position, a point that is a distance equal to a first preset reference distance from the optical layer may be calculated as the content position, depending on whether the depth value is equal to or greater than a preset maximum depth value. In the step of calculating the content position, a point that is a distance greater than the first preset reference distance from the optical layer may be calculated as the content position, depending on whether the depth value is less than the maximum depth value.

[0452] In one embodiment of the present disclosure, in the step of calculating the content location, a point that is further from the optical layer as the depth value decreases may be calculated as the content location. In the step of calculating the content location, a point that is a distance equal to a preset second reference distance from the optical layer may be calculated as the content location as the depth value is equal to or smaller than a preset minimum depth value. The second reference distance may be a distance further from the optical layer than the first reference distance.

[0453] In one embodiment of the present disclosure, in the step of generating a plurality of holographic images, the plurality of holographic images may be generated by performing inversion-optical propagation on each of the plurality of view images acquired using the calculated content positions.

[0454] In one embodiment of the present disclosure, the method of operating an electronic device may further include the step of generating a plurality of phase-modulated images by applying a plurality of view images, a content location, and a plurality of diffraction angles to a modulation image generation module. The modulation image generation module may include an artificial intelligence model trained to infer a plurality of phase-modulated images for displaying holographic content at the content location.

[0455] In one embodiment of the present disclosure, a method for training an artificial intelligence model may include a step of generating a plurality of training holographic images based on a plurality of training view images acquired by photographing an object from a plurality of views. The method for training an artificial intelligence model may include a step of generating a plurality of training phase delay patterns corresponding to a plurality of training diffraction angles. The method for training an artificial intelligence model may include a step of generating a plurality of training phase-modulated images by multiplying the plurality of training holographic images by the plurality of training phase-modulated patterns. The method for training an artificial intelligence model may include a step of training an artificial intelligence model based on a loss function that compares training holographic content represented by the plurality of training phase-modulated images with object content represented by the plurality of training view images.

[0456] In one embodiment of the present disclosure, a method of operating an electronic device may include providing coherent light to a spatial light modulator via a coherent light source. In the step of calculating a plurality of diffraction angles, angles formed by a plurality of lines passing through the center of a lens included in an optical layer and each of a plurality of views and an optical axis of the lens may be calculated as a plurality of diffraction angles.

[0457] In order to solve the above-described technical problem, a computer-readable recording medium having recorded thereon a program for performing at least one method of operating an electronic device disclosed in the present disclosure on a computer can be provided.

[0458] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0459] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.

[0460] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.

[0461] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0462] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.

[0463] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.

[0464] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

Claims

1. In an electronic device (100) displaying holographic content (380), A spatial light modulator (SLM, 112) displaying multiple phase-modulated images; An optical layer (113) that receives a plurality of holographic images (300, 310, 320) reproduced from the above spatial light modulator (112); A memory (120) storing at least one instruction; and comprising at least one processor (130) including a processing circuit; The electronic device (100) executes the at least one processor individually or collectively the at least one instruction stored in the memory (120), Obtain multiple view images corresponding to each of the multiple views, Using the depth information for the acquired multiple view images, the multiple hologram images (300, 310, 320) are generated, Calculate multiple diffraction angles for diffracting each of the generated multiple holographic images (300, 310, 320) from the optical layer (113) toward each of the multiple views, Generating a plurality of phase delay patterns (330, 340) corresponding to the above-described plurality of calculated diffraction angles, An electronic device (100) that generates the plurality of phase modulation images by multiplying the plurality of holographic images (300, 310, 320) and the plurality of phase delay patterns (330, 340) corresponding to the plurality of holographic images (300, 310, 320).

2. In paragraph 1, Each of the above plurality of phase delay patterns (330, 340) includes a plurality of grid patterns having the same period, An electronic device (100) in which the period of each of the plurality of grating patterns is determined corresponding to each of the plurality of diffraction angles.

3. In either of the first or second paragraphs, The above electronic device (100) By adding all of the above generated multiple phase modulation images, a final modulation image is generated, An electronic device (100) that controls the spatial light modulator (112) to display the generated final modulated image.

4. In any one of clauses 1 to 3, The above depth information includes a depth value for an object included in the acquired multiple view images, The above electronic device (100) When the depth value is equal to or greater than the preset maximum depth value, a point that is equal to the preset first reference distance from the optical layer (113) is calculated as the content position where the hologram content (380) is to be displayed. An electronic device (100) that calculates a point that is a distance longer than a preset first reference distance from the optical layer (113) as the content location, as the depth value is smaller than the maximum depth value.

5. In paragraph 4, The above electronic device (100) The smaller the depth value, the farther away the point from the optical layer (113) is calculated as the content location. When the depth value is equal to or less than a preset minimum depth value, a point that is equal to a preset second reference distance from the optical layer (113) is calculated as the content location. An electronic device (100) in which the second reference distance is a distance further from the optical layer (113) than the first reference distance.

6. In either of paragraphs 4 or 5, The above electronic device (100) An electronic device (100) that performs inversion-optical propagation on each of the acquired plurality of view images using the calculated content positions to generate the plurality of holographic images (300, 310, 320).

7. In any one of clauses 4 to 6, The above electronic device (100) By applying the plurality of view images, the content positions and the plurality of diffraction angles to a modulation image generation module, the plurality of phase modulation images are generated, The above-mentioned modulation image generation module is an electronic device (100) including an artificial intelligence model learned to infer the plurality of phase modulation images for displaying the holographic content (380) at the content location.

8. In paragraph 7, The above learned artificial intelligence model is, Generate multiple training holographic images based on multiple training view images obtained by photographing an object from multiple views, Generate multiple training phase delay patterns corresponding to multiple training diffraction angles, By multiplying the plurality of training holographic images and the plurality of training phase delay patterns, a plurality of training phase modulation images are generated, An electronic device (100) which is an artificial intelligence model learned using a loss function that compares training hologram content displayed by the plurality of training phase modulation images and object content by the plurality of training view images.

9. In any one of clauses 1 to 8, An electronic device (100) further comprising a coherent light source providing coherent light to the spatial light modulator (112).

10. In any one of clauses 1 to 9, The above optical layer (113) includes a lens, The above electronic device (100) An electronic device (100) that calculates the angle formed between a plurality of lines passing through the center of the lens and each of the plurality of views and the optical axis of the lens as the plurality of diffraction angles.

11. In a method of operating an electronic device (100) displaying holographic content (380), Step (S100) of obtaining multiple view images each corresponding to multiple views; A step (S200) of generating a plurality of hologram images by using depth information for the acquired plurality of view images; A step (S300) of calculating a plurality of diffraction angles for diffracting the plurality of hologram images so that each of the plurality of hologram images is directed toward each of the plurality of views from an optical layer provided with the plurality of hologram images reproduced by a spatial light modulator (SLM); A step (S400) of generating a plurality of phase delay patterns corresponding to the above-described plurality of calculated diffraction angles; A step (S500) of generating a plurality of phase modulation images by multiplying the plurality of holographic images and the plurality of phase delay patterns corresponding to the plurality of holographic images respectively; and An operating method of an electronic device (100) including a step (S600) of displaying a plurality of phase modulation images generated through the spatial light modulator.

12. In paragraph 11, Each of the above plurality of phase delay patterns includes a plurality of grating patterns having the same period, An operating method of an electronic device (100), wherein the period of each of the plurality of grating patterns is determined corresponding to each of the plurality of diffraction angles.

13. In either of paragraphs 11 or 12, The step (S600) of displaying the plurality of phase modulation images generated through the spatial light modulator is as follows. Step (S610) of generating a final modulation image by adding all of the generated multiple phase modulation images; and An operating method of an electronic device (100) including a step (S620) of displaying the final modulated image through the spatial light modulator.

14. In any one of paragraphs 11 to 13, The above depth information includes a depth value for an object included in the acquired multiple view images, The operating method of the above electronic device (100) is: Further comprising a step (S150) of calculating a content location to display the holographic content based on the depth value; In the step (S150) of calculating the above content location, If the depth value is equal to or greater than a preset maximum depth value, a point that is a distance equal to a preset first reference distance from the optical layer is calculated as the content location, An operating method of an electronic device (100) that calculates a point that is a distance longer than a preset first reference distance from the optical layer as the content location when the depth value is smaller than the maximum depth value.

15. A computer-readable recording medium having recorded thereon a program for performing the method described in any one of claims 11 to 14 on a computer.

Images