Electronic device for displaying hologram image, and operating method of electronic device
Patent Information
- Application Number
- PCT/KR2026/003066
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-03-11
- Filing Date
- 2026-02-24
- Publication Date
- 2026-09-17
Smart Images

Figure KR2026003066_17092026_PF_FP_ABST
Abstract
Description
Electronic device displaying a holographic image and method of operation of the electronic device
[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, it relates to an electronic device that displays a holographic image and a method of operating the electronic device.
[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed and distributed. Electronic devices, including display devices that display images, have been developing rapidly in recent years.
[0003] As electronic devices have advanced, the types of images displayed on electronic devices have also become more diverse. Electronic devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.
[0004] In addition, an electronic device and method for displaying 3D stereoscopic images using holographic technology utilizing the diffraction effect of light have been proposed.
[0005] As it is necessary to display multiple images from various viewpoints on a display in order to provide different images depending on the user's viewpoint, electronic devices and methods are being developed to increase the resolution of each of the multiple images displayed on the display.
[0006] One embodiment of the present disclosure provides an electronic device. The electronic device may include a spatial light modulator comprising a plurality of sub-spatial light modulators (SLMs) arranged in a first direction. The electronic device may include a coherent light source that provides coherent light. The electronic device may include a diffusion layer that is spaced apart from the spatial light modulator in a second direction orthogonal to the first direction and diffuses a plurality of reconstructed images obtained from the spatial light modulator. The electronic device may include two reflection layers that extend in the second direction and are spaced apart from each other in a first direction between the spatial light modulator and the diffusion layer, and reflect at least one of the plurality of reconstructed images provided from the spatial light modulator to provide at least one of the reflected reconstructed images among the plurality of reconstructed images to the diffusion layer. The electronic device may include at least one processor that displays a plurality of holographic patterns through the spatial light modulator and provides coherent light to the spatial light modulator through a coherent light source to provide a holographic image corresponding to the plurality of holographic patterns and the plurality of reconstructed images generated by the coherent light.
[0007] In one embodiment of the present disclosure, a method of operating an electronic device may be provided. The method of operating the electronic device may include the step of displaying a plurality of holographic patterns through a spatial light modulator comprising a plurality of sub-spatial light modulators (SLMs) arranged in a first direction. The method of operating the electronic device may include the step of providing coherent light to the spatial light modulator through a coherent light source to provide a holographic image corresponding to a plurality of holographic patterns and a plurality of reconstructed images generated by the coherent light. The electronic device may include a diffusion layer disposed spaced apart from the spatial light modulator in a second direction orthogonal to a first direction and diffusing a plurality of reconstructed images obtained from the spatial light modulator. The electronic device may include two reflection layers that extend in the second direction and are disposed spaced apart from each other in a first direction between the spatial light modulator and the diffusion layer, and reflect at least one of a plurality of reconstructed images provided from the spatial light modulator to provide at least one reflected reconstructed image among a plurality of reconstructed images to the diffusion layer.
[0008] In one embodiment of the present disclosure, a computer-readable recording medium may be provided on which a program for performing at least one of the embodiments of the method of operating the disclosed electronic device is recorded on a computer.
[0009] The technical problems to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.
[0010] The present disclosure may be understood by the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.
[0011] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0012] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.
[0013] FIG. 3 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0014] FIG. 4 is a drawing for explaining the structure of a spatial light modulator, a diffusion layer, and a reflection layer according to one embodiment of the present disclosure.
[0015] FIG. 5 is a diagram illustrating a plurality of sub-space optical modulators included in a spatial optical modulator according to one embodiment of the present disclosure.
[0016] FIG. 6 is a diagram illustrating a plurality of sub-space optical modulators included in a spatial optical modulator according to one embodiment of the present disclosure.
[0017] FIG. 7 is a drawing for explaining the arrangement of a spatial light modulator, a diffusion layer, and a reflection layer according to one embodiment of the present disclosure.
[0018] FIG. 8 is a drawing for explaining a coherent light source that provides coherent light to a spatial light modulator according to one embodiment of the present disclosure.
[0019] FIG. 9 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure.
[0020] FIG. 10 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure.
[0021] FIG. 11 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure.
[0022] FIG. 12 is a drawing for explaining spreading a plurality of reproduced images in a third direction through a diffusion layer according to one embodiment of the present disclosure.
[0023] FIG. 13 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure.
[0024] FIG. 14 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure.
[0025] FIG. 15 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure.
[0026] FIG. 16 is a flowchart for explaining the operation of acquiring a plurality of holographic patterns according to one embodiment of the present disclosure.
[0027] FIG. 17 is a diagram illustrating the operation of acquiring a plurality of holographic patterns from a plurality of view images through a holographic pattern generation module according to one embodiment of the present disclosure.
[0028] FIG. 18 is a flowchart illustrating the operation of training an artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0029] FIG. 19 is a diagram illustrating the operation of training a first artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0030] FIG. 20 is a diagram illustrating the operation of training a second artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0031] FIG. 21 is a diagram illustrating a training operation of a second artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0032] The terms used in this disclosure will be briefly explained, and an embodiment of this disclosure will be described in detail.
[0033] Throughout this disclosure, unless specifically stated otherwise, "or" is inclusive and not exclusive. Accordingly, "A or B" may mean "A, B, or both" unless clearly indicated otherwise by the context.
[0034] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.
[0035] The terms used in this disclosure have been selected to be as widely used as possible, taking into account the functions in the embodiments of this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined not merely by their names, but based on their meanings and the content throughout this disclosure.
[0036] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification.
[0037] Throughout this disclosure, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "module," etc., as used in this disclosure refer to a unit that processes at least one function or operation, and may be implemented in hardware or software, or as a combination of hardware and software.
[0038] The expression “configured to” as used in this disclosure may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “system configured to” may mean that the system is “capable of” together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in memory.
[0039] In addition, when a component is described in the present disclosure as being “connected” or “connected” to another component, it should be understood that the component may be directly connected to or directly connected to the other component, but unless otherwise specifically stated, it may also be connected or connected through another component in between.
[0040] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.
[0041] All functions or operations described in this document may be processed by a single processor or a combination of multiple processors.
[0042] Functions related to artificial intelligence according to the present disclosure are operated through processors and memory. One or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are dedicated artificial intelligence processors, the dedicated artificial intelligence processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0043] The predefined rules of operation or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that a predefined rules of operation or artificial intelligence models configured to perform desired characteristics (or objectives) are created by a basic artificial intelligence model being trained using a number of training data by a learning algorithm. Such learning may be performed on the electronic device itself in which the artificial intelligence model according to the present disclosure is used, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.
[0044] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values and performs neural network operations through operations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. The artificial neural network may include a Deep Neural Network (DNN), such as a Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN), Generative Adversarial Networks (GAN), Transformer, Variational Auto Encoder (VAE), or U-Net, but is not limited to the examples mentioned above.
[0045] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, an embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiment described herein. Furthermore, in order to clearly explain an embodiment of the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the present disclosure are denoted by similar reference numerals.
[0046] Embodiments of the present disclosure will be described in detail below with reference to the drawings.
[0047] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0048] Referring to FIG. 1, in one embodiment of the present disclosure, an electronic device (100) may provide a holographic image (400) to a user (500). The holographic image (400) may be an image provided to the user (500) so that different sides of an object included in the holographic image (400) can be seen depending on the position of the user (500) looking at the electronic device (100).
[0049] In one embodiment of the present disclosure, the holographic image (400) may be an image capable of providing a three-dimensional effect to a user (500) using an electronic device (100).
[0050] In one embodiment of the present disclosure, the electronic device (100) may include a spatial light modulator (SLM, 110) and a coherent light source (120) that provides coherent light (200).
[0051] In one embodiment of the present disclosure, the spatial optical modulator (110) may include a plurality of sub-space optical modulators (111). The positions of each of the plurality of sub-space optical modulators (111) may be different from each other.
[0052] In one embodiment of the present disclosure, an electronic device (100) may provide coherent light (200) to a spatial light modulator (110) through a coherent light source (120). The electronic device (100) may provide coherent light (200) to each of a plurality of sub-spatial light modulators (111) through a coherent light source (120).
[0053] In one embodiment of the present disclosure, the electronic device (100) can acquire a plurality of view images corresponding to each of a plurality of different views. In this case, the 'view' may correspond to the location of each of the plurality of sub-space optical modulators (111).
[0054] In one embodiment of the present disclosure, a plurality of view images may be images obtained by capturing a specific object from a plurality of different views. However, the present disclosure is not limited thereto, and the plurality of view images may be images generated as images obtained when observing a specific object from a plurality of different views.
[0055] In one embodiment of the present disclosure, the electronic device (100) may control the spatial light modulator (110) to display a holographic pattern. The “holographic pattern” may mean a pattern for modulating the phase of the coherent light (200) provided to the spatial light modulator (110).
[0056] The electronic device (100) may be a device that displays a holographic pattern, which is an interference pattern for modulating light through a spatial light modulator (110), and irradiates coherent light (200) onto the holographic pattern through a coherent light source (120) to reproduce a three-dimensional holographic image (400).
[0057] In one embodiment of the present disclosure, an electronic device (100) can acquire a holographic pattern based on a plurality of view images. The electronic device (100) can acquire a holographic pattern from a plurality of view images through a holographic pattern generation module (152, see FIG. 2) to be described later.
[0058] In one embodiment of the present disclosure, coherent light (200) provided from a coherent light source (120) may be diffracted by a holographic pattern displayed on a spatial light modulator (110) to generate a reconstructed image. As the reconstructed image is optically propagated, it may be provided to a user (500) as a holographic image (400).
[0059] At this time, "reproduced image" may refer to an image provided to the user (500) as a holographic image (400) at the user's (500) viewing angle as the coherent light (200) provided to the spatial light modulator (110) is diffracted and optically propagated by the holographic pattern.
[0060] In one embodiment of the present disclosure, the viewing angle at which a user (500) can view a holographic image (400) provided by an electronic device (100) may be determined by the diffraction angle of a reproduced image in which a holographic pattern displayed on a spatial light modulator (110) is reproduced by coherent light.
[0061] At this time, the diffraction angle of the reproduced image can be determined by the pitch of each of the plurality of pixels included in the spatial light modulator (110). The smaller the pitch of each pixel, the larger the diffraction angle of the reproduced image, and the larger the viewing angle of the holographic image (400).
[0062] However, due to technological limitations, there may be difficulties in manufacturing spatial light modulators that have high resolution and a large display area. When using a spatial light modulator with high resolution and a small display area, the viewing angle of the holographic image can be increased, but the amount of data included in the holographic image (e.g., grayscale information such as Red, Green, and Blue) may be reduced.
[0063] In this case, the amount of data may include the grayscale values of each of the multiple pixels constituting the image (e.g., the grayscale value of Red, the grayscale value of Green, the grayscale value of Blue). The amount of data included in the image may increase as the image resolution increases. The amount of data included in the image may increase as the range of colors capable of expressing the image widens.
[0064] Accordingly, an electronic device (100) according to one embodiment of the present disclosure can provide a user (500) with a wide viewing angle and a large amount of data by displaying a plurality of reproduced images (300) through a spatial light modulator (110) that includes a plurality of sub-spatial light modulators (111) each having high resolution.
[0065] In one embodiment of the present disclosure, an electronic device (100) can acquire a plurality of holographic patterns based on a plurality of view images.
[0066] The electronic device (100) of the present disclosure can display a plurality of holographic patterns through a spatial light modulator (110) comprising a plurality of sub-spatial light modulators (111) arranged in a first direction (10). The electronic device (100) can control each of the plurality of sub-spatial light modulators (111) to display a corresponding holographic pattern.
[0067] Meanwhile, FIG. 1 is illustrated as having a plurality of subspace optical modulators (111) arranged in two lines aligned in a third direction (30), but the present disclosure is not limited thereto. The plurality of subspace optical modulators (111) may be arranged in a single line or in three or more lines.
[0068] A plurality of reproduced images (300) reproduced in a plurality of subspace light modulators (111) can be optically propagated by coherent light (200) provided to a plurality of holographic patterns and provided to a user (500) as a holographic image (400).
[0069] In one embodiment of the present disclosure, the electronic device (100) may further include a diffusion layer (130) and two reflection layers (140). The diffusion layer (130) may be represented as a holographic screen.
[0070] In one embodiment of the present disclosure, the diffusion layer (130) may be spaced apart from the spatial light modulator (110) in a second direction (20) that is orthogonal to the first direction (10).
[0071] In one embodiment of the present disclosure, each of the two reflective layers (140) may extend in a second direction (20) and be spaced apart from each other in a first direction (10) between the spatial light modulator (110) and the diffusion layer (130). In one embodiment of the present disclosure, the two reflective layers (140) may include planar mirrors.
[0072] In one embodiment of the present disclosure, a plurality of reproduced images (300) reproduced from a plurality of sub-space light modulators (111) included in a spatial light modulator (110) may be optically propagated and provided to a diffusion layer (130). Additionally, among the plurality of reproduced images (300) reproduced from the plurality of sub-space light modulators (111), some of the reproduced images that are optically propagated toward two reflection layers (140) may also be reflected by the two reflection layers (140) and provided again to the diffusion layer (130).
[0073] In one embodiment of the present disclosure, a plurality of reproduced images (300) reproduced from a plurality of subspace light modulators (111) arranged in a first direction (10) can be transmitted to a diffusion layer (130) by two reflection layers (140).
[0074] Accordingly, the electronic device (100) of the present disclosure can transmit a plurality of reproduced images (300) reproduced in each of a plurality of subspace optical modulators (111) to a diffusion layer (130) without including complex optical elements.
[0075] In one embodiment of the present disclosure, the diffusion layer (130) can diffuse a plurality of reconstructed images (300) obtained from a spatial light modulator (110). The plurality of reconstructed images (300) reproduced from the spatial light modulator (110) can be diffused through the diffusion layer (130) and then optically propagated to be provided to a user (500) as a holographic image (400).
[0076] In one embodiment of the present disclosure, when the resolution of one subspace optical modulator is m*n, and it includes m pixels in the first direction (10) and n pixels in the third direction (30), and the number of multiple subspace optical modulators (111) arranged in the first direction (10) is k, the amount of data in the first direction (10) of multiple reconstructed images transmitted to the diffusion layer (130) can correspond to m*k.
[0077] In one embodiment of the present disclosure, the amount of data in the third direction (30) of a plurality of reconstructed images transmitted to the diffusion layer (130) may correspond to n. In this case, m, n and k may each be a natural number greater than or equal to 1.
[0078] FIG. 1 is illustrated as having a plurality of subspace optical modulators (111) arranged in two lines arranged in a third direction (30). However, a plurality of reproduced images (300) reproduced from the plurality of subspace optical modulators (111) are optically propagated so as to be arranged in a first direction (10), and in the diffusion layer (130), they may be located on a single line extended in the first direction (10).
[0079] In one embodiment of the present disclosure, a plurality of reconstructed images (300) transmitted to the diffusion layer (130) can be provided to a user (500) as a holographic image (400) as it is optically propagated in a second direction (20).
[0080] In one embodiment of the present disclosure, a plurality of reconstructed images (300) that are optically propagated through a diffusion layer (130) include an amount of data of m*k obtained from a plurality of sub-space optical modulators (111) in a first direction (10). The plurality of reconstructed images (300) provided to the diffusion layer (130) may include an amount of data in the first direction (10) that is relatively larger than the amount of data in the third direction (30). Accordingly, the holographic image (400) may provide a large amount of data to the user (500) in the first direction (10) along with a wide viewing angle.
[0081] The electronic device (100) can provide a three-dimensional holographic image (400) to the user even if the user (500) moves in the first direction (10) or the opposite direction of the first direction (10).
[0082] In one embodiment of the present disclosure, as the electronic device (100) provides a holographic image (400) with a wide viewing angle, a plurality of users can view the holographic image (400) through the electronic device (100). Additionally, as the electronic device (100) can provide a holographic image (400) containing a large amount of data, it may also provide a holographic image (400) capable of expressing a wide range of depth.
[0083] In one embodiment of the present disclosure, a plurality of reconstructed images (300) that are optically propagated through a diffusion layer (130) include a data amount of n obtained from a plurality of subspace optical modulators (111) in a third direction (30). A plurality of reconstructed images (300) provided to the diffusion layer (130) may include a relatively small amount of data in the third direction (30).
[0084] In one embodiment of the present disclosure, the diffusion layer (130) may be a layer that transmits incident light directly in a first direction (10) and diffuses it in a third direction (30) that is orthogonal to each of the first direction (10) and the second direction (20). Accordingly, the holographic image (400) may be an image in which a plurality of reconstructed images (300) are diffused in the third direction (30) or in the opposite direction of the third direction (30) and transmitted by light.
[0085] Accordingly, the electronic device (100) can ensure that the holographic image (400) is visible to the user (500) even if the user (500) moves in the third direction (30) or the opposite direction of the third direction (30), so that the user (500) using the electronic device (100) does not feel a sense of strangeness.
[0086] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood from the present disclosure by those skilled in the art to which the present disclosure pertains.
[0087] Hereinafter, details regarding the configuration of the electronic device (100) of the present disclosure and the method of operation of the electronic device (100) will be described in detail in FIGS. 2 to 21.
[0088] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.
[0089] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an electronic device (100) may include a spatial light modulator (110), a coherent light source (120), a diffusion layer (130), a reflection layer (140), a memory (150), at least one processor (160), an input / output interface (170), and a communication interface (180).
[0090] However, not all of the components shown in FIG. 2 are essential components. The electronic device (100) may be implemented with more components than those shown in FIG. 2. Additionally, the electronic device (100) may be implemented with fewer components than those shown in FIG. 2.
[0091] In one embodiment of the present disclosure, a spatial light modulator (110), a coherent light source (120), a diffusion layer (130), a reflection layer (140), a memory (150), at least one processor (160), an input / output interface (170), and a communication interface (180) included in an electronic device (100) may each be electrically connected to one another.
[0092] In one embodiment of the present disclosure, the spatial light modulator (110) may be a device used to control the spatial distribution of light in three-dimensional space. The spatial light modulator (110) may be a device displaying a holographic pattern capable of modulating at least one of the phase or amplitude of light provided to the spatial light modulator (110).
[0093] In one embodiment of the present disclosure, light provided to the spatial light modulator (110) is reflected by the spatial light modulator (110) and at least one of the phase or amplitude may be modulated. Additionally, light provided to the spatial light modulator (110) passes through the spatial light modulator (110) and at least one of the phase or amplitude may be modulated.
[0094] In one embodiment of the present disclosure, the spatial light modulator (110) may include a liquid crystal layer comprising a liquid crystal (LC). The spatial light modulator (110) may modulate at least one of the phase or amplitude of light provided through the anisotropy of the liquid crystal by adjusting the arrangement direction of the liquid crystal included in the liquid crystal layer.
[0095] In one embodiment of the present disclosure, a computer-generated hologram (CGH) may be displayed on the spatial light modulator (110). The "computer-generated hologram" may be a holographic image generated by numerically simulating the propagation of light. The computer-generated hologram may be a holographic image calculated by simulating an interference pattern between a reference light and an object light reflected from the reference light provided to an object. In the present disclosure, the computer-generated hologram may be referred to as a holographic pattern.
[0096] In one embodiment of the present disclosure, displaying a hologram pattern through a spatial light modulator (110) may mean applying a voltage corresponding to the data of the hologram pattern to a liquid crystal layer included in the spatial light modulator (110) to change the arrangement of the liquid crystals included in the liquid crystal layer.
[0097] In one embodiment of the present disclosure, the coherent light source (120) may mean a light source that provides light having a single wavelength and maintaining a constant phase. The coherent light source (120) may include a laser. In one embodiment of the present disclosure, the coherent light source (120) may provide coherent light to a spatial light modulator (110).
[0098] In one embodiment of the present disclosure, the diffusion layer (130) may be a layer that diffuses incident light. The diffusion layer (130) may diffuse incident light by scattering or reflecting the incident light to change the path of the light. The diffusion layer (130) may include scattering particles such as a polymer, silica, etc.
[0099] In one embodiment of the present disclosure, the diffusion layer (130) may include a plurality of diffusion patterns. The plurality of diffusion patterns may have an uneven shape, a groove shape, or a lens shape. The plurality of diffusion patterns may include a liquid crystal or a meta surface.
[0100] In one embodiment of the present disclosure, the reflective layer (140) may be a layer that reflects incident light. The reflective layer (140) may include a mirror and may include a metal such as aluminum, silver, etc. Additionally, the reflective layer (140) may include a multilayer thin film structure in which thin film layers having different refractive indices are alternately stacked. In one embodiment of the present disclosure, the electronic device (100) may include two reflective layers.
[0101] In one embodiment of the present disclosure, the memory (150) may store instructions, data structures, and program code that can be read by at least one processor (160).
[0102] In one embodiment of the present disclosure, there may be one or more memory (150). Operations performed by the electronic device (100) may be implemented by at least one processor (160) executing instructions or codes of a program stored in memory (150).
[0103] In one embodiment of the present disclosure, the memory (150) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid-state drive (SSD).
[0104] In one embodiment of the present disclosure, the memory (150) may not exist separately and may be configured to be included in at least one processor (160).
[0105] In one embodiment of the present disclosure, the memory (150) may store instructions or program code for performing functions or operations of the electronic device (100).
[0106] Instructions, algorithms, data structures, program codes, and application programs stored in memory (150) can be implemented in a programming or scripting language such as, for example, C, C++, Java, Python, assembler, etc.
[0107] In one embodiment of the present disclosure, various types of modules that can be used to perform the operation of the electronic device (100) may be stored in the memory (150).
[0108] In one embodiment of the present disclosure, the memory (150) may store an image acquisition module (151), a hologram pattern generation module (152), and a display control module (155). However, not all of the modules shown in FIG. 2 are required. More modules than those shown in FIG. 2 may be stored in the memory (150), or fewer modules may be stored.
[0109] In one embodiment of the present disclosure, a 'module' included in the memory (150) may mean a unit that processes a function or operation performed by at least one processor (160). The 'module' included in the memory (150) may be implemented as software such as instructions, algorithms, data structures, or program code.
[0110] In one embodiment of the present disclosure, the image acquisition module (151) may be composed of instructions or program code regarding an operation or function of acquiring a plurality of view images. The image acquisition module (151) may be composed of instructions or program code regarding an operation or function of receiving a plurality of view images from an external server or peripheral electronic devices.
[0111] By having at least one processor (160) execute the instructions or program code of the image acquisition module (151), the electronic device (100) can acquire multiple view images from an external server or surrounding electronic devices.
[0112] However, the present disclosure is not limited thereto. The image acquisition module (151) may be composed of instructions or program code for generating a plurality of view images. The image acquisition module (151) may be composed of instructions or program code for generating a plurality of view images from at least one view image corresponding to at least one acquired view using an interpolation algorithm.
[0113] Additionally, the image acquisition module (151) may include a generative artificial intelligence model such as a Generative Adversarial Network (GAN), Variational Auto Encoder (VAE), or Transformer for generating multiple view images.
[0114] By having at least one processor (160) execute instructions or program code of the image acquisition module (151), the electronic device (100) may generate and acquire multiple view images.
[0115] In one embodiment of the present disclosure, the hologram pattern generation module (152) may be composed of instructions or program code that generate a plurality of hologram patterns based on a plurality of view images.
[0116] By having at least one processor (160) execute instructions or program code of a hologram pattern generation module (152), the electronic device (100) can generate multiple hologram patterns from multiple view images.
[0117] In one embodiment of the present disclosure, the hologram pattern generation module (152) may include a first image generation module (153) and a second image generation module (154).
[0118] In one embodiment of the present disclosure, the first image generation module (153) may be composed of instructions or program code that generate a plurality of reproduction images displayed on the diffusion layer (130) by inversion-optical propagation of the plurality of view images based on a plurality of view images.
[0119] In one embodiment of the present disclosure, the second image generation module (154) may be composed of instructions or program code that generate a plurality of holographic patterns that are back-photo-propagated from a plurality of reconstructed images and displayed on a plurality of sub-space optical modulators (111).
[0120] However, although the first image generation module (153) and the second image generation module (154) are shown as separate modules in FIG. 2, the present disclosure is not limited thereto. It goes without saying that the operation performed through the first image generation module (153) and the second image generation module (154) may be performed through a single module.
[0121] In one embodiment of the present disclosure, a hologram pattern generation module (152) may include a pre-trained artificial intelligence model that receives a plurality of view images as input and infers a plurality of hologram patterns corresponding to the plurality of view images.
[0122] The artificial intelligence model included in the hologram pattern generation module (152) may be an artificial intelligence model trained to infer multiple hologram patterns, which are provided as inputs of multiple view images, and which are provided as hologram images through a diffusion layer, such that multiple reproduction images obtained from multiple hologram patterns corresponding to the multiple view images are provided as hologram images.
[0123] In one embodiment of the present disclosure, the first image generation module (153) may include a first artificial intelligence model that is pre-trained to receive a plurality of view images as input and infer a plurality of reproduction images.
[0124] In one embodiment of the present disclosure, the second image generation module (154) may include a second artificial intelligence model that is pre-trained to receive a plurality of reconstructed images as input and infer a plurality of holographic patterns.
[0125] Hereinafter, the operation of the hologram pattern generation module (152) and the training method of the artificial intelligence model included in the hologram pattern generation module (152) will be described in FIGS. 17 to 21.
[0126] In one embodiment of the present disclosure, the display control module (155) may be composed of instructions or program code that control the spatial light modulator (110) to display a plurality of holographic patterns.
[0127] By having at least one processor (160) execute instructions or program code of the display control module (155), the electronic device (100) can display a plurality of holographic patterns through the spatial light modulator (110).
[0128] In one embodiment of the present disclosure, at least one processor (160) may be configured as one or more processors to control a series of processes to operate an electronic device (100) according to the embodiments described below.
[0129] In one embodiment of the present disclosure, at least one processor (160) may be composed of at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), a Communication Processor (CP), a Neural Processing Unit, or an AI-dedicated processor designed with a hardware structure specialized for the learning and processing of an artificial intelligence model (AI), but is not limited thereto.
[0130] In one embodiment of the present disclosure, if one or more processors included in at least one processor (160) are artificial intelligence dedicated processors, said artificial intelligence dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0131] In one embodiment of the present disclosure, at least one processor (160) may be composed of a circuit such as a System on Chip (SoC) or an Integrated Circuit (IC).
[0132] In one embodiment of the present disclosure, at least one processor (160) can execute various types of modules stored in memory (150). At least one processor (160) can execute at least one instruction constituting various types of modules stored in memory (150). By executing a program or at least one instruction stored in memory (150), at least one processor (160) can process data according to a predefined operation rule or artificial intelligence model.
[0133] In one embodiment of the present disclosure, at least one processor (160) may include a plurality of processors. In one embodiment of the present disclosure, at least one of a plurality of modules in memory (150) may be executed by any one of the plurality of processors. The remaining modules among the plurality of modules stored in memory (150) may be executed by another of the plurality of processors.
[0134] In one embodiment of the present disclosure, at least one processor (160) controls an input / output interface (170), so that the electronic device (100) can acquire a plurality of view images from an external electronic device, etc., through the input / output interface (170).
[0135] In one embodiment of the present disclosure, the input / output interface (170) may perform input / output operations with an external electronic device using at least one of an input / output method including an HDMI port (High-Definition Multimedia Interface port), DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-mentioned input / output methods.
[0136] In one embodiment of the present disclosure, at least one processor (160) controls a communication interface (180), so that the electronic device (100) can perform data communication with an external server or an external electronic device.
[0137] The communication interface (180) can perform data communication with an external server or an external electronic device using at least one of the data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, Zigbee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet), WiMAX (World Interoperability for Microwave Access), SWAP (Shared Wireless Access Protocol), WiGig (Wireless Gigabit Alliance), and RF communication.
[0138] Additionally, the electronic device (100) can acquire multiple view images from an external electronic device or an external server through a communication interface (180).
[0139] However, the present disclosure is not limited thereto, and the electronic device (100) may further include a camera. The electronic device (100) may obtain a plurality of view images by capturing an object or space to be provided as a holographic image (400) through the camera.
[0140] In addition, the electronic device (100) may generate multiple view images corresponding to the object or space to be provided as a holographic image (400).
[0141] In one embodiment of the present disclosure, the electronic device (100) may obtain a pre-trained artificial intelligence model or parameters of a pre-trained artificial intelligence model included in a hologram pattern generation module (152) from an external server or external electronic device through a communication interface (180).
[0142] FIG. 3 is a flowchart for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0143] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of displaying a plurality of holographic patterns through a spatial light modulator (110) comprising a plurality of sub-spatial light modulators (111) arranged in a first direction (10).
[0144] In step S100, the electronic device (100) can display a plurality of holographic patterns through a spatial light modulator (110) comprising a plurality of sub-space light modulators (111). The electronic device (100) can display different holographic patterns on each sub-space light modulator.
[0145] At this time, the plurality of hologram patterns may be obtained based on the plurality of view images. The operation of the electronic device (100) generating the plurality of hologram patterns based on the plurality of view images will be described later in FIGS. 16 and 17.
[0146] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S200) of providing coherent light (200) to a spatial light modulator (110) through a coherent light source (120).
[0147] In step S200, the electronic device (100) may provide coherent light (200) to the spatial light modulator (110) through a coherent light source (120). In step S200, coherent light may be provided to each of a plurality of sub-spatial light modulators (111) that display different holographic patterns included in the spatial light modulator (110).
[0148] In one embodiment of the present disclosure, through the operation of steps S100 and S200, a plurality of reconstructed images (300) generated in the spatial light modulator (110) can be provided to the diffusion layer (130).
[0149] In one embodiment of the present disclosure, some of the plurality of reproducible images (300) may be provided directly to the diffusion layer (130), and the remaining portion of the plurality of reproducible images (300) may be provided to the diffusion layer (130) by being reflected by the reflection layer (140). The plurality of reproducible images (300) provided to the diffusion layer (130) may be transmitted as is in the first direction (10) and diffused in the third direction (30). The plurality of reproducible images (300) provided to the diffusion layer (130) may be optically propagated in the second direction (20) and provided to the user (500) as a holographic image (400).
[0150] FIG. 4 is a drawing for explaining the structure of a spatial light modulator, a diffusion layer, and a reflection layer according to one embodiment of the present disclosure.
[0151] Referring to FIGS. 1, FIGS. 2 and FIGS. 4, in one embodiment of the present disclosure, FIG. 4 shows a spatial light modulator (110), a diffusion layer (130), and two reflection layers (140).
[0152] In one embodiment of the present disclosure, the spatial light modulator (110) and the diffusion layer (130) may be spaced apart in a second direction (20) and arranged to face each other.
[0153] In one embodiment of the present disclosure, two reflective layers (140) may be positioned on both sides of the spatial light modulator (110) and on both sides of the diffusion layer (130) and arranged to face each other. The two reflective layers (140) may include a first reflective layer (141) and a second reflective layer (142). Each of the first reflective layer (141) and the second reflective layer (142) may have a shape extending in a second direction (20). The first reflective layer (141) and the second reflective layer (142) may be arranged to be spaced apart from each other in a first direction (10).
[0154] In one embodiment of the present disclosure, the spatial light modulator (110) and the diffusion layer (130) may each have a shape extending in a second direction (20). The first reflective layer (141) and the second reflective layer (142) may have a shape extending in a first direction (10) perpendicular to the second direction (20). The angle formed by the first reflective layer (141) and the second reflective layer (142) with the spatial light modulator (110) and the diffusion layer (130) may be 90 degrees.
[0155] In one embodiment of the present disclosure, the first reflective layer (141) may be positioned on one side of the spatial light modulator (110) and on one side of the corresponding diffusion layer (130). In one embodiment of the present disclosure, the second reflective layer (142) may be positioned on the other side of the spatial light modulator (110) and on the other side of the corresponding diffusion layer (130).
[0156] In one embodiment of the present disclosure, the spatial light modulator (110) may include a plurality of sub-spatial light modulators (111) arranged in a first direction (10). A plurality of reconstructed images (300) may be displayed through the plurality of sub-spatial light modulators (111).
[0157] In one embodiment of the present disclosure, a plurality of reconstructed images (300) may be optically propagated toward a second direction (20). At this time, due to the diffraction characteristics of light, some of the plurality of reconstructed images (300) may be optically propagated toward a direction between the first direction (10) and the second direction (20).
[0158] In one embodiment of the present disclosure, if the electronic device (100) does not include two reflection layers (140), some of the plurality of reconstructed images (300) that are optically propagated through the plurality of subspace optical modulators (111) may not be transmitted to the diffusion layer (130). Accordingly, the amount of data contained in the plurality of reconstructed images (300) that are optically propagated through the plurality of subspace optical modulators (111) and the amount of data contained in the plurality of reconstructed images transmitted to the diffusion layer (130) may be different.
[0159] In one embodiment of the present disclosure, the electronic device (100) can transmit a portion of a reconstructed image that is optically propagated in a direction between a first direction (10) and a second direction (20) among a plurality of reconstructed images (300) to a diffusion layer (130) by reflecting it through two reflective layers (140).
[0160] Specifically, the electronic device (100) can prevent a reproduction image that is optically propagated in a direction other than the second direction (20) among a plurality of reproduction images (300) optically propagated from a plurality of subspace optical modulators (111) from spreading to another region without being transmitted to the diffusion layer (130).
[0161] Through this, the electronic device (100) of the present disclosure can transmit all of the plurality of reconstructed images (300) that are optically propagated from the plurality of subspace optical modulators (111) to the diffusion layer (130). The amount of data included in the plurality of reconstructed images (300) that are optically propagated through the plurality of subspace optical modulators (111) and the amount of data included in the plurality of reconstructed images transmitted to the diffusion layer (130) may be the same.
[0162] In one embodiment of the present disclosure, as the electronic device (100) includes two reflection layers (140), the amount of data of a plurality of reconstructed images (300) transmitted to the diffusion layer (130) may be greater than the amount of data when the two reflection layers (140) are not included. At this time, the amount of data of a plurality of reconstructed images (300) transmitted to the diffusion layer (130) may refer to the resolution of the plurality of reconstructed images (300) transmitted to the diffusion layer (130). The greater the amount of data of the plurality of reconstructed images (300) transmitted to the diffusion layer (130), the higher the resolution of the plurality of reconstructed images (300).
[0163] The electronic device (100) of the present disclosure can transmit a plurality of reconstructed images (300) containing a data amount such as that of a plurality of virtual subspace light modulators (410) in a diffusion layer (130) using two reflection layers (140) without a plurality of virtual subspace light modulators (410) extended in a first direction (10).
[0164] In one embodiment of the present disclosure, as two reflection layers (140) are arranged, the amount of data of a plurality of reconstructed images (300) transmitted to the diffusion layer (130) of the present disclosure may be the same as the amount of data of a plurality of reconstructed images transmitted to the diffusion layer (130) when a plurality of sub-space light modulators (111) and a plurality of virtual sub-space light modulators (410) extending in a first direction (10) from the spatial light modulator (110) are located when two reflection layers (140) do not exist.
[0165] In one embodiment of the present disclosure, a plurality of reconstructed images (300) transmitted to a diffusion layer (130) may be optically propagated in a second direction (20) and provided as a holographic image (400). At this time, it is obvious that the plurality of reconstructed images (300) being optically propagated may be diffused in the diffusion layer (130) according to optical characteristics and may be optically propagated in a second direction (20).
[0166] FIG. 5 is a diagram illustrating a plurality of sub-space optical modulators included in a spatial optical modulator according to one embodiment of the present disclosure.
[0167] Referring to FIGS. 1, FIGS. 4 and FIGS. 5, in one embodiment of the present disclosure, FIG. 5 shows a plurality of sub-space optical modulators included in a spatial optical modulator (110).
[0168] In one embodiment of the present disclosure, a plurality of subspace optical modulators may be arranged along a plurality of lines extending in a first direction (10). The plurality of lines may include a first line (112) and a second line (114). The first line (112) and the second line (114) may each extend in the first direction (10) and be spaced apart in a third direction (30).
[0169] Although FIG. 5 is illustrated as having multiple lines including two lines, the present disclosure is not limited thereto. The spatial light modulator (110) may include a plurality of sub-spatial light modulators arranged along three or more lines that extend in a first direction (10) and are spaced apart in a third direction (30).
[0170] In one embodiment of the present disclosure, each of the plurality of sub-optical modulators may include a display area (116) on which a holographic pattern is displayed and a bezel area (117) adjacent to the display area (116). In one embodiment of the present disclosure, the bezel area (117) may be an area for protecting the display area (116) from external impact. The bezel area (117) may be an area on which a circuit for displaying a holographic pattern on the display area (116) is disposed.
[0171] In one embodiment of the present disclosure, the bezel region (117) may be a region surrounding the display region (116). Although FIG. 5 illustrates that the bezel region (117) included in the subspace optical modulator is located on all four sides of the subspace optical modulator, the present disclosure is not limited thereto. In one embodiment of the present disclosure, the bezel region (117) may be located on at least one side of the subspace optical modulator.
[0172] In one embodiment of the present disclosure, a plurality of subspace optical modulators may include a plurality of first subspace optical modulators (113) included in a first line (112) and a plurality of second subspace optical modulators (115) included in a second line (114).
[0173] In one embodiment of the present disclosure, a plurality of first subspace optical modulators (113) and a plurality of second subspace optical modulators (115) may be arranged staggered with respect to each other. Specifically, the display area of one of the first subspace optical modulators and the bezel area of the second subspace optical modulator adjacent to the first subspace optical modulator may be arranged to overlap in a third direction (30). In one embodiment of the present disclosure, the first subspace optical modulator may not overlap with or may partially overlap with two adjacent second subspace optical modulators in the third direction (30). Additionally, the second subspace optical modulator may not overlap with or may partially overlap with two adjacent first subspace optical modulators in the third direction (30).
[0174] In one embodiment of the present disclosure, a plurality of first subspace optical modulators (113) and a plurality of second subspace optical modulators (115) may be arranged such that the display area of one of the first subspace optical modulators and the display area of an adjacent second subspace optical modulator are in contact with a line extending in a third direction (30). That is, the display area of one of the first subspace optical modulators and the display area of an adjacent second subspace optical modulator may not overlap.
[0175] In one embodiment of the present disclosure, coherent light (200) may be provided to a plurality of first subspace light modulators (113) each displaying a plurality of holographic patterns and a plurality of second subspace light modulators (115) each displaying a plurality of holographic patterns.
[0176] In one embodiment of the present disclosure, a plurality of reconstructed images provided by a plurality of first subspace optical modulators (113) and a plurality of reconstructed images provided by a plurality of second subspace optical modulators (115) can be optically propagated and provided to a diffusion layer (130).
[0177] In one embodiment of the present disclosure, a phase delay pattern may be included in each of the plurality of holographic patterns displayed in the plurality of first subspace optical modulators (113) and the plurality of holographic patterns displayed in the plurality of second subspace optical modulators (115).
[0178] In one embodiment of the present disclosure, the phase delay pattern may be a pattern for delaying the phase of coherent light (200) provided to a subspace light modulator. The phase delay pattern may act as a phase plate to control and diffract the phase of the provided coherent light (200).
[0179] In one embodiment of the present disclosure, the phase delay pattern may include a plurality of grating patterns having the same period. The period of each of the plurality of grating patterns may be determined in correspondence with the angle at which the coherent light (200) is to be diffracted.
[0180] In one embodiment of the present disclosure, depending on the period of a plurality of grating patterns included in a phase delay pattern, the provided coherent light (200) can be diffracted at a specific angle and propagated by light.
[0181] In one embodiment of the present disclosure, the electronic device (100) can generate a plurality of phase delay patterns that diffract a plurality of reconstructed images such that a plurality of reconstructed images provided by a plurality of first subspace optical modulators (113) and a plurality of reconstructed images provided by a plurality of second subspace optical modulators (115) are located on a line extended in a first direction (10) on a diffusion layer (130).
[0182] Specifically, the electronic device (100) can generate a phase delay pattern that diffracts a plurality of reconstructed images provided by a plurality of first subspace optical modulators (113) into a third direction (30). The electronic device (100) can generate a phase delay pattern that diffracts a plurality of reconstructed images provided by a plurality of second subspace optical modulators (115) into a direction opposite to the third direction (30).
[0183] In one embodiment of the present disclosure, a plurality of view images may include position information of a plurality of cameras corresponding to the positions of a plurality of sub-space optical modulators. The electronic device (100) may generate a plurality of phase delay patterns based on the position information of the plurality of cameras and the distance between the spatial optical modulator (110) and the diffusion layer (130), etc. However, the present disclosure is not limited thereto, and the electronic device (100) may obtain a plurality of pre-generated phase delay patterns corresponding to each of the plurality of sub-space optical modulators.
[0184] In one embodiment of the present disclosure, the electronic device (100) can display a pattern obtained by multiplying each of the plurality of hologram patterns generated through the hologram pattern generation module (152) by a corresponding phase delay pattern as a hologram pattern to a plurality of subspace optical modulators.
[0185] Accordingly, a plurality of reconstructed images that extend in the first direction (10) and do not include a bezel area (117) may be provided in the diffusion layer (130). Each of the plurality of sub-space light modulators arranged alternately in the first line (112) and the second line (114) includes a display area (116) and a bezel area (117), but as they are diffracted and propagated by a phase delay pattern, a plurality of reconstructed images that extend in the first direction (10) and do not include a bezel area (117) may be provided in the diffusion layer (130).
[0186] However, the present disclosure is not limited thereto, and the electronic device (100) may diffract only the plurality of reconstructed images provided by a plurality of subspace optical modulators included in either the first line (112) or the second line (114), so that the plurality of reconstructed images provided on the diffusion layer (130) are located on a line extended in the first direction (10) on the diffusion layer (130).
[0187] Additionally, FIG. 5 describes an example in which a plurality of subspace optical modulators include a bezel area (117), but the present disclosure is not limited thereto. A plurality of subspace optical modulators may not include a bezel area (117) and may include only a display area (116). When a plurality of subspace optical modulators include only a display area (116), a plurality of subspace optical modulators may be arranged on a single line extended in a first direction (10).
[0188] FIG. 6 is a drawing for explaining a plurality of sub-space optical modulators included in a spatial optical modulator according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 5, and redundant descriptions are omitted.
[0189] Referring to FIGS. 1, FIGS. 2 and FIGS. 6, in one embodiment of the present disclosure, the spatial light modulator (110) may further include a plurality of sub-spatial light modulators (111) arranged in a third direction (30).
[0190] In one embodiment of the present disclosure, the spatial light modulator (110) may further include a plurality of sub-spatial light modulators (111) arranged in a first direction (10) and a third direction (30).
[0191] In this case, the resolution of one subspace optical modulator is m*n, the number of multiple subspace optical modulators arranged in the first direction (10) is k, and the number of multiple subspace optical modulators arranged in the third direction (30) is j. At this time, j may be a natural number greater than or equal to 1.
[0192] In one embodiment of the present disclosure, as the spatial light modulator (110) includes a plurality of sub-spatial light modulators (111) arranged in a first direction (10) and a third direction (30), the electronic device (100) may further include two reflective layers (140) that are spaced apart from each other in a third direction (30) and extend in a second direction (20) between the spatial light modulator (110) and the diffusion layer (130).
[0193] The electronic device (100) may include reflective layers surrounding the space between the spatial light modulator (110) and the diffusion layer (130). Accordingly, all data included in a plurality of reconstructed images (300) provided by the spatial light modulator (110) can be transmitted to the diffusion layer (130).
[0194] In one embodiment of the present disclosure, the amount of data in the first direction (10) of a plurality of reconstructed images transmitted to the diffusion layer (130) may correspond to m*k. The amount of data in the third direction (30) of a plurality of reconstructed images transmitted to the diffusion layer (130) may correspond to n*j.
[0195] Accordingly, the holographic image (400) that is optically propagated from the diffusion layer (130) and provided to the user (500) may contain a large amount of data in the first direction (10) as well as in the third direction (30). The user (500) can feel a sense of depth through the holographic image (400) even if they move in either the first direction (10) or the third direction (30).
[0196] In one embodiment of the present disclosure, each subspace light modulator may not include a bezel area, or the area of the bezel area may be very small compared to the display area (116). Accordingly, a plurality of subspace light modulators (111) arranged in a first direction (10) and a third direction (30) may be configured in a seamless form such that the area where the holographic pattern is not displayed between each display area (116) is not visible.
[0197] In this case, in one embodiment of the present disclosure, the plurality of holographic patterns displayed on the plurality of subspace optical modulators (111) may not include a phase delay pattern. Even if the phase delay pattern is not included, the plurality of reproduced images (300) reproduced from the plurality of subspace optical modulators (111) are optically propagated so as to be arranged in a first direction (10) and a third direction (30), and may be located on a plane formed by the first direction (10) and the third direction (30) in the diffusion layer (130).
[0198] However, the present disclosure is not limited thereto, and the spatial optical modulator (110) may include a plurality of sub-spatial optical modulators that extend in a first direction (10) and are configured in a seamless form. Additionally, the number of a plurality of sub-spatial optical modulators arranged in the first direction (10) and the number of a plurality of sub-spatial optical modulators arranged in the third direction (30) included in the spatial optical modulator (110) may be different from each other.
[0199] FIG. 7 is a drawing illustrating the arrangement of a spatial light modulator, a diffusion layer, and a reflection layer according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 4, and redundant descriptions are omitted.
[0200] Referring to FIGS. 1, FIGS. 2, FIGS. 4 and FIGS. 7, in one embodiment of the present disclosure, FIG. 7 shows a spatial light modulator (110), a diffusion layer (130), and two reflection layers (141, 142).
[0201] In one embodiment of the present disclosure, the first length (710) in the first direction (10) of the spatial light modulator (110) and the second length (720) in the first direction (10) of the diffusion layer (130) may be the same. The spatial light modulator (110) and the diffusion layer (130) may be arranged to overlap in the second direction (20).
[0202] In one embodiment of the present disclosure, the length in the first direction (10) between the first reflective layer (141) and the second reflective layer (142) may be equal to the first length (710). The first reflective layer (141) and the second reflective layer (142) may be located on both sides of the spatial light modulator (110) and on both sides of the diffusion layer (130), respectively. The first reflective layer (141) and the second reflective layer (142) may be arranged to be in contact with both sides of the spatial light modulator (110) and on both sides of the diffusion layer (130).
[0203] In one embodiment of the present disclosure, a third length (730) in a second direction (20) between the spatial light modulator (110) and the diffusion layer (130) may be determined to be a length such that all of the multiple reproduced images reproduced in the spatial light modulator (110) can be transmitted to the diffusion layer (130).
[0204] In one embodiment of the present disclosure, the third length (730) may be determined by the specifications of the spatial light modulator (110) and the second length (720) of the diffusion layer (130).
[0205] Specifically, in the middle subspace light modulator among the plurality of subspace light modulators (111) included in the spatial light modulator (110), a third length (730) can be determined so that the reconstructed image provided by diffracting at a diffraction angle (700) can be fully transmitted to the diffusion layer (130) of the second length (720).
[0206] In one embodiment of the present disclosure, the diffraction angle (700) of the reproduced image reproduced in each subspace optical modulator may be determined by the pitch of each of the plurality of pixels included in each subspace optical modulator. In this case, the pitch of each pixel may refer to the length in the first direction (10) of the pixel. The longer the length in the first direction (10) of the pixel, the smaller the diffraction angle (700) may be.
[0207] In one embodiment of the present disclosure, the second length (720) of the diffusion layer (130) is the same as the first length (710) of the spatial light modulator (110), and as the diffraction angle (700) of the reproduced image is determined by the pixel pitch, the third length (730) can also be determined by the second length (720) and the diffraction angle (700).
[0208] Specifically, as the diffraction angle (700) becomes smaller, the third length (730) can be determined to be longer. As the second length (720) becomes longer, the third length (730) can be determined to be longer.
[0209] In one embodiment of the present disclosure, the second length (720) of the diffusion layer (130) is the same as the first length (710) of the spatial light modulator (110), and the amount of data included in the plurality of reproduction images provided in the diffusion layer (130) may be the same as the amount of data of the plurality of reproduction images provided in the spatial light modulator (110).
[0210] Accordingly, the diffusion layer (130) may include a plurality of virtual space light modulators equal to the number of sub-space light modulators (111). A virtual space light modulator may be a virtual configuration that performs the role of providing a reconstructed image that is optically propagated in the diffusion layer (130). The size of each of the virtual virtual space light modulators may be equal to the size of each of the plurality of sub-space light modulators.
[0211] In one embodiment of the present disclosure, a plurality of reconstructed images that are optically propagated in a second direction (20) from a diffusion layer (130) and provided to a user (500) as a holographic image (400) may be provided from a plurality of virtual space light modulators. The diffraction angle (700) of the plurality of reconstructed images provided from the plurality of virtual space light modulators may be the same as the diffraction angle (700) in the spatial light modulator (110).
[0212] In one embodiment of the present disclosure, a viewing area (750) optimized for observing a holographic image (400) provided in an electronic device (100) may be determined by a second length (720) of a diffusion layer (130) and a diffraction angle (700) of a plurality of reconstructed images that are optically propagated in the diffusion layer (130).
[0213] In one embodiment of the present disclosure, the viewing area (750) may refer to an area where the reconstructed images provided by each of two virtual space light modulators located on both sides of the first direction (10) of the diffusion layer (130) overlap. The viewing area (750) may refer to an optimal area where the electronic device (100) can provide a three-dimensional holographic image (400) to the user (500).
[0214] The user (500) can see different sides of an object included in a holographic image (400) as they move in the first direction (10) or the opposite direction of the first direction (10) within the viewing area (750).
[0215] In one embodiment of the present disclosure, the fourth length (740) in the second direction (20) between the diffusion layer (130) and the viewing area (750) may be the same as the third length (730).
[0216] In one embodiment of the present disclosure, a spatial light modulator (110) and a diffusion layer (130) included in an electronic device (100) are arranged to overlap in a second direction (20), and the first length (710) of the spatial light modulator (110) and the second length (720) of the diffusion layer (130) may be the same. Additionally, the spatial light modulator (110) and the diffusion layer (130) included in the electronic device (100) may be arranged apart by a third length (730) in the second direction (20). In this case, the viewing area (750) of the electronic device (100) may be an area separated by a fourth length (740) in the second direction (20) from the diffusion layer (130).
[0217] FIG. 8 is a drawing for explaining a coherent light source that provides coherent light to a spatial light modulator according to one embodiment of the present disclosure.
[0218] Referring to FIGS. 1, FIGS. 2 and FIGS. 8, in one embodiment of the present disclosure, FIG. 8 illustrates a coherent light source (120) included in an electronic device (100). Additionally, the electronic device (100) may include a lens (800) and a prism (810). In one embodiment of the present disclosure, the coherent light source (120), the lens (800), and the prism (810) are illustrated as separate components, but the present disclosure is not limited thereto. The coherent light source (120), the lens (800), and the prism (810) may be formed as a single component.
[0219] In one embodiment of the present disclosure, the lens (800) can refraction light provided to the lens (800) to collect or disperse the light. Depending on the shape of the lens (800), the light provided to the lens (800) may converge or diverge.
[0220] In one embodiment of the present disclosure, a coherent light source (120) may generate and provide coherent light (200). The coherent light (200) provided by the coherent light source (120) may be refracted and propagated through a lens (800).
[0221] In one embodiment of the present disclosure, the prism (810) can change the direction of travel of light by refraction or dispersion of light provided to the prism (810).
[0222] In one embodiment of the present disclosure, the prism (810) may include a wedge prism. The wedge prism may deflect the provided light at a specific angle. Coherent light (200) provided from a coherent light source (120) may be provided to the prism (810) through a lens (800), and the direction of propagation may be changed through the prism (810) and provided to the spatial light modulator (110).
[0223] In one embodiment of the present disclosure, the prism (810) may include a grating. The grating included in the prism (810) is a diffraction grating and can diffract light provided to the prism (810) to disperse it in multiple directions. Coherent light (200) provided to the prism (810) including the grating, passing through the lens (800), is dispersed in multiple directions and can be deflected at a specific angle.
[0224] In one embodiment of the present disclosure, the grating included in the prism (810) may include a surface relief grating, a volume grating, or a polarization grating.
[0225] Accordingly, the electronic device (100) can provide coherent light (200) provided from a coherent light source (120) to a spatial light modulator (110) comprising a plurality of sub-spatial light modulators (111) extended in the first direction in the form of a plane-light source extended in the first direction (10) through a lens (800) and a prism (810). The electronic device (100) can provide coherent light (200) to each of the plurality of sub-spatial light modulators (111) using a single coherent light source (120) through the lens (800) and the prism (810).
[0226] FIG. 9 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure.
[0227] Referring to FIGS. 1, FIGS. 2, FIGS. 5 and FIGS. 9, in one embodiment of the present disclosure, FIG. 9 illustrates a plurality of sub-coherent light sources (121) included in a coherent light source (120). In one embodiment of the present disclosure, the coherent light source (120) may include a plurality of sub-coherent light sources (121) arranged in a first direction (10).
[0228] In one embodiment of the present disclosure, the electronic device (100) may include a plurality of lenses (801). Coherent light (200) provided from a plurality of subcoherent light sources (121) may be refracted and propagated through the plurality of lenses (801).
[0229] In one embodiment of the present disclosure, each of the plurality of subcoherent light sources (121) may correspond to a plurality of subspace light modulators (111). Each of the plurality of subcoherent light sources (121) may provide coherent light (200) to the corresponding subspace light modulator.
[0230] Accordingly, the electronic device (100) can provide high-intensity coherent light (200) to each of the plurality of subspace light modulators.
[0231] In one embodiment of the present disclosure, the coherent light (200) provided by a plurality of sub-coherent light sources (121) may be in an unpolarized state (210). Hereinafter, for convenience of explanation, the unpolarized state (210) is referred to as the first state (210).
[0232] In one embodiment of the present disclosure, the electronic device (100) may include a linear polarizer (900). Coherent light (200) provided from a plurality of subcoherent light sources (121) may be provided to the linear polarizer (900) through a plurality of lenses (801).
[0233] In one embodiment of the present disclosure, a plurality of sub-coherent light sources (121), a plurality of lenses (801), and a linear polarizer (900) included in the coherent light source (120) are shown as separate configurations, but the present disclosure is not limited thereto. A plurality of sub-coherent light sources (121), a plurality of lenses (801), and a linear polarizer (900) included in the coherent light source (120) may be formed as a single configuration.
[0234] In one embodiment of the present disclosure, the linear polarizer (900) includes a preset polarization axis and can transmit only the light component parallel to the polarization axis among the incident light. The linear polarizer (900) can transmit only the light component vibrating in a specific direction corresponding to the polarization axis among the incident light, and can block the remaining light components by absorbing or reflecting them.
[0235] In one embodiment of the present disclosure, light of a first state (210) provided to a linear polarizer (900) through a plurality of lenses (801) may be polarized in a specific direction by the linear polarizer (900). The state polarized in a specific direction is referred to as a second state (220). The second state (210) may be a linear polarization state.
[0236] In one embodiment of the present disclosure, the liquid crystal layer included in the spatial light modulator (110) may include an alignment layer that determines the initial orientation of the liquid crystal. In one embodiment of the present disclosure, the alignment layer may be rubbed in a specific direction to determine the initial orientation of the liquid crystal included in the liquid crystal layer.
[0237] In one embodiment of the present disclosure, the linear polarizer (900) may be an optical configuration that transmits light in the same direction as the rubbing direction of the alignment layer included in the spatial light modulator (110). Accordingly, the electronic device (100) may provide coherent light (200) polarized in the same direction as the rubbing direction of the alignment layer included in the spatial light modulator (110) to the spatial light modulator (110).
[0238] FIG. 10 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure. FIG. 11 is a drawing for explaining a plurality of sub-coherent light sources included in a coherent light source according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 9, and redundant descriptions are omitted.
[0239] Referring to FIGS. 1, FIGS. 2, FIGS. 9 and FIGS. 10, in one embodiment of the present disclosure, FIG. 10 shows a plurality of sub-coherent light sources (121) and a plurality of lenses (801) included in a coherent light source (120).
[0240] In one embodiment of the present disclosure, a plurality of subcoherent light sources (121) may provide coherent light (200). The coherent light (200) provided by the plurality of subcoherent light sources (121) may be in a first state (1010) that is not polarized.
[0241] In one embodiment of the present disclosure, the electronic device (100) may include a polarized beam splitter (PBS). The polarized beam splitter may be an optical element that separates incident light into different paths according to its polarization state.
[0242] In one embodiment of the present disclosure, when the light of the first state (1010) includes light of a parallel polarization component and light of a horizontal polarization component, the polarization beam splitter can separate the light of the parallel polarization component and the light of the horizontal polarization component into different directions.
[0243] In one embodiment of the present disclosure, a polarizing beam splitter may pass light of a horizontal polarization component and refract and propagate light of a vertical polarization component. In one embodiment of the present disclosure, the horizontally polarized state may be referred to as the third state (1020), and the vertically polarized state as the fourth state (1030).
[0244] In one embodiment of the present disclosure, the electronic device (100) may include a plurality of polarizing beam splitters. The plurality of polarizing beam splitters may be arranged so that two correspond to each subcoherent light source.
[0245] In one embodiment of the present disclosure, coherent light (200) of a first state (1010) provided from any one sub-coherent light source may be provided to a first polarizing beam splitter (1001) through a lens (801).
[0246] In one embodiment of the present disclosure, the coherent light of the third state (1020) among the coherent light (200) provided to the first polarizing beam splitter (1001) can be transmitted as is and provided to the corresponding subspace light modulator.
[0247] In one embodiment of the present disclosure, among the coherent light (200) provided to the first polarizing beam splitter (1001), the coherent light of the fourth state (1030) may be refracted and provided to the second polarizing beam splitter (1002).
[0248] In one embodiment of the present disclosure, the electronic device (100) may include at least one half-wave plate (1040). The half-wave plate (1040) can change the phase of the incident light by half the wavelength and rotate the polarization direction of the light.
[0249] In one embodiment of the present disclosure, coherent light of the fourth state (1030) provided to the second polarizing beam splitter (1002) may be refracted and provided to the half-wave plate (1040).
[0250] At this time, the angle formed by the optical axis of the half-wave plate (1040) and the direction of the fourth state (1030) may be 45 degrees. Accordingly, the light passing through the half-wave plate (1040) may again become the third state (1020). The coherent light of the third state (1020) passing through the half-wave plate (1040) may be provided to another sub-space light modulator corresponding to the corresponding sub-coherent light source.
[0251] In one embodiment of the present disclosure, the electronic device (100) can provide coherent light of a third state (1020) to each of two subspace light modulators using one subcoherent light source. Accordingly, compared to FIG. 9, the electronic device (100) can reduce the number of subcoherent light sources required to provide coherent light (200) to the space light modulator (110).
[0252] Referring to FIG. 11, in one embodiment of the present disclosure, FIG. 11 shows a plurality of sub-coherent light sources (1100, 1110) that extend in a first direction (10) and are spaced apart in a third direction (30). Configurations identical to those described in FIG. 10 are given the same reference numerals, and redundant descriptions are omitted.
[0253] Referring to FIGS. 5, 10, and 11, a plurality of subcoherent light sources (1100, 1110) may include a plurality of first subcoherent light sources (1100) arranged to correspond to a plurality of first subspace light modulators (113) arranged in a first line (112). A plurality of subcoherent light sources (1100, 1110) may include a plurality of second subcoherent light sources (1110) arranged to correspond to a plurality of second subspace light modulators (115) arranged in a second line (114).
[0254] In one embodiment of the present disclosure, a plurality of first subcoherent light sources (1100) and a plurality of second subcoherent light sources (1110) may be spaced apart in a third direction (30).
[0255] In one embodiment of the present disclosure, the lens may be included in a plurality of first subcoherent light sources (1100) and a plurality of second subcoherent light sources (1110). The plurality of first subcoherent light sources (1100) and the plurality of second subcoherent light sources (1110) may provide coherent light (200) of a first state (1010).
[0256] In one embodiment of the present disclosure, coherent light (200) provided from a plurality of first subcoherent light sources (1100) may be provided to a plurality of first subspace light modulators (113) arranged in a first line (112) as coherent light of a third state (1020) through a first polarizing beam splitter (1001), a second polarizing beam splitter (1002), and a half-wave plate (1040).
[0257] In one embodiment of the present disclosure, coherent light (200) provided from a plurality of second subcoherent light sources (1110) may be provided to a plurality of first subspace light modulators (115) arranged in a second line (114) as coherent light of a third state (1020) through a first polarizing beam splitter (1001), a second polarizing beam splitter (1002), and a half-wave plate (1040).
[0258] Through this, the electronic device (100) can provide coherent light (200) to a plurality of subspace light modulators spaced apart in a third direction (30).
[0259] FIG. 12 is a drawing for explaining spreading a plurality of reproduced images in a third direction through a diffusion layer according to one embodiment of the present disclosure.
[0260] Referring to FIG. 1, FIG. 4 and FIG. 12, in one embodiment of the present disclosure, FIG. 12 shows a diffusion layer (130).
[0261] In one embodiment of the present disclosure, the diffusion layer (130) may be provided with a plurality of reconstructed images that are optically propagated from a spatial light modulator (110) to a second direction (20) or reflected by two reflection layers (140).
[0262] In one embodiment of the present disclosure, the diffusion layer (130) can transmit the acquired plurality of reconstructed images as they are in the second direction (20).
[0263] In one embodiment of the present disclosure, a plurality of reproduction images may include a first reproduction image (1200), a second reproduction image (1210), and a third reproduction image (1220) for providing different sides of an object according to the viewing position of the user (500) in the holographic image (400) by optical propagation.
[0264] In one embodiment of the present disclosure, the first reproduction image (1200) may include a amount of data for providing the front view of an object included in the holographic image (400) to a user (500) located in front of the electronic device (100) as the first reproduction image (1200) is optically propagated.
[0265] The second reproduction image (1210) may contain a amount of data to provide the left side of an object included in the holographic image (400) to a user (500) located on the left side of the electronic device (100) (e.g., the direction between the second direction (20) and the opposite direction of the first direction (10)) as the second reproduction image (1210) is transmitted by light.
[0266] The third reproduction image (1220) may contain a amount of data to provide the right side of an object included in the holographic image (400) to a user (500) located to the right of the electronic device (100) (e.g., the direction between the second direction (20) and the first direction (10)) as the third reproduction image (1220) is transmitted by light.
[0267] In one embodiment of the present disclosure, a plurality of reproducible images provided in the diffusion layer (130) may be located in the central region of the diffusion layer (130) and extend in a first direction (10). The plurality of reproducible images provided in the diffusion layer (130) may be images containing parallax information in the first direction (10), that is, in the left-right direction of the user (500) viewing the holographic image (400). Accordingly, the electronic device (100) may provide a holographic image (400) that provides a different side of an object depending on the viewing position of the user (500) located in the first direction (10) or the opposite direction of the first direction (10).
[0268] In one embodiment of the present disclosure, the diffusion layer (130) can scatter or refract a plurality of acquired reconstructed images to diffuse them into a third direction (30). Specifically, a plurality of reconstructed images provided to the diffusion layer (130) can diffuse into the third direction (30) and the opposite direction of the third direction (30).
[0269] In one embodiment of the present disclosure, a plurality of reconstructed images diffused by the diffusion layer (130) in the third direction (30) and in the opposite direction of the third direction (30) may be optically propagated in the second direction (20) and provided to a user (500) as a holographic image (400). The plurality of reconstructed images provided to the diffusion layer (130) may be images that do not contain parallax information in the third direction (30), that is, in the up-down direction of the user (500) viewing the holographic image (400).
[0270] Accordingly, the electronic device (100) can provide a holographic image (400) to the user (500) even if the user (500) is located in the third direction (30) or in the opposite direction of the third direction (30). Generally, considering that the parallax in the left-right direction corresponding to the first direction (10) has a large influence on the perception of three-dimensional information due to human cognitive characteristics, and the parallax in the up-down direction corresponding to the third direction (30) has a small influence, the electronic device (100) can provide a holographic image (400) to the user (500) by diffusing a plurality of reproduced images through the diffusion layer (130) into the third direction (30) and the opposite direction of the third direction (30).
[0271] In one embodiment of the present disclosure, FIG. 12 illustrates holographic images provided to a user (500) according to the location of the user (500) using an electronic device (100).
[0272] In one embodiment of the present disclosure, when the front of an electronic device (100) is referred to as a first position, a first holographic image (1230) may be provided to a user (500) located at the first position. In one embodiment of the present disclosure, based on the first position, as the user (500) moves in a first direction (10) or in a direction opposite to the first direction (10), the first holographic image (1230) may provide the front, left, or right side of an object.
[0273] In one embodiment of the present disclosure, when the position where the user (500) moves in a third direction (30) relative to a first position is called the second position, a second holographic image (1240) may be provided to the user (500) located at the second position. The second holographic image (1240) is formed by optical propagation of a plurality of reconstructed images diffused in the third direction (30) by the diffusion layer (130), and an image identical to the first holographic image (1230) may be provided to the user (500) located at the second position.
[0274] In one embodiment of the present disclosure, when the position where the user (500) moves in the opposite direction of the third direction (30) relative to the first position is called the third position, a third holographic image (1250) may be provided to the user (500) located at the third position. The third holographic image (1250) is formed by optical propagation of a plurality of reconstructed images diffused in the opposite direction of the third direction (30) by the diffusion layer (130), and an image identical to the first holographic image (1230) may be provided to the user (500) located at the third position.
[0275] Through this, the electronic device (100) can provide a holographic image (400) to a user (500) located in a third direction (30) or opposite to the third direction (30) from the front of the electronic device (100), even if the spatial light modulator (110) includes a plurality of sub-spatial light modulators (111) arranged in a first direction (10).
[0276] FIG. 13 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure. FIG. 14 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure. FIG. 15 is a drawing for explaining a diffusion layer according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 12, and redundant descriptions are omitted.
[0277] Referring to FIG. 1, FIG. 12 and FIG. 13, in one embodiment of the present disclosure, the diffusion layer (130) may include a plurality of diffusion patterns (1300) arranged in a third direction (30). The plurality of diffusion patterns (1300) shown in FIG. 13 may be included in an enlarged area of a portion of the diffusion layer (130).
[0278] In one embodiment of the present disclosure, each of the plurality of diffusion patterns (1300) may include a groove structure extending in a first direction (10). Each of the plurality of diffusion patterns (1300) may extend in the first direction (10) and be arranged repeatedly in a third direction (30).
[0279] In one embodiment of the present disclosure, the spacing between a plurality of diffusion patterns (1300) may decrease as the angle at which a plurality of reconstructed images are to be refracted in a third direction (30) or in a direction opposite to the third direction (30) through the diffusion layer (130) increases. That is, the smaller the period of the plurality of diffusion patterns (1300) included in the diffusion layer (130), the larger the angle at which a plurality of reconstructed images are to be refracted in a third direction (30) or in a direction opposite to the third direction (30) through the diffusion layer (130) may increase.
[0280] Referring to FIG. 1, FIG. 13 and FIG. 14, in one embodiment of the present disclosure, each of the plurality of diffusion patterns (1300) included in the diffusion layer (130) may include a lenticular lens (1400) that extends in a first direction (10) and is repeatedly arranged in a third direction (30).
[0281] In one embodiment of the present disclosure, the lenticular lens (1400) may have a cylinder shape extending in a first direction (10). The lenticular lens (1400) may include glass or plastic, etc.
[0282] In one embodiment of the present disclosure, the smaller the radius of curvature of the lenticular lens (1400), the larger the angle at which a plurality of reproduced images are to be refracted through the diffusion layer (130) in the third direction (30) or in the opposite direction of the third direction (30).
[0283] In one embodiment of the present disclosure, the smaller the period of the plurality of lenticular lenses included in the diffusion layer (130), the larger the angle at which the plurality of reproduced images are to be refracted through the diffusion layer (130) in the third direction (30) or in the opposite direction of the third direction (30).
[0284] Referring to FIGS. 1, 13 and 15, in one embodiment of the present disclosure, each of the plurality of diffusion patterns (1300) included in the diffusion layer (130) may include a liquid crystal layer (1500) containing liquid crystal. The electronic device (100) may adjust the arrangement of the liquid crystal included in the liquid crystal layer (1500) so that the plurality of reproduced images provided in the diffusion layer (130) are refracted in a third direction (30) or in a direction opposite to the third direction (30).
[0285] The electronic device (100) can form a plurality of diffusion patterns (1300) that are extended in a first direction (10) and repeatedly arranged in a third direction (30) through the anisotropy of the liquid crystal. In one embodiment of the present disclosure, the electronic device (100) may, of course, adjust the arrangement of the liquid crystal differently according to the angle at which the plurality of reproduced images are to be refracted.
[0286] In one embodiment of the present disclosure, each of the plurality of diffusion patterns (1300) included in the diffusion layer (130) may include a plurality of meta atoms (1510) constituting a meta surface. In one embodiment of the present disclosure, the "meta atom" is a structure having a nano-scale size and can change the phase of incident light. The "meta surface" is an optical structure composed of meta atoms and can perform the role of a specific optical element depending on the size, arrangement, spacing, shape, etc. of the plurality of meta atoms included.
[0287] In one embodiment of the present disclosure, a plurality of diffusion patterns (1300) included in the diffusion layer (130) may include a plurality of meta atoms (1510) arranged so that a plurality of reproduction images provided in the diffusion layer (130) are refracted in a third direction (30) or in a direction opposite to the third direction (30).
[0288] FIG. 16 is a flowchart illustrating an operation for acquiring a plurality of holographic images according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to steps identical to those described in FIG. 3, and redundant descriptions are omitted.
[0289] Referring to FIGS. 2, FIGS. 3 and FIGS. 16, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S50) of acquiring a plurality of view images corresponding to a plurality of views corresponding to a plurality of subspace optical modulators (111).
[0290] In step S50, the electronic device (100) may acquire a plurality of view images through an input / output interface (170) or a communication interface (180). In one embodiment of the present disclosure, the electronic device (100) may receive a plurality of view images captured from multiple angles of an object from an external server through the communication interface (180). However, the present disclosure is not limited thereto, and it is understood that the electronic device (100) may generate a plurality of view images corresponding to an object to be displayed in three dimensions through a holographic image (400).
[0291] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S60) of acquiring a plurality of holographic patterns by applying a plurality of view images to a holographic pattern generation module (152).
[0292] In step S60, the electronic device (100) can provide a plurality of view images as input to a hologram pattern generation module (152) to obtain a plurality of hologram patterns corresponding to the plurality of view images.
[0293] In step S60, the electronic device (100) can generate (or infer) multiple reconstructed images provided to the diffusion layer (130) from multiple view images through a first image generation module (153) included in the hologram pattern generation module (152). The electronic device (100) can generate multiple hologram patterns to be displayed on multiple sub-space light modulators from multiple reconstructed images through a second image generation module (154) included in the hologram pattern generation module (152).
[0294] However, the present disclosure is not limited thereto, and it is obvious that the operation of generating a plurality of holographic patterns from a plurality of view images may be performed in a single step.
[0295] Below, the operation in step S60 will be described later in FIG. 17.
[0296] In one embodiment of the present disclosure, after step S60, the electronic device (100) may perform the operation of step S100 of FIG. 3.
[0297] FIG. 17 is a diagram illustrating the operation of acquiring a plurality of holographic images from a plurality of view images through a holographic pattern generation module according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 2, and redundant descriptions are omitted.
[0298] Referring to FIG. 2 and FIG. 17, in one embodiment of the present disclosure, an electronic device (100) can acquire a holographic pattern (1620) corresponding to each of the plurality of view images by providing each of the acquired view images as an input to a holographic pattern generation module (152).
[0299] In one embodiment of the present disclosure, the electronic device (100) may provide a view image (1600) to a first image generation module (153) included in a hologram pattern generation module (152). The first image generation module (153) may include a first artificial intelligence model that is pre-trained to receive the view image as input and infer a reconstructed image (1610).
[0300] At this time, one view image (1600) may be an image visible to the user (500) at a specific location when the user (500) views the hologram image (400) at a specific location. The reconstructed image (1610) may be an image formed on the diffusion layer (130) by a sub-space light modulator. The reconstructed image (1610) may be an image obtained by performing back propagation to the diffusion layer (130) with respect to one view image (1600) at a specific location.
[0301] In one embodiment of the present disclosure, the electronic device (100) may provide a reconstructed image (1610) to a second image generation module (154) included in a hologram pattern generation module (152). The second image generation module (154) may include a second artificial intelligence model that is pre-trained to receive the reconstructed image (1610) as input and infer a hologram pattern (1620).
[0302] At this time, the hologram pattern (1620) may be an image displayed on a subspace optical modulator. The hologram pattern (1620) may be an image obtained by performing backpropagation on a reproduction image (1610) formed on a diffusion layer (130) using a subspace optical modulator.
[0303] The above operation may be repeated to obtain multiple holographic patterns from multiple view images.
[0304] Hereinafter, the first artificial intelligence model included in the first image generation module (153) and the second artificial intelligence model included in the second image generation module (154) will be described later in FIGS. 18 to 21.
[0305] In one embodiment of the present disclosure, FIG. 17 illustrates that a hologram pattern generation module (152) is divided into a first image generation module (153) and a second image generation module (154), and that the operation of acquiring a hologram pattern (1620) from a view image (1600) is performed separately through the first image generation module (153) and the second image generation module (154), but the present disclosure is not limited thereto.
[0306] The operation of acquiring a hologram pattern (1620) from a view image (1600) may be performed in a single step, and it goes without saying that the operation through the first artificial intelligence model and the operation through the second artificial intelligence model may be performed in a single artificial intelligence model.
[0307] FIG. 18 is a flowchart illustrating the operation of training an artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0308] Referring to FIGS. 1, FIGS. 2, FIGS. 17 and FIGS. 18, in one embodiment of the present disclosure, FIG. 18 illustrates a plurality of steps for training an artificial intelligence model included in a hologram pattern generation module (152).
[0309] In one embodiment of the present disclosure, the operation of training an artificial intelligence model included in a hologram pattern generation module (152) may include the step (S10) of acquiring a training target image (1920, see FIG. 19) provided to a diffusion layer (130) based on a training view image (1900, see FIG. 19) acquired by capturing an object in one view.
[0310] In step S10, the electronic device (100) may acquire a training target image (1920) provided to the diffusion layer (130) based on a training view image (1900) acquired by capturing an object in one view. However, the present disclosure is not limited thereto, and the electronic device (100) may acquire a training view image (1900) from an input / output interface (170) or a communication interface (180) and acquire a training target image (1920) based on the acquired training view image (1900).
[0311] The training target image (1920) may be an image obtained by performing backpropagation to the diffusion layer (130) at a location where the holographic image (400) is provided to the user (500) with respect to the training view image (1900) during the learning process of the artificial intelligence model.
[0312] In one embodiment of the present disclosure, the operation of training an artificial intelligence model included in a hologram pattern generation module (152) may include the step (S20) of obtaining a training hologram pattern (2020, see FIG. 20) displayed on a sub-spatial light modulator corresponding to one view based on a training target image (1920).
[0313] In step S20, the electronic device (100) can acquire a training hologram pattern (2020) displayed through a subspace light modulator based on a training target image (1920). The training hologram pattern (2020) may be an image displayed through a subspace light modulator located in a view corresponding to a training view image (1900) during the learning process of an artificial intelligence model.
[0314] In one embodiment of the present disclosure, the operation of training an artificial intelligence model included in a hologram pattern generation module (152) may include the step (S30) of obtaining a training reproduction image (2040, see FIG. 20) that is reproduced through a training hologram pattern (2020).
[0315] In step S30, the electronic device (100) can obtain a training reconstructed image (2040) that is reproduced by providing coherent light (200) to a subspace light modulator displaying a training hologram pattern (2020). The training reconstructed image (2040) may be an image that is provided to a diffusion layer (130) via optical propagation, in the learning process of an artificial intelligence model, where the image reproduced by providing coherent light (200) to a subspace light modulator displaying a training hologram pattern (2020) is provided.
[0316] In one embodiment of the present disclosure, the operation of training an artificial intelligence model included in a hologram pattern generation module (152) may include the step (S40) of training an artificial intelligence model based on a loss function (2050, see FIG. 20) that compares a training target image (1920) and a training reproduction image (2040).
[0317] In step S40, the electronic device (100) can update a plurality of weights included in an artificial intelligence model so as to minimize the magnitude of the loss function (2050) based on a loss function (2050, see FIG. 20) that compares a training target image (1920) and a training reproduction image (2040).
[0318] In one embodiment of the present disclosure, FIG. 18 illustrates a plurality of steps for training an artificial intelligence model to infer a training hologram pattern (2020) by receiving a training target image (1920) as input based on a loss function (2050) that compares a training target image (1920) and a training reproduction image (2040).
[0319] At this time, the artificial intelligence model trained to infer a training hologram pattern (2020) by receiving a training target image (1920) as input may be the second artificial intelligence model included in the second image generation module (154). Below, the operation of training the second artificial intelligence model will be described later in FIGS. 20 and 21.
[0320] However, the present disclosure is not limited thereto, and the operation of training an artificial intelligence model included in a hologram pattern generation module (152) may further include a plurality of steps of training an artificial intelligence model to infer a training target image (1920) by receiving a training view image (1900) as input.
[0321] At this time, the artificial intelligence model trained to infer a training target image (1920) by receiving a training view image (1900) as input may be the first artificial intelligence model included in the first image generation module (153). Below, the operation of training the first artificial intelligence model will be described later in FIG. 19.
[0322] FIG. 19 is a diagram illustrating the operation of training a first artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0323] Referring to FIGS. 18 and 19, in one embodiment of the present disclosure, FIG. 19 illustrates a training view image (1900), a first image generation module (1910), a training target image (1920), an optical propagation module (1930), a training propagation image (1940), and a loss function (1950). In one embodiment of the present disclosure, the loss function (1950) may refer to a loss function model including the loss function (1950).
[0324] In one embodiment of the present disclosure, an electronic device (100) can acquire a training target image (1920) from a training view image (1900) through a first image generation module (1910). The first image generation module (1910) may include a first artificial intelligence model that receives the training view image (1900) as input and infers the training target image (1920).
[0325] In one embodiment of the present disclosure, the electronic device (100) can acquire a training propagation image (1940) from a training target image (1920) through an optical propagation module (1930). The optical propagation module (1930) may include a forward propagation algorithm.
[0326] The electronic device (100) can acquire a training radio wave image (1940) in which a training target image (1920) is optically propagated from the diffusion layer (130) to the location of a holographic image (400) through the optical radio wave module (1930).
[0327] In one embodiment of the present disclosure, a loss function (1950) for comparing a training view image (1900) and a training propagation image (1940) may have a larger value as the difference between the training view image (1900) and the training propagation image (1940) increases. The loss function (1950) may have a smaller value as the difference between the training view image (1900) and the training propagation image (1940) decreases.
[0328] Hereinafter, the loss function (1950) for comparing the training view image (1900) and the training propagation image (1940) may be referred to as the first loss function (1950) for convenience of explanation.
[0329] In one embodiment of the present disclosure, the electronic device (100) may update the weights of the first artificial intelligence model to minimize the value of the first loss function (1950). The electronic device (100) may update the weights of the first artificial intelligence model to train the first artificial intelligence model to infer a training target image (1920) such that the difference between the training propagation image (1940) obtained by receiving the training view image (1900) as input and propagating light through the optical propagation module (1930) to the location of the holographic image (400) and the training view image (1900) can be minimized.
[0330] FIG. 20 is a diagram illustrating the operation of training a second artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure. FIG. 21 is a diagram illustrating the operation of training a second artificial intelligence model included in a hologram pattern generation module according to one embodiment of the present disclosure.
[0331] Referring to FIG. 18 and FIG. 20, in one embodiment of the present disclosure, FIG. 20 illustrates a training target image (2000), a second image generation module (2010), a training hologram pattern (2020), an optical propagation module (2030), a training reconstructed image (2040), and a loss function (2050). In one embodiment of the present disclosure, the loss function (2050) may refer to a loss function model including the loss function (2050).
[0332] In one embodiment of the present disclosure, the electronic device (100) can acquire a training hologram pattern (2020) from a training target image (2000) through a second image generation module (2010). The second image generation module (2010) may include a second artificial intelligence model that receives the training target image (2000) as input and infers the training hologram pattern (2020).
[0333] At this time, the training target image (2000) may be obtained from the training view image (1900) through the first image generation module (1910) shown in FIG. 19.
[0334] In one embodiment of the present disclosure, the size of the domain of the training hologram pattern (2020) obtained through the second image generation module (2010) may be the same as the size of the domain of the training target image (2000). In this case, "domain" may refer to a spatial area in which each image is displayed. The domain may refer to an area in which each image is displayed.
[0335] Referring to FIG. 20 and FIG. 21, in one embodiment of the present disclosure, FIG. 21 shows a training target image (2000), an initial holographic pattern (2100), a masking pattern (2110), a training holographic pattern (2020), and a training reproduction image (2040).
[0336] In one embodiment of the present disclosure, the initial hologram pattern (2100) may be an image obtained by performing backpropagation from the diffusion layer (130) to the sub-space optical modulator with respect to the training target image (2000) through the second image generation module (2010). However, the present disclosure is not limited thereto, and in the initial stage of learning, the initial hologram pattern (2100) may be a randomly generated pattern having a domain of the same size as the domain of the training reproduction image (2040).
[0337] At this time, the backpropagation algorithm included in the second image generation module (2010) may be an algorithm that performs backpropagation while maintaining the same domain size (e.g., angular spectrum method). The domain size of the initial hologram pattern (2100) may be the same as the domain size of the training target image (2000).
[0338] In one embodiment of the present disclosure, the size of the domain of the masking pattern (2110) may be the same as the size of the domain of the initial hologram pattern (2100). The masking pattern (2110) may include a transparent region (2111) and a masking region (2112).
[0339] In one embodiment of the present disclosure, the transmission area (2111) may overlap with the display area (116, see FIG. 5) of the subspace optical modulator. The area of the transmission area (2111) may be the same as the area of the display area (116) of the subspace optical modulator.
[0340] In one embodiment of the present disclosure, the masking area (2112) may be adjacent to the transmission area (2111).
[0341] In one embodiment of the present disclosure, in the transmission area (2111), data of the initial hologram pattern (2100) corresponding to the area may pass through as is. In the masking area (2112), information or data of the initial hologram pattern (2100) corresponding to the area may be masked and not transmitted.
[0342] In one embodiment of the present disclosure, a second image generation module (2010) can generate an initial hologram pattern (2100) from a training target image (2000). The initial hologram pattern (2100) may be an image obtained by backpropagating the training target image (2000) while maintaining the domain size.
[0343] In one embodiment of the present disclosure, the second image generation module (2010) can obtain a training hologram pattern (2020) by multiplying an initial hologram pattern (2100) by a masking pattern (2110).
[0344] In one embodiment of the present disclosure, the training hologram pattern (2020) may include a first effective area (2021) and a non-effective area (2022).
[0345] In one embodiment of the present disclosure, the first effective region (2021) may be an area that overlaps with the transmission region (2111) of the initial hologram pattern (2100). The first effective region (2021) may overlap with the display area (116, see FIG. 5) of the subspace optical modulator. The area of the first effective region (2021) may be the same as the area of the display area (116) of the subspace optical modulator.
[0346] In one embodiment of the present disclosure, the first effective area (2021) may include the amount of data included in the area overlapping with the transmission area (2111) of the initial hologram pattern (2100) as is.
[0347] In one embodiment of the present disclosure, the non-effective region (2022) may be adjacent to the first effective region (2021). The non-effective region (2022) may be an area that overlaps with the masking region (2112) of the initial hologram pattern (2100).
[0348] In one embodiment of the present disclosure, in the non-valid area (2022), the amount of data included in the area overlapping with the masking area (2112) of the initial hologram pattern (2100) may be masked and not transmitted. The amount of data included in the non-valid area (2022) may have a value of "0".
[0349] In one embodiment of the present disclosure, FIG. 21 illustrates a step in which a second image generation module (2010) obtains an initial hologram pattern (2100) from a training target image (2000) and obtains a training hologram pattern (2020) using a masking pattern (2110), but the present disclosure is not limited thereto.
[0350] Of course, the second image generation module (2010) may also perform the operation of acquiring a training hologram pattern (2020) using an initial hologram pattern (2100) and a masking pattern (2110) from a training target image (2000).
[0351] In one embodiment of the present disclosure, an electronic device (100) can acquire a training reproduction image (2040) from a training hologram pattern (2020) through an optical propagation module (2030). The optical propagation module (2030) may include a forward propagation algorithm. The forward propagation algorithm included in the optical propagation module (2030) may be an algorithm that performs forward propagation while maintaining the same domain size (e.g., an angular spectrum method).
[0352] In one embodiment of the present disclosure, the electronic device (100) can obtain a training reproduction image (2040) in which an image generated by providing coherent light (200) to a subspace light modulator displaying a training hologram pattern (2020) through a light propagation module (2030) is light propagated to a diffusion layer (130).
[0353] In one embodiment of the present disclosure, the loss function (2050) for comparing a training target image (2000) and a training reproduction image (2040) of an electronic device (100) may have a larger value as the difference between the training target image (2000) and the training reproduction image (2040) increases. The loss function (2050) may have a smaller value as the difference between the training target image (2000) and the training reproduction image (2040) decreases.
[0354] Hereinafter, the loss function (2050) for comparing the training target image (2000) and the training reproduction image (2040) may be referred to as the second loss function (2050) for convenience of explanation.
[0355] In one embodiment of the present disclosure, the electronic device (100) may update the weights of the second artificial intelligence model to minimize the value of the second loss function (2050). The electronic device (100) may update the weights of the second artificial intelligence model to train the second artificial intelligence model to infer a training hologram pattern (2020) such that the difference between the training reproduction image (2040) obtained by receiving the training target image (2000) as input and transmitting light through the optical propagation module (2030) to the location of the diffusion layer (130) and the training target image (2000) can be minimized.
[0356] In one embodiment of the present disclosure, through a process of training a second artificial intelligence model using a second loss function (2050), the second artificial intelligence model may be trained to infer a training hologram pattern (2020) that receives a training target image (2000) as input, has a domain of the same size as the domain of the training target image (2000), includes a data amount in the first valid region (2021), and does not include a data amount in the non-valid region (2022) (e.g., has a value of "0"). At this time, the training hologram pattern (2020) may be a pattern for providing the training target image (2000) on the diffusion layer (130) as it is provided with coherent light (200) and transmitted as light.
[0357] Through this, the second artificial intelligence model can be trained using an algorithm that performs forward and backpropagation while maintaining the same domain size.
[0358] Additionally, the second artificial intelligence model can be trained such that the difference between the training reproduction image (2040) and the training target image (2000) obtained by optical propagation is small, and an appropriate amount of data is included within a first valid area (2021) having a domain smaller than the domain size of the training reproduction image (2040).
[0359] In one embodiment of the present disclosure, the learning process of the first artificial intelligence model and the second artificial intelligence model included in the hologram pattern generation module (152) shown in FIGS. 18 to 21 may be performed on an external electronic device or an external server.
[0360] In one embodiment of the present disclosure, an electronic device (100) may acquire a pre-learned first artificial intelligence model and a second artificial intelligence model or a pre-updated weight through a communication interface (180) and use them as a hologram pattern generation module (152).
[0361] Additionally, the electronic device (100) may be used as a hologram pattern generation module (152) by performing transfer learning or fine-turning on the acquired first artificial intelligence model and second artificial intelligence model.
[0362] Referring to FIGS. 2, FIGS. 4, FIGS. 17 and FIGS. 20, in one embodiment of the present disclosure, an electronic device (100) can display a holographic pattern (1620) obtained through a second image generation module (154) including a second artificial intelligence model that has been pre-learned through the process on a sub-space light modulator.
[0363] At this time, the hologram pattern (1620) may refer to a pattern included in the first valid area among the patterns obtained through the second image generation module (154). That is, the electronic device (100) may display the pattern of the area containing a meaningful amount of data among the patterns obtained through the second image generation module (154) as the hologram pattern (1620) on the sub-space optical modulator.
[0364] In one embodiment of the present disclosure, an image that is optically propagated in a direction other than a direction parallel to the second direction (20) among the reconstructed images generated in a subspace light modulator can be reflected by two reflection layers (140) and transmitted to a diffusion layer (130).
[0365] The holographic pattern (1620) displayed on the subspace light modulator may be a pattern optimized to provide a holographic image (400) for a reproduction image provided on a diffusion layer (130) having an area wider than the display area (116) of the subspace light modulator.
[0366] In one embodiment of the present disclosure, a plurality of reconstructed images (300) are transmitted to a diffusion layer (130) as they are optically propagated from a plurality of subspace light modulators (111), and a holographic image (400) in which the plurality of reconstructed images (300) are optically propagated from the diffusion layer (130) may be provided to a user (500).
[0367] By doing so, the electronic device (100) of the present disclosure can display a plurality of holographic patterns on a spatial light modulator (110) including a plurality of sub-spatial light modulators (111), and by transmitting a plurality of reconstructed images (300) provided from the spatial light modulator (110) to a diffusion layer (130) through two reflection layers (140), a large area holographic screen for displaying a holographic image (400) without including a bezel area can be realized.
[0368] Additionally, the electronic device (100) of the present disclosure can obtain a holographic pattern through a holographic pattern generation module (152) that takes into account the reconstructed image provided from sub-space light modulators (111) being optically propagated and transmitted to a diffusion layer (130) as the domain size increases.
[0369] Accordingly, the electronic device (100) of the present disclosure can provide a user (500) with a wide viewing angle and a holographic image (400) containing a large amount of data.
[0370] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood from the present disclosure by those skilled in the art to which the present disclosure pertains.
[0371] In order to solve the technical problem described above, an electronic device is provided in one embodiment of the present disclosure. The electronic device may include a spatial light modulator comprising a plurality of sub-spatial light modulators (SLMs) arranged in a first direction. The electronic device may include a coherent light source that provides coherent light. The electronic device may include a diffusion layer that is spaced apart from the spatial light modulator in a second direction orthogonal to the first direction and diffuses a plurality of reconstructed images obtained from the spatial light modulator. The electronic device may include two reflection layers that extend in the second direction and are spaced apart from each other in a first direction between the spatial light modulator and the diffusion layer, and reflect a plurality of reconstructed images provided from the spatial light modulator to provide to the diffusion layer. The electronic device may include at least one processor that displays a plurality of holographic patterns through the spatial light modulator and provides a holographic image corresponding to a plurality of reconstructed images generated by providing coherent light to the spatial light modulator through a coherent light source.
[0372] In one embodiment of the present disclosure, the diffusion layer can transmit a plurality of acquired reconstructed images in a first direction and diffuse them in a third direction orthogonal to each of the first direction and the second direction.
[0373] In one embodiment of the present disclosure, the diffusion layer may include a plurality of diffusion patterns arranged in a third direction orthogonal to each of the first direction and the second direction.
[0374] In one embodiment of the present disclosure, a coherent light source may include a plurality of subcoherent light sources. An electronic device may provide coherent light to each of a plurality of subspace light modulators through the plurality of subcoherent light sources.
[0375] In one embodiment of the present disclosure, each of the plurality of subspace optical modulators may include a display area on which a holographic pattern is displayed and a bezel area adjacent to the display area. The plurality of subspace optical modulators are arranged along a plurality of lines, and the plurality of lines may include a first line extending in a first direction and a second line extending in a first direction and spaced apart from the first line in a second direction. The plurality of subspace optical modulators may be arranged such that the display area of a first subspace optical modulator arranged on the first line and the bezel area of a second subspace optical modulator arranged on the second line, adjacent to the first subspace optical modulator, overlap in a second direction.
[0376] In one embodiment of the present disclosure, the spatial optical modulator may further include a plurality of sub-spatial optical modulators arranged in a third direction orthogonal to each of the first direction and the second direction.
[0377] In one embodiment of the present disclosure, the first length in the first direction of the spatial light modulator and the second length in the first direction of the diffusion layer may be the same. Two reflection layers may be located on both sides of the spatial light modulator and on both sides of the diffusion layer and arranged to face each other.
[0378] In one embodiment of the present disclosure, an electronic device may acquire a plurality of view images corresponding to a plurality of views corresponding to a plurality of sub-space optical modulators. The electronic device may acquire a plurality of holographic patterns by applying the plurality of view images to a holographic pattern generation module. The holographic pattern generation module may include an artificial intelligence model trained to infer a plurality of holographic patterns, wherein a plurality of reconstructed images obtained from a plurality of holographic patterns corresponding to the plurality of view images are provided as holographic images through a diffusion layer.
[0379] In one embodiment of the present disclosure, a trained artificial intelligence model may acquire a training target image provided to a diffusion layer based on a training view image obtained by capturing an object in one view. Based on the training target image, the trained artificial intelligence model may acquire a training hologram pattern displayed on a subspatial optical modulator corresponding to one view. The trained artificial intelligence model may acquire a training reproduction image reproduced through the training hologram pattern. The trained artificial intelligence model may be an artificial intelligence model trained using a loss function that compares the training target image and the training reproduction image. The training hologram pattern may include a first effective region that overlaps with the display area of the subspatial optical modulator and a non-effective region adjacent to the first effective region. The training reproduction image may include a second effective region that overlaps with the first effective region and the non-effective region.
[0380] In one embodiment of the present disclosure, the non-valid region of the training hologram pattern may have a value of "0".
[0381] In order to solve the technical problem described above, in one embodiment of the present disclosure, a method of operating an electronic device may be provided. The method of operating an electronic device may include the step of displaying a plurality of holographic patterns through a spatial light modulator comprising a plurality of sub-spatial light modulators (SLMs) arranged in a first direction. The method of operating an electronic device may include the step of providing a holographic image corresponding to a plurality of reconstructed images generated by providing coherent light to the spatial light modulator through a coherent light source. The electronic device may include a diffusion layer disposed spaced apart from the spatial light modulator in a second direction orthogonal to the first direction and diffusing a plurality of reconstructed images obtained from the spatial light modulator. The electronic device may include two reflection layers that extend in the second direction and are disposed spaced apart from each other in a first direction between the spatial light modulator and the diffusion layer, and reflect a plurality of reconstructed images provided from the spatial light modulator to provide to the diffusion layer.
[0382] In one embodiment of the present disclosure, the step of providing coherent light may include providing coherent light to each of a plurality of subspace light modulators through a plurality of sub-coherent light sources included in a coherent light source.
[0383] In one embodiment of the present disclosure, a method of operating an electronic device may include the step of acquiring a plurality of view images corresponding to a plurality of views corresponding to a plurality of sub-space optical modulators. A method of operating an electronic device may further include the step of acquiring a plurality of holographic patterns by applying the plurality of view images to a holographic pattern generation module. The holographic pattern generation module may include an artificial intelligence model trained to infer a plurality of holographic patterns, wherein a plurality of reconstructed images acquired from a plurality of holographic patterns corresponding to the plurality of view images are provided as holographic images through a diffusion layer.
[0384] In one embodiment of the present disclosure, a method for training an artificial intelligence model may include the step of acquiring a training target image provided to a diffusion layer based on a training view image acquired by capturing an object in one view. A method for training an artificial intelligence model may include the step of acquiring a training hologram pattern displayed on a subspatial light modulator corresponding to one view based on the training target image. A method for training an artificial intelligence model may include the step of acquiring a training reproduction image reproduced through the training hologram pattern. A method for training an artificial intelligence model may include the step of training an artificial intelligence model using a loss function that compares the training target image and the training reproduction image.
[0385] In order to solve the aforementioned technical problem, a computer-readable recording medium may be provided on which a program for performing at least one method of an embodiment of the method of operating an electronic device disclosed in the present disclosure is recorded on a computer.
[0386] A program executed by an electronic device described in this disclosure may be implemented by hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.
[0387] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively.
[0388] Software can be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable recording media include magnetic storage media (e.g., ROM (read-only memory), RAM (random-access memory), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). Computer-readable recording media can be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. The recording medium is readable by a computer, stored in memory, and can be executed by a processor.
[0389] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.
[0390] In addition, the program according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.
[0391] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) that is distributed electronically through a manufacturer of an electronic device or an electronic market (e.g., Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer of the electronic device, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.
[0392] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, appropriate results can be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or module are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.
Claims
1. A spatial light modulator (110) comprising a plurality of sub-spatial light modulators (SLM, 111) arranged in a first direction; A coherent light source (120) that provides coherent light; A diffusion layer (130) spaced apart from the spatial light modulator (110) in a second direction orthogonal to the first direction and diffusing a plurality of reconstructed images obtained from the spatial light modulator (110); Two reflection layers (140) that are extended in the second direction and spaced apart from each other in the first direction between the spatial light modulator (110) and the diffusion layer (130), and reflect at least one of the plurality of reproduction images provided from the spatial light modulator (110) to provide the at least one reflected reproduction image among the plurality of reproduction images to the diffusion layer (130); and An electronic device (100) comprising at least one processor that displays a plurality of holographic patterns through the spatial light modulator (110) and provides the spatial light modulator (110) with the coherent light through the coherent light source (120) to provide a holographic image corresponding to the plurality of reconstructed images generated by the plurality of holographic patterns and the coherent light.
2. In Paragraph 1, The above diffusion layer (130) is an electronic device (100) that transmits the acquired plurality of reproduced images in the first direction and diffuses them in a third direction orthogonal to each of the first direction and the second direction.
3. In either Paragraph 1 or Paragraph 2, The above diffusion layer (130) is an electronic device (100) comprising a plurality of diffusion patterns arranged in a third direction orthogonal to each of the first direction and the second direction.
4. In any one of paragraphs 1 to 3, The above-mentioned coherent light source (120) includes a plurality of sub-coherent light sources, and The above electronic device (100) is, An electronic device (100) that provides the coherent light to each of the plurality of subspace light modulators (111) through the plurality of subcoherent light sources.
5. In any one of paragraphs 1 through 4, Each of the above plurality of subspace light modulators (111) includes a display area where a holographic pattern is displayed and a bezel area adjacent to the display area, and The plurality of subspace optical modulators (111) are arranged along a plurality of lines, wherein the plurality of lines include a first line extended in the first direction and a second line extended in the first direction and spaced apart from the first line in the second direction. An electronic device (100) arranged such that the display area of a first subspace optical modulator placed on the first line and the bezel area of a second subspace optical modulator placed on the second line adjacent to the first subspace optical modulator overlap in the second direction.
6. In any one of paragraphs 1 through 5, The above spatial light modulator (110) is, An electronic device (100) further comprising a plurality of subspace optical modulators arranged in a third direction orthogonal to each of the first direction and the second direction.
7. In any one of paragraphs 1 through 6, The first length in the first direction of the spatial light modulator (110) and the second length in the first direction of the diffusion layer (130) are the same, and The two reflective layers (140) are located on both sides of the spatial light modulator (110) and on both sides of the diffusion layer (130) and are arranged to face each other in an electronic device (100).
8. In any one of paragraphs 1 through 6, The above electronic device (100) is, A plurality of view images corresponding to a plurality of views corresponding to a plurality of subspace optical modulators (111) are obtained, and By applying the above plurality of view images to a hologram pattern generation module, the above plurality of hologram patterns are obtained, and The above hologram pattern generation module is an electronic device (100) that includes an artificial intelligence model trained to infer the plurality of hologram patterns by receiving the plurality of view images as inputs.
9. In Paragraph 8, The above-mentioned trained artificial intelligence model is, Based on a training view image obtained by capturing an object from one view, a training target image provided to the diffusion layer (130) is obtained, and Based on the above training target image, a training hologram pattern displayed on a sub-space light modulator corresponding to one view is obtained, and A training reproduction image reproduced through the above training hologram pattern is obtained, and It is an artificial intelligence model trained based on a loss function that compares the above-mentioned training target image and the above-mentioned training reproduction image, and The above training hologram pattern includes a first effective region that overlaps with the display area of the subspace optical modulator and a non-effective region adjacent to the first effective region, and The above training reproduction image is an electronic device (100) comprising a first effective area and a second effective area that overlaps with the non-effective area.
10. In Paragraph 9, The non-valid area of the above training hologram pattern is an electronic device (100) having a value of "0".
11. In the method of operating the electronic device (100), Step (S100) of displaying a plurality of holographic patterns through a spatial light modulator (110) comprising a plurality of sub-spatial light modulators (SLM, 111) arranged in a first direction; and The method includes the step of providing coherent light to the spatial light modulator (110) through a coherent light source (120) (S200) to provide a holographic image corresponding to the plurality of holographic patterns and the plurality of reconstructed images generated by the coherent light. The above electronic device (100) is, A method of operation of an electronic device (100) comprising: a diffusion layer (130) which is spaced apart from the spatial light modulator (110) in a second direction orthogonal to the first direction and diffuses the plurality of reconstructed images obtained from the spatial light modulator (110); and two reflection layers (140) which are extended in the second direction and spaced apart from each other in the first direction between the spatial light modulator (110) and the diffusion layer (130), and which reflect at least one of the plurality of reconstructed images provided from the spatial light modulator (110) to provide the at least one reconstructed image among the plurality of reconstructed images to the diffusion layer (130).
12. In Paragraph 11, The above-mentioned diffusion layer (130) transmits the acquired plurality of reproduced images in the first direction and diffuses them in a third direction orthogonal to each of the first direction and the second direction, in a method of operation of an electronic device (100).
13. In either Article 11 or Article 12, The step (S200) of providing the above-mentioned coherent light is, A method of operation of an electronic device (100) comprising the step of providing the coherent light to each of the plurality of sub-space light modulators (111) through a plurality of sub-coherent light sources included in the above coherent light source (120).
14. In any one of paragraphs 11 through 13, Each of the above plurality of subspace light modulators (111) includes a display area where a holographic pattern is displayed and a bezel area adjacent to the display area, and The plurality of subspace optical modulators (111) are arranged along a plurality of lines, wherein the plurality of lines include a first line extended in the first direction and a second line extended in the first direction and spaced apart from the first line in the second direction. A method of operation of an electronic device (100) in which a display area of a first subspace optical modulator placed on the first line and a bezel area of a second subspace optical modulator placed on the second line adjacent to the first subspace optical modulator are arranged to overlap in the second direction.
15. A computer-readable recording medium having a program recorded thereon for performing the method of operation described in any one of paragraphs 11 through 14 on a computer.