Electronic device and operating method of electronic device

Abstract

This electronic device comprises: a spatial light modulator; a plurality of light sources, each providing coherent light to the spatial light modulator; an optical layer, which includes an optical filter and receives a holographic image reproduced by the spatial light modulator; a memory; and at least one processor, wherein the at least one processor executes at least one instruction stored in the memory so that the electronic device can control: each of the plurality of light sources such that coherent light is sequentially provided to the spatial light modulator; the spatial light modulator such that a holographic image corresponding to any one light source providing coherent light from among the plurality of light sources is displayed; and the optical filter such that a filtering pattern for filtering a signal component included in a generated image reproduced on the basis of the holographic image and the coherent light is included.

Description

Electronic devices and methods of operating electronic devices

[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, the present disclosure relates to an electronic device that provides holographic content and a method of operating the electronic device.

[0002] With the advancement of electronic device technology, various electronic devices that provide users with content such as videos and images are being developed and distributed.

[0003] As electronic devices advance, the types of images they display have diversified. Devices capable of displaying not only two-dimensional images but also three-dimensional images are being developed.

[0004] Recently, among electronic devices that provide three-dimensional images, holographic display devices that provide holographic content using a spatial light modulator (SLM) and a coherent light source are being developed.

[0005] One embodiment of the present disclosure provides an electronic device. The electronic device may include a spatial light modulator (SLM). The electronic device may include a plurality of light sources, each of which provides coherent light to the spatial light modulator. The electronic device may include an optical filter and an optical layer that receives a holographic image reproduced by the spatial light modulator. The electronic device may include a memory storing at least one instruction. The electronic device may include at least one processor including a processing circuit. The electronic device may control each of the plurality of light sources to sequentially provide coherent light to the spatial light modulator by having the at least one processor individually or collectively execute at least one instruction stored in the memory. The electronic device may control the spatial light modulator to display a holographic image corresponding to any one of the plurality of light sources that provides coherent light by having the at least one processor execute at least one instruction stored in the memory. By having at least one processor execute at least one instruction stored in a memory, the electronic device can control an optical filter to include a filtering pattern for filtering a signal component included in a holographic image and a generated image reconstructed based on coherent light.

[0006] One embodiment of the present disclosure provides a method of operating an electronic device. The method of operating the electronic device may include a step of sequentially providing coherent light to a spatial light modulator (SLM) through each of a plurality of light sources. The method of operating the electronic device may include a step of displaying a holographic image corresponding to one of the light sources providing coherent light through the spatial light modulator. The method of operating the electronic device may include a step of controlling an optical filter provided with a reconstructed holographic image from the spatial light modulator to include a filtering pattern for filtering a signal component included in a generated image reconstructed based on the holographic image and the coherent light.

[0007] As one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one method of the method of operating the disclosed electronic device on a computer may be provided.

[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0009] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.

[0010] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0011] FIG. 2 is a drawing for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0012] FIG. 3 is a flowchart illustrating a method of operating an electronic device including a plurality of light sources according to one embodiment of the present disclosure.

[0013] FIG. 4 is a flowchart illustrating an operation method of an electronic device in which each of a plurality of light sources includes a plurality of sub-light sources according to one embodiment of the present disclosure.

[0014] FIG. 5 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image according to one embodiment of the present disclosure.

[0015] FIG. 6 is a drawing for explaining a filtering pattern for filtering one order of diffracted light included in each of a plurality of light components included in a generated image according to one embodiment of the present disclosure.

[0016] FIG. 7 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image according to one embodiment of the present disclosure.

[0017] FIG. 8 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image reproduced by each of a plurality of sub-coherent light sources according to one embodiment of the present disclosure.

[0018] FIG. 9 is a flowchart illustrating an operation method for generating a holographic image according to one embodiment of the present disclosure.

[0019] FIG. 10 is a drawing for explaining an operation of generating a holographic image according to one embodiment of the present disclosure.

[0020] FIG. 11 is a flowchart illustrating an operation method for generating a sub-hologram image according to one embodiment of the present disclosure.

[0021] FIG. 12 is a drawing for explaining an operation of generating a sub-hologram image according to one embodiment of the present disclosure.

[0022] FIG. 13 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0023] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.

[0024] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.

[0025] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0026] Unless the context clearly indicates otherwise, the singular forms "a," "an," and "the" are to be understood to include plural referents. Thus, for example, the description "a constituent surface" may also include reference to one or more of such surfaces.

[0027] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0028] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.

[0029] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.

[0030] It should be understood that the blocks and combinations of flowcharts in each flowchart can be executed by one or more computer programs containing computer-executable instructions. The one or more computer programs may be stored entirely in a single memory, or may be stored in separate portions across multiple different memories.

[0031] All functions or operations described in this document may be performed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing, and may include circuitry such as an Application Processor (AP), a Communication Processor (CP), a Graphical Processing Unit (GPU), a Neural Processing Unit (NPU), a Microprocessor Unit (MPU), a System on Chip (SoC), or an Integrated Chip (IC).

[0032] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.

[0033] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0034] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0035] Referring to FIG. 1, in one embodiment of the present disclosure, an electronic device (100) may provide a user (200) with holographic content (124). Specifically, the holographic content (124) may be provided such that the user (200) may view different sides of an object included in the holographic content (124) depending on the position of the user (200) looking at the electronic device (100). In one embodiment of the present disclosure, the holographic content (124) may be an image that may provide a three-dimensional effect to the user (200) using the electronic device (100).

[0036] In one embodiment of the present disclosure, the electronic device (100) may be any type of electronic device that provides holographic content (124) to a user. In one embodiment of the present disclosure, the electronic device (100) may be implemented as any type and form of electronic device, such as a television, digital signage, a projector, a mobile device, a smart phone, a laptop computer, a tablet PC, a wearable device, or a head mounted display (HMD).

[0037] In one embodiment of the present disclosure, an electronic device (100) may include a spatial light modulator (SLM) 110, a plurality of light sources (120), and an optical layer (130).

[0038] In one embodiment of the present disclosure, an electronic device (100) may provide light (121) to a spatial light modulator (110) via a plurality of light sources (120). At this time, each of the plurality of light sources (120) may be a light source that generates coherent light. The electronic device (100) may control each of the plurality of light sources (120) to sequentially provide coherent light (121) to the spatial light modulator (110).

[0039] In one embodiment of the present disclosure, an electronic device (100) can generate a holographic image (111). The electronic device (100) can generate a plurality of holographic images each corresponding to a plurality of coherent lights sequentially provided by a plurality of light sources (120).

[0040] In one embodiment of the present disclosure, the electronic device (100) can control the spatial light modulator (110) to display a holographic image (111). The electronic device (100) can control the spatial light modulator (110) to display a holographic image (111) corresponding to any one of the plurality of light sources (120) that provides coherent light to the spatial light modulator (110). The electronic device (100) can sequentially display a plurality of holographic images by controlling the spatial light modulator (110) to correspond to the plurality of light sources (120) that sequentially provide coherent light (121).

[0041] In one embodiment of the present disclosure, a generated image (122) can be reproduced by a holographic image (111) displayed on a spatial light modulator (110) and coherent light (121) provided to the spatial light modulator (110). At this time, the generated image (122) can be an image that is optically propagated through an optical layer (130) and provided to a user (200) as holographic content (124).

[0042] In one embodiment of the present disclosure, the generated image (122) may be an image reproduced by coherent light (121) provided from any one of a plurality of light sources (120) that are sequentially provided, and any one of a plurality of holographic images (111) that are sequentially displayed on a light modulator (110) corresponding to the provided light source. The holographic content (124) may be a content provided to a user (200) by optically propagating a plurality of generated images reproduced by the plurality of light sources (120) and the plurality of holographic images over a plurality of frames.

[0043] In one embodiment of the present disclosure, the optical layer (130) may include a first lens (131), a second lens (133), a third lens (135), a fourth lens (136), a reflector (132), and an optical filter (134). However, the types and arrangements of the components included in the optical layer (130) are not limited thereto. It goes without saying that the types and arrangements of the components included in the optical layer (130) may vary depending on the arrangement, wavelength, and shape of the plurality of light sources (120), the type, shape, and arrangement of the spatial light modulator (110), etc.

[0044] In one embodiment of the present disclosure, the optical layer (130) may be provided with a generated image (122) reproduced from the spatial light modulator (110). However, the present disclosure is not limited thereto. Coherent light (121) sequentially provided from a plurality of light sources (120) may be provided to a reflector (132) through a first lens (131) included in the optical layer (130). The coherent light (121) provided to the reflector (132) may be provided toward the spatial light modulator (110).

[0045] In one embodiment of the present disclosure, a generated image (122) reproduced through a spatial light modulator (110) may be provided to an optical filter (134) through a second lens (133). In one embodiment of the present disclosure, the generated image (122) through the second lens (133) may be filtered by an optical filter (134) located at a first Fourier plane (300) of the second lens (133).

[0046] In one embodiment of the present disclosure, the generated image (122) may include a signal component and a noise component. The generated image (122) may include multiple orders of diffracted light. In this case, the signal component may be a diffracted light of any one order that is to be filtered through an optical filter (134) and provided to the user as holographic content (124). The noise component may be a diffracted light of a different order than the signal component.

[0047] In one embodiment of the present disclosure, the electronic device (100) can control the optical filter (134) to include a filtering pattern for filtering a signal component included in a generated image (122) that has passed through the second lens (133). In one embodiment of the present disclosure, the signal component of the generated image (122) provided to the optical filter (134) can pass through the filtering pattern, and the noise component can be blocked. Accordingly, the hologram content (124) provided to the user (200) can be provided by optically propagating only the signal component included in the generated image (122).

[0048] In one embodiment of the present disclosure, the filtered generated image (123) may be provided to the user (200) as holographic content (124) through the third lens (135) and the fourth lens (136).

[0049] In one embodiment of the present disclosure, the generated image (122) may be optically propagated through the second lens (133), the optical filter (134), the third lens (135), and the fourth lens (136) and provided as holographic content (124) on the second Fourier plane (310) of the fourth lens (136). The user (200) may view the holographic content (124) on the second Fourier plane (310).

[0050] In one embodiment of the present disclosure, at least one of the positions of each of the plurality of light sources (120) or the angles of incidence at which the coherent light (121) provided from each of the plurality of light sources (120) is provided to the spatial light modulator (110) may be different. The positions at which the plurality of generated images reproduced by the plurality of light sources (120) that sequentially provide the coherent light (121) to the spatial light modulator (110) and the plurality of hologram images respectively displayed corresponding to the plurality of light sources (120) are optically propagated and formed as images on the second Fourier plane (310) may be different. Accordingly, the electronic device (100) can provide the user (200) with hologram content (124) at a wide viewing angle.

[0051] In one embodiment of the present disclosure, each of the plurality of light sources (120) may include a plurality of sub-light sources (125, see FIG. 2) that provide a plurality of sub-coherent lights having different wavelengths.

[0052] In one embodiment of the present disclosure, a holographic image (111) may include a plurality of sub-holographic images each corresponding to a plurality of sub-coherent lights provided by a plurality of sub-light sources included in each light source.

[0053] In one embodiment of the present disclosure, the electronic device (100) can control the spatial light modulator (110) to provide a plurality of sub-light sources (125) included in one of the plurality of light sources (120) with a plurality of sub-coherent lights. The electronic device (100) can control the spatial light modulator (110) to display a holographic image (111) including a plurality of sub-holographic images corresponding to the plurality of sub-coherent lights included in the one of the plurality of light sources.

[0054] In one embodiment of the present disclosure, the generated image (122) may include a plurality of light components having different wavelengths. By each sub-coherent light having a wavelength provided to the spatial light modulator (110) and a sub-holographic image corresponding to each sub-coherent light, any one light component having a wavelength corresponding to each sub-coherent light among the plurality of light components included in the generated image (122) may be reproduced.

[0055] In one embodiment of the present disclosure, each of the plurality of optical components may include diffracted light of multiple orders. The electronic device (100) may control the optical filter (134) to include a filtering pattern for passing diffracted light of one order included in each of the plurality of optical components as a signal component and blocking diffracted light of the remaining orders.

[0056] In one embodiment of the present disclosure, the electronic device (100) can control the light filter (134) to sequentially include a plurality of filtering patterns corresponding to each of a plurality of sequentially displayed light sources (120). A plurality of generated images reproduced by the plurality of light sources (120) can be filtered with different filtering patterns. In this case, a single generated image (122) reproduced by a plurality of sub-light sources included in each light source can be filtered with the same filtering pattern.

[0057] In one embodiment of the present disclosure, the filtering pattern may be obtained in advance to filter out one order of diffracted light among the multiple orders of diffracted light included in each of the multiple light components included in the generated image (122). The multiple light components included in the filtered generated image (123) that has passed through the optical filter (134) may be images that each include only one order of diffracted light.

[0058] The generated image (123) filtered through the optical filter (134) including the filtering pattern according to one embodiment of the present disclosure is optically transmitted and provided to the user (200), and the holographic content (124) may include a plurality of optical components, each of which includes only one order of diffracted light. Accordingly, the electronic device (100) may provide the user (200) with clear and sharp holographic content (124) free of noise components. In addition, the electronic device (100) may provide the user (200) with color holographic content (124) composed of a plurality of wavelengths.

[0059] In one embodiment of the present disclosure, the electronic device (100) can generate a holographic image (111) by considering that only one order of diffracted light included in each of a plurality of light components of a generated image (122) is filtered as a signal component by an optical filter (134) including a filtering pattern. The electronic device (100) can generate an optimized holographic image (111) by considering that the generated image (122) is filtered by the optical filter (134) and optically propagated to a second Fourier plane (310) and provided to a user (200) as holographic content (124).

[0060] Accordingly, an electronic device (100) according to one embodiment of the present disclosure is optimized for an optical filter (134) and can provide holographic content (124) containing rich information to a user (200).

[0061] In one embodiment of the present disclosure, as the electronic device (100) controls a plurality of light sources (120) to sequentially provide coherent light to the spatial light modulator (110) to provide holographic content (124), a frequency at which one light source provides coherent light may be higher than a frequency of the holographic content (124) provided to the user (200). In addition, as the electronic device (100) controls the spatial light modulator (110) to sequentially display a plurality of holographic images corresponding to the sequentially provided coherent light, a frequency at which the spatial light modulator (110) displays the holographic image (111) may be higher than a frequency of the holographic content (124) provided to the user (200).

[0062] In one embodiment of the present disclosure, the spatial light modulator (110) may include a digital micro-mirror device. The digital micro-mirror device may display a holographic image (111) by using a plurality of reflective elements that reflect incident light. In one embodiment of the present disclosure, the digital micro-mirror device may display the holographic image (111) as “0” or “1.” Accordingly, the digital micro-mirror device may display a sub-holographic image corresponding to coherent light of a wavelength of any one of a plurality of sub-light sources included in one light source.

[0063] In one embodiment of the present disclosure, the electronic device (100) can control a plurality of sub-light sources included in each of the plurality of light sources (120) to sequentially provide sub-coherent light to the spatial light modulator (110).

[0064] In one embodiment of the present disclosure, the electronic device (100) can control the spatial light modulator (110) to sequentially display a plurality of sub-hologram images corresponding to each of a plurality of sub-coherent lights sequentially provided by a plurality of sub-light sources.

[0065] Hereinafter, the configuration and operation of the electronic device (100) will be described with reference to FIGS. 2 to 13.

[0066] FIG. 2 is a drawing for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0067] Referring to FIGS. 1 and 2, in one embodiment of the present disclosure, an electronic device (100) may include a spatial light modulator (110), a light source (120), an optical layer (130), a memory (140), at least one processor (150), an input / output interface (160), and a communication interface (170).

[0068] However, not all of the components illustrated in FIG. 2 are essential components. The electronic device (100) may be implemented with more components than those illustrated in FIG. 2. Furthermore, the electronic device (100) may also be implemented with fewer components than those illustrated in FIG. 2.

[0069] The spatial light modulator (110), light source (120), optical layer (130), memory (140), at least one processor (150), input / output interface (160), and communication interface (170) included in the electronic device (100) may be electrically and / or physically connected to each other, respectively.

[0070] In one embodiment of the present disclosure, the spatial light modulator (110) may be a device used to control the spatial distribution of light in a three-dimensional space. The spatial light modulator (110) may be a device that modulates at least one of the phase or amplitude of light provided to the spatial light modulator (110).

[0071] In one embodiment of the present disclosure, light provided to the spatial light modulator (110) may be transmitted through the spatial light modulator (110) and at least one of phase or amplitude may be modulated. In addition, light provided to the spatial light modulator (110) may be reflected by the spatial light modulator (110) and at least one of phase or amplitude may be modulated.

[0072] In one embodiment of the present disclosure, the spatial light modulator (110) may include a liquid crystal layer including liquid crystals (LC). The spatial light modulator (110) may modulate at least one of the phase or amplitude of light provided through anisotropy of the liquid crystals by adjusting the arrangement direction of the liquid crystals included in the liquid crystal layer. However, the present disclosure is not limited thereto. The spatial light modulator (110) may include a digital micro-mirror device including a plurality of reflective elements. The spatial light modulator (110) may modulate at least one of the phase or amplitude of light provided to the plurality of reflective elements by adjusting the angles of each of the plurality of reflective elements.

[0073] In one embodiment of the present disclosure, a spatial light modulator (110) may display a holographic image (111). The holographic image (111) may be a computer-generated hologram (CGH). In this case, a "computer-generated hologram" may be an image generated by numerically simulating the propagation of light. The computer-generated hologram may be an image calculated by simulating an interference pattern between a reference light and object light reflected from the reference light provided to an object.

[0074] In one embodiment of the present disclosure, displaying a holographic image (111) through a spatial light modulator (110) may mean changing the arrangement of liquid crystals included in the liquid crystal layer by applying a voltage corresponding to the holographic image (111) to the liquid crystal layer included in the spatial light modulator (110). In addition, it may mean changing the angles of a plurality of reflective elements constituting the spatial light modulator (110).

[0075] In one embodiment of the present disclosure, the light source (120) may refer to a light source that provides coherent light. In this case, the coherent light may be provided to the spatial light modulator (110) as reference light. In one embodiment of the present disclosure, the electronic device (100) may include a plurality of light sources (120). Hereinafter, for convenience of explanation, the light source (120) will be referred to as a plurality of light sources (120).

[0076] In one embodiment of the present disclosure, the plurality of light sources (120) may include lasers. The plurality of light sources (120) may provide coherent light to the spatial light modulator (110).

[0077] In one embodiment of the present disclosure, each of the plurality of light sources (120) may include a plurality of sub-light sources (125). Each of the plurality of sub-light sources (125) may refer to a light source that provides coherent light having different wavelengths.

[0078] In one embodiment of the present disclosure, when the light provided by each of the plurality of sub-light sources (125) is referred to as sub-coherent light, each of the plurality of sub-coherent lights may have a single wavelength and maintain a constant phase. Each of the plurality of sub-light sources (125) may be a laser that provides different sub-coherent light.

[0079] In one embodiment of the present disclosure, each of the plurality of sub-coherents may have different wavelengths for combining colors. In one embodiment of the present disclosure, each of the plurality of sub-coherents may have a wavelength corresponding to red, a wavelength corresponding to green, and a wavelength corresponding to blue. However, the present disclosure is not limited thereto, and each of the plurality of sub-coherents may have various combinations of wavelengths that can be combined with each other to express colors.

[0080] In one embodiment of the present disclosure, the optical layer (130) can receive a generated image (122) reproduced from a spatial light modulator (110). In one embodiment of the present disclosure, the optical layer (130) can receive a plurality of generated images reproduced corresponding to each of a plurality of light sources (120) from the spatial light modulator (110).

[0081] In one embodiment of the present disclosure, the optical layer (130) may include a lens unit (137) and an optical filter (134). The lens unit (137) may include a first lens (131), a second lens (133), a third lens (135), and a fourth lens (136). However, the present disclosure is not limited thereto, and the configuration, arrangement, shape, etc. of the lens unit (137) included in the optical layer (130) may vary in order to refract or diffract coherent light (121) or generated image (122) depending on the method by which the electronic device (100) provides holographic content (124). In addition, the optical layer (130) may include a reflector (132).

[0082] In one embodiment of the present disclosure, the optical filter (134) may include a liquid crystal layer including liquid crystals. At least one processor (150) may control the optical filter (134) to include a filtering pattern (530, see FIG. 5) by adjusting the arrangement direction of the liquid crystals included in the liquid crystal layer of the optical filter (134). However, the present disclosure is not limited thereto, and the optical filter (134) may include a plurality of openings that are physically turned on or off, and at least one processor (150) may control the plurality of openings to be turned on or off so as to include the filtering pattern (530).

[0083] In one embodiment of the present disclosure, the memory (140) may store instructions, data structures, and program codes that can be read by at least one processor (150). In one embodiment of the present disclosure, there may be more than one memory (140). Operations performed by the electronic device (100) may be implemented by at least one processor (150) executing instructions or codes of a program stored in the memory (140).

[0084] In one embodiment of the present disclosure, the memory (140) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a Mask ROM, a Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).

[0085] In one embodiment of the present disclosure, the memory (140) may not exist separately and may be configured to be included in at least one processor (150).

[0086] In one embodiment of the present disclosure, memory (140) may store instructions or program codes for performing functions or operations of the electronic device (100). Instructions, algorithms, data structures, program codes, and application programs stored in memory (140) may be implemented in a programming or scripting language such as, for example, C, C++, Java, Python, or an assembler.

[0087] In one embodiment of the present disclosure, various types of modules that can be used to perform operations of the electronic device (100) may be stored in the memory (140).

[0088] In one embodiment of the present disclosure, the memory (140) may store an image acquisition module (141), a hologram image generation module (142), a light source control module (143), a spatial light modulator control module (144), and an optical filter control module (145). However, not all of the modules illustrated in FIG. 2 are essential modules. The memory (140) may store more or fewer modules than the modules illustrated in FIG. 2.

[0089] In one embodiment of the present disclosure, a 'module' included in the memory (140) may mean a unit that processes a function or operation performed by at least one processor (150). The 'module' included in the memory (140) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.

[0090] In one embodiment of the present disclosure, the image acquisition module (141) may be configured with commands or program codes related to an operation or function of acquiring an input image to be reproduced as holographic content (124). The image acquisition module (141) may be configured with commands or program codes related to an operation or function of receiving an input image from an external server or peripheral electronic devices.

[0091] At least one processor (150) can acquire input images from external servers or peripheral electronic devices through an input / output interface (160) or a communication interface (170) by executing commands or program codes of an image acquisition module (141).

[0092] In one embodiment of the present disclosure, the holographic image generation module (142) may be configured with commands or program codes related to an operation or function of generating a holographic image (111).

[0093] In one embodiment of the present disclosure, the acquired input image may include information such as the location of the camera that captured the input image and the distance between the camera and an object included in the input image. The holographic image generation module (142) may include commands or program codes for acquiring depth information about the input image using information about the location of the camera that captured the input image and the distance between the camera and an object included in the input image.

[0094] However, the present disclosure is not limited thereto, and the hologram image generation module (142) may include commands or program codes for calculating a depth value of an object included in an input image by using binocular parallax included in adjacent frame images included in the input image based on the acquired input image.

[0095] In one embodiment of the present disclosure, the holographic image generation module (142) may include commands or program codes for generating a holographic image (111) by using the acquired input image, the acquired depth value, and information about the plurality of light sources (120). The holographic image generation module (142) may include commands or program codes for generating a holographic image (111) by back-light propagating the input image by the distance from the electronic device (100) to the depth value.

[0096] In one embodiment of the present disclosure, the holographic image generation module (142) may include commands or program codes for generating a plurality of sub-holographic images by using the acquired input image, the acquired depth value, and information about the plurality of sub-light sources (125).

[0097] In one embodiment of the present disclosure, at least one processor (150) can generate a holographic image (111) by executing commands or program codes of a holographic image generation module (142). At least one processor (150) can generate a plurality of sub-holographic images by executing commands or program codes of a holographic image generation module (142).

[0098] In one embodiment of the present disclosure, the holographic image generation module (142) may include an artificial intelligence model trained to infer a holographic image (111) or a sub-holographic image by receiving information on an input image, a depth value, and a plurality of sub-light sources as input.

[0099] In one embodiment of the present disclosure, an artificial intelligence model learned to infer a holographic image (111) or a sub-holographic image includes a CNN (Convolutional Neural Network), a U-net, a DNN (Deep Neural Network), an RNN (Recurrent Neural Network), a GAN (Generative Adversarial Network), a CGAN (Conditional Generative Adversarial Network), a DCGAN (Deep Convolutional Generative Adversarial Network), a VAE (Variational Auto Encoder), or a Diffusion model, and the artificial intelligence model in the present disclosure is not limited to the above-described examples.

[0100] At least one processor (150) can provide information on an input image, a depth value, and a plurality of sub-light sources as inputs to an artificial intelligence model included in a hologram image generation module (142), thereby generating a hologram image (111) or a sub-hologram image.

[0101] Hereinafter, the operation of the hologram image generation module (142) will be described later with reference to FIGS. 9 to 12.

[0102] In one embodiment of the present disclosure, the light source control module (143) may be configured with commands or program codes relating to operations or functions for controlling a plurality of light sources (120) and a plurality of sub-light sources (125) included in each of the plurality of light sources (120).

[0103] In one embodiment of the present disclosure, at least one processor (150) can control a plurality of light sources (120) and a plurality of sub-light sources (125) included in each of the plurality of light sources (120) by executing instructions or program codes of the light source control module (143).

[0104] In one embodiment of the present disclosure, when providing holographic content (124) to a user (200) at a first frequency, at least one processor (150) may control each of a plurality of light sources (120) to sequentially provide coherent light (121) to a spatial light modulator (110) at a second frequency. At this time, the second frequency may be a frequency greater than the first frequency.

[0105] In one embodiment of the present disclosure, the second frequency may be the product of the first frequency and the number of the plurality of light sources (120). When the plurality of light sources (120) are four and the first frequency is 60 Hz (hertz), the second frequency may be 240 Hz.

[0106] In one embodiment of the present disclosure, at least one processor (150) can control a plurality of sub-light sources (125) included in each light source of the spatial light modulator (110) to simultaneously provide a plurality of sub-coherent lights, or can control a plurality of sub-light sources (125) to sequentially provide a plurality of sub-coherent lights.

[0107] In one embodiment of the present disclosure, when controlling a plurality of sub-light sources (125) included in each light source in a spatial light modulator (110) to simultaneously provide a plurality of sub-coherent lights, at least one processor (150) can control the plurality of sub-light sources (125) included in each light source at a second frequency.

[0108] In one embodiment of the present disclosure, when controlling a plurality of sub-light sources (125) included in each light source in a spatial light modulator (110) to sequentially provide sub-coherent lights, at least one processor (150) can control each of the plurality of sub-light sources (125) included in each light source to a third frequency. At this time, the third frequency may be a frequency greater than the second frequency.

[0109] In one embodiment of the present disclosure, the third frequency may be the product of the second frequency and the number of sub-light sources (125). When the number of sub-light sources (125) included in each light source is three and the second frequency is 240 Hz, the third frequency may be 720 Hz.

[0110] However, the present disclosure is not limited thereto. At least one processor (150) may control the plurality of light sources (120) and the plurality of sub-light sources (125) at various frequencies depending on the frequency at which the electronic device (100) intends to provide holographic content (124), the number of the plurality of light sources (120), the number of the plurality of sub-light sources (125) included in each light source, the type of the spatial light modulator (110), the operating principle, etc.

[0111] In one embodiment of the present disclosure, the spatial light modulator control module (144) may be configured with commands or program codes relating to an operation or function of controlling the spatial light modulator (110) to display a generated holographic image (111).

[0112] In one embodiment of the present disclosure, at least one processor (150) can control the spatial light modulator (110) to display a holographic image (111) generated through the holographic image generation module (142) by executing instructions or program codes of the spatial light modulator control module (144).

[0113] In one embodiment of the present disclosure, at least one processor (150) can control the spatial light modulator (110) to sequentially display a holographic image (111) corresponding to the provided coherent light according to a plurality of light sources (120) that sequentially provide coherent light to the spatial light modulator (110).

[0114] In one embodiment of the present disclosure, when providing holographic content (124) to a user (200) at a first frequency, at least one processor (150) can control a spatial light modulator (110) at a second frequency to display a holographic image (111) corresponding to one light source that provides coherent light.

[0115] In one embodiment of the present disclosure, when a plurality of sub-light sources (125) included in each light source are controlled to simultaneously provide a plurality of sub-coherent lights, at least one processor (150) can control a spatial light modulator (110) at a second frequency to display a holographic image (111) including a plurality of sub-holographic images corresponding to the plurality of sub-light sources (125).

[0116] In one embodiment of the present disclosure, when a plurality of sub-light sources (125) included in each light source are controlled to sequentially provide sub-coherent lights, at least one processor (150) can control the spatial light modulator (110) at a third frequency to display a sub-hologram image corresponding to any one of the sub-light sources providing the sub-coherent lights.

[0117] However, the present disclosure is not limited thereto. In one embodiment of the present disclosure, when the spatial light modulator (110) is a digital micromirror device, at least one processor (150) can provide holographic content (124) to a user (200) through time-division driving of a plurality of light sources (120), a plurality of sub-light sources (125), and the spatial light modulator (110). In this case, it goes without saying that the plurality of light sources (120), the plurality of sub-light sources (125), and the spatial light modulator (110) may be driven at a higher frequency for time-division driving.

[0118] In one embodiment of the present disclosure, the optical filter control module (145) may be configured with instructions or program codes relating to an operation or function of controlling the optical filter (134) to include a filtering pattern (530).

[0119] In one embodiment of the present disclosure, at least one processor (150) can control the optical filter (134) to include a filtering pattern (530) by executing instructions or program codes of the optical filter control module (145). At least one processor (150) can control the optical filter (134) to include a filtering pattern (530) for passing a signal component included in each of a plurality of optical components included in a generated image (122) provided from the spatial light modulator (110) and blocking a noise component by executing instructions or program codes of the optical filter control module (145).

[0120] In one embodiment of the present disclosure, when a plurality of light sources (120) are controlled at a second frequency to sequentially provide coherent light (121) to a spatial light modulator (110), and the spatial light modulator (110) is controlled to update and display a holographic image (111) at the second frequency, a generated image (122) updated at the second frequency may be provided to an optical filter (134). In this case, at least one processor (150) may control the optical filter (134) at the second frequency so that a filtering pattern (530) corresponding to the updated generated image (122) is included.

[0121] In one embodiment of the present disclosure, when a plurality of sub-light sources (125) included in each light source are controlled at a second frequency to provide a plurality of sub-coherent lights to a spatial light modulator (110), and the spatial light modulator (110) is controlled to update and display a holographic image (111) including a plurality of sub-holographic images at the second frequency, a generated image (122) updated at the second frequency may be provided to the optical filter (134). In this case, at least one processor (150) may control the optical filter (134) at the second frequency so that a filtering pattern (530) corresponding to the updated generated image (122) is included.

[0122] In one embodiment of the present disclosure, even if a plurality of sub-light sources (125) included in each light source are controlled at a third frequency to sequentially provide a plurality of sub-coherent lights to a spatial light modulator (110), and the spatial light modulator (110) is controlled to update and display a sub-hologram image at the third frequency, a generated image (122) including a plurality of light components having different wavelengths that are updated at a second frequency can be provided to the optical filter (134). In this case, at least one processor (150) can control the optical filter (134) at the second frequency so that a filtering pattern (530) corresponding to the updated generated image (122) is included.

[0123] In one embodiment of the present disclosure, at least one processor (150) may be configured as one or more processors, which control a series of processes to allow the electronic device (100) to operate according to the embodiments described below.

[0124] In one embodiment of the present disclosure, at least one processor (150) may be configured as at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), a Digital Signal Processor (DSPs), a Digital Signal Processing Device (DSPDs), a Programmable Logic Device (PLDs), a Field Programmable Gate Array (FPGAs), a Communication Processor (CP), a Neural Processing Unit, or an artificial intelligence (AI) processor designed with a hardware structure specialized for learning and processing an artificial intelligence (AI) model, but is not limited thereto.

[0125] In one embodiment of the present disclosure, if one or more processors included in at least one processor (150) are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0126] In one embodiment of the present disclosure, at least one processor (150) may be configured as a circuit (Circuitry) such as a System on Chip (SoC) or an Integrated Circuit (IC).

[0127] In one embodiment of the present disclosure, at least one processor (150) can execute various types of modules stored in the memory (140). At least one processor (150) can execute at least one instruction constituting the various types of modules stored in the memory (140). By executing the program or at least one instruction stored in the memory (140), at least one processor (150) can process data according to predefined operation rules or artificial intelligence models.

[0128] In one embodiment of the present disclosure, at least one processor (150) may include multiple processors. In one embodiment of the present disclosure, at least one module among the multiple modules in the memory (140) may be executed by any one of the multiple processors. The remaining modules among the multiple modules stored in the memory (140) may be executed by other processors among the multiple processors.

[0129] In one embodiment of the present disclosure, the input / output interface (160) can receive at least one of image data or audio data from an external electronic device, etc., under the control of at least one processor (150). At least one processor (150) can obtain an input image from the external electronic device through the input / output interface (160).

[0130] In one embodiment of the present disclosure, the input / output interface (160) can perform input / output operations with an external electronic device using at least one of input / output methods including an HDMI port (High-Definition Multimedia Interface port), a DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-described input / output methods.

[0131] In one embodiment of the present disclosure, the communication interface (170) can perform data communication with an external server or an external electronic device under the control of at least one processor (150). The communication interface (170) can perform data communication with an external server or an external electronic device using at least one of data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.

[0132] In one embodiment of the present disclosure, at least one processor (150) may receive an input image from an external server or an external electronic device via a communication interface (170). At least one processor (150) may receive information about a preset filtering pattern from an external server or an external electronic device via the communication interface (170).

[0133] In one embodiment of the present disclosure, at least one processor (150) may receive parameters of a learned hologram image generation module (142) or a hologram image generation module from an external server or an external electronic device through a communication interface (170).

[0134] FIG. 3 is a flowchart illustrating a method of operating an electronic device including a plurality of light sources according to one embodiment of the present disclosure.

[0135] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S100) of sequentially providing coherent light (121) to a spatial light modulator (110) through each of a plurality of light sources (120).

[0136] In the step (S100) of sequentially providing coherent light, at least one processor (150) can control each of the plurality of light sources (120) to sequentially provide coherent light (121) to the spatial light modulator (110) by executing commands or program codes of the light source control module (143).

[0137] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S200) of displaying a holographic image (111) corresponding to one of a plurality of light sources (120) that provides coherent light (121) through a spatial light modulator (110).

[0138] In the step (S200) of displaying a holographic image (111), at least one processor (150) can control the spatial light modulator (110) to display a holographic image (111) corresponding to one of the light sources (120) that provides coherent light (121) by executing commands or program codes of the spatial light modulator control module (144).

[0139] Hereinafter, the hologram image (111) displayed on the spatial light modulator (110) will be described later with reference to FIGS. 9 and 10.

[0140] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S300) of controlling an optical filter (134) to include a filtering pattern (530, see FIG. 5) for filtering a signal component included in a generated image (122) reconstructed based on a holographic image (111) and coherent light (121).

[0141] In the step (S300) of controlling the optical filter (134), at least one processor (150) can control the optical filter (134) to include a filtering pattern (530) for filtering a signal component included in a generated image (122) reconstructed based on a holographic image (111) and coherent light (121) by executing commands or program codes of the optical filter control module (145).

[0142] Hereinafter, the filtering pattern (530) included in the light filter (134) will be described later with reference to FIGS. 4 and 5.

[0143] In one embodiment of the present disclosure, the method of operation of an electronic device (100) may be as shown in FIGS. 3 to 5, when the spatial light modulator (110) includes a liquid crystal layer.

[0144] That is, when a plurality of light sources (120) are each controlled to sequentially provide coherent light (121) to a spatial light modulator (110), a plurality of sub-light sources included in each light source may be controlled to provide a plurality of sub-coherent lights of different wavelengths together to the spatial light modulator (110), which may be an operating method of an electronic device (100).

[0145] The method of operation of the electronic device (100) may be a case where the spatial light modulator (110) is controlled to display a holographic image (111) including a plurality of sub-holographic images corresponding to a plurality of sub-coherent lights, corresponding to each light source providing coherent light (121).

[0146] In addition, the optical filter (134) may be a method of operating an electronic device (100) in which the optical filter (134) is controlled to include a filtering pattern (530) for filtering a signal component included in a plurality of optical components having different wavelengths included in a generated image (122) reproduced by each light source providing coherent light (121) and a corresponding holographic image (111).

[0147] In one embodiment of the present disclosure, steps S200 and S300 may be repeatedly performed as one of the plurality of light sources (120) is sequentially controlled to provide coherent light (121) to the spatial light modulator (110) in step S100.

[0148] FIG. 4 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image according to one embodiment of the present disclosure. FIG. 5 is a diagram for explaining a filtering pattern for filtering a diffracted light of one order included in each of a plurality of light components included in a generated image according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIG. 1 are given the same reference numerals, and redundant descriptions are omitted.

[0149] Referring to FIGS. 1, 2, 4 and 5, in one embodiment of the present disclosure, some of the configurations of the electronic device (100) are illustrated to explain the filtering pattern (530).

[0150] Hereinafter, in FIGS. 4 and 5, it is described that a plurality of sub-light sources (125) included in each light source are provided together to a spatial light modulator (110). In addition, it is described that the plurality of sub-light sources (125) include a red light source that provides sub-coherent light of a red wavelength, a green light source that provides sub-coherent light of a green wavelength, and a blue light source that provides sub-coherent light of a blue wavelength, respectively.

[0151] In FIG. 4, all of the coherent lights sequentially provided to the spatial light modulator (110) by the plurality of light sources (120) are illustrated for explanation purposes, but the plurality of light sources (120) can be controlled to sequentially perform this operation by providing the coherent light (121) to the spatial light modulator (110) using one light source by at least one processor (150).

[0152] In one embodiment of the present disclosure, any one of the plurality of light sources (120) may provide coherent light (121) to the spatial light modulator (110). At this time, each light source providing coherent light (121) may include a red light source, a green light source, and a blue light source, and the coherent light (121) may include sub-coherent light of a red wavelength, sub-coherent light of a green wavelength, and sub-coherent light of a blue wavelength.

[0153] In one embodiment of the present disclosure, coherent light (121) provided by each light source may be provided to a spatial light modulator (110) through a first lens (131) and a reflector (132). A generated image (122) may be reproduced and displayed by the coherent light (121) provided to the spatial light modulator (110) on which a holographic image (111) is displayed. At this time, the holographic image (111) may include three sub-holographic images corresponding to sub-coherent light of a red wavelength, sub-coherent light of a green wavelength, and sub-coherent light of a blue wavelength, respectively.

[0154] In one embodiment of the present disclosure, the generated image (122) may be provided to an optical filter (134) via a second lens (133). At this time, the optical filter (134) may include a filtering pattern (530).

[0155] Referring to FIGS. 4 and 5, in one embodiment of the present disclosure, FIG. 5 illustrates a region (400) including a light filter (134) of FIG. 4 and a plurality of light components included in a generated image (122) passing through the region (400), specifically a red light component (500), a green light component (510), and a blue light component (520), to explain a filtering pattern (530).

[0156] At this time, the red light component (500) may be a light component reproduced by the sub-coherent light of the red wavelength and the corresponding sub-hologram image, which may be optically propagated to the first Fourier plane (300, see FIG. 1) where the optical filter (134) is located. The green light component (510) may be a light component reproduced by the sub-coherent light of the green wavelength and the corresponding sub-hologram image, which may be optically propagated to the first Fourier plane (300). The blue light component (520) may be a light component reproduced by the sub-coherent light of the blue wavelength and the corresponding sub-hologram image, which may be optically propagated to the first Fourier plane (300).

[0157] In one embodiment of the present disclosure, a plurality of light components that are optically propagated to the first Fourier plane (300) may each include multiple orders of diffracted light due to diffraction in the spatial light modulator (110).

[0158] In one embodiment of the present disclosure, the filtering pattern (530) may be a pattern obtained to pass diffracted light of one order of each of the plurality of light components included in the generated image (122) as a signal component and block diffracted light of the remaining orders as noise components.

[0159] In one embodiment of the present disclosure, the filtering pattern (530) may be a pattern in which a first pattern (501) that passes diffracted light of one order of a red light component (500), a second pattern (511) that passes diffracted light of one order of a green light component (510), and a third pattern (521) that passes diffracted light of one order of a blue light component (520) all overlap.

[0160] In one embodiment of the present disclosure, the filtering pattern (530) may be determined within an area where the first pattern (501), the second pattern (511), and the third pattern (521) all overlap. The area of ​​the filtering pattern (530) may be smaller than the area of ​​the area where the first pattern (501), the second pattern (511), and the third pattern (521) all overlap.

[0161] In one embodiment of the present disclosure, the first pattern (501) may be a pattern that blocks the remaining orders of diffracted light of the red light component (500) (e.g., the 0th order DC noise component, the conjugated component of the signal component, the higher order diffracted light, etc.). The second pattern (511) may be a pattern that blocks the remaining orders of diffracted light of the green light component (510) (e.g., the 0th order DC noise component, the conjugated component of the signal component, the higher order diffracted light, etc.). The third pattern (521) may be a pattern that blocks the remaining orders of diffracted light of the blue light component (520) (e.g., the 0th order DC noise component, the conjugated component of the signal component, the higher order diffracted light, etc.).

[0162] In one embodiment of the present disclosure, the positions of the multiple orders of diffracted light included in the generated image (122) in the first Fourier plane (300) may be determined by at least one of the wavelengths of each of the multiple light sources (120), the type of the spatial light modulator (110), the operating method of the spatial light modulator (110), the arrangement between the multiple light sources (120) and the spatial light modulator (110), or the incident angle of the coherent light (121) provided to the spatial light modulator (110).

[0163] Accordingly, at least one processor (150) may determine a filtering pattern (530) that passes one order of diffracted light among the multiple orders of diffracted light included in the generated image (122) as a signal component and blocks the remaining orders of diffracted light as noise components by at least one of the wavelengths of each of the plurality of light sources (120), the type of the spatial light modulator (110), the operating method of the spatial light modulator (110), the arrangement between the plurality of light sources (120) and the spatial light modulator (110), or the incident angle of the coherent light (121) provided to the spatial light modulator (110).

[0164] In one embodiment of the present disclosure, the filtering pattern (530) may be obtained in advance by at least one of the wavelength of each of the plurality of light sources (120), the type of the spatial light modulator (110), the operating method of the spatial light modulator (110), the arrangement between the plurality of light sources (120) and the spatial light modulator (110), or the incident angle of the coherent light (121) provided to the spatial light modulator (110).

[0165] In one embodiment of the present disclosure, the positions of the multiple orders of diffracted light included in each of the red light component (500), the green light component (510), and the blue light component (520) in the first Fourier plane (300) may be determined by at least one of the wavelength of each of the plurality of sub-light sources (125), the type of the spatial light modulator, the arrangement between the plurality of sub-light sources (125) and the spatial light modulator, or the incident angles of the plurality of sub-coherent lights provided to the spatial light modulator.

[0166] Accordingly, at least one processor (150) can determine the filtering pattern (530) by at least one of the wavelength of each of the plurality of sub-light sources (125), the type of the spatial light modulator, the arrangement between the plurality of sub-light sources (125) and the spatial light modulator, or the incident angle of the plurality of sub-coherent lights provided to the spatial light modulator.

[0167] At this time, the filtering pattern (530) may be a pattern that passes one order of diffracted light among multiple orders of diffracted light of each of multiple light components having different wavelengths included in the generated image (122) as a signal component, and blocks the remaining orders of diffracted light as noise components.

[0168] It may be preset which order of diffracted light among multiple orders is to be passed as a signal component. In one embodiment of the present disclosure, the first pattern (501) may be a pattern that passes the 5th order diffracted light of the red light component (500) as a signal component and blocks the diffracted light of the remaining orders as noise components. The second pattern (511) may be a pattern that passes the 6th order diffracted light of the green light component (510) as a signal component and blocks the diffracted light of the remaining orders as noise components. The third pattern (521) may be a pattern that passes the 7th order diffracted light of the blue light component (520) as a signal component and blocks the diffracted light of the remaining orders as noise components.

[0169] Accordingly, the filtering pattern (530) may be a pattern determined to pass the 5th order diffracted light of the red light component (500), the 6th order diffracted light of the green light component (510), and the 7th order diffracted light of the blue light component (520) as signal components of the generated image (122), and block the remaining orders of diffracted light as noise components.

[0170] However, the 5th, 6th, and 7th order diffracted light are examples, and the present disclosure is not limited thereto. It goes without saying that the filtering pattern (530) for passing only one order of diffracted light of each of the plurality of light components as a signal component may be obtained differently depending on the change in the position of the plurality of orders of diffracted light included in each of the plurality of light components in the first Fourier plane (300).

[0171] In one embodiment of the present disclosure, the filtering pattern (530) may be obtained in advance by at least one of the wavelength of each of the plurality of sub-light sources (125), the type of the spatial light modulator, the arrangement between the plurality of sub-light sources (125) and the spatial light modulator, or the incident angle of the plurality of sub-coherent lights provided to the spatial light modulator.

[0172] At least one processor (150) may obtain a pre-obtained filtering pattern (530) from an external electronic device or an external server via an input / output interface (160) or a communication interface (170). In addition, the pre-obtained filtering pattern (530) may be stored in the memory (140).

[0173] In one embodiment of the present disclosure, at least one processor (150) can control the optical filter (134) to include a filtering pattern (530) by executing instructions or program codes of the optical filter control module (145). The at least one processor (150) can control the optical filter (134) to change the arrangement of the liquid crystal layer of the optical filter (134) or to turn on a physical opening to include a pre-obtained filtering pattern (530).

[0174] Accordingly, the optical filter (134) may include a filtering pattern (530) corresponding to each light source. The position and shape of the filtering pattern (530) included in the optical filter (134) may change as the light source providing coherent light (121) to the spatial light modulator (110) changes.

[0175] In one embodiment of the present disclosure, the filtered generated image (123) that has passed through the optical filter (134) may include only one order of diffracted light filtered by the filtering pattern (530). The filtered generated image (123) may include only one diffracted light of each of a plurality of optical components having different wavelengths.

[0176] FIG. 6 is a flowchart illustrating an operation method of an electronic device in which each of a plurality of light sources includes a plurality of sub-light sources according to one embodiment of the present disclosure.

[0177] Referring to FIGS. 1, 2, 3, 6 and 7, in one embodiment of the present disclosure, the step (S100) of providing coherent light (121) to the spatial light modulator (110) may include the step (S110) of sequentially providing a plurality of sub-coherent lights (701) to the spatial light modulator (110) through each of a plurality of sub-light sources (700).

[0178] In the step (S110) of sequentially providing a plurality of coherent lights (701), at least one processor (150) can control each of the plurality of sub-light sources (700) to sequentially provide a plurality of sub-coherent lights (701) to the spatial light modulator (110) by executing commands or program codes of the light source control module (143).

[0179] In one embodiment of the present disclosure, the step (S200) of displaying a holographic image (111) may include the step (S210) of displaying a sub-holographic image (711) corresponding to any one sub-light source that provides any one of a plurality of sub-coherent lights (701) through a spatial light modulator (110).

[0180] In the step (S210) of displaying a sub-hologram image (711), at least one processor (150) can control the spatial light modulator (110) to display a sub-hologram image (711) corresponding to any one sub-light source that provides any one sub-coherent light among a plurality of sub-coherent lights (701) by executing commands or program codes of the spatial light modulator control module (144).

[0181] Hereinafter, the sub-hologram image (711) displayed on the spatial light modulator (110) will be described later with reference to FIGS. 11 and 12.

[0182] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S310) of controlling an optical filter (134) to include a filtering pattern for filtering a signal component included in a generated image (712) reconstructed based on a plurality of sub-hologram images and a plurality of sub-coherent lights (701).

[0183] At this time, the filtering pattern displayed in step S310 may be a pattern for passing, as a signal component, any one order of diffracted light included in each of the plurality of light components sequentially reproduced based on the plurality of sub-light sources included in each light source. Hereinafter, the filtering pattern included in the light filter (134) in step S310 will be described later with reference to FIGS. 7 and 8.

[0184] In one embodiment of the present disclosure, the method of operation of an electronic device (100) may be as shown in FIGS. 6 to 8, where the spatial light modulator (110) includes a digital micromirror device.

[0185] That is, when a plurality of light sources (120) are each controlled to sequentially provide coherent light (121) to a spatial light modulator (110), a plurality of sub-light sources (700) included in each light source are also each controlled to sequentially provide a plurality of sub-coherent lights (701) of different wavelengths to the spatial light modulator (110), this may be an operating method of an electronic device (100).

[0186] The spatial light modulator (110) may be an operating method of an electronic device (100) in which the electronic device (100) is controlled to display a sub-hologram image (711) corresponding to the sub-coherent light in response to each sub-light source providing the sub-coherent light.

[0187] In addition, the optical filter (134) may be a method of operating an electronic device (100) in which the optical filter (134) is controlled to include a filtering pattern (530) for filtering a signal component included in a plurality of light components having different wavelengths included in a generated image (122) reproduced by a plurality of sub-light sources providing a plurality of sub-coherent lights (701) included in each light source and a corresponding holographic image (111).

[0188] In one embodiment of the present disclosure, steps S110, S210 and S310 may be performed repeatedly as the plurality of light sources (120) are sequentially controlled to provide coherent light (121) to the spatial light modulator (110).

[0189] FIG. 7 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image according to one embodiment of the present disclosure. FIG. 8 is a diagram for explaining a filtering pattern for filtering a signal component included in a generated image reproduced by each of a plurality of sub-coherent light sources according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIGS. 4 and 5 are given the same reference numerals and redundant descriptions are omitted.

[0190] Referring to FIGS. 1, 2, 5, 7 and 8, in one embodiment of the present disclosure, some of the configurations of the electronic device (100) are illustrated to explain the filtering pattern (530).

[0191] In FIG. 7, for the sake of explanation, both the plurality of coherent lights and the plurality of sub-coherent lights (701) sequentially provided to the spatial light modulator (110) by the plurality of light sources (120) and the plurality of sub-light sources (700) included in each light source are illustrated, but the plurality of light sources (120) can be controlled by at least one processor (150) to sequentially provide the coherent lights (121) to the spatial light modulator (110), and the plurality of sub-light sources (700) included in each light source can be controlled by at least one processor (150) to sequentially provide the plurality of sub-coherent lights (701) to the spatial light modulator (110).

[0192] In one embodiment of the present disclosure, the plurality of sub-light sources (700) included in each light source may include a red light source providing sub-coherent light of a red wavelength, a green light source providing sub-coherent light of a green wavelength, and a blue light source providing sub-coherent light of a blue wavelength.

[0193] In one embodiment of the present disclosure, sub-coherent light of a red wavelength, sub-coherent light of a green wavelength, and sub-coherent light of a blue wavelength provided from a red light source, a green light source, and a blue light source, respectively, may be sequentially provided to a spatial light modulator (710).

[0194] In one embodiment of the present disclosure, a plurality of light components, each reproduced by a red wavelength sub-coherent light, a green wavelength sub-coherent light, and a blue wavelength sub-coherent light, which are sequentially provided to a spatial light modulator (110) in which a plurality of sub-hologram images are sequentially displayed, may be provided to an optical filter (134) through a second lens (133). At this time, the plurality of light components may be included in a generated image (712).

[0195] At this time, the plurality of sub-hologram images may include three sub-hologram images corresponding to sub-coherent light of a red wavelength, sub-coherent light of a green wavelength, and sub-coherent light of a blue wavelength, respectively.

[0196] Referring to FIGS. 5, 6 and 7, in one embodiment of the present disclosure, FIG. 7 illustrates a region (720) including a light filter (134) of FIG. 6 and a plurality of light components included in a generated image (712) passing through the region (720), specifically a red light component (800), a green light component (810) and a blue light component (820), to explain a filtering pattern (530).

[0197] In one embodiment of the present disclosure, the red light component (800), the green light component (810), and the blue light component (820) may be a plurality of light components sequentially reproduced in the spatial light modulator (110) and optically propagated to the first Fourier plane (300).

[0198] In one embodiment of the present disclosure, the filtering pattern (530) can pass only one order of diffracted light among the multiple orders of diffracted light included in the sequentially reproduced red light component (800), green light component (810), and blue light component (820), and block the remaining orders of diffracted light.

[0199] In one embodiment of the present disclosure, the filtering pattern (530) may include filtering areas (802, 812, 822) and masking areas (801, 811, 821). FIG. 8 illustrates filtering areas (802, 812, 822) and masking areas (801, 811, 821) corresponding to red light components (800), green light components (810), and blue light components (820), respectively.

[0200] In one embodiment of the present disclosure, the filtering regions (802, 812, 822) may be patterns for passing diffracted light of a predetermined order in each of the red light component (800), the green light component (810), and the blue light component (820). The filtering regions (802, 812, 822) may be regions set to filter diffracted light of a predetermined order in each of the red light component (800), the green light component (810), and the blue light component (820).

[0201] In one embodiment of the present disclosure, a filtering area (802, 812, 822) included in one filtering pattern (530) can filter any one order of diffracted light included in each of the red light component (800), the green light component (810), and the blue light component (820).

[0202] In one embodiment of the present disclosure, the masking regions (801, 811, 821) may be regions for masking, i.e. blocking, the remaining orders of diffracted light that are not filtered, i.e., not passed, in the filtering regions (802, 812, 822) in the red light component (800), the green light component (810), and the blue light component (820), respectively.

[0203] In Fig. 8, the areas of the masking areas (801, 811, 821) are shown to be different for explanation, but the masking areas (801, 811, 821) may be the remaining areas excluding the filtering areas (802, 812, 822) in the filtering pattern (530).

[0204] In one embodiment of the present disclosure, the filtered generated image (714) that has passed through the optical filter (134) may include only one order of diffracted light in the red wavelength, one order of diffracted light in the green wavelength, and one order of diffracted light in the blue wavelength filtered by the filtering pattern (530).

[0205] In one embodiment of the present disclosure, the filtered generated image (714) can be optically propagated and provided to the user (200) as holographic content (124) in the second Fourier plane (310). Accordingly, the electronic device (100) can provide the user (200) with holographic content (124) that does not contain noise components and has a clear image quality.

[0206] FIG. 9 is a flowchart illustrating an operation method for generating a holographic image according to one embodiment of the present disclosure. FIG. 10 is a diagram illustrating an operation for generating a holographic image according to one embodiment of the present disclosure.

[0207] Referring to FIGS. 1, 2, 9 and 10, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S10) of generating an initial holographic image (1000).

[0208] In one embodiment of the present disclosure, the initial holographic image (1000) may be a randomly generated image without any specific rules. In one embodiment of the present disclosure, the initial holographic image (1000) may be a randomly generated image with various grayscales that can be displayed through the spatial light modulator (110). In the case where an image with 8-bit grayscales from 0 to 255 can be displayed using the liquid crystal layer included in the spatial light modulator (110), the initial holographic image (1000) may be randomly generated within the grayscales from 0 to 255.

[0209] In the step (S10) of generating an initial hologram image (1000), at least one processor (150) can generate an initial hologram image (1000) by executing commands or program codes of a hologram image generation module (142).

[0210] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S20) of generating restored hologram content (1020) by performing optical propagation on an initial hologram image (1000).

[0211] In the step (S20) of generating restored hologram content (1020), at least one processor (150) can generate restored hologram content (1020) by performing optical propagation on the initial hologram image (1000) by executing commands or program codes of the hologram image generation module (142).

[0212] In one embodiment of the present disclosure, the holographic image generation module (142) may include a light propagation module (1010). The light propagation module (1010) may include a light propagation algorithm for performing light propagation within a space. At least one processor (150) may perform light propagation on an initial holographic image (1000) by executing instructions or program codes of the light propagation module (1010), thereby generating restored holographic content (1020).

[0213] However, the present disclosure is not limited thereto, and the photoelectric module (1010) may be stored in the memory (140) as a separate module distinct from the hologram image generation module (142).

[0214] In one embodiment of the present disclosure, the step (S20) of generating restored hologram content (1020) may include a step of generating restored hologram content (1020) by performing optical propagation so that the initial hologram image (1000) passes through a filtering pattern (530).

[0215] At least one processor (150) can optically propagate the initial hologram image (1000) to the second Fourier plane (310) to generate restored hologram content (1020). At this time, at least one processor (150) can optically propagate the initial hologram image (1000) by taking into consideration a plurality of lenses and optical filters (134) included in the optical layer (130).

[0216] In one embodiment of the present disclosure, at least one processor (150) can optically propagate an initial holographic image (1000) by considering a second lens (133), an optical filter (134) including a filtering pattern (530), a third lens (135), and a fourth lens (136) located in a path through which light is propagated to a second Fourier plane (310). Accordingly, an optical signal filtered by the filtering pattern (530) among the initial holographic image (1000) can be optically propagated to the second Fourier plane (310) to generate a restored holographic content (1020).

[0217] In one embodiment of the present disclosure, the method of operating an electronic device (1000) may include a step (S30) of generating a hologram image (111) by updating an initial hologram image (1000) using a loss function that compares a target image (1030) to be provided to a user (200) as hologram content (124) and restored hologram content (1020).

[0218] In one embodiment of the present disclosure, the initial hologram image (1000) and the restored hologram content (1020) may be generated for each frame of the driving frequency at which the electronic device (100) intends to provide the hologram content (124). The target image (1030) may refer to an image corresponding to a frame of the restored hologram content (1020) among the input images composed of a plurality of acquired frames.

[0219] In the step (S30) of updating the initial hologram image (1000) to generate the hologram image (111), at least one processor (150) can update the initial hologram image (1000) to generate the hologram image (111) by using a loss function that compares the target image (1030) and the restored hologram content (1020) by executing the commands or program code of the hologram image generation module (142).

[0220] The loss function comparing the restored hologram content (1020) and the target image (1030) may have a larger value as the difference between the restored hologram content (1020) and the target image (1030) increases. The loss function may have a smaller value as the difference between the restored hologram content (1020) and the target image (1030) decreases.

[0221] In one embodiment, the restored hologram content (1020) generated by optically propagating the generated initial hologram image (1000) to the second Fourier plane (310) may differ from the target image (1030) because it is a photopropagated version of the randomly generated initial hologram image (1000).

[0222] In one embodiment of the present disclosure, the hologram image generation module (142) may include a loss calculation module (1040). At least one processor (150) may update the initial hologram image (1000) by using a loss function that compares the target image (1030) and the restored hologram content (1020) by executing instructions or program codes of the loss calculation module (1040), thereby generating a hologram image (111). At this time, the loss calculation module (1040) may include a loss function, a forward propagation algorithm, a back-propagation algorithm, and the like.

[0223] However, the present disclosure is not limited thereto, and the loss calculation module (1040) may be stored in the memory (140) as a separate module distinct from the hologram image generation module (142).

[0224] In one embodiment, in the step (S30) of generating a hologram image (111) by updating an initial hologram image (1000), the initial hologram image (1000) may be updated to minimize a loss function using a forward propagation algorithm and a back propagation algorithm included in a loss calculation module (1040).

[0225] In one embodiment of the present disclosure, the step (S30) of generating a holographic image (111) by updating an initial holographic image (1000) may be repeated until the size of the loss function becomes smaller than a preset reference value. At least one processor (150) may repeat step S30 to display the updated holographic image when the size of the loss function becomes smaller than the preset reference value as a holographic image (111) on the spatial light modulator (110).

[0226] In one embodiment of the present disclosure, when sequentially displaying a holographic image (111) including a plurality of sub-holographic images through a spatial light modulator (110), steps S10, S20, and S30 may be performed before step S200. In one embodiment of the present disclosure, steps S10, S20, and S30 may be performed for each frame in which a holographic image (111) is to be displayed through the spatial light modulator (110), thereby generating a holographic image (111).

[0227] However, the present disclosure is not limited thereto, and the hologram image generation module (142) may include an artificial intelligence model. FIGS. 9 and 10 may illustrate a method for training an artificial intelligence model included in the hologram image generation module (142).

[0228] In one embodiment of the present disclosure, the artificial intelligence model included in the holographic image generation module (142) may include a plurality of neural network layers. Each of the plurality of neural network layers may include a plurality of weight values. The artificial intelligence model may perform calculations of the current neural network layer through calculations of the calculation results of the previous neural network layer and the plurality of weight values.

[0229] In one embodiment, at least one processor (150) may train an artificial intelligence model included in the hologram image generation module (142). At least one processor (150) may also perform transfer learning and fine-tuning using a pre-trained model to train the artificial intelligence model included in the hologram image generation module (142).

[0230] In one embodiment of the present disclosure, the weights of the artificial intelligence model included in the hologram image generation module (142) can be updated by the method illustrated in FIGS. 9 and 10. Specifically, the weights of the model generating the initial hologram image (1000) can be updated.

[0231] At least one processor (150) can generate an initial hologram image (1000) using a hologram image generation module (142) including updated weights through learning. At this time, the restored hologram content (1020) obtained by optically propagating the initial hologram image (1000) inferred by the hologram image generation module (142) including the updated weights may have a small difference from the target image (1030). Through this, at least one processor (150) can use the initial hologram image (1000) as a hologram image (111).

[0232] However, the present disclosure is not limited thereto, and at least one processor (150) may receive an artificial intelligence model trained to infer a hologram image (111) or a sub-hologram image (711) for displaying hologram content (124) on the second Fourier plane (310) using the target image (1030), information of the second Fourier plane (310), and a filtering pattern (530) from an external server or peripheral electronic devices through a communication interface (170).

[0233] In one embodiment of the present disclosure, the method illustrated in FIG. 10 may utilize a Camera In The Loop (CITL) method. The Camera In The Loop method may be a method for considering that the initial hologram image (1000) is physically or optically affected by a plurality of lenses and optical filters (134) included in the optical layer (130) when light is transmitted to the reconstructed hologram content (1020). Through the Camera In The Loop method, at least one processor (150) may update the weights of a model that generates the initial hologram image (1000) by using a loss function that compares a captured image obtained by capturing the reconstructed hologram content (1020) with a target image (1030).

[0234] FIG. 11 is a flowchart illustrating an operation method for generating a sub-hologram image according to one embodiment of the present disclosure. FIG. 12 is a diagram illustrating an operation for generating a sub-hologram image according to one embodiment of the present disclosure.

[0235] Referring to FIGS. 1, 2, 11 and 12, in one embodiment of the present disclosure, a method of operating an electronic device (100) may include a step (S40) of generating an initial holographic image (1000).

[0236] In the step (S40) of generating an initial hologram image (1200), at least one processor (150) can generate an initial hologram image (1200) by executing commands or program codes of a hologram image generation module (142).

[0237] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S51) of binarizing an initial hologram image (1200) to generate a binarized hologram image (1220).

[0238] In one embodiment of the present disclosure, the holographic image generation module (142) may include a binarization module (1210), a photopropagation module (1230), and a loss calculation module (1260). However, the present disclosure is not limited thereto, and at least one of the binarization module (1210), the photopropagation module (1230), or the loss calculation module (1260) may be stored in the memory (140) as a separate module distinct from the holographic image generation module (142).

[0239] In the step (S51) of generating a binary hologram image (1220), at least one processor (150) can generate a binary hologram image (1220) by binarizing the initial hologram image (1200) by executing commands or program codes of a binarization module (1210).

[0240] In one embodiment of the present disclosure, when the spatial light modulator (110) includes a digital micromirror device, the spatial light modulator (110) can display a binarized image having a 1-bit grayscale of “0” or “1.” At least one processor (150) can binarize the initial hologram image (1200) to generate a binarized hologram image (1220) that can be displayed by the spatial light modulator (110).

[0241] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S61) of generating restored binary hologram content (1240) by performing optical propagation on a binary hologram image (1220).

[0242] In the step (S61) of generating restored binary hologram content (1240), at least one processor (150) can perform optical propagation on a binary hologram image (1220) by executing commands or program codes of a photopropagation module (1230) to generate restored binary hologram content (1240).

[0243] In one embodiment of the present disclosure, the restored binary hologram content (1240) may be a hologram content reproduced to have a grayscale of 1 bit. In one embodiment of the present disclosure, the electronic device (100) may display a plurality of restored binary hologram contents (1240) through time-division driving to reproduce hologram content having a grayscale of 2 bits or more.

[0244] In one embodiment of the present disclosure, the step (S61) of generating the restored binary hologram content (1240) may include a step of generating the restored binary hologram content (1240) by performing optical propagation so that the binary hologram image (1200) passes through the filtering pattern (530). At least one processor (150) may perform optical propagation on the binary hologram image (1200) by taking into consideration a plurality of lenses and optical filters (134) included in the optical layer (130) by executing instructions or program codes of the optical propagation module (1230), thereby generating the restored binary hologram content (1240).

[0245] In one embodiment of the present disclosure, the operating method of the electronic device (100) may include a step (S71) of updating a binarized hologram image (1220) to generate a sub-hologram image (711, see FIG. 7) using a loss function that compares restored binarized hologram content (1240) and a target binarized image (1250).

[0246] In one embodiment of the present disclosure, when the electronic device (100) wants to provide holographic content (124) to the user (200) at a driving frequency, each of the plurality of light sources (120) may be sequentially provided to the spatial light modulator (110) at the driving frequency. Each of the plurality of sub-light sources (700) may be sequentially provided to the spatial light modulator (110) at a frequency that is the product of the driving frequency and the number of the plurality of sub-light sources (700).

[0247] In one embodiment of the present disclosure, an initial holographic image (1200) and a reconstructed binary holographic image (1220) can be generated each time a plurality of sub-light sources (700) included in each of a plurality of light sources (120) are sequentially provided to a spatial light modulator (110).

[0248] In one embodiment of the present disclosure, the target binarized image (1250) may be a binarized image of an image corresponding to a frame in which holographic content including the restored holographic content (1020) is provided among an input image composed of a plurality of acquired frames. The target binarized image (1250) may be a binarized image of a light component corresponding to a wavelength of sub-coherent light provided to a spatial light modulator (110) among images corresponding to a frame in which holographic content including the restored holographic content (1020) is provided.

[0249] In one embodiment of the present disclosure, when a red light source included in one of the light sources in the spatial light modulator (110) provides sub-coherent light of a red wavelength to the spatial light modulator (110), a binarized image of a light component having a red wavelength of an image corresponding to a frame in which the corresponding light source is provided among input images can be used as a target image. By using the binarized image of the light component having a red wavelength as a target image, a restored binarized hologram image (1220) to be displayed on the spatial light modulator (110) when sub-coherent light of a red wavelength is provided to the spatial light modulator (110) can be generated using the method illustrated in FIG. 12.

[0250] In the step (S71) of updating the binary hologram image (1220) to generate a sub-hologram image (711), at least one processor (150) may update the binary hologram image (1220) to generate the sub-hologram image (711) by using a loss function that compares the restored binary hologram content (1240) and the target binary image (1250) by executing instructions or program codes of the loss calculation module (1260). In one embodiment of the present disclosure, the loss calculation module (1260) may also approximate and update the binary hologram image (1220) by using a differentiable binarization function, for example, a hyperbolic tangent function, in order to update the binary hologram image (1220).

[0251] However, the present disclosure is not limited thereto. The method illustrated in FIGS. 11 and 12 may illustrate a method for training an artificial intelligence model included in a hologram image generation module (142). At least one processor (150) may generate an initial hologram image (1200) or a binarized hologram image (1220) using a hologram image generation module (142) including weights updated through learning.

[0252] In one embodiment of the present disclosure, in the process of updating a binary hologram image (1220) using a loss function, by performing optical propagation so that the binary hologram image (1220) passes through a filtering pattern (530), a restored binary hologram content (1240) obtained by comparing the target binary image (1250) with the target binary hologram content (1240), an optimized binary hologram image (1220) can be generated such that information about the hologram content (124) is included in the diffracted light of an order filtered by the filtering pattern (530) and is not included in the diffracted light of the remaining orders blocked by the filtering pattern (530).

[0253] Accordingly, the electronic device (100) can provide hologram content (124) with a wide viewing angle to the user (200) by sequentially providing a plurality of light sources (120) to the spatial light modulator (710). In addition, the electronic device (100) can provide hologram content (124) composed of color by providing a plurality of sub-light sources having different wavelengths, each of which is included in the plurality of light sources (120), to the spatial light modulator (710).

[0254] At this time, the electronic device (100) can prevent noise from being included in the hologram content (124) provided in color by using an optical filter (134) including a filtering pattern (530) that filters only one order of diffracted light included in each of a plurality of optical components reproduced with different wavelengths.

[0255] In addition, the electronic device (100) can provide the user (200) with holographic content (124) in which noise components are removed and signal components to be provided to the user (200) are emphasized by using the optimized holographic image (111) and sub-holographic images (711) generated by using the result of the light propagation through the filtering pattern (530) and the result of comparing the target image.

[0256] FIG. 13 is a diagram illustrating the operation of an electronic device according to one embodiment of the present disclosure. Hereinafter, redundant descriptions of components identical to those described in FIGS. 1 and 2 will be omitted.

[0257] Referring to FIG. 13, in one embodiment of the present disclosure, FIG. 13 illustrates an electronic device (1300) including a spatial light modulator (1310), a plurality of light sources (1320), and an optical layer (1330).

[0258] In one embodiment of the present disclosure, FIG. 1 illustrates coherent light (121) sequentially provided by each of a plurality of light sources (120) being reflected from a spatial light modulator (110) and directed toward an optical layer (130).

[0259] However, the present disclosure is not limited thereto. Referring to FIG. 13, coherent light sequentially provided by each of a plurality of light sources (1320) may be transmitted through a spatial light modulator (1310) and provided to an optical layer (1330). In one embodiment of the present disclosure, depending on the type and driving method of the spatial light modulator (1310), the coherent light provided to the spatial light modulator (1310) may be transmitted or reflected and provided to the optical layer (1330).

[0260] In one embodiment of the present disclosure, a generated image reproduced by coherent light sequentially provided from each of a plurality of light sources (1320) to a spatial light modulator (1310) displaying a holographic image (1311) may be provided to a user (200) as holographic content (1340) through a plurality of lenses (1331, 1333, 1334) and an optical filter (1332) included in an optical layer (1330).

[0261] At this time, the light filter (1332) may include a filtering pattern (530, see FIG. 5). The holographic image (1311) displayed on the spatial light modulator (1310) may include all of the sub-holographic images corresponding to the plurality of sub-light sources included in each light source, or the plurality of sub-holographic images may be sequentially displayed, depending on the type and driving method of the spatial light modulator (1310) and the operating method of the plurality of light sources (1320).

[0262] To solve the above-described technical problem, in one embodiment of the present disclosure, an electronic device is provided. The electronic device may include a spatial light modulator (SLM). The electronic device may include a plurality of light sources, each of which provides coherent light to the spatial light modulator. The electronic device may include an optical filter and an optical layer that receives a holographic image reproduced by the spatial light modulator. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor including a processing circuit. The electronic device may control each of the plurality of light sources to sequentially provide coherent light to the spatial light modulator by having the at least one processor individually or collectively execute at least one instruction stored in the memory. The electronic device may control the spatial light modulator to display a holographic image corresponding to any one of the plurality of light sources that provides coherent light by having the at least one processor execute at least one instruction stored in the memory. By having at least one processor execute at least one instruction stored in a memory, the electronic device can control an optical filter to include a filtering pattern for filtering a signal component included in a holographic image and a generated image reconstructed based on coherent light.

[0263] In one embodiment of the present disclosure, the plurality of light sources may include a plurality of sub-light sources that each provide a plurality of sub-coherent lights having different wavelengths. The generated image may include a plurality of light components having the different wavelengths, and each of the plurality of light components may include diffracted lights of multiple orders. The filtering pattern may be a pattern that passes the diffracted light of one order included in each of the plurality of light components as a signal component and blocks the diffracted light of the remaining orders.

[0264] In one embodiment of the present disclosure, the filtering pattern may be a pattern obtained in advance based on at least one of the wavelength of each of the plurality of sub-light sources, the type of the spatial light modulator, the arrangement between the plurality of sub-light sources and the spatial light modulator, or the incident angles of the plurality of sub-coherent lights provided to the spatial light modulator.

[0265] In one embodiment of the present disclosure, an electronic device can generate an initial holographic image by having at least one processor individually or collectively execute at least one instruction stored in a memory. By having at least one processor execute at least one instruction stored in a memory, the electronic device can perform optical propagation on the initial holographic image to generate reconstructed holographic content. By having at least one processor execute at least one instruction stored in a memory, the electronic device can update the initial holographic image using a loss function that compares a target image to be provided as holographic content with the reconstructed holographic content to generate a holographic image.

[0266] In one embodiment of the present disclosure, the electronic device can generate reconstructed holographic content by performing optical propagation so that an initial holographic image passes through a filtering pattern by having at least one processor individually or collectively execute at least one instruction stored in a memory.

[0267] In one embodiment of the present disclosure, the spatial light modulator may include a digital micromirror device (DMD). By having at least one processor individually or collectively execute at least one instruction stored in a memory, the electronic device may control each of the plurality of sub-light sources to sequentially provide a plurality of sub-coherent lights to the spatial light modulator.

[0268] In one embodiment of the present disclosure, the electronic device can control the spatial light modulator to display a sub-holographic image corresponding to any one sub-light source providing any one sub-coherent light among a plurality of sub-coherent lights by individually or collectively executing at least one command stored in a memory by at least one processor. The filtering pattern can be a pattern for filtering a signal component included in a plurality of sub-holographic images corresponding to each of the plurality of sub-light sources included in any one of the plurality of light sources and a generated image reconstructed based on the plurality of sub-coherent lights.

[0269] In one embodiment of the present disclosure, an electronic device can generate a random holographic image by having at least one processor individually or collectively execute at least one command stored in a memory. By having at least one processor execute at least one command stored in a memory, the electronic device can binarize an initial holographic image to generate a binarized holographic image. By having at least one processor execute at least one command stored in a memory, the electronic device can perform optical propagation on the binarized holographic image to generate a reconstructed binarized holographic content. By having at least one processor execute at least one command stored in a memory, the electronic device can update the binarized holographic image using a loss function that compares a target binarized image with the reconstructed binarized holographic content to generate a sub-holographic image.

[0270] In one embodiment of the present disclosure, the electronic device can generate reconstructed binary holographic content by performing optical propagation so that a binary holographic image passes through a filtering pattern by having at least one processor individually or collectively execute at least one instruction stored in a memory.

[0271] In order to solve the above-described technical problem, one embodiment of the present disclosure provides a method of operating an electronic device. The method of operating the electronic device may include a step of sequentially providing coherent light to a spatial light modulator (SLM) through each of a plurality of light sources. The method of operating the electronic device may include a step of displaying a holographic image corresponding to any one of the plurality of light sources providing coherent light through the spatial light modulator. The method of operating the electronic device may include a step of controlling an optical filter provided with a holographic image reproduced from the spatial light modulator to include a filtering pattern for filtering a signal component included in a generated image reproduced based on the holographic image and the coherent light.

[0272] In one embodiment of the present disclosure, the plurality of light sources may include a plurality of sub-light sources that each provide a plurality of sub-coherent lights having different wavelengths. The generated image may include a plurality of light components having different wavelengths. Each of the plurality of light components may include diffracted lights of multiple orders. The filtering pattern may be a pattern that passes the diffracted light of one order included in each of the plurality of light components as a signal component and blocks the diffracted light of the remaining orders.

[0273] In one embodiment of the present disclosure, a method of operating an electronic device may include generating an initial holographic image. The method of operating the electronic device may include generating reconstructed holographic content by performing optical propagation on the initial holographic image. The method of operating the electronic device may include generating a holographic image by updating the initial holographic image using a loss function that compares the reconstructed holographic content with a target image to be provided as holographic content.

[0274] In one embodiment of the present disclosure, in the step of generating restored hologram content, the restored hologram content can be generated by performing optical propagation so that the initial hologram image passes through a filtering pattern.

[0275] In one embodiment of the present disclosure, the spatial light modulator may include a digital micromirror device (DMD). The step of sequentially providing coherent light may include the step of sequentially providing a plurality of sub-coherent lights to the spatial light modulator through each of a plurality of sub-light sources.

[0276] In one embodiment of the present disclosure, the step of displaying a holographic image may include the step of displaying a sub-holographic image corresponding to any one of a plurality of sub-coherent lights through a spatial light modulator, wherein the sub-holographic image corresponding to any one of a plurality of sub-coherent lights is provided. The filtering pattern may be a pattern for filtering a signal component included in a plurality of sub-holographic images corresponding to each of a plurality of sub-light sources included in any one of the plurality of light sources and a generated image reconstructed based on the plurality of sub-coherent lights.

[0277] In one embodiment of the present disclosure, a method of operating an electronic device may include a step of generating an initial holographic image. The method of operating the electronic device may include a step of binarizing the initial holographic image to generate a binarized holographic image. The method of operating the electronic device may include a step of performing optical propagation so that the binarized holographic image passes through a filtering pattern to generate a reconstructed binarized holographic content. The method of operating the electronic device may include a step of updating the binarized holographic image to generate a sub-holographic image using a loss function that compares a target binarized image with the reconstructed binarized holographic content.

[0278] In order to solve the above-described technical problem, a computer-readable recording medium having recorded thereon a program for performing at least one method of an embodiment of an operating method of an electronic device disclosed in the present disclosure on a computer can be provided.

[0279] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.

[0280] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.

[0281] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.

[0282] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0283] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.

[0284] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.

[0285] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0286] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.

Claims

Spatial Light Modulator (SLM, 110); A plurality of light sources (120) each providing coherent light to the spatial light modulator (110); An optical layer (130) including an optical filter (134) and receiving a generated image reproduced from the spatial light modulator (110); A memory (140) storing at least one instruction; and At least one processor (150) comprising a processing circuit, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), Controlling each of the plurality of light sources (120) to sequentially provide the coherent light to the spatial light modulator (110), Control the spatial light modulator (110) to display a holographic image corresponding to one of the plurality of light sources (120) that provides the coherent light, An electronic device (100) that controls the optical filter (134) to include a filtering pattern for filtering signal components included in the generated image reproduced based on the holographic image and the coherent light. In the first paragraph, The above filtering pattern is an electronic device (100) that is a pattern obtained in advance based on at least one of the wavelength of each of the plurality of light sources (120), the type of the spatial light modulator (110), the arrangement between the plurality of light sources (120) and the spatial light modulator (110), or the incident angle of the coherent light provided to the spatial light modulator (110). In any one of the first or second clauses, The above plurality of light sources (120) include a plurality of sub-light sources that each provide a plurality of sub-coherent lights having different wavelengths, The above generated image includes a plurality of light components having different wavelengths, and each of the plurality of light components includes diffracted light of multiple orders. The above filtering pattern is an electronic device (100) that passes diffracted light of one order included in each of the plurality of light components as the signal component and blocks diffracted light of the remaining orders. In the third paragraph, The above filtering pattern is an electronic device (100) that is a pattern obtained in advance based on at least one of the wavelength of each of the plurality of sub-light sources, the type of the spatial light modulator (110), the arrangement between the plurality of sub-light sources and the spatial light modulator (110), or the incident angle of the plurality of sub-coherent lights provided to the spatial light modulator (110). In any one of claims 1 to 4, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), Create an initial holographic image, Performing optical propagation on the initial holographic image to generate restored holographic content, An electronic device (100) that generates a hologram image by updating the initial hologram image using a loss function that compares the target image to be provided as hologram content with the restored hologram content. In paragraph 5, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), An electronic device (100) that generates the restored hologram content by performing the optical propagation so that the initial hologram image passes through the filtering pattern. In any one of the third to fifth clauses, The above spatial light modulator (110) includes a digital micro-mirror device (DMD), The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), An electronic device (100) that controls each of the plurality of sub-light sources to sequentially provide the plurality of sub-coherent lights to the spatial light modulator (110). In paragraph 7, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), Control the spatial light modulator (110) to display a sub-hologram image corresponding to any one sub-light source that provides any one of the plurality of sub-coherent lights, The above filtering pattern is an electronic device (100) that is a pattern for filtering the signal component included in the generated image reproduced based on a plurality of sub-hologram images and a plurality of sub-coherent lights corresponding to each of a plurality of sub-light sources included in one of the plurality of light sources (120). In any one of the 7th or 8th clauses, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), Create an initial holographic image, Binarizing the above initial hologram image to generate a binarized hologram image, Performing optical propagation on the above binary hologram image to generate restored binary hologram content, An electronic device (100) that generates the sub-hologram image by updating the binarized hologram image using a loss function that compares the target binarized image and the restored binarized hologram content. In paragraph 9, The electronic device (100) executes the at least one processor (150) individually or collectively the at least one instruction stored in the memory (140), An electronic device (100) that generates the restored binary hologram content by performing the optical propagation so that the binary hologram image passes through the filtering pattern. A step (S100) of sequentially providing coherent light to a spatial light modulator (SLM, 110) through each of a plurality of light sources (120); A step (S200) of displaying a holographic image corresponding to one of the plurality of light sources (120) that provides the coherent light through the spatial light modulator (110); An operating method of an electronic device (100), comprising a step (S300) of controlling an optical filter (134) provided with the generated image reproduced from the spatial light modulator (110) to include a filtering pattern for filtering a signal component included in the generated image reproduced based on the holographic image and the coherent light. In Article 11, The above filtering pattern is a pattern obtained in advance based on at least one of the wavelength of each of the plurality of light sources (120), the type of the spatial light modulator (110), the arrangement between the plurality of light sources (120) and the spatial light modulator (110), or the incident angle of the coherent light provided to the spatial light modulator (110). The method of operating an electronic device (100). In any one of the 11th or 12th clauses, The above plurality of light sources (120) include a plurality of sub-light sources that each provide a plurality of sub-coherent lights having different wavelengths, The above generated image includes a plurality of light components having different wavelengths, and each of the plurality of light components includes diffracted light of multiple orders. The above filtering pattern is a method of operating an electronic device (100) that is a pattern that passes diffracted light of one order included in each of the plurality of light components as the signal component and blocks diffracted light of the remaining orders. In the 13th paragraph, The above filtering pattern is a pattern obtained in advance based on at least one of the wavelength of each of the plurality of sub-light sources, the type of the spatial light modulator, the arrangement between the plurality of sub-light sources and the spatial light modulator (110), or the incident angle of the plurality of sub-coherent lights provided to the spatial light modulator (110). The method of operating an electronic device (100). A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 11 to 14 on a computer.

Images