Method for providing hologram image, and electronic device for supporting same

Abstract

An electronic device according to one embodiment may comprise: a light source; a spatial light modulator configured to modulate light emitted from the light source; a mask configured to modulate the light modulated by the spatial light modulator; a memory; and at least one processor. The at least one processor may obtain a target hologram image, and obtain a plurality of holograms by performing learning on the basis of alignment errors that may occur between the spatial light modulator and the mask. The at least one processor may control the spatial light modulator to output a pattern on the basis of the plurality of obtained holograms such that the light emitted from the light source is modulated. The light modulated by the spatial light modulator may be modulated by means of the mask to sequentially form a plurality of hologram images corresponding to the plurality of holograms within a preset time.

Description

Method for providing holographic images and electronic devices supporting the same

[0001] The present disclosure relates to a method for providing a holographic image and an electronic device supporting the same.

[0002] A holographic display method may be a three-dimensional image display method that can provide full parallax while matching the depth perception of the brain with the focus of the eye. The holographic display method may be a method that provides a computer-generated hologram (CGH) signal to a spatial light modulator, and reproduces a three-dimensional image by having a hologram pattern output by the spatial light modulator based on the CGH signal diffract a reference light.

[0003] Recently, research has been actively conducted on a holographic display method using a spatial light modulator and a mask that has a pixel pitch smaller than the pixel pitch of the spatial light modulator and can modulate light modulated by the spatial light modulator.

[0004] A holographic display method using a spatial light modulator and a mask may have the advantage of expanding the field of view (also referred to as a “field of view”) and / or viewing area (also referred to as an “eyebox”) compared to a holographic display method that modulates light (e.g., reference light) using only a spatial light modulator.

[0005] In a holographic display method using a spatial light modulator and a mask, the mask may be a mask having a fine periodic structure of about 1 μm to about 4 μm (e.g., a mask having a horizontal length of about 1 μm to about 4 μm and a vertical length of about 1 μm to about 4 μm). The mask, like a piece of glass, may randomly (e.g., in an irregular direction) scatter incident light. Based on the position of the spatial light modulator, the position of the mask, and information about the mask (e.g., the degree of amplitude and / or phase modulation of incident light by the mask, or the structure of pixels constituting the mask), an inverse compensation operation may be performed on a target holographic image (e.g., a holographic image that a user intends to reproduce through a holographic display device), thereby allowing an electronic device (e.g., a holographic display device) to reproduce a clearer holographic image.

[0006] However, the conditions (and environments) assumed in the reverse compensation operation for the target holographic image may differ from the actual conditions of the electronic device (e.g., holographic display device). For example, the actual structure of the mask may differ from the actual structure of the mask assumed in the reverse compensation operation. For example, the actual alignment between the spatial light modulator and the mask (e.g., the actual positional relationship between the spatial light modulator and the mask, or the actual alignment error between the spatial light modulator and the mask) may differ from the alignment (e.g., alignment error) between the spatial light modulator and the mask assumed in the reverse compensation operation. For example, while the electronic device (e.g., holographic display device) is in use, as the alignment between the spatial light modulator and the mask changes due to heat generation, external temperature, or impact from an external object, the actual conditions of the electronic device that were the same as the conditions assumed in the reverse compensation operation may also differ. In such a case, the quality of the holographic image reproduced through the electronic device may deteriorate.

[0007] The present disclosure relates to a method for providing a holographic image and an electronic device supporting the same, which can minimize loss between a reproduced holographic image and a target holographic image by taking into account possible alignment errors between a spatial light modulator and a mask.

[0008] An electronic device according to one embodiment may include a light source, a spatial light modulator configured to modulate light emitted from the light source, a mask configured to modulate light modulated by the spatial light modulator, a memory, and at least one processor. The at least one processor may acquire a plurality of holograms by performing learning based on a target hologram image and possible alignment errors between the spatial light modulator and the mask. The at least one processor may control the spatial light modulator to output a pattern based on the acquired plurality of holograms such that light emitted from the light source is modulated. Light modulated by the spatial light modulator may be modulated by the mask, so that a plurality of hologram images corresponding to the plurality of holograms may be sequentially formed within a preset time.

[0009] In one embodiment, a method for providing a holographic image in an electronic device may include: acquiring a plurality of holograms by performing learning based on possible alignment errors between a target holographic image, a spatial light modulator of the electronic device, and a mask of the electronic device; and controlling the spatial light modulator to output a pattern based on the acquired plurality of holograms such that light emitted from the light source is modulated. Light modulated by the spatial light modulator may be modulated by the mask such that a plurality of holographic images corresponding to the plurality of holograms are sequentially formed within a preset time.

[0010] In one embodiment, an electronic device may include a light source emitting light, a spatial light modulator configured to modulate light emitted from the light source, a mask configured to modulate light modulated by the spatial light modulator, a memory, and at least one processor. The at least one processor may obtain a plurality of holograms using an artificial intelligence model based on a target hologram image. The at least one processor may control the spatial light modulator to output a pattern based on the obtained plurality of holograms such that light emitted from the light source is modulated. The light modulated by the spatial light modulator may be modulated by the mask, so that a plurality of hologram images corresponding to the plurality of holograms may be sequentially formed within a preset time. The artificial intelligence model may be trained using a plurality of first holograms obtained by using an input hologram image as input data and performing training based on possible alignment errors between the input hologram image, the spatial light modulator, and the mask as correct answers.

[0011] In one embodiment, a non-transitory computer-readable medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when executed by at least one processor, cause an electronic device to acquire a plurality of holograms by performing learning based on possible alignment errors between a target hologram image, a spatial light modulator of the electronic device, and a mask of the electronic device. The computer-executable instructions, when executed by the at least one processor, control the spatial light modulator to output a pattern based on the acquired plurality of holograms such that light emitted from the light source is modulated. Light modulated by the spatial light modulator may be modulated by the mask, so that a plurality of hologram images corresponding to the plurality of holograms may be sequentially formed within a preset time.

[0012] FIG. 1 is a drawing for explaining the structure of an electronic device according to one embodiment.

[0013] FIG. 2 is a drawing for explaining an electronic device according to one embodiment.

[0014] FIG. 3 is a block diagram of an electronic device according to one embodiment.

[0015] Figure 4 is a drawing for explaining a mask according to one embodiment.

[0016] FIG. 5 is a flowchart illustrating a method for providing a holographic image according to one embodiment.

[0017] FIG. 6 is a flowchart illustrating a method for obtaining multiple holograms according to one embodiment.

[0018] FIG. 7 is a drawing for explaining a method of obtaining a plurality of holograms according to one embodiment.

[0019] FIGS. 8A and 8B are drawings illustrating possible alignment errors between a spatial light modulator and the mask according to one embodiment.

[0020] FIG. 9 is a diagram illustrating a method for obtaining a loss function according to one embodiment.

[0021] FIG. 10 is a diagram illustrating a method for setting a light propagation framework based on a phase error of a mask according to one embodiment.

[0022] FIG. 11 is a drawing for explaining a method of obtaining one hologram according to one embodiment.

[0023] FIG. 12 is a drawing for explaining a method for providing a holographic image according to one embodiment.

[0024] FIG. 13 is a flowchart illustrating a method for providing a holographic image according to one embodiment.

[0025] FIG. 14 is a diagram illustrating a method for obtaining an artificial intelligence model according to one embodiment.

[0026] FIG. 15 is a drawing for explaining hologram images reproduced through a comparative example according to one embodiment.

[0027] FIG. 16 is a drawing for explaining hologram images reproduced based on an operation of providing a hologram according to one embodiment.

[0028] FIG. 1 is a drawing for explaining the structure of an electronic device (201) according to one embodiment.

[0029] Referring to FIG. 1, in one embodiment, an electronic device (101) may include one or more first cameras (111-1, 111-2), one or more second cameras (112-1, 112-2), and one or more third cameras (113). In one embodiment, images acquired through one or more first cameras (111-1, 111-2) may be used for detecting hand gestures by a user, tracking the user's head, and / or recognizing space. In one embodiment, one or more first cameras (111-1, 111-2) may be GS (Global shutter) cameras.

[0030] In one embodiment, one or more first cameras (111-1, 111-2) can perform simultaneous localization and mapping (SLAM) operations using depth imaging. In one embodiment, one or more first cameras (111-1, 111-2) can perform spatial recognition for six degrees of freedom (6DoF).

[0031] In one embodiment, images acquired through one or more second cameras (112-1, 112-2) may be used to detect and track the user's pupils. In one embodiment, one or more second cameras (112-1, 112-2) may be GS cameras. In one embodiment, one or more second cameras (112-1, 112-2) may correspond to the left and right eyes, respectively, and the performance of one or more second cameras (112-1, 112-2) may be identical.

[0032] In one embodiment, one or more of the third cameras (113) may be high-resolution cameras. In one embodiment, one or more of the third cameras (113) may perform auto-focusing (AF) and shake correction functions. In one embodiment, one or more of the third cameras (213) may be GS cameras or RS (rolling shutter) cameras.

[0033] In one embodiment, the electronic device (101) may include one or more light-emitting elements (114-1, 114-2). In one embodiment, the light-emitting elements (114-1, 114-2) may be different from a light source, which will be described later, that radiates light to a screen output area of ​​a display. In one embodiment, the light-emitting elements (114-1, 114-2) may radiate light to facilitate pupil detection when detecting and tracking a user's pupil through one or more second cameras (112-1, 112-2).

[0034] In one embodiment, the light emitting elements (114-1, 114-2) may each include a light emitting diode (LED). In one embodiment, the light emitting elements (114-1, 114-2) may emit light in the infrared region. In one embodiment, the light emitting elements (114-1, 114-2) may be attached to the periphery of the frame of the electronic device (101). In one embodiment, the light emitting elements (114-1, 114-2) are positioned around one or more first cameras (111-1, 111-2) and may assist gesture detection, head tracking, and / or spatial recognition by one or more first cameras (111-1, 111-2) when the electronic device (101) is used in a dark environment. In one embodiment, the light emitting elements (114-1, 114-2) are positioned around one or more third cameras (113) and can assist in image acquisition by the one or more third cameras (113) when the electronic device (101) is used in a dark environment.

[0035] In one embodiment, the electronic device (101) may include batteries (135-1, 135-2). The batteries (135-1, 135-2) may store power to operate the remaining components of the electronic device (101).

[0036] In one embodiment, the electronic device (101) may include a first display (151), a second display (152), one or more input optical members (153-1, 153-2), one or more transparent members (190-1, 190-2), and one or more screen display portions (154-1, 154-2).

[0037] In one embodiment, the first display (151) and the second display (152) may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0038] In one embodiment, when the first display (151) and the second display (152) are formed of one of a liquid crystal display (LCD), a digital mirror display, or a silicon liquid crystal display, the electronic device (101) may include a light source that irradiates light onto the screen output area of ​​the display. In one embodiment, when the first display (151) and the second display (152) can generate light on their own (e.g., when formed of one of an organic light emitting diode (OLED) or a micro LED), the electronic device (101) may provide a relatively good quality virtual image to the user even without including a separate light source.

[0039] In one embodiment, one or more transparent members (190-1, 190-2) may be positioned to face the user's eyes when the user wears the electronic device (101). In one embodiment, the one or more transparent members (190-1, 190-2) may include at least one of a glass plate, a plastic plate, or a polymer. In one embodiment, the user may view the outside world through the one or more transparent members (190-1, 190-2) when the user wears the electronic device (101). In one embodiment, one or more input optical members (153-1, 153-2) may guide light generated by the first display (151) and the second display (152) to the user's eyes. In one embodiment, an image based on light generated by a first display (151) and a second display (152) is formed on one or more screen display portions (154-1, 154-2) on one or more transparent members (190-1, 190-2), and a user can view the image formed on one or more screen display portions (154-1, 154-2).

[0040] In one embodiment, the electronic device (101) may include one or more voice input devices (162-1, 162-2, 162-3) and one or more voice output devices (163-1, 163-2).

[0041] In one embodiment, the electronic device (101) may include a first PCB (170-1) and a second PCB (170-2). The first PCB (170-1) and the second PCB (170-2) may be configured to transmit electrical signals to components included in the electronic device (101), such as one or more first cameras (111-1, 111-2), one or more second cameras (112-1, 112-2), one or more third cameras (113), displays, audio modules, and sensors. In one embodiment, the first PCB (170-1) and the second PCB (170-2) may include a flexible printed circuit board (FPCB). In one embodiment, the first PCB (170-1) and the second PCB (170-2) may each include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate.

[0042] FIG. 2 is a drawing for explaining an electronic device (201) according to one embodiment.

[0043] Referring to FIG. 2, in one embodiment, the electronic device (201) may be a head mounted display (HMD) device (e.g., augmented reality glass (AR glass), virtual reality glass (VR glass)) capable of reproducing a holographic image.

[0044] In one embodiment, the electronic device (201) may include a light source (210), a spatial light modulator (220), a mirror (225), a holographic optical element (226), and / or a mask (230).

[0045] In one embodiment, the light source (210) can emit light (221). For example, the light source (210) can include a laser diode capable of generating coherent light (e.g., laser light). However, the light source (210) is not limited to a laser diode that emits coherent light. For example, the light source (210) can include a light emitting diode (LED). In addition, the light output from the light source (210) is not limited to coherent light. For example, the light output from the light source (210) may include incoherent light.

[0046] In one embodiment, the light source (210) may include a plurality of light sources each emitting light having different wavelengths (e.g., red light, green light, and blue light). However, the present invention is not limited thereto, and the light source (210) may include only one light source emitting light of a single wavelength.

[0047] In one embodiment, the spatial light modulator (220) may output a plurality of hologram patterns corresponding to each of the plurality of holograms based on a plurality of holograms (hereinafter referred to as “the plurality of holograms”) (e.g., a computer generated hologram (CGH) signal or data for the plurality of holograms) provided from a processor (e.g., a processor (350) to be described later). For example, the spatial light modulator (220) may sequentially receive a plurality of holograms (262-1, 262-2, 262-N) from the processor. The spatial light modulator (220) may sequentially output a plurality of hologram patterns (not shown) corresponding to each of the plurality of holograms (262-1, 262-2, 262-N) provided from the processor. However, the present invention is not limited thereto. For example, the spatial light modulator (220) may sequentially receive a plurality of holograms (262-1, 262-2, 262-N) from the processor within a preset time, and then, under the control of the processor, sequentially output a plurality of hologram patterns corresponding to the plurality of holograms (262-1, 262-2, 262-N) within a preset time. In one embodiment, the plurality of holograms (262-1, 262-2, 262-N) may be obtained by taking into account alignment errors between the spatial light modulator (220) and the mask (230). An operation of obtaining the plurality of holograms will be described in detail below.

[0048] In one embodiment, the spatial light modulator (220) can modulate light (221) incident from the light source (210). For example, the spatial light modulator (220) can modulate the amplitude and / or phase of light (221) incident from the light source (210). For example, the spatial light modulator (220) can output the plurality of hologram patterns such that light (221) incident from the light source (210) is modulated by the plurality of hologram patterns.

[0049] In one embodiment, the plurality of holograms provided from the processor to the spatial light modulator (220) may be holograms acquired (e.g., generated, produced) by the processor based on a hologram image (261) (hereinafter referred to as a “target hologram image”) that is a reproduction target using the electronic device (201) (e.g., a hologram image that a user wants to reproduce through the electronic device (201). The operation of the processor acquiring the plurality of holograms will be described in detail below.

[0050] In one embodiment, the mirror (225) can reflect light (221) modulated by the spatial light modulator (220). For example, the mirror (225) can change the direction of propagation of the light (221) so that the light (221) modulated by the spatial light modulator (220) is incident on the holographic optical element (226).

[0051] In one embodiment, the holographic optical element (226) may be an optical element that reflects light (222) incident from a mirror (225) and causes the reflected light to converge.

[0052] In one embodiment, the mask (230) can modulate incident light (e.g., amplitude and / or phase of the light). A holographic image can be formed (hereinafter, also referred to as “reproduced”) by the light modulated by the mask (230). For example, based on the spatial light modulator (220) sequentially outputting a plurality of holographic patterns corresponding to a plurality of holograms within a preset time, a plurality of holographic images (263-1, 263-2, 263-N) can be sequentially reproduced in space as virtual images by the light modulated by the mask (230).

[0053] In one embodiment, when the target hologram image (261) is one image (e.g., one frame), the plurality of hologram images (263-1, 263-2, 263-N) may be hologram images that correspond to one target hologram image (261) and are played back within a preset time. When the target hologram image is an image including a plurality of frames, the plurality of hologram images may be played back within a preset time for each of the plurality of frames.

[0054] In one embodiment, in FIG. 2, reference numeral 241 may represent a field of view (also referred to as a “FOV”), and reference numeral 242 may represent a viewing area (also referred to as an “eyebox”).

[0055] In FIG. 2, a part of an electronic device (201) that allows a user to view a holographic image through the left eye (240) is illustrated (e.g., components corresponding to the left side of the electronic device (201)); however, the electronic device (201) may further include a part of the electronic device (201) that allows a user to view a holographic image through the right eye (e.g., components corresponding to the right side of the electronic device (201) that are implemented symmetrically with respect to the components corresponding to the left side of the electronic device (201) based on the axis (270).

[0056] In one embodiment, the electronic device (201) can sequentially reproduce a plurality of hologram images (263-1, 263-2, 263-N) corresponding to a target hologram image (261) within a preset time by using a plurality of holograms (262-1, 262-2, 262-N) acquired by taking into account alignment errors between the spatial light modulator (220) and the mask (230), thereby allowing a user to view a hologram image of higher quality.

[0057] In Fig. 2, multiple hologram images are played back for a single target hologram image, but this is not limited thereto. For example, a single hologram image may be played back for a single target hologram image.

[0058] FIG. 3 is a block diagram of an electronic device (301) according to one embodiment.

[0059] Referring to FIG. 3, in one embodiment, the electronic device (301) may be the electronic device (201) of FIG. 2 (e.g., an HMD device capable of reproducing a holographic image).

[0060] In one embodiment, the electronic device (301) may include a light source (310), a spatial light modulator (320), a mask (330), memory (340), and / or a processor (350).

[0061] In one embodiment, the light source (310) may include the light source (210) of FIG. 2. For example, the light source (310) may include a laser diode capable of generating coherent light (e.g., laser light). However, the light source (210) is not limited to a laser diode that emits coherent light. For example, the light source (210) may include a light emitting diode (LED). Furthermore, the light output from the light source (210) is not limited to coherent light. For example, the light output from the light source (210) may also include incoherent light.

[0062] In one embodiment, the light source (210) may include a plurality of light sources each emitting light having different wavelengths (e.g., red light, green light, and blue light). However, the present invention is not limited thereto, and the light source (210) may include only one light source emitting light of a single wavelength.

[0063] In one embodiment, the spatial light modulator (320) may include the spatial light modulator (220) of FIG. 2.

[0064] In one embodiment, the spatial light modulator (320) can output a holographic pattern having an interference pattern for modulating incident light based on a hologram (e.g., a CGH signal) (also referred to as “holographic data”) provided from a processor (350). Light incident on the spatial light modulator (320) can be diffracted and modulated by the holographic pattern.

[0065] In one embodiment, the spatial light modulator (320) may include a liquid crystal display (LCD) panel, a liquid crystal on silicon (LCoS) panel, or a digital micromirror display (DMD) panel. However, the spatial light modulator (320) is not limited to the examples described above.

[0066] In one embodiment, the mask (330) (referred to as a “scattering mask” or “random mask”) may include the mask (230) of FIG. 2.

[0067] Hereinafter, the mask (330) will be described in detail with reference to FIG. 4.

[0068] FIG. 4 is a drawing for explaining a mask (330) according to one embodiment.

[0069] Referring to FIG. 4, in one embodiment, reference numeral 401 may be a drawing showing a side surface of a mask (330) (e.g., mask (410)).

[0070] In one embodiment, the pixel pitch of the mask (410) may be smaller than the pixel pitch of the spatial light modulator (320). For example, each of the plurality of pixels included in the mask (410) may have a length (e.g., horizontal length and / or vertical length) (also referred to as “pixel pitch”) of about 1 μm to about 4 μm.

[0071] In one embodiment, the arrangement of the thicknesses of the plurality of pixels included in the mask (410) (e.g., the thicknesses of the protrusions of the plurality of pixels) may not be periodic. For example, the thicknesses of the plurality of pixels (410-1, 410-2, 410-3, 410-4, 410-5, 410-6, 410-7, 410-8, 410-9, 410-10, 410-11, 410-12, 410-13) may be d1, d1, d2, d1, d1, d1, d2, d1, d1, d2, d1, depending on the arrangement order of the plurality of pixels. The pattern of thicknesses of a plurality of pixels (410-1, 410-2, 410-3, 410-4, 410-5, 410-6, 410-7, 410-8, 410-9, 410-10, 410-11, 410-12, 410-13) arranged sequentially, such as d1, d1, d2, d1, d1, d2, d1, d1, d2, d1, may not be periodic. For example, the plurality of pixels may be implemented so that the thicknesses are irregular.

[0072] In one embodiment, if the pattern of thicknesses of the plurality of pixels included in the mask (410) is non-periodic, the pattern of phases modulated by the plurality of pixels included in the mask (410) may also not be periodic. For example, the thicknesses of the plurality of pixels included in the mask (410) may correspond to phases (420) of light modulated by the plurality of pixels (e.g., amounts of modulated phases). For example, if the pattern of thicknesses of the plurality of pixels included in the mask (410) is non-periodic, the phases of light modulated by the plurality of pixels may not be periodic, such as π (radian), π, 0, π, π, π, 0, π, 0, π, π, 0, π.

[0073] In one embodiment, reference numeral 401 illustrates, but is not limited to, a mask (410) having pixels that can change the phase of light by one of two phases, such as 0 and π. For example, the mask (410) may include a mask having pixels that can change the phase of light by one of more than two phases (e.g., four phases, such as 0, π / 2, -π / 2, and π).

[0074] In one embodiment, reference numeral 401 illustrates, but is not limited to, a mask (410) capable of changing the phase of light. For example, the mask (330) may include a mask capable of changing the amplitude of light. For example, the mask (330) may include a mask capable of changing the amplitude and phase of light.

[0075] In one embodiment, reference numeral 402 may be a drawing representing a plane of a mask (330) (e.g., mask (410)). For example, reference numeral 401 may be a drawing representing the mask (410) viewed in a direction indicated by an arrow (451) in reference numeral 402. In the pixels of the mask (410) of reference numeral 402, black boxes (420-1, 420-2) may represent protrusions having a thickness of d1. In one embodiment, as illustrated in reference numeral 402, the pattern of thicknesses of a plurality of pixels arranged sequentially may not be periodic.

[0076] In one embodiment, the mask (410) can increase the viewing angle. For example, reference numeral 402 may be a drawing for explaining the viewing angle formed by the spatial light modulator (320) and the viewing angle formed by the mask (410) as light is modulated by the spatial light modulator (320) and the mask (410). Lights (411-1, 411-2) that propagate in parallel can be diffracted (and / or scattered) by the spatial light modulator (320) to form lights (421-1, 421-2, 421-3, 421-4, 421-5, 421-6). The above lights (421-1, 421-2, 421-3, 421-4, 421-5, 421-6) diffracted (and scattered) by the spatial light modulator (320) may be diffracted (and scattered) by the mask (410) to form lights (431-1, 431-2, 431-3, 431-4, 431-5, 431-6). In one embodiment, the ratio of the pixel pitch of the spatial light modulator (320) to the pixel pitch of the mask (410) may be substantially inversely proportional to the ratio of the viewing angle formed by the mask (410) to the viewing angle formed by the spatial light modulator (320). For example, if the pixel pitch of the spatial light modulator (320) is about twice the pixel pitch of the mask (410), the viewing angle (θ2) (or “diffusion angle”) formed by the mask (410) may be about twice the viewing angle (θ1) formed by the spatial light modulator (320).

[0077] In one embodiment, the memory (340) may store information for performing an operation of providing a hologram. The information for performing an operation of providing a hologram stored in the memory (340) will be described in detail below.

[0078] In one embodiment, the processor (350) may control the overall operation of providing a hologram. The processor (350) may include one or more processors for performing the operation of providing a hologram. The operation of providing a hologram performed by the processor (350) will be described below with reference to FIGS. 4 to 16.

[0079] In FIG. 3, the electronic device (301) is illustrated as including a light source (310), a spatial light modulator (320), a mask (330), a memory (340), and / or a processor (350), but is not limited thereto. For example, the electronic device (301) may further include at least one of the components of the electronic device (101) of FIG. 1 and the components of the electronic device (301) of FIG. 2. For example, the electronic device (301) may further include a mirror (225) and / or a holographic optical element (226) of FIG. 2.

[0080] FIG. 5 is a flowchart (500) for explaining a method for providing a holographic image according to one embodiment.

[0081] Referring to FIG. 5, in operation 501, in one embodiment, the processor (350) may obtain a target holographic image.

[0082] In one embodiment, a target holographic image (hereinafter referred to as a “target holographic image”) (e.g., the target holographic image (261) of FIG. 2) may be a holographic image that is the target of reproduction using an electronic device (301). For example, the target holographic image may be a holographic image that a user wants to reproduce through the electronic device (301).

[0083] In one embodiment, the target hologram image may be a hologram image stored in a memory (340) or a server wirelessly connected to the electronic device (301). The processor (350) may obtain the target hologram image from the memory (340) (or the server). For example, the processor (350) may select a target hologram image from among a plurality of target hologram images stored in the memory (340) based on a user input. The processor (350) may obtain the selected target hologram image as a target hologram image to be played back through the electronic device (301). For example, the processor (350) may obtain the target hologram image by receiving the target hologram image from a server wirelessly connected to the electronic device (301) through a communication circuit.

[0084] In one embodiment, the target holographic image may be a holographic image comprising one frame or a holographic image comprising multiple frames.

[0085] In operation 503, in one embodiment, the processor (350) may acquire a plurality of holograms (e.g., a plurality of final holograms to be described later) by performing learning based on possible alignment errors between the target hologram image, the spatial light modulator (320), and the mask (330). Hereinafter, the operation of acquiring a plurality of holograms will be described in detail with reference to FIGS. 6, 7, 8A, and 8B.

[0086] FIG. 6 is a flowchart (600) for explaining a method of obtaining multiple holograms according to one embodiment.

[0087] FIG. 7 is a drawing for explaining a method of obtaining a plurality of holograms according to one embodiment.

[0088] FIGS. 8A and 8B are drawings for explaining possible alignment errors between a spatial light modulator (320) and the mask (330) according to one embodiment.

[0089] Referring to FIGS. 6 to 8, in operation 601, in one embodiment, when a plurality of first holograms are sequentially provided to a spatial light modulator (320) within a preset time, a processor (350) can obtain a plurality of first hologram images predicted to be formed by light modulated by a mask (330) according to possible alignment errors between the spatial light modulator (320) and the mask (330) for the plurality of first holograms.

[0090] In one embodiment, in FIG. 7, the processor (350) may obtain (e.g., generate) a plurality of holograms (711, 712 to 713) (hereinafter referred to as “plurality of first holograms”) to be initially input into the optical propagation framework (720) based on a target hologram image (710).

[0091] In one embodiment, the processor (350) may acquire (e.g., generate) holographic images that include pixels having values ​​of pixels that are the same as the values ​​of pixels of the target holographic image (710) and having phases that are at least partially different from the phases of pixels of the target holographic image (710). For example, if the acquired holographic images include holographic image 1 and holographic image 2, the values ​​of the pixels of holographic image 1 and the values ​​of the pixels of holographic image 2 may be the same as the values ​​of the pixels of the target holographic image (710). The phases of the pixels of holographic image 1 and the phases of the pixels of holographic image 2 may be different from the phases of the pixels of the target holographic image (710). The phases of the pixels of holographic image 1 may be different from the phases of the pixels of holographic image 2.

[0092] In one embodiment, the processor (350) can obtain a plurality of first holograms by applying the obtained hologram images to an inverse wave function (also referred to as an “optical backpropagation function” or a “wave backpropagation function”). For example, the processor (350) can obtain (e.g., produce) a wave function (also referred to as an “optical backpropagation function” or a “wave backpropagation function”) for generating a hologram image from the hologram based on a path along which light emitted from the light source (310) travels and a position of the spatial light modulator (320) within the electronic device (301) (e.g., based on a path along which light emitted from the light source (310) travels and a position of the spatial light modulator (320) within the electronic device (301) assuming that the mask (330) is not included in the electronic device (301). The processor (350) can produce an inverse wave function for generating a hologram from the hologram image based on the obtained wave function. The processor (350) can obtain a plurality of first holograms to be initially (e.g., initially) input to the optical propagation framework (720) by applying the obtained hologram images (e.g., hologram images including pixels having values ​​of pixels that are the same as the values ​​of pixels of the target hologram image (710) and having phases that are at least partially different from the phases of pixels of the target hologram image (710)) to the produced inverse wave function.

[0093] In one embodiment, the number of the plurality of first holograms may be determined based on a scan rate of the spatial light modulator (320) (e.g., a frequency at which the spatial light modulator (320) outputs a hologram pattern). For example, the processor (350) may determine the maximum number of hologram patterns that the spatial light modulator (320) can output within a preset time (e.g., about 1 / 60 second as a maximum time during which a user cannot distinguish between the plurality of hologram images to be played back through the electronic device (301)) as the number of the plurality of first holograms. Hereinafter, for convenience of explanation, it will be explained assuming that the number of the plurality of first holograms is N (N is an integer).

[0094] In one embodiment, the processor (350) may, based on a plurality of first holograms, use a light propagation framework to obtain a plurality of first hologram images (hereinafter referred to as “a plurality of first hologram images”) predicted to be formed by light modulated by the spatial light modulator (320) and the mask (330) for each of the plurality of first holograms and possible alignment errors that may occur between the spatial light modulator (320) and the mask (330).

[0095] In one embodiment, the optical propagation framework (720) may be a framework capable of performing a simulation operation on a hologram, assuming that the environment (or condition) of the electronic device (301) is the same as the actual environment of the electronic device (301) (e.g., the state of the electronic device (301) of FIG. 2), except for an error in the alignment of the spatial light modulator (320) and the mask (330) (e.g., a difference between the alignment state between the spatial light modulator (320) and the mask (330) that allows the hologram image to be reproduced on a position or plane set by the electronic device (301) and the actual alignment state between the spatial light modulator (320) and the mask (330)) (hereinafter referred to as “alignment error”). For example, the light propagation framework (720) may include wave functions for generating a holographic image predicted to be reproduced by light modulated by the spatial light modulator (320) and the mask (330) when a hologram (e.g., a holographic signal or holographic data) is provided to the spatial light modulator (320) according to possible alignment errors in the environment of the electronic device (301) described above. In one embodiment, the light propagation framework (720) may be implemented in software. However, the present invention is not limited thereto, and the light propagation framework (720) may be implemented in hardware. In one embodiment, the light propagation framework (720) may be included in the electronic device (301) or included in a server.

[0096] In one embodiment, possible alignment errors between the spatial light modulator (320) and the mask (330) can be assumed to occur at various pixel spacings.

[0097] In one embodiment, reference numeral 801 of FIG. 8A and reference numeral 804 of FIG. 8B may indicate a case where there is no alignment error between the spatial light modulator (320) and the mask (330) (e.g., a case where the alignment error between the spatial light modulator (320) and the mask (330) is 0 pixels). For example, as illustrated in reference numeral 801, when there is no alignment error, the position of the pixel (321) of the spatial light modulator (320) may correspond to the positions of the pixels (331-1, 331-2, 331-3, 331-4) of the mask (330), and the position of the pixel (322) of the spatial light modulator (320) may correspond to the positions of the pixels (332-1, 332-2, 332-3, 332-4) of the mask (330).

[0098] In one embodiment, reference numeral 802 of FIG. 8A and reference numeral 805 of FIG. 8B may indicate a case where an alignment error occurs by 1 pixel with respect to the -X axis between the spatial light modulator (320) and the mask (330). For example, as illustrated in reference numeral 802, when an alignment error occurs by 1 pixel with respect to the -X axis, the position of the pixel (321) of the spatial light modulator (320) may not correspond to the positions of the pixels (331-1, 331-2, 331-3, 331-4) of the mask (330), and the position of the pixel (322) of the spatial light modulator (320) may not correspond to the positions of the pixels (332-1, 332-2, 332-3, 332-4) of the mask (330).

[0099] In one embodiment, reference numeral 803 of FIG. 8A and reference numeral 806 of FIG. 8B may indicate a case where an alignment error occurs by 2 pixels with respect to the -X axis between the spatial light modulator (320) and the mask (330). For example, as illustrated in reference numeral 803, when an alignment error occurs by 2 pixels with respect to the -X axis, the position of the pixel (321) of the spatial light modulator (320) may not correspond to the positions of the pixels (331-1, 331-2, 331-3, 331-4) of the mask (330), and the position of the pixel (322) of the spatial light modulator (320) may not correspond to the positions of the pixels (332-1, 332-2, 332-3, 332-4) of the mask (330).

[0100] Although the alignment errors between the spatial light modulator (320) and the mask (330) are illustrated as occurring with respect to the -X axis in reference numerals 802 and 803 of FIG. 8A and reference numerals 805 and 806 of FIG. 8B, they are not limited thereto. For example, the alignment errors between the spatial light modulator (320) and the mask (330) may include one or more of an alignment error with respect to the X axis, an alignment error with respect to the Y axis, an alignment error with respect to the Z axis, an alignment error due to relative rotation of the mask (330) with respect to the spatial light modulator (320) with respect to the X axis, an alignment error due to relative rotation of the mask (330) with respect to the spatial light modulator (320) with respect to the Y axis, or an alignment error due to relative rotation of the mask (330) with respect to the spatial light modulator (320) with respect to the Z axis.

[0101] In one embodiment, the light propagation framework (720) can output, for each of the plurality of first holograms, a plurality of first hologram images predicted to be output when the first hologram is provided to the spatial light modulator (320) according to alignment errors. For example, when the first hologram (711) is input to the light propagation framework (720), the light propagation framework (720) can output a predicted first hologram image (731-1) when the alignment error is 0 pixels (when there is no alignment error) or a predicted m-th hologram image (731-m) when the alignment error is m pixels (where m is an integer). For example, when a first hologram (712) is input to a light propagation framework (720), the light propagation framework (720) can output a first hologram image (732-1) predicted when the alignment error is 1 pixel, or an m-th hologram image (732-m) predicted when the alignment error is m pixels. For example, when a first hologram (713) is input to a light propagation framework (720), the light propagation framework (720) can output a first hologram image (733-1) predicted when the alignment error is 0 pixel, or an m-th hologram image (733-m) predicted when the alignment error is m pixels.

[0102] In one embodiment, the processor (350) can control an operation of sequentially inputting a plurality of first holograms (711, 712 to 713) into the optical propagation framework (720). As the plurality of first holograms (711, 712 to 713) are sequentially input into the optical propagation framework (720), a set of first hologram images (731-1 to 731-m), and a set of first hologram images (732-1 to 732-m) or a set of first hologram images (733-1 to 733-m) can be sequentially output from the optical propagation framework (720).

[0103] In one embodiment, the alignment errors in FIG. 7 illustrate, but are not limited to, alignment errors about one axis (e.g., the X-axis of FIGS. 8A and 8B). For example, the alignment errors may include at least one of alignment errors about the X-axis, alignment errors about the Y-axis, alignment errors about the Z-axis, alignment errors due to relative rotation of the mask (330) with respect to the spatial light modulator (320) about the X-axis, alignment errors due to relative rotation of the mask (330) with respect to the spatial light modulator (320) about the Y-axis, and alignment errors due to relative rotation of the mask (330) with respect to the spatial light modulator (320) about the Z-axis.

[0104] In operation 603, in one embodiment, the processor (350) may obtain a plurality of second holographic images (hereinafter referred to as “a plurality of second holographic images”) by overlapping a plurality of first holographic images by alignment errors.

[0105] In one embodiment, the processor (350) may perform an operation (740) of overlapping a plurality of first hologram images according to alignment errors. For example, when the alignment error is 0 pixels, the processor (350) may obtain (e.g., produce) the second hologram image (741-1) by adding the first hologram image (731-1) to the first hologram image (733-1) output by the optical propagation framework (720). For example, when the alignment error is m pixels, the processor (350) may obtain (e.g., produce) the second hologram image (741-m) by adding the first hologram image (731-m) to the first hologram image (733-m) output by the optical propagation framework (720).

[0106] In operation 605, in one embodiment, a loss can be obtained based on errors between a plurality of second hologram images and a target hologram.

[0107] In one embodiment, the processor (350) can obtain (e.g., calculate) errors between a plurality of second hologram images and a target hologram. For example, in FIG. 7, the processor (350) can obtain an error (e1) between the second hologram image (741-1) and the target hologram image (710) to an error (e) between the second hologram image (741-m) and the target hologram image (710). m ) can be produced.

[0108] In one embodiment, the processor (350) may obtain a loss based on errors between a plurality of second hologram images and a target hologram image. For example, the processor (350) may obtain a loss (751) by inputting the errors into a preset loss function (hereinafter referred to as a "loss function") (750).

[0109] In one embodiment, the loss function may include the mean squared error (MSE). However, the loss function is not limited to MSE. For example, the loss function may be a function that sums the errors.

[0110] In operation 607, in one embodiment, the processor (350) may obtain a plurality of holograms (e.g., a plurality of final holograms described below) based on the loss.

[0111] In one embodiment, the processor (350) may obtain (e.g., calculate) a slope (also referred to as a “gradient”) of a loss function using gradient descent when a loss is obtained through operation 605. Based on the obtained slope, the processor (350) may obtain (760) a plurality of holograms to be inputted after the plurality of first holograms into the light propagation framework (720).

[0112] In one embodiment, the processor (350) may obtain a plurality of holograms (hereinafter referred to as “plurality of final holograms”) by repeatedly performing the operation of obtaining a plurality of holograms to be input after the plurality of first holograms described above, from the operation 601 described above to the operation of obtaining the plurality of holograms to be input after the plurality of first holograms, so as to minimize loss (e.g., an output value of a loss function). For example, the processor (350) may repeatedly perform the operation of obtaining a plurality of holograms to be input after the plurality of first holograms described above. If the loss is minimized while repeatedly performing the operation of obtaining a plurality of holograms to be input after the plurality of first holograms described above, from the operation 601 described above to the operation of obtaining the plurality of holograms to be input after the plurality of first holograms (e.g., if the loss is not reduced while repeatedly performing the operation of obtaining a plurality of holograms to be input after the plurality of first holograms described above), the processor (350) may determine the plurality of holograms that were input into the light propagation framework (720) as the plurality of final holograms.

[0113] Below, the operation of obtaining multiple final holograms using a loss function will be described in more detail.

[0114] In one embodiment, the processor (350) may obtain (e.g., calculate) a loss function. The operation of obtaining the loss function may be performed before performing operation 501 of FIG. 5.

[0115] In one embodiment, the processor (350) inputs a plurality of holograms to the optical propagation framework (720) to x i (1, 2, ..., n-1, n ∈ i, where n represents the number of multiple holograms to be input to the optical propagation framework (720)) can be set. The processor (350) processes the output of the optical propagation framework (720) as a function f j (x i) can be set to (1, 2, ..., m-1, m ∈ j) (where m represents the alignment error). The function f j (x i ) may represent wave functions for producing a holographic image predicted to be reproduced by light modulated by the spatial light modulator (320) and the mask (330) when the hologram is provided to the spatial light modulator (320) for each alignment error. The processor (350) may output the outputs f of the light propagation framework (720) for each alignment error. j (x i ) by nesting (e.g. summing) the nested functions by alignment error The processor (350) can calculate the overlap function and the error between the target hologram image for each alignment error, and can calculate the loss function based on the calculated error.

[0116]

[0117]

[0118] In one embodiment, in [Equation 1] and [Equation 2], T may represent a target holographic image.

[0119] In one embodiment, the processor (350) performs the operations described above to obtain a loss function (e.g., the loss function of [Equation 2]), and then, when a target hologram image is confirmed (e.g., when a target hologram image is confirmed in operation 501), a plurality of first holograms (e.g., x initially input) to be initially input to the light propagation framework (720) are generated. i) can be obtained. The processor (350) can calculate the first loss by applying (e.g., substituting) the plurality of first holograms and the target hologram image to the loss function. Based on the first loss and the loss function, the processor (350) can use the gradient descent method to calculate holograms to be input to the light propagation framework (720) after the plurality of first holograms. The processor (350) can update the holograms input to the light propagation framework (720) by repeating the operations described above. The processor (350) can continuously obtain losses using the updated holograms. Based on confirming that the obtained losses are no longer reduced, the processor (350) can determine the holograms finally input to the light propagation framework (720) as the plurality of final holograms.

[0120] Referring back to FIG. 5, at operation 505, in one embodiment, the processor (350) may control the spatial light modulator (320) to output a pattern based on a plurality of holograms (a plurality of final holograms).

[0121] In one embodiment, the processor (350) may control the spatial light modulator (320) to sequentially output a plurality of hologram patterns corresponding to each of the plurality of holograms within a preset time period. For example, the processor (350) may provide a plurality of holograms and a control signal to a driving circuit (also referred to as a “driver”) of the spatial light modulator (320). The driving circuit of the spatial light modulator (320) may control a panel of the spatial light modulator (320) based on the control signal such that the panel of the spatial light modulator (320) sequentially outputs a plurality of hologram patterns corresponding to the plurality of holograms within a preset time period. For example, the processor (350) may provide a plurality of holograms to the driving circuit of the spatial light modulator (320). The driving circuit of the spatial light modulator (320) can control the panel of the spatial light modulator (320) to sequentially output a plurality of hologram patterns corresponding to the plurality of holograms within a preset time based on preset settings.

[0122] Although not described through FIGS. 5, 6, 7, 8a, and 8b, in one embodiment, the processor (350) can set a maximum value of the alignment error between the spatial light modulator (320) and the mask (330) set in the light propagation framework (720) (e.g., m pixels as the alignment error between the spatial light modulator (320) and the mask (330) in FIG. 7). For example, the processor (350) can set a maximum value of the alignment error between the spatial light modulator (320) and the mask (330) set in the light propagation framework (720) based on a user input.

[0123] FIG. 9 is a diagram illustrating a method for obtaining a loss function according to one embodiment.

[0124] Referring to FIG. 9, in one embodiment, the processor (350) may set different weights for each alignment error between the spatial light modulator (320) and the mask (330) when obtaining a loss function.

[0125] In one embodiment, as described above, an alignment error may occur between the spatial light modulator (320) and the mask (330). For example, reference numeral 901 may indicate a case where the alignment error between the spatial light modulator (320) and the mask (330) is 0. Reference numeral 902 may indicate a case where the alignment error between the spatial light modulator (320) and the mask (330) is 1 pixel with respect to the Y-axis. Reference numeral 903 may indicate a case where the alignment error between the spatial light modulator (320) and the mask (330) is 10 pixels with respect to the Y-axis. In reference numerals 901 to 903, an arrow (911) indicates the direction of propagation of light, and in reference numerals 902 and 903, a dotted line (330-1) may indicate a state aligned with the spatial light modulator (320) (e.g., a state in which the alignment error between the spatial light modulator (320) and the mask (330) is 0).

[0126] In one embodiment, the smaller the alignment error between the spatial light modulator (320) and the mask (330), the higher the probability of alignment error occurrence. For example, when manufacturing the electronic device (301), the spatial light modulator (320) and the mask (330) may be positioned within the electronic device (301) such that the alignment error between the spatial light modulator (320) and the mask (330) is minimized (e.g., the alignment error is substantially 0 pixels). Accordingly, the smaller the alignment error between the spatial light modulator (320) and the mask (330), the higher the probability of alignment error occurrence.

[0127] In one embodiment, the processor (350) may set (e.g., assign) a higher weight to the error (e.g., the error of [Mathematical Formula 1]) for each alignment error between the spatial light modulator (320) and the mask (330) as the alignment error between the spatial light modulator (320) and the mask (330) becomes smaller.

[0128] In one embodiment, the processor (350) may set different weights for each alignment error between the spatial light modulator (320) and the mask (330) based on a probability distribution function (e.g., a normal distribution function). For example, reference numeral 904 may represent a graph (941) of a normal distribution function (e.g., a probability density function f(x) with a mean of μ and a standard deviation of σ). In reference numeral 904, x1 may represent an alignment error of 0 pixels, x2 may represent an alignment error of 1 pixel, x9 may represent an alignment error of 9 pixels, and x10 may represent an alignment error of 1 pixel. The processor (350) may set a value obtained by multiplying the area A1 by 2 as an integral value of f(x) between μ and x1 as a weight for an error corresponding to an alignment error of 0 pixels. The processor (350) may set a value (probability) obtained by multiplying the area A2 by 2 as the integral value of f(x) between x1 and x2 as a weight for an error corresponding to an alignment error of 1 pixel. The processor (350) may set a value obtained by multiplying the area A10 by 2 as the integral value of f(x) between x9 and x10 as a weight for an error corresponding to an alignment error of 10 pixels.

[0129] In one embodiment, the processor (350) may obtain (e.g., calculate) a loss function, such as [Mathematical Formula 3] below, based on the set weights.

[0130]

[0131] In one embodiment, in [Equation 3], T represents a target hologram image, and aj may represent weights for each error due to alignment errors between the spatial light modulator (320) and the mask (330). In one embodiment, the sum of the weights may be substantially 1. However, the present invention is not limited thereto. For example, the processor (350) may set all of the weights to the same value.

[0132] FIG. 10 is a diagram for explaining a method of setting a light propagation framework (720) based on a phase error of a mask (330) according to one embodiment.

[0133] Referring to FIG. 10 , in one embodiment, phases corresponding to pixels included in a mask (e.g., phases of light changed by pixels included in a mask (330)) may be different from phases set (e.g., intended by a designer) when designing the mask (330). For example, errors in the thicknesses of some pixels of the mask (330) may occur when manufacturing the mask (330). In FIG. 10 , reference numeral 1011 may indicate a mask (1011) intended when designed. As illustrated in FIG. 10 , the thickness of a pixel (1051) of the mask (1011) may be intended to be d1 when designed, but the thickness of the manufactured pixel (1051) may be d3, as indicated by the dotted line (1041). Additionally, in pixels (1052) and pixels (1053), the thicknesses of the actually manufactured pixels (1052) and pixels (1053) indicated by the design thicknesses and the dotted lines (1042, 1043) may be different. In FIG. 10, reference numeral 1010 denotes first phases corresponding to pixels included in the intended mask (1011) during mask design, reference numeral 1020 denotes second phases corresponding to pixels included in the actually manufactured mask (1011), and reference numeral 1030 may denote the difference between the first phases and the second phases.

[0134] In one embodiment, the processor (350) may set (or adjust) the light propagation framework (720) by taking into account design and manufacturing errors (hereinafter referred to as “mask phase errors”) for phases corresponding to pixels included in the mask (330). For example, as described above, if the input of the light propagation framework (720) is x i In this case, the output of the photopropagation framework (720) is the function f j (x i ) can be set as follows. For example, the processor (350) may set the input of the optical propagation framework (720) to x based on the phase errors of the mask (330) that may occur. i In this case, a function representing the output of the optical propagation framework (720) can be set as in [Mathematical Formula 4] below.

[0135]

[0136] In [Equation 4], b k For each pixel of the mask (330), it can represent the possible phase errors. For example, if the mask (330) includes a first pixel and a second pixel, b k can represent each of the combinations of possible errors for the first pixel and possible errors for the second pixel.

[0137] In one embodiment, the processor (350) can obtain (e.g., calculate) a loss function by performing the operations described above when a light propagation framework (720) such as [Mathematical Formula 4] is set.

[0138] FIG. 11 is a drawing for explaining a method of obtaining one hologram according to one embodiment.

[0139] Referring to FIG. 11, in one embodiment, the above-described examples describe an operation of acquiring multiple holograms (multiple final holograms), but are not limited thereto. For example, the processor (350) may acquire a single final hologram.

[0140] In one embodiment, the processor (350) may obtain (e.g., generate) a hologram (1111) to be initially input into the optical propagation framework (1120) based on a target hologram image (1110) (e.g., the target hologram image (261)). For example, the processor (350) may obtain (e.g., generate) a hologram image including pixels having values ​​that are the same as the values ​​of the pixels of the target hologram image (1110) and having phases that are at least partially different from the phases of the pixels of the target hologram image (1110). The processor (350) may obtain the hologram (1111) by applying the hologram image to an inverse wave function.

[0141] In one embodiment, the processor (350) may output a first hologram image predicted to be output when the hologram (1111) is provided to the spatial light modulator (320) according to alignment errors for the hologram (1111). For example, the light propagation framework may output a predicted hologram image (1131) when the alignment error is 0 pixels (when there is no alignment error) or a predicted hologram image (1131-m) when the alignment error is m pixels (where m is an integer).

[0142] In one embodiment, the processor (350) calculates errors (e1 to e) between the hologram image (1131) to the hologram image (1131-m) and the target hologram image (1110). m ) can be obtained (e.g., produced).

[0143] In one embodiment, the processor (350) calculates errors (e1 to e) between the hologram image (1131) to the hologram image (1131-m) and the target hologram image (1110). m ), the loss can be obtained. For example, the processor (350) can obtain the errors (e1 to e) for the loss function. m ) can be applied (1150) (e.g., by substitution), and the loss (1151) can be obtained.

[0144] In one embodiment, the processor (350) may obtain (e.g., calculate) the gradient of the loss function using the gradient descent method when the loss (1151) is obtained. Based on the obtained gradient and the loss function, the processor (350) may obtain (1160) a hologram to be inputted next to the hologram (1111) into the light propagation framework.

[0145] In one embodiment, the processor (350) can obtain a hologram (hereinafter referred to as a “final hologram”) with minimal loss by repeatedly performing the operations described above.

[0146] In one embodiment, the processor (350) can control the spatial light modulator (320) to output a hologram pattern corresponding to the final hologram.

[0147] FIG. 12 is a drawing for explaining a method for providing a holographic image according to one embodiment.

[0148] Referring to FIG. 12, in one embodiment, reference numerals 1211-1, 1211-2, and 1211-3 through 1211-N in FIG. 12 represent a plurality of final holograms (h1, h2, and h3 through h) to be provided to the spatial light modulator (320). N ) can be represented. Multiple final holograms (h1, h2, and h3 to h N ) can be obtained by performing the operations described through FIGS. 2 to 11.

[0149] In one embodiment, the processor (350) generates a plurality of final holograms (h1, h2, and h3 to h N ) can be sequentially provided to the spatial light modulator (320) within a preset time.

[0150] In one embodiment, the processor (350) generates a plurality of final holograms (h1, h2, and h3 to h N ) can control the spatial light modulator (320) so that a plurality of hologram patterns corresponding to each of the plurality of holograms are sequentially output within a preset time. For example, the processor (350) can provide a plurality of holograms and a control signal to the driving circuit of the spatial light modulator (320). The driving circuit of the spatial light modulator (320) can control the panel of the spatial light modulator (320) based on the control signal so that the panel of the spatial light modulator (320) sequentially outputs a plurality of hologram patterns corresponding to the plurality of holograms within a preset time. For example, the processor (350) can provide a plurality of holograms to the driving circuit of the spatial light modulator (320). The driving circuit of the spatial light modulator (320) can control the panel of the spatial light modulator (320) so that the plurality of hologram patterns corresponding to the plurality of holograms are sequentially output within a preset time based on a preset setting.

[0151] In one embodiment, a plurality of final holograms (h1, h2, and h3 through h N) as the number of hologram patterns can be determined based on the scan rate of the spatial light modulator (320) (e.g., the frequency at which the spatial light modulator (320) outputs the hologram pattern). For example, the processor (350) can determine the maximum number of hologram patterns that the spatial light modulator (320) can output within a preset time (e.g., about 1 / 60 second as the maximum time during which a user cannot distinguish between multiple hologram images to be played back through the electronic device (301)) as N.

[0152] In one embodiment, if the target hologram image is one image (e.g., one frame), a plurality of final holograms (h1, h2, and h3 to h N ) may be holograms acquired based on a single target hologram image. If the target hologram image is a plurality of images (e.g., an image including a plurality of frames), a plurality of final holograms may be acquired for each of the plurality of images.

[0153] In one embodiment, the light (1271) comprises a plurality of final holograms (h1, h2, and h3 to h N ) may represent light modulated by a plurality of hologram patterns corresponding to each other. In one embodiment, light (1272) may represent light modulated by the plurality of hologram patterns and then modulated again by the mask (330). In one embodiment, reference numeral 1261 indicates the direction of propagation of light (1272), and the dotted line (330-2) may represent the mask (330) when the alignment error between the spatial light modulator (320) and the mask (330) is 0 pixel.

[0154] In one embodiment, light (1273) may represent light that converges to the user's eye (1250) by transmitting light (1272) through an optical element (1240) (e.g., an eyepiece lens). The optical element (1240) may generate a plurality of final holograms (h1, h2, and h3 through h N) can be played sequentially as virtual images within a preset time.

[0155] In one embodiment, a plurality of final holograms (h1, h2, and h3 to h) are acquired based on possible alignment errors between the spatial light modulator (320) and the mask (330). N ), multiple final holograms (h1, h2, and h3 to h N ) are sequentially reproduced within a preset time, so that the plurality of hologram images having a quality higher than the preset quality can be reproduced with respect to actual alignment errors between the spatial light modulator (320) and the mask (330).

[0156] In one embodiment, although the electronic device (301) is exemplified as an HMD device capable of reproducing a holographic image in FIGS. 2 to 12, it is not limited thereto. For example, the electronic device (301) may be a device (e.g., a server, a PC, a laptop) that can generate a plurality of holograms (e.g., a plurality of final holograms) by performing the operations described above, and provide the generated holographic images to an HMD capable of reproducing the holographic images, without including components for reproducing the holographic images, such as a spatial light modulator (320), a mask (330), and optical elements.

[0157] FIG. 13 is a flowchart (1300) for explaining a method of providing a holographic image according to one embodiment.

[0158] Referring to FIG. 13, in operation 1301, in one embodiment, the processor (350) may obtain a target holographic image (e.g., target holographic image (261)).

[0159] Since operation 1301 is at least partially identical or similar to operation 501 of FIG. 5, a detailed description thereof will be omitted.

[0160] In operation 1303, in one embodiment, the processor (350) may acquire a plurality of holograms (hereinafter referred to as “plurality of final holograms”) using an artificial intelligence model based on the target hologram image. Hereinafter, the operation of learning the artificial intelligence model will be described in detail with reference to FIG. 14.

[0161] FIG. 14 is a diagram illustrating a method for obtaining an artificial intelligence model according to one embodiment.

[0162] Referring to FIG. 14, in one embodiment, an input hologram image (1410) may be input data input to an artificial neural network (1420).

[0163] In one embodiment, the ground truth used for learning may be a plurality of holograms (1431-1, 1431-2 to 1431-N) corresponding to the hologram image (1410).

[0164] In one embodiment, the plurality of holograms (1431-1, 1431-2 to 1431-N) corresponding to the input hologram image (1410) may be a plurality of final holograms obtained in learning in which the input hologram image (1410) is used as a target hologram image (e.g., target hologram image (710), target hologram image (1110)) in the operations described through FIGS. 2 to 13. For example, the plurality of holograms (1431-1, 1431-2 to 1431-N) may be a plurality of final holograms obtained by performing operation 503 of FIG. 5 using the input hologram image (1410) (e.g., obtained by performing learning based on possible alignment errors between the hologram image (1410) and the spatial light modulator (320) and the mask (330).

[0165] In one embodiment, the artificial neural network (1420) can output a plurality of first hologram images (1421-1, 1421-2 to 1421-N) when an input hologram image (1410) is input, under the control of the processor (350).

[0166] In one embodiment, the processor (350) calculates errors (e1, e2 to e) between the plurality of first hologram images (1421-1, 1421-2 to 1421-N) and the plurality of holograms (1431-1, 1431-2 to 1431-N) as the correct answer. N ) can be obtained.

[0167] In one embodiment, the processor (350) calculates errors (e1, e2 to e N ), a loss function (1441) can be obtained (1440). In one embodiment, the loss function can include mean squared error (MSE). However, the loss function is not limited to MSE. For example, the loss function can include errors (e1, e2 to e N ) may be a summation function.

[0168] In one embodiment, the processor (350) may learn (e.g., update) an artificial intelligence model (e.g., weights of an artificial neural network (1420)) using gradient descent for a loss function. For example, the processor (350) may calculate the gradient of the loss function. Based on the obtained gradient, the processor (350) may update the weights of the artificial neural network.

[0169] In one embodiment, the processor (350) can obtain an artificial intelligence model (e.g., weights of an artificial neural network) by repeatedly performing the operations described above.

[0170] In the examples described above, the operation of learning an artificial intelligence model is described as being performed by the processor (350), but is not limited thereto. At least a portion of the operation of learning an artificial intelligence model described above may be performed on a server capable of wireless connection with the electronic device (301).

[0171] Referring back to FIG. 13, in one embodiment, the processor (350) may obtain a plurality of final holograms by inputting a target hologram image into an artificial neural network (e.g., an artificial neural network (1420)) that utilizes a learned artificial intelligence model (e.g., learned weights).

[0172] In operation 1305, in one embodiment, the processor (350) may control the spatial light modulator (320) to output a pattern based on the plurality of holograms.

[0173] Since operation 1305 is at least partially identical or similar to operation 505 of FIG. 5, a detailed description thereof will be omitted.

[0174] FIG. 15 is a drawing for explaining hologram images reproduced based on the operation of a comparative example according to one embodiment.

[0175] FIG. 16 is a drawing for explaining hologram images reproduced based on an operation of providing a hologram according to one embodiment.

[0176] Referring to FIGS. 15 and 16 , in one embodiment, the operation of the comparative example may be an operation of obtaining a hologram corresponding to a target hologram image, assuming that the alignment error between the spatial light modulator (320) and the mask (330) is 0 pixels. For example, the operation of the comparative example may include an operation of the light propagation framework (e.g., the light propagation framework (720)) in FIG. 11 outputting a hologram image only when the alignment error is 0 pixels (considering only the case where the alignment error is 0 pixels) when a hologram is input, and an operation of obtaining a hologram such that the acquired loss is minimized based on one error between the output hologram image and the target hologram image.

[0177] In one embodiment, in FIG. 15, the hologram image (1520) may be a hologram image reproduced by providing a hologram obtained by performing the operation of the comparative example using the target hologram image (1510) to the spatial light modulator (320) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 0 pixels to the spatial light modulator (320). The hologram image (1530) may be a hologram image reproduced by providing a hologram obtained by performing the operation of the comparative example using the target hologram image (1510) to the spatial light modulator (320) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 5 pixels. The hologram image (1540) may be a hologram image reproduced by providing a hologram obtained by performing the operation of the comparative example using the target hologram image (1510) to the spatial light modulator (320) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 10 pixels.

[0178] In one embodiment, in FIG. 16, the hologram image (1620) may be a hologram image reproduced by providing to the spatial light modulator (320) a plurality of final holograms obtained by performing operations 501 to 505 described above using the target hologram image (1510) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 0 pixels. The hologram image (1630) may be a hologram image reproduced by providing to the spatial light modulator (320) a plurality of final holograms obtained by performing operations 501 to 505 described above using the target hologram image (1510) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 5 pixels. The hologram image (1640) may be a hologram image reproduced by providing a plurality of final holograms obtained by performing the above-described operations 501 to 505 using the target hologram image (1510) to the spatial light modulator (320) when the actual alignment error between the spatial light modulator (320) and the mask (330) is 10 pixels.

[0179] In one embodiment, when comparing the hologram image (1520) and the hologram image (1620) in FIGS. 15 and 16, when the actual alignment error between the spatial light modulator (320) and the mask (330) is 0 pixels, there may be substantially no difference in the image quality of the hologram image (1520) and the image quality of the hologram image (1620). When comparing the hologram image (1520) and the hologram image (1530) with the hologram image (1620) and the hologram image (1630), respectively, as the actual alignment error between the spatial light modulator (320) and the mask (330) increases, the difference between the image quality of the hologram image reproduced based on the operation of the comparative example and the image quality of the hologram image reproduced by providing the plurality of final holograms obtained by performing the above-described operations 501 to 505 using the target hologram image (1510) to the spatial light modulator (320) may increase.

[0180] It should be understood that the embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0181] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0182] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0183] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0184] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0185] An electronic device (301) according to one embodiment may include a light source (310), a spatial light modulator (320) configured to modulate light emitted from the light source (310), a mask (330) configured to modulate light modulated by the spatial light modulator (320), a memory (340), and at least one processor (350). The at least one processor (350) may acquire a plurality of holograms by performing learning based on a target hologram image and possible alignment errors between the spatial light modulator (320) and the mask (330). The at least one processor (350) may control the spatial light modulator (320) to output a pattern based on the acquired plurality of holograms so that light emitted from the light source is modulated. Light modulated by the spatial light modulator (320) is modulated by the mask (330), so that a plurality of hologram images corresponding to the plurality of holograms can be sequentially formed within a preset time.

[0186] In one embodiment, the at least one processor (350) may obtain a plurality of first hologram images predicted to be formed by light modulated by the mask (330) for each of the plurality of first holograms according to the alignment errors when the plurality of first holograms are sequentially provided to the spatial light modulator (320) within the preset time. The at least one processor (350) may obtain a plurality of second hologram images by overlapping the plurality of first hologram images according to the alignment errors. The at least one processor (350) may obtain a loss based on errors between the plurality of second hologram images and the target hologram image. The at least one processor (350) may obtain the plurality of holograms based on the loss.

[0187] In one embodiment, the at least one processor (350) can obtain holographic images including pixels having values ​​identical to the values ​​of pixels of the target holographic image and having phases at least partially different from the phases of pixels of the target holographic image. The at least one processor (350) can obtain the plurality of first holograms by applying the obtained holographic images to an inverse wave function.

[0188] In one embodiment, the electronic device (301) may include a light propagation framework configured to output hologram images predicted to be formed by light modulated by the mask (330) for each alignment error when sequentially providing holograms to the spatial light modulator (320) within the preset time. The at least one processor (350) may obtain superimposed hologram images by overlapping the hologram images for each alignment error. The at least one processor (350) may obtain a loss function based on errors between the superimposed hologram images and the target hologram image. The at least one processor (350) may obtain the plurality of holograms such that the loss function is minimized by using a gradient descent method.

[0189] In one embodiment, the at least one processor (350) may set weights for errors between the overlapping hologram images and the target hologram image, based on a probability distribution function, such that the smaller the alignment error corresponding to the error, the higher the weight.

[0190] In one embodiment, the optical propagation framework may be configured to output holographic images predicted to be formed by light modulated by the mask (330) based on phases modulated by pixels included in the mask (330) and phase errors between phases set during design of the mask (330) for each alignment error for the holograms.

[0191] In one embodiment, the at least one processor (350) may receive the target hologram image from a server wirelessly connected to the electronic device (301) through a communication circuit or obtain the target hologram image from the memory (340).

[0192] In one embodiment, the at least one processor (350) may set the number of possible alignment errors between the target holographic image and the spatial light modulator (320) and the mask (330) based on user input.

[0193] In one embodiment, the at least one processor (350) may determine the number of the plurality of holograms based on the scan rate of the spatial light modulator (320).

[0194] According to one embodiment, a method for providing a holographic image in an electronic device (301) may include an operation of acquiring a plurality of holograms by performing learning based on alignment errors that may occur between a target holographic image, a spatial light modulator (320) of the electronic device (301) and a mask (330) of the electronic device (301), and an operation of controlling the spatial light modulator (320) to output a pattern based on the acquired plurality of holograms such that light emitted from the light source is modulated. Light modulated by the spatial light modulator (320) may be modulated by the mask (330) so that a plurality of holographic images corresponding to the plurality of holograms may be sequentially formed within a preset time.

[0195] In one embodiment, the operation of obtaining the plurality of holograms may include an operation of obtaining a plurality of first hologram images predicted to be formed by light modulated by the mask (330) for each of the alignment errors when the plurality of first holograms are sequentially provided to the spatial light modulator (320) within the preset time. The operation of obtaining the plurality of holograms may include an operation of obtaining a plurality of second hologram images by overlapping the plurality of first hologram images for each of the alignment errors. The operation of obtaining the plurality of holograms may include an operation of obtaining a loss based on errors between the plurality of second hologram images and the target hologram image. The operation of obtaining the plurality of holograms may include an operation of obtaining the plurality of holograms based on the loss.

[0196] In one embodiment, the operation of obtaining the plurality of first holographic images may include an operation of obtaining holographic images including pixels having values ​​of pixels identical to values ​​of pixels of the target holographic image and having phases that are at least partially different from phases of pixels of the target holographic image. The operation of obtaining the plurality of holograms may include an operation of obtaining the plurality of first holograms by applying the obtained holographic images to an inverse wave function.

[0197] In one embodiment, the electronic device (301) may include a light propagation framework configured to output hologram images predicted to be formed by light modulated by the mask (330) for each alignment error when sequentially providing holograms to the spatial light modulator (320) within the preset time. The method may further include an operation of obtaining superimposed hologram images by overlapping the hologram images for each alignment error. The method may further include an operation of obtaining a loss function based on errors between the superimposed hologram images and the target hologram image. The method may further include an operation of obtaining the plurality of holograms such that the loss function is minimized using a gradient descent method.

[0198] In one embodiment, the operation of obtaining the loss function may include an operation of setting weights for errors between the overlapping hologram images and the target hologram image, based on a probability distribution function, such that the smaller the alignment error corresponding to the error, the higher the weight.

[0199] In one embodiment, the optical propagation framework may be configured to output holographic images predicted to be formed by light modulated by the mask (330) based on phases modulated by pixels included in the mask (330) and phase errors between phases set during design of the mask (330) for each alignment error for the holograms.

[0200] In one embodiment, the method may further include receiving the target hologram image from a server wirelessly connected to the electronic device (301) through a communication circuit or obtaining the target hologram image from the memory (340).

[0201] In one embodiment, the method may further include an operation of setting a number of possible alignment errors between the target holographic image and the spatial light modulator (320) and the mask (330) based on a user input.

[0202] In one embodiment, the method may further include an operation of determining the number of the plurality of holograms based on a scan rate of the spatial light modulator (320).

[0203] According to one embodiment, an electronic device (301) may include a light source (310) that emits light, a spatial light modulator (320) configured to modulate light emitted from the light source (310), a mask (330) configured to modulate light modulated by the spatial light modulator (320), a memory (340), and at least one processor (350). The at least one processor (350) may acquire a plurality of holograms using an artificial intelligence model based on a target hologram image. The at least one processor (350) may control the spatial light modulator (320) to output a pattern based on the acquired plurality of holograms so that light emitted from the light source (310) is modulated. Light modulated by the spatial light modulator (320) may be modulated by the mask (330), so that a plurality of hologram images corresponding to the plurality of holograms may be sequentially formed within a preset time. The above artificial intelligence model can be trained by using an input hologram image as input data and using a plurality of first holograms obtained by performing training based on possible alignment errors between the input hologram image and the spatial light modulator (320) and the mask (330) as correct answers.

[0204] In one embodiment, the operation of performing learning based on possible alignment errors between the input hologram image and the spatial light modulator (320) and the mask (330) may include the operation of inputting the input hologram image into an artificial neural network using the artificial intelligence model, the operation of obtaining errors based on a plurality of second holograms and the plurality of first holograms output from the artificial neural network, and the operation of obtaining weights of the artificial neural network such that a loss function obtained based on the errors is minimized using a gradient descent method.

[0205] In one embodiment, a non-transitory computer-readable medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when executed by at least one processor (350), may cause the electronic device (301) to acquire a plurality of holograms by performing learning based on possible alignment errors between a target hologram image, a spatial light modulator (320) of the electronic device (301) and a mask (330) of the electronic device (301). The computer-executable instructions, when executed by at least one processor (350), may control the spatial light modulator (320) to output a pattern based on the acquired plurality of holograms such that light emitted from the light source (310) is modulated. Light modulated by the spatial light modulator (320) may be modulated by the mask (330), so that a plurality of hologram images corresponding to the plurality of holograms may be sequentially formed within a preset time.

[0206] Additionally, the structure of the data used in the embodiments of the present document described above can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

Claims

1. In an electronic device (301), A light source (310) emitting light; A spatial light modulator (320) configured to modulate light emitted from the light source; A mask (330) configured to modulate light modulated by the above spatial light modulator (320); memory (340); and comprising at least one processor (350), At least one processor of the above: By performing learning based on the target hologram image and the possible alignment errors between the spatial light modulator and the mask, a plurality of holograms are obtained, and Controlling the spatial light modulator to output a pattern based on the acquired plurality of holograms so that light emitted from the light source is modulated, An electronic device in which light modulated by the spatial light modulator is modulated by the mask, so that a plurality of hologram images corresponding to the plurality of holograms are sequentially formed within a preset time.

2. In paragraph 1, At least one processor of the above: When a plurality of first holograms are sequentially provided to the spatial light modulator within the preset time, a plurality of first hologram images predicted to be formed by light modulated by the mask are obtained for each alignment error for the plurality of first holograms, By superimposing the plurality of first hologram images according to the alignment errors, a plurality of second hologram images are obtained, Obtaining a loss based on errors between the plurality of second hologram images and the target hologram image, and An electronic device for obtaining the plurality of holograms based on the above loss.

3. In paragraph 2, At least one processor of the above: Obtaining holographic images including pixels having values ​​of pixels identical to the values ​​of pixels of the target holographic image and having phases at least partially different from the phases of pixels of the target holographic image, and An electronic device that obtains a plurality of first holograms by applying the obtained holographic images to an inverse wave function.

4. In any one of paragraphs 1 to 3, The electronic device comprises a light propagation framework configured to output hologram images predicted to be formed by light modulated by the mask according to the alignment errors for the holograms when the holograms are sequentially provided to the spatial light modulator within the preset time, At least one processor of the above: By overlapping the above hologram images by the above alignment errors, overlapping hologram images are obtained, Based on the errors between the above-described overlapping hologram images and the target hologram image, a loss function is obtained, and An electronic device for obtaining the plurality of holograms such that the loss function is minimized using the gradient descent method.

5. In paragraph 4, At least one processor of the above: An electronic device for setting weights such that, based on a probability distribution function, a smaller alignment error corresponding to an error is given a higher weight for errors between the overlapping hologram images and the target hologram image.

6. In paragraph 4, The above-mentioned optical propagation framework is an electronic device that outputs holographic images predicted to be formed by light modulated by the mask, based on the phases modulated by pixels included in the mask and the phase errors between the phases set during the design of the mask, for each alignment error with respect to the holograms.

7. In any one of paragraphs 1 to 6, An electronic device wherein at least one processor receives the target hologram image from a server wirelessly connected to the electronic device through a communication circuit or obtains the target hologram image from the memory.

8. In any one of paragraphs 1 to 7, At least one processor of the above: An electronic device for setting the number of possible alignment errors between the target holographic image, the spatial light modulator and the mask, based on user input.

9. In any one of paragraphs 1 to 8, At least one processor of the above: An electronic device that determines the number of the plurality of holograms based on the injection rate of the spatial light modulator.

10. A method for providing a holographic image in an electronic device, An operation of acquiring a plurality of holograms by performing learning based on possible alignment errors between a target hologram image, a spatial light modulator of the electronic device, and a mask of the electronic device; and An operation of controlling the spatial light modulator to output a pattern based on the acquired plurality of holograms so that light emitted from a light source of the electronic device is modulated, A method in which light modulated by the spatial light modulator is modulated by a mask of the electronic device, so that a plurality of hologram images corresponding to the plurality of holograms are sequentially formed within a preset time.

11. In Article 10, The operation of obtaining the above multiple holograms is as follows: An operation of obtaining a plurality of first hologram images predicted to be formed by light modulated by the mask for each alignment error of the plurality of first holograms by sequentially providing the plurality of first holograms within the preset time using the spatial light modulator; An operation of obtaining a plurality of second hologram images by superimposing the plurality of first hologram images according to the alignment errors; An operation of obtaining a loss based on errors between the plurality of second hologram images and the target hologram image; and A method comprising an operation of obtaining the plurality of holograms based on the loss.

12. In paragraph 11, The operation of acquiring the above plurality of first holographic images comprises: An operation of obtaining holographic images including pixels having values ​​of pixels identical to the values ​​of pixels of the target holographic image and having phases at least partially different from the phases of pixels of the target holographic image; and A method including an operation of obtaining a plurality of first holograms by applying the obtained holographic images to an inverse wave function.

13. In any one of paragraphs 10 to 12, The electronic device comprises a light propagation framework configured to output hologram images predicted to be formed by light modulated by the mask according to the alignment errors for the holograms when the holograms are sequentially provided to the spatial light modulator within the preset time, An operation of obtaining superimposed hologram images by superimposing the above hologram images according to the above alignment errors; An operation of obtaining a loss function based on errors between the above-described overlapping hologram images and the target hologram image; and A method further comprising the operation of obtaining the plurality of holograms such that the loss function is minimized using a gradient descent method.

14. In paragraph 13, The operation of obtaining the above loss function is, A method including an operation of setting weights such that, based on a probability distribution function, a smaller alignment error corresponding to an error is given a higher weight, for errors between the overlapping hologram images and the target hologram image.

15. In paragraph 13, The above-mentioned light propagation framework is configured to output holographic images predicted to be formed by light modulated by the mask based on phases modulated by pixels included in the mask and phase errors between phases set during the design of the mask, for each alignment error with respect to the holograms.

Images