Display system, method for manufacturing a display system, and method for presenting holography.

Abstract

By using incoherent light, safety for human viewing is ensured, and by realizing both the light source and hologram placement using a display device, a new display system with reduced manufacturing costs is provided. [Solution] According to one aspect of the present invention, a holographic display system is provided, comprising a processor and a display device, wherein the processor is configured to acquire holographic information corresponding to the target data to be reproduced, and the display device comprises a light source that emits incoherent light and a display surface that displays an image in which at least a part of the holographic information is visualized by the light emitted from the light source, and when the image is displayed, an optical image of the target data is reproduced at an observation position that is distal to the hologram in the optical path starting from the light source.

Description

Technical Field

[0001] The present invention relates to a display system, a method for manufacturing a display system, and a method for presenting holography.

Background Art

[0002] Patent Document 1 discloses a holographic display system that realizes light field display with a holographic optical system. Such a holographic display system includes a first display including a light field display configured to project light along a set of paths of the projected light so as to form at least a first holographic surface having a first projected depth profile with respect to the display screen plane.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the above prior art requires a complex optical system for the reconstruction of light ray information, making it difficult to miniaturize and reduce the cost of the system. Also, it was difficult to stably reproduce a bright and high-definition image while ensuring the freedom of the viewing position.

[0005] In view of the above circumstances, the present invention aims to provide a new display system that secures safety for naked-eye viewing by using incoherent light and suppresses manufacturing costs by realizing both the arrangement of the light source and the hologram with a display device.

Means for Solving the Problems

[0006] According to one aspect of the present invention, a holographic display system is provided, comprising a processor and a display device, wherein the processor is configured to acquire holographic information corresponding to the target data to be reproduced, and the display device comprises a light source that emits incoherent light and a display surface that displays an image in which at least a portion of the holographic information is visualized by the light emitted from the light source, and when the image is displayed, an optical image of the target data is reproduced at an observation position distal to the hologram in the optical path starting from the light source.

[0007] In this embodiment, safety for visual inspection is ensured by using incoherent light, and a new display system can be provided that reduces manufacturing costs by realizing both the light source and the hologram arrangement using a display device. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram representing display system 1. [Figure 2] This block diagram shows the electrical hardware configuration of the information processing device 2 and the display device 3. [Figure 3] This is a schematic diagram showing the optical hardware configuration of optical system group 4. [Figure 4] This is a block diagram showing the functional configuration of the information processing device 2. [Figure 5] This is a reference diagram showing an example of an amplitude hologram H1 (see Figure 5A) and a phase hologram H2 (see Figure 5B). [Figure 6] This is a schematic diagram showing an example of a means for identifying the hologram H (first identification means M1). [Figure 7] This is a flowchart showing a method for presenting a hologram according to the first embodiment. [Figure 8] This is a schematic diagram showing an example of a means for identifying the hologram H (second identification means M2). [Modes for carrying out the invention]

[0009] [Embodiment] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below are interchangeable. The components, materials, dimensions, tolerances, process conditions, measurement conditions, numerical ranges, processing procedures, etc. disclosed in one embodiment are illustrative and can be replaced with functionally equivalent known or well-known means.

[0010] Incidentally, the program for implementing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or it may be provided as a downloadable medium from an external server, or it may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as "reference information") is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a trained model that has been pre-trained to learn the correlation between input and output, or a generative AI such as a large-scale language model that can output a desired result by inputting a prompt (these models include parameters that construct the correlation relationship between input and output) or a visual language model.

[0012] Furthermore, in one embodiment, "part" may include, for example, hardware resources implemented by a circuit in a broad sense, and the information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and this information can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on a circuit in a broad sense.

[0013] Furthermore, a circuit in a broad sense is a circuit realized by combining at least a suitable combination of circuits, circuits, processors, and memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, it includes application-specific integrated circuits (ASICs), programmable logic devices (for example, simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc. [overview] In summary, one embodiment of the display system is a holographic display system. This display system comprises a processor and a display device. The processor is configured to acquire holographic information corresponding to the target data to be reproduced. The display device comprises a light source that emits incoherent light and a display surface that displays an image in which at least a portion of the holographic information is visualized by the light emitted from the light source. When the image is displayed, the optical image of the target data is reproduced at an observation position distal to the hologram in the optical path starting from the light source. With this embodiment, safety for viewing with the naked eye is ensured by using incoherent light, and a new display system can be provided that reduces manufacturing costs by realizing both the light source and the hologram arrangement with the display device.

[0014] [First Embodiment] The following describes a display system 1 according to the first embodiment, which may be included in the overview mentioned at the beginning.

[0015] 1. Hardware Configuration The following describes the hardware configuration of a display system 1 according to one embodiment, which can be included in the overview mentioned at the beginning, with reference to Figures 1 to 3.

[0016] 1.1 Display System 1 FIG. 1 is a schematic diagram showing a display system 1. As shown in FIG. 1, the display system 1 includes an information processing apparatus 2, a display apparatus 3, and an optical system group 4. At least the information processing apparatus 2 and the display apparatus 3 are configured to be communicable through a telecommunication line (e.g., a wired cable 11). Here, a system consists of one or more devices or components. Therefore, even the information processing apparatus 2 or the display apparatus 3 alone is an example of a system. More specifically, the display system 1 may include elements selected from the group consisting of the information processing apparatus 2, the display apparatus 3, and the optical system group 4. Also, a plurality of information processing apparatuses 2 or display apparatuses 3 may be used. Even if an unselected element is not included in the system, it may be electrically connected to the selected element as an external element.

[0017] Also, in FIG. 1, a state where an observer using the display system 1 observes a hologram image HI (corresponding to target data DT) reproduced in the front space is schematically shown. Such a user experience provided to such an observer will be described in more detail later.

[0018] Section 1.2 Information Processing Apparatus 2 FIG. 2 is a block diagram showing the electrical hardware configuration of the information processing apparatus 2 and the display apparatus 3. As shown in FIG. 2, the information processing apparatus 2 includes a communication bus 20, a communication unit 21, a storage unit 22, and a processor 23. The communication unit 21, the storage unit 22, and the processor 23 are electrically connected to each other inside the information processing apparatus 2 via the communication bus 20.

[0019] The communication unit 21 preferably uses wired communication methods such as USB, IEEE1394, Thunderbolt®, and wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth® communication as needed. In other words, it is more preferable to implement it as a collection of these multiple communication methods. That is, the information processing device 2 may communicate various information from the outside via the communication unit 21 and a communication network (not shown). In particular, in one embodiment, the display device 3 is connected as an external device to the information processing device 2 via the communication unit 21 and a wired cable 11. The specifications of the wired cable 11 are not particularly limited, and it may be a USB cable compatible with Thunderbolt®, an HDMI® cable, or a DisplayPort cable.

[0020] The storage unit 22 stores various types of information as defined above. This can be implemented, for example, as a storage device such as an SSD that stores various programs related to the information processing device 2 executed by the processor 23, or as memory such as RAM that stores temporarily necessary information related to program calculations. The storage unit 22 stores various programs and variables related to the information processing device 2 executed by the processor 23. Furthermore, the storage unit 22 stores reference information (hereinafter also referred to as reference information RI).

[0021] In providing the user experience described later, various types of reference information RI, including rule-based forms, may be used. For example, at least one reference information RI may be a trained model that has been trained to output results according to the input content. In one embodiment, a trained model or optimization algorithm may be used as reference information RI by the processor 23 to identify information on amplitude hologram H1 and / or phase hologram H2 based on target data DT (e.g., 3D volume data or a group of images IMs that are tomographic images thereof).

[0022] In one embodiment, regardless of which storage medium the reference information RI is stored on, it may be stored in the storage unit 22 of the information processing device 2, in the storage unit 32 of the display device 3, or in another storage medium not shown. Alternatively, an API for using the reference information RI may be provided to the information processing device 2 via a communication network not shown by another server or the like.

[0023] The processor 23 performs processing and control of the overall operation related to the information processing device 2. The processor 23 is, for example, a CPU. The processor 23 realizes various functions related to the information processing device 2 by reading predetermined programs stored in the memory unit 22. Note that the processor 23 is not limited to a single processor, and may be implemented with multiple processors 23 for each function.

[0024] 1.3 Display device 3 As shown in Figure 2, the display device 3 comprises a connection interface 31, a storage unit 32, a processing circuit 33, a backlight 34, and an LCD 35. The connection interface 31, storage unit 32, processing circuit 33, backlight 34, and LCD 35 are electrically connected within the display device 3 via a communication bus 30. In one embodiment, the LCD 35 displays an image that visualizes the amplitude hologram H1, and the backlight 34 illuminates the display.

[0025] The connection interface 31 is an interface for bidirectional data communication with the information processing device 2, and may be based on HDMI®, DisplayPort, or Thunderbolt®, etc. This allows the device to receive image signals and control signals transmitted from an external source (especially the information processing device 2).

[0026] The memory unit 32 is composed of NOR flash memory, EEPROM, etc., and can store firmware and tables related to, for example, the drawing control of the LCD 35, the lighting control of the backlight 34, and the drive control of the optical system group 4 (phase pattern, synchronization timing, etc.). The memory unit 32 may also function as a frame buffer to temporarily hold the image data being displayed.

[0027] The processing circuit 33 is a control circuit responsible for controlling the entire display device 3. Based on the image data and timing control signals received via the connection interface 31, the processing circuit 33 displays the amplitude hologram H1 on the LCD 35. As will be described later, the spatial phase modulator 42 included in the optical system group 4 realizes the phase hologram H2. As a result, the hologram image HI corresponding to the target data DT is reproduced at a predetermined observation position P. In other words, in one embodiment, the hologram H includes the amplitude hologram H1 and the phase hologram H2.

[0028] The backlight 34 is a lighting module that emits incoherent light and can utilize white LEDs, miniLEDs, or a light guide plate system. Incoherent illumination offers superior eye safety and speckle suppression compared to laser illumination.

[0029] LCD35 (an example of a display surface) is configured to display an image that visualizes the amplitude hologram H1. In other words, the amplitude hologram H1 is the image itself, and the amplitude hologram H1 is displayed on LCD35 (an example of a display surface). LCD35 is configured to display the grayscale image that constitutes the amplitude hologram H1. The pixel arrangement, pixel pitch, subpixel arrangement, etc., of LCD35 are not particularly limited, and existing liquid crystal display technology can be applied. The amplitude hologram H1 may be updated over time, or it may be a static image that does not depend on time. The phase hologram H2 is realized on a predetermined surface that is distal (post-stage) to LCD35 (an example of a display surface) and proximal (pre-stage) to the observation position P in the optical path OP starting from the center of the backlight 34 (an example of a light source). The details of the predetermined surface will be described later, but with this configuration, an amplitude hologram H1, which is relatively easy to display, is shown on the LCD35 (an example of a display surface), and a phase hologram H2 is realized on the predetermined surface by other means, thereby providing a natural visual effect that balances three-dimensionality and brightness.

[0030] 1.4 Optical system Figure 3 is a schematic diagram showing the optical hardware configuration of optical system group 4. As shown in Figure 3, optical system group 4 comprises at least a half mirror 41, a spatial phase modulator 42, and a Fourier lens 43. Each optical element is arranged so that incoherent light emitted from the backlight 34 passes through the LCD 35 and is then sequentially incident along a predetermined optical path.

[0031] The half-mirror 41 is an optical element configured to transmit a portion of the incident light and reflect the remaining portion. This reflects and recombines a portion of the light incident on the spatial phase modulator 42, assisting in the formation of a reconstructed image without utilizing coherence. In one embodiment, the half-mirror 41 is provided in front of the spatial phase modulator 42, and its transmittance and reflectance can be appropriately selected according to the optical path design.

[0032] The spatial phase modulator 42 is composed of, for example, a liquid crystal (LCOS) or DMD type device. The spatial phase modulator 42 is configured to control the phase distribution of the wavefront corresponding to the incident light based on the phase hologram H2 identified by the processor 23. In this way, in cooperation with the amplitude hologram H1 presented on the LCD 35, a holographic image HI corresponding to the target data DT is reproduced in space and made observable at the observation position P.

[0033] In other words, the display system 1 further comprises a spatial phase modulator 42. The spatial phase modulator 42 includes the aforementioned predetermined surface and is configured to realize a phase hologram H2 corresponding to the reproduced target data DT. In this embodiment, by using only one spatial phase modulator 42 while realizing both an amplitude hologram H1 and a phase hologram H2, a new display system 1 can be provided with high accuracy and low cost.

[0034] The Fourier lens 43 is a lens for imaging the light modulated by the spatial phase modulator 42 into the Fourier transform space. As a result, the wavefront distribution corresponding to the phase hologram H2 is superimposed interferentially on the Fourier plane, and a three-dimensional reconstructed image can be formed at the observation position P (or its vicinity). The focal length of the Fourier lens 43 should be selected to an optimal value depending on the distance between the display device 3 and the observation position P, and the size of the hologram.

[0035] Incidentally, the observation position P has a width in the direction along the optical path OP. Then, a hologram image HI (an example of an optical image) of the target data DT corresponding to the observation position P is reproduced. In the example shown in Figure 3, observation positions P1 and P2, which are different positions in the direction along the optical path OP, are shown. According to this embodiment, a display system 1 can be provided that can reproduce a hierarchical optical image of the target data DT in the direction along the optical path OP. A vision sensor V1 may be placed at observation position P1, and a vision sensor V2 may be placed at observation position P2. That is, the vision sensors V1 and V2 can capture the state of the hologram image HI at observation positions P1 and P2, and output the captured data as a feedback signal to the processor 23 of the information processing device 2. As a result, the algorithm for identifying the amplitude hologram H1 and / or phase hologram H2 may be dynamically corrected based on the quality of the image observed at observation positions P1 and P2 (e.g., focal position, brightness, three-dimensionality, etc.).

[0036] With this configuration, the optical system group 4 forms a Fourier optical structure while achieving re-development under incoherent illumination conditions. The half-mirror 41 adjusts the interference of multiple optical paths, and the spatial phase modulator 42 and Fourier lens 43 reconstruct the wavefront, so that a stable hologram image HI can be reproduced at observation positions P1 and P2.

[0037] Furthermore, the configuration of the optical system group 4 can be adjusted according to the desired reconstructed image. For example, the depth position of the reconstructed hologram image HI can be controlled by changing the distance between the half-mirror 41 and the spatial phase modulator 42.

[0038] As shown in Figure 3, observation positions P1 and P2 are set at different distances along the optical path OP. This allows for the observation of the foreground image at observation position P1 and the observation of the background image at observation position P2. Therefore, a multilayer hologram display is possible, providing a hierarchical reconstructed image along the optical path OP.

[0039] 2. Functional Configuration Next, with reference to Figure 4, the functional configurations of the display system 1 will be described. Figure 4 is a block diagram showing the functional configuration of the information processing device 2. As shown in Figure 4, the processor 23 functions as an acquisition unit 231, a generation unit 232, a specification unit 233, a display control unit 234, and an arithmetic unit 235 by executing various programs stored in the storage unit 22. In other words, information processing by software stored in the storage unit 22 is concretely realized by the processor 23, which is an example of hardware, and can be executed as each functional unit included in the processor 23.

[0040] The acquisition unit 231 is configured to acquire various types of information as an acquisition step. Specifically, the acquisition unit 231 acquires target data DT (e.g., 3D volume data or image group IMs) via the communication unit 21 or the storage unit 22, and is configured to make this data readable to at least the working memory.

[0041] The generation unit 232 is configured to generate various types of information as a generation step. For example, the generation unit 232 may generate a group of images IMs from volume data, which is the target data DT.

[0042] The identification unit 233 is configured to identify various pieces of information as an identification step. For example, the identification unit 233 may identify an amplitude hologram H1 and / or a phase hologram H2 based on target data DT.

[0043] The display control unit 234 performs display control of the display device 3 based on the information of the generated or identified hologram H as a display control step. Specifically, the display control unit 234 is configured to display the amplitude hologram H1 on the LCD 35 and, if necessary, to output the phase hologram H2 to the spatial phase modulator 42 included in the optical system group 4.

[0044] The arithmetic unit 235 is configured to perform various arithmetic processes in the display system 1 as an arithmetic step. The type of arithmetic is not limited.

[0045] 3. Hologram H Next, with reference to Figures 5 and 6, the hologram H identified in the display system 1 and the means for identifying it (here, the first identifying means M1) will be explained.

[0046] 3.1 Amplitude hologram H1 and phase hologram H2 Figure 5 is a reference diagram showing an example of an amplitude hologram H1 (see Figure 5A) and a phase hologram H2 (see Figure 5B).

[0047] The amplitude hologram H1 illustrated in Figure 5A is a hologram H that encodes information corresponding to the intensity distribution of a light wave, i.e., the amplitude component of light. The amplitude hologram H1 is visualized, for example, as a grayscale image on the LCD 35 of the display device 3, and its amplitude modulation is optically realized by transmitting illumination light from the backlight 34, which is an incoherent light source.

[0048] The phase hologram H2 illustrated in Figure 5B is a hologram H used to modulate the light propagation path by reconstructing the wavefront shape through controlling the phase distribution of the light wave. The phase hologram H2 is physically realized as a phase shift distribution on a predetermined surface such as a spatial phase modulator 42. Each point of the phase hologram H2 is defined as a phase delay amount given to the incident light, enabling the reconstruction of the wavefront at observation positions P1 and P2 through interference and diffraction of the light wave. This allows a three-dimensional hologram image HI to be reproduced in space in coordination with the light intensity distribution controlled by the amplitude hologram H1.

[0049] 3.2 Means for identifying hologram H In the display system 1, the hologram H is preferably identified by calculations performed by the information processing device 2. In other words, the processor 23 in the information processing device 2 is configured to identify the information of the hologram H based on the target data DT. With this configuration, it is possible to provide a display system 1 that can identify and realize the hologram H simply by providing the target data DT, and reproduce the hologram image HI (an example of an optical image) of the target data DT. An example of the identification means is described below.

[0050] Figure 6 is a schematic diagram showing an example of a means for identifying a hologram H (first identification means M1). As shown in Figure 6, the first identification means M1 uses an iterative optimization process to identify the hologram H (amplitude hologram H1 and phase hologram H2) based on target data DT. The target data DT is given, for example, as a group of images IMs, which are multiple tomographic images or multi-view images, and the intensity distribution of the hologram image HI that reproduces them is defined. When using the first identification means M1, the calculation unit 235 performs a calculation to minimize the error between the hologram image HI reproduced at the observation position P and the target data DT, based on an optical propagation model. That is, an objective function as shown in Equation 1 is considered.

number

[0051] In other words, the information of hologram H is identified by performing iterative calculations to minimize the error between the target data DT and the hologram image HI (an example of observed data) observed at the observation position P. According to this configuration, the information of hologram H can be identified with high accuracy through iterative calculations.

[0052] 4. Method of presenting holography Preferably, a method for presenting a hologram may be provided. Figure 7 is a flowchart of a method for presenting a hologram according to the first embodiment. Such a presentation method defines a series of processes for identifying a hologram H based on target data DT and reproducing the hologram image HI at a predetermined observation position P using incoherent light. Specifically, this presentation method includes the following steps. The steps described below will be explained in accordance with those shown in Figure 7.

[0053] First, the acquisition unit 231 acquires target data DT related to the object (step S001). For example, the target data DT is volume data representing the three-dimensional shape.

[0054] Next, the generation unit 232 generates a group of images IMs corresponding to the acquired target data DT (step S002). The generation unit 232 can generate the group of images IMs by extracting tomographic images and viewpoint images from the volume data, which is the target data DT.

[0055] Next, the identification unit 233 identifies the amplitude hologram H1 and phase hologram H2 corresponding to the image group IMs (step S003). The identification of the amplitude hologram H1 and phase hologram H2 can be performed by the first identification means M1 (optimization process by iterative calculation) described above. As a result, the acquisition unit 231 acquires information on the hologram H for reproducing the spatial information of the target data DT. In other words, in the acquisition step, information on the hologram H corresponding to the target data DT to be reproduced is acquired.

[0056] Next, the display control unit 234 causes the identified amplitude hologram H1 to be displayed on the LCD 35 of the display device 3 (step S004). In other words, the display control step causes the display device 3 to display an image that visualizes at least a part of the information of the hologram H. As described above, the display device 3 includes a backlight 34 (an example of a light source) that emits incoherent light and an LCD 35 (an example of a display surface) that displays an image by the light emitted by the backlight 34. The LCD 35 is illuminated by the backlight 34 that emits incoherent light, and amplitude modulation is achieved by transmitting the illumination light. Furthermore, the spatial phase modulator 42 realizes a phase hologram H2 (step S005), and through the coordinated operation of the two, the intensity distribution and wavefront of the light wave are reconstructed into a predetermined shape.

[0057] Finally, at observation position P, a hologram image HI (an example of an optical image) corresponding to the target data DT is reproduced (step S006). In other words, when an image is displayed, at observation position P, which is distal to the hologram H in the optical path OP starting from the center of the backlight 34, the hologram image HI (an example of an optical image) of the target data DT is reproduced.

[0058] In this embodiment, safety for human viewing is ensured by using incoherent light, and by realizing both the backlight 34 (an example of a light source) and the arrangement of the hologram H using a display device, a new method for presenting holography with reduced manufacturing costs can be provided.

[0059] [Second Embodiment] The following describes a display system 1 according to a second embodiment, which may be included in the overview mentioned at the beginning. Descriptions or configurations that are substantially the same as those of the first embodiment will be omitted.

[0060] Figure 8 is a schematic diagram showing an example of a means for identifying the hologram H (second identification means M2). As shown in Figure 8, the second identification means M2 is similar to the first identification means M1 in that it generates an amplitude hologram H1 and a phase hologram H2 based on target data DT, but it differs in that the phase hologram H2 is a fixed pattern realized by a diffractive optical element 42a rather than a spatial phase modulator 42.

[0061] The diffractive optical element 42a is configured to modulate the wavefront of a light wave with a predetermined phase distribution and is responsible for the component of the phase hologram H2 that does not depend on the target data DT. In the second identification means M2, the identification unit 233 calculates the amplitude hologram H1 based on the target data DT and combines it with a phase distribution (for example, a periodic diffraction grating or Fresnel zone pattern) that has been pre-designed for the diffractive optical element 42a to reproduce the hologram image HI at a predetermined observation position P.

[0062] In other words, the display system 1 further comprises a diffractive optical element 42a. The diffractive optical element 42a includes a predetermined surface and is configured to realize a phase hologram H2 that is independent of the target data DT. With this embodiment, by using a phase hologram H2 that is independent of the target data DT, the spatial phase modulator 42 can be made unnecessary, and a new display system 1 can be provided at an even lower cost.

[0063] Furthermore, in the second identification means M2, a trained model is used in identifying the amplitude hologram H1 based on the target data DT. That is, the identification unit 233 holds a model as reference information RI that has been previously trained using information on multiple three-dimensional structure data and their corresponding holograms H. By inputting the target data DT (e.g., 3D volume data or image group IMs) into this trained model, it is configured to output the amplitude hologram H1 corresponding to the target data DT. The trained model may be stored as reference information RI in the storage unit 22 or an external server. The trained model includes deep learning structures such as a convolutional neural network (CNN) or a transformer, and is designed to directly estimate an optically effective amplitude distribution from the input information. This makes it possible to achieve faster identification processing and lower power consumption compared to using the first identification means M1.

[0064] Furthermore, the trained model should be trained to have high generalization performance even with changes in the type of target data DT and viewpoint conditions, and should be able to quickly identify an appropriate amplitude hologram H1 even for object data with different shapes and depth structures. The amplitude hologram H1 thus identified is displayed directly on the LCD 35 of the display device 3 and, in cooperation with a fixed phase hologram H2 generated by the diffractive optical element 42a, enables the reproduction of the hologram image HI at the observation position P. Alternatively, a configuration may be adopted in which various parameters of the trained model and the phase hologram H2 are updated together for the image group IMs, and amplitude hologram H1 can be generated for any target data DT.

[0065] In other words, among the information of hologram H, the information of amplitude hologram H1 is identified by inputting target data DT into a second identification means M2, which is a trained model (an example of a predetermined model). The predetermined model is configured to output an amplitude hologram H1 corresponding to target data DT when it is input. The information of phase hologram H2 is identified in advance, independently of target data DT, and corresponding to the predetermined model. With this configuration, the information of amplitude hologram H1 can be identified at high speed using AI technology.

[0066] [others] With respect to the display system 1 according to the above-described embodiment, the following embodiments may be adopted.

[0067] The information processing device 2 is not necessarily limited to a general-purpose external computer, but may be implemented using a microcontroller (MPC), a DSP (Digital Signal Processor), or an FPGA, etc. For example, a microcontroller may be mounted inside the housing of the display device 3, and this configuration may perform the functions of the information processing device 2. With such an embodiment, the display device 3 can be provided as an integrated module that can operate independently, enabling miniaturization and lower power consumption of the display system 1.

[0068] As a modification according to one embodiment, when specifying the hologram H, conditions related to the appearance based on optical elements may be taken into consideration. That is, the system may be configured to synthesize a hologram that can reproduce the blurring and parallax of the hologram image HI in response to changes in the viewpoint position and focal position. According to this embodiment, the sense of depth and three-dimensionality obtained when observing a real object can be reproduced under incoherent light.

[0069] As a modification according to one embodiment, the holograms H corresponding to multiple observation positions P may be optimized collectively. For example, by including the focal position and blur amount of the hologram image HI for each observation position P in the loss function, it is possible to reproduce the hologram image HI with viewpoint-dependent three-dimensionality and natural depth of field.

[0070] As a modification according to one embodiment, lens characteristics and sensor imaging conditions may be included in the optical propagation model to improve the accuracy of hologram reproduction. With this embodiment, a highly faithful hologram image HI can be obtained in which visual effects such as blur and parallax are consistent with the simulation results when observed on an actual display device 3.

[0071] As an example of a modification according to one embodiment, the number and arrangement of observation positions P are not limited. There may be one or more observation positions P. Parameters such as distance, spacing, width, and shape related to observation positions P should be appropriately selected according to the application and enclosure design.

[0072] As a modified example according to one embodiment, the form of the target data DT and the image group IMs is not limited. The number of images, resolution, number of colors, number of viewpoints, tomographic interval, etc., of the image group IMs are arbitrary, and in addition to tomographic images and multi-view images, the data may also be generated from light fields, video frame sequences, point clouds, meshes, depth maps, NeRFs, and other neural representations.

[0073] As a modified example according to one embodiment, the identification means for identifying the hologram H is not limited to the first identification means M1 or the second identification means M2 described above. Optimization by iterative calculations (gradient descent, ADAM, ADMM, alternating optimization, etc.) or pre-trained models (CNN, U-Net, Transformer, physically informed neural networks, diffusion models, etc.) may be used alone or in combination, and this does not prevent the arbitrary design of various objective functions and regularizations.

[0074] Furthermore, a method for manufacturing the display system 1 may be provided. This manufacturing method includes at least a step of arranging an existing display device 3. According to this embodiment, safety for human viewing is ensured by using incoherent light, and a new display system 1 can be manufactured at a reduced cost by realizing both the arrangement of the backlight 34 (an example of a light source) and the hologram H using the display device.

[0075] Furthermore, they may be provided in the following embodiments.

[0076] (1) A display system using holography, comprising a processor and a display device, wherein the processor is configured to acquire hologram information corresponding to the target data to be reproduced, and the display device comprises a light source that emits incoherent light and a display surface that displays an image in which at least a part of the hologram information is visualized by the light emitted from the light source, and when the image is displayed, the optical image of the target data is reproduced at an observation position distal to the hologram in the optical path starting from the light source.

[0077] In this embodiment, safety for visual inspection is ensured by using incoherent light, and a new display system can be provided that reduces manufacturing costs by realizing both the light source and the hologram arrangement using a display device.

[0078] (2) The display system described in (1) above, wherein the hologram includes an amplitude hologram and a phase hologram, the display surface is configured to display the image obtained by visualizing the amplitude hologram, and the phase hologram is realized on a predetermined surface in the optical path starting from the light source that is distal to the display surface and proximal to the observation position.

[0079] According to this embodiment, by displaying an amplitude hologram, which is relatively easy to present, on the display surface, and separately realizing a phase hologram on a predetermined surface by other means, a natural visual effect that balances three-dimensionality and brightness can be provided.

[0080] (3) The display system described in (2) above, further comprising a spatial phase modulator, wherein the spatial phase modulator includes the predetermined surface and is configured to realize the phase hologram corresponding to the target data to be reproduced.

[0081] According to this embodiment, by realizing both amplitude holograms and phase holograms while using only one spatial phase modulator, a new display system can be provided that is highly accurate and low-cost.

[0082] (4) The display system described in (2) above, further comprising a diffractive optical element, wherein the diffractive optical element includes the predetermined surface and is configured to realize the phase hologram that is independent of the target data.

[0083] According to this embodiment, by using a phase hologram that is independent of the target data, a spatial phase modulator can be eliminated, and a new display system can be provided at a lower cost.

[0084] (5) In the display system described in (4) above, the information of the amplitude hologram among the hologram information is identified by inputting the target data into a predetermined model, where the predetermined model is a model configured to output the amplitude hologram corresponding to the target data when the target data is input, and the information of the phase hologram is identified in advance to be independent of the target data and to correspond to the predetermined model.

[0085] In this configuration, information from amplitude holograms can be rapidly identified using AI technology.

[0086] (6) A display system according to any one of (1) to (3) above, wherein the information of the hologram is identified by performing iterative calculations to minimize the error between the target data and the observation data observed at the observation position.

[0087] In this configuration, the information in the hologram can be identified with high accuracy through iterative calculations.

[0088] (7) A display system according to (5) or (6) above, wherein the processor is configured to identify the information of the hologram based on the target data.

[0089] According to this embodiment, a display system can be provided that identifies and realizes a hologram simply by providing target data, and can reproduce the optical image of the target data.

[0090] (8) A display system according to any one of (1) to (7) above, wherein the observation position has a width in the direction along the optical path, and an optical image of the target data corresponding to the observation position is reproduced.

[0091] According to this embodiment, a display system capable of reproducing an optical image of hierarchical target data in the optical path direction can be provided.

[0092] (9) A method for manufacturing a display system, wherein the display system is the display system described in any one of (1) to (8) above, and the method comprises at least the step of arranging an existing display device.

[0093] In this configuration, safety for human viewing is ensured by using incoherent light, and a new display system can be manufactured at a reduced cost by realizing both the light source and the hologram arrangement using a display device.

[0094] (10) A method for presenting a holography, comprising the following steps: an acquisition step of acquiring information of a hologram corresponding to the target data to be reproduced; and a display control step of causing a display device to display an image in which at least a portion of the information of the hologram is visualized, wherein the display device comprises a light source that emits incoherent light and a display surface that displays the image by the emission of light from the light source, and when the image is displayed, the optical image of the target data is reproduced at an observation position distal to the hologram in the optical path starting from the light source.

[0095] In this embodiment, safety for viewing with the naked eye is ensured by using incoherent light, and by realizing both the light source and the hologram placement with a display device, a new method for presenting holography with reduced manufacturing costs can be provided. Of course, this is not always the case.

[0096] Finally, various embodiments of the present invention have been described, but these are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of symbols]

[0097] 1: Display System 11: Wired cable 2: Information Processing Device 20: Communications bus 21: Communications Department 22: Storage section 23: Processor 231: Acquisition Department 232 :Generation part 233: Specific part 234: Display Control Unit 235: Arithmetic section 3:Display device 30: Communications bus 31: Connection Interface 32: Storage section 33: Processing Circuit 34: Backlight 35: LCD 4:Optical system group 41: Half-mirror 42: Spatial Phase Modulator 42a: Diffractive optical element 43: Fourier lens DT: Target Data H: Hologram H1: Amplitude hologram H2: Phase Hologram HI: Holographic image IMs: Image group M1: First specific means M2: Second specific means OP: Light Path P: Observation position P1: Observation position P2: Observation position RI: Reference information V1: Vision Sensor V2: Vision Sensor

Claims

1. A display system using holography, A device comprising a processor and a display device, The processor is configured to acquire hologram information corresponding to the target data to be reproduced. The aforementioned display device is A light source that emits incoherent light, The system includes a display surface that displays an image in which at least a portion of the information of the hologram is visualized by the light emitted from the aforementioned light source, A system in which, when the aforementioned image is displayed, the optical image of the target data is reproduced at an observation position that is distal to the hologram in the optical path starting from the light source.

2. In the display system according to claim 1, The hologram includes an amplitude hologram and a phase hologram. The display surface is configured to display the image obtained by visualizing the amplitude hologram. The system is such that the phase hologram is realized on a predetermined surface in the optical path starting from the light source, which is distal to the display surface and proximal to the observation position.

3. In the display system according to claim 2, It further includes one spatial phase modulator, The spatial phase modulator is configured to include the predetermined surface and realize the phase hologram corresponding to the target data to be reproduced.

4. In the display system according to claim 2, Further equipped with a diffractive optical element, A system in which the diffractive optical element includes the predetermined surface and is configured to realize the phase hologram that is independent of the target data.

5. In the display system according to claim 4, Of the information in the aforementioned hologram, The amplitude hologram information is identified by inputting the target data into a predetermined model, where the predetermined model is configured to output the amplitude hologram corresponding to the target data when the target data is input. A system in which the information of the phase hologram is predetermined to be independent of the target data and to correspond to a predetermined model.

6. In the display system according to claim 1, The system identifies the hologram information by performing iterative calculations to minimize the error between the target data and the observation data observed at the observation position.

7. In the display system according to claim 5, The system wherein the processor is configured to identify the information of the hologram based on the target data.

8. In the display system according to claim 1, The observation position has a width in the direction along the optical path, A system that reproduces an optical image of the target data corresponding to the observation position.

9. A method for manufacturing a display system, The display system is the display system according to any one of claims 1 to 8. A method comprising at least the step of arranging an existing display device.

10. A method of presenting holography, The following steps are included: In the acquisition step, information about the hologram corresponding to the target data to be reproduced is acquired. In the display control step, the display device is made to display an image that visualizes at least a portion of the hologram information, and here The display device comprises a light source that emits incoherent light and a display surface that displays the image by the light emitted from the light source. A method wherein, when the aforementioned image is displayed, the optical image of the target data is reproduced at an observation position that is distal to the hologram in the optical path starting from the light source.

Images