Information processing device, information processing method, and information processing program

Abstract

An information processing device (20) comprises: a specifying unit (23A) that specifies, from among a plurality of layer data items which enable object light of a three-dimensional object to be represented in stages, an occlusion region which is deficient due to a foreground image of layer data of another tier; and a modifying unit (23B) that modifies the amplitude and / or the phase of the layer data at the boundary with the specified occlusion region so as to suppress leakage of the object light to outside the occlusion region.

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] A hologram display device performs hidden surface removal processing on a three-dimensional object to be reproduced and displayed, calculates a hologram, and irradiates the hologram with a reference wave to reproduce the three-dimensional object. The hidden surface removal processing is a processing for removing a wavefront generated from the back surface of the object, i.e., a surface that is not visible from the viewpoint, and making only the wavefront generated from the surface of the object visible from the viewpoint. For example, Patent Document 1 discloses a technology in which a hidden surface removal means removes hidden surfaces based on the distance between each point on an object image represented in a screen coordinate system and the viewpoint, and the object image on the screen coordinate system from which the hidden surfaces have been removed is subjected to inverse perspective transformation to obtain hologram data of the object image represented in a coordinate system in real space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-3128 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, when reproducing a hologram having a foreground and background, ringing occurs due to the wavefront leaking out between the foreground and background, so there is a need to suppress the occurrence of ringing.

[0005] Therefore, the present disclosure proposes an information processing device, an information processing method, and an information processing program that can suppress the occurrence of ringing in a hologram having a front-to-back relationship of an object. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing device of one embodiment according to the present disclosure includes an identification unit that identifies an occlusion area that is missing due to a foreground image of layer data of another hierarchy from a plurality of layer data that can gradually represent object light of a three-dimensional object, and a modification unit that modifies at least one of the amplitude and phase in the layer data of the boundary with the identified occlusion area so as to suppress leakage of the object light outside the occlusion area.

[0007] Furthermore, an information processing method according to one embodiment of the present disclosure includes a computer identifying an occlusion area that is missing due to a foreground image of layer data of another layer from a plurality of layer data capable of gradually expressing object light of a three-dimensional object, and modifying at least one of the amplitude and phase in the layer data at the boundary with the identified occlusion area so as to suppress leakage of the object light outside the occlusion area.

[0008] In addition, an information processing program of one embodiment according to the present disclosure causes a computer to identify an occlusion area that is missing due to a foreground image of layer data of another hierarchical layer from a plurality of layer data capable of gradually expressing object light of a three-dimensional object, and to modify at least one of the amplitude and phase in the layer data at the boundary with the identified occlusion area so as to suppress leakage of the object light outside the occlusion area. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram for explaining an overview of generation of a hologram according to an embodiment. [Diagram 2] FIG. 13 is a diagram for explaining an example of hidden surface processing of a hologram. [Diagram 3] 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a relationship between image data and object light data. [Diagram 5]11 is a flowchart illustrating an example of an object light generation process executed by the information processing apparatus according to the embodiment. [Figure 6] 11 is a flowchart illustrating an example of a wavefront propagation calculation process executed by the information processing device according to the embodiment. [Figure 7] 11 is a flowchart illustrating an example of an interference fringe generation process executed by the information processing device according to the embodiment. [Figure 8] FIG. 13 is a diagram for explaining an overview of a measure (1) of the information processing device according to the embodiment. [Figure 9] 6 is a flowchart showing the object light generation process shown in FIG. 5 with a measure (1-1) added thereto. [Figure 10] 6 is a flowchart showing the object light generation process shown in FIG. 5 with a measure (1-2) added thereto. [Figure 11] 6 is a flowchart showing the object light generation process shown in FIG. 5 with a measure (1-3) added thereto. [Figure 12] FIG. 11 is a diagram for explaining an example of a measure (1-3) in the object light generation process. [Figure 13] 6 is a flowchart showing the object light generation process shown in FIG. 5 with measure (2) added. [Figure 14] 6 is a flowchart showing the object light generation process shown in FIG. 5 with a measure (3-1) added thereto. [Figure 15] 6 is a flowchart showing the object light generation process shown in FIG. 5 with a measure (3-2) added. [Figure 16] FIG. 13 is a diagram for explaining an example of a measure (3-2) according to the type of occlusion region. [Figure 17] 6 is a flowchart showing a measure (4) added to the object light generation process shown in FIG. 5. [Figure 18] 6 is a flowchart showing a measure (5) added to the object light generation process shown in FIG. 5. [Figure 19] FIG. 2 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and duplicated descriptions will be omitted.

[0011] [Hologram Outline] A hologram is a display medium that records interference fringes that are generated by interfering object light reflected from an object with highly coherent reference light such as a laser. When a light beam having the same amplitude and phase as the reference light is applied to a hologram, the object light is reproduced by diffraction of light. The detailed principle of the hologram is described, for example, in JP 2013-54068 A.

[0012] FIG. 1 is a diagram for explaining an overview of the generation of a hologram according to an embodiment. In the example shown in FIG. 1, a hologram H (hologram data) enables an image T of an object to be reconstructed using a light beam L1 having the same amplitude and phase as a reference light, as is well known. The light beam L is incident on the hologram H via an optical system 100. The optical system 100 includes, for example, a laser light source 101, a collimator 102, a mirror 103, and a spatial filter 104. The hologram H reconstructs an object light beam L2 of the object by being irradiated with the light beam L1 of the optical system 100. A user U visually recognizes the object light beam L2 emitted by the hologram H, thereby recognizing an image T of a reconstructed three-dimensional object.

[0013] For example, for hologram H, wavefront propagation calculation is performed in order from the distant view to the near view. FIG. 2 is a diagram for explaining an example of hidden surface processing of a hologram. As shown in the left diagram of FIG. 2, hologram H shows three-dimensional objects 200-1 and 200-2. Object 200-1 is located in front of object 200-2 in the depth direction indicated by the Z axis. When hologram H is viewed from the XY plane, a part of object 200-1 is visually recognized as overlapping object 200-2. Hereinafter, when there is no distinction between object 200-1 and object 200-2, object 200-1 and object 200-2 are described as "object 200".

[0014] The right diagram of FIG. 2 shows the depth direction (Z-axis direction) of the left diagram of FIG. 2 from above. As shown in the right diagram of FIG. 2, the hologram H propagates in the wavefront from the rear layer to the front layer in the depth direction. The object light of the rear layer that is blocked by the front layer is replaced by the object light of the front layer. For example, the light ray L21 of the object 200-2 is blocked by the object 200-1 and replaced by the light ray L22, which is the object light of the object 200-1. The light ray L22 of the object 200-1 reaches the hologram surface H1.

[0015] Hologram H is subjected to hidden surface processing to erase the parts of object 200 that are not visible from the viewpoint. Hidden surface processing can use equation (1) for processing the wavefront of the front stage and equation (2) for processing the wavefront of hologram surface H1. The front stage refers to the layer closer to hologram surface H1 between the layers. The rear stage refers to the layer further back than the front stage between the layers. The frontmost stage refers to the layer closest to hologram surface H1. h n+1 (x,y)=P n (m n (x,y)×h n (x,y)+o n (x, y)···Eq. (1) h hologram (x,y)=P N (m N (x,y)×h N (x,y)+o N (x,y)···Eq. (2)

[0016] In the formulas (1) and (2), n and N are integers, and the values ​​become larger as they approach the hologram surface H1. n+1 (x,y) indicates the wavefront of the n+1th layer (previous stage). m n (x,y) indicates the mask function of the nth layer (later stage). m n If (x,y) has a value of "0", it indicates the inside of the object. n If (x,y) has a value of "1", it indicates the outside of the object. n (x,y) is the wavefront of the nth layer. P nis the front propagation operator. n is an integer. n (x,y) denotes the object beam of the nth layer. m N (x,y) denotes the mask function of the front layer. h N (x,y) is the wavefront of the front layer. P N is the front propagation operator. N (x,y) indicates the object beam of the frontmost layer.

[0017] For example, in the hologram H shown in the left diagram of Fig. 2, ringing may occur, in which the contours of objects 200-1, 200-2, etc. are visually perceived as blurred due to the background image. Ringing may occur when a wavefront leaks out from a boundary portion between the foreground and background of objects 200-1, 200-2, etc. For this reason, the present disclosure provides an information processing device and the like capable of suppressing the occurrence of ringing in hologram H having a front-back relationship of objects.

[0018] (Embodiment) [Outline of information processing system configuration] FIG. 3 is a diagram showing a schematic configuration of an information processing system according to an embodiment. The information processing system 1 shown in FIG. 3 is a system that reproduces a hologram H. The hologram H is hologram data generated based on, for example, image data. The image data includes, for example, image information and distance information. The image information includes, for example, information indicating a two-dimensional image of an object captured by a distance measuring camera. The image information includes information on a plurality of pixels. The pixel information includes, for example, position information, intensity information, and the like. In the present disclosure, the hologram H is generated by performing a diffraction process based on the pixel information of each of a plurality of pixels in the image data.

[0019] 3, the information processing system 1 includes a hologram display unit 10 and an information processing device 20. The information processing device 20 is electrically connected to the hologram display unit 10.

[0020] The hologram display unit 10 displays a hologram H based on hologram data from the information processing device 20. The hologram display unit 10 includes a display medium 11 and a light source 12. The hologram display unit 10 may further include, for example, an optical system 100 and the like.

[0021] The display medium 11 is a medium capable of recording hologram data. The display medium 11 includes, for example, a hologram, a spatial light modulator, and the like. The display medium 11 may include a function of outputting, as a video signal, a complex amplitude distribution of a hologram surface H1 indicated by the hologram data, to a liquid crystal display or the like. The light source 12 emits a light beam L1 corresponding to a reference light under the control of the information processing device 20. The light source 12 includes, for example, a laser light source 101, and the like. The light beam L1 emitted by the light source 12 is irradiated onto the display medium 11 (hologram H) via the optical system 100.

[0022] [Example of configuration of information processing device] The information processing device 20 is, for example, a dedicated or general-purpose computer. The information processing device 20 controls the display of the hologram display unit 10. The information processing device 20 has a function of generating hologram data. The information processing device 20 may include an interface, a communication device, etc., for enabling data transmission and reception with an external electronic device.

[0023] The information processing device 20 includes a storage unit 21 and a control unit 22. The control unit 22 is electrically connected to the hologram display unit 10 and the storage unit 21.

[0024] The storage unit 21 stores various data and programs. The storage unit 21 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 21 stores various data such as, for example, image data 21A, object light data 21B, wavefront data 21C, and hologram data 21D.

[0025] The image data 21A is data indicating an image that is the basis of the hologram H. The image data 21A includes, for example, data indicating RGB, distance, etc. The image data 21A is data acquired from an external electronic device, a server, etc. The image data 21A may be, for example, data created from three-dimensional computer graphics, but in this embodiment, it is assumed that the image data 21A does not contain hidden information in the context of an object in the image.

[0026] The object light data 21B is, for example, data showing the object light of a three-dimensional object obtained from the image data 21A. The object light data 21B is, for example, data showing light rays of an object at different angles for each of a plurality of layers. In this embodiment, the object light data 21B is an example of layer data. The wavefront data 21C is, for example, data calculated by calculating the wavefront propagation to the hologram surface H1 for each layer. The hologram data 21D is, for example, data calculated by calculating the interference fringes on the hologram surface H1 between the object light and the reference light. The hologram data 21D has a plurality of position data corresponding to a plurality of pixels constituting the hologram creation surface, and at least one of phase data and amplitude data corresponding to the position data.

[0027] The control unit 22 controls the information processing device 20. The control unit 22 has various processing units such as an object light generation unit 23, a wavefront propagation calculation unit 24, and an interference fringe generation unit 25. The object light generation unit 23 has various functional units such as a specification unit 23A and a change unit 23B. In this embodiment, the various processing units of the control unit 22, namely, the object light generation unit 23, the wavefront propagation calculation unit 24, and the interference fringe generation unit 25, are realized by, for example, a central processing unit (CPU) or a micro control unit (MCU) executing a program stored inside the information processing device 20 using a random access memory (RAM) or the like as a working area. In addition, each processing unit may be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

[0028] The object light generating unit 23 generates object light data 21B indicating object light based on the image data 21A. For example, the object light generating unit 23 obtains light ray information of different angles obtained from an object from a plurality of image data 21A, and generates object light data 21B for each layer. The identifying unit 23A of the object light generating unit 23 identifies an occlusion region (foreground region) that is missing due to a foreground image of other object light data 21B from a plurality of object light data 21B that shows a gradual image of an object and can express the object light of the object. The changing unit 23B of the object light generating unit 23 changes at least one of the amplitude and phase in the object light data 21B at the boundary with the identified occlusion region so as to suppress the object light. The object light generating unit 23 stores the generated object light data 21B in the storage unit 21.

[0029] The wavefront propagation calculation unit 24 calculates the wavefront propagation based on the amplitude, phase, etc. of the object light data 21B. The wavefront propagation calculation unit 24 calculates the wavefront propagation using a calculation method such as the Rayleigh-Sommerfeld diffraction formula, the angular spectrum method, Fresnel diffraction, Fraunhofer diffraction, etc. The wavefront propagation calculation unit 24 stores wavefront data 21C indicating the calculation result in the storage unit 21.

[0030] The interference fringe generation unit 25 calculates an interference fringe between the object light and the reference light, which is expressed by the complex amplitude of the hologram plane H1, based on the wavefront data 21C, and generates hologram data 21D. The interference fringe generation unit 25 generates hologram data 21D to be displayed on the display medium 11, based on, for example, the calculated interference fringe. The interference fringe generation unit 25 stores the generated hologram data 21D in the storage unit 21.

[0031] The configuration example of the information processing device 20 according to the embodiment has been described above. Note that the above configuration described with reference to Fig. 3 is merely an example, and the configuration of the information processing device 20 according to the embodiment is not limited to this example. The functional configuration of the information processing device 20 according to the embodiment can be flexibly modified according to the specifications and operation.

[0032] In the present embodiment, the information processing device 20 will be described with respect to a case where the object light generating unit 23 has the specifying unit 23A and the changing unit 23B, but is not limited thereto. For example, the specifying unit 23A and the changing unit 23B may be realized by the wavefront propagation calculating unit 24 or may be realized as independent processing units.

[0033] [Example of object light data according to the embodiment] Fig. 4 is a diagram showing an example of the relationship between image data and object light data. Image data 21A shown in Fig. 4 is data showing a two-dimensional image obtained by capturing an image of an object. The image data 21A includes distance information. In the example shown in Fig. 4, the image data 21A is an image obtained by capturing a foreground 211 and a background 212 of a user U or the like.

[0034] For example, in a three-dimensional space, when there is a front-to-back relationship between a plurality of objects, a state called occlusion occurs. Occlusion is a state in which an object in front hides an object behind it, making it invisible. Image data 21A is in a state in which foreground 211 hides a part of background 212, making it invisible. For example, when hologram data 21D has an occlusion state, a phenomenon called ringing, in which a wavefront at the boundary of an occlusion region leaks out, may occur. That is, ringing includes a state in which the boundary portion of an occlusion region is displayed as if it is blurred. For this reason, the present disclosure provides an information processing device 20 and the like that can suppress a decrease in visibility of a hologram even when an occlusion state occurs.

[0035] The object light data 21B1 and the object light data 21B2 are data obtained by modeling the object light for each different layer from the image data 21A. The object light data 21B1 and the object light data 21B2 are data of layers that sample light rays. The object light data 21B1 is, for example, data corresponding to the layer of the background 212 of the image data 21A. The object light data 21B2 is data corresponding to the layer of the foreground 211 of the image data 21A. In the object light data 21B1, the foreground 211 is an occlusion region 213. The occlusion region 213 includes, for example, a region where no data exists due to an object, an image, or the like of a different layer. In other words, the occlusion region 213 is a region where the pixel value is 0. Hereinafter, when the object light data 21B1 and the object light data 21B2 are not distinguished from each other, the object light data 21B1 and the object light data 21B2 are described as "object light data 21B".

[0036] In the example shown in FIG. 4, for the sake of simplicity, the information processing device 20 assumes two layers, the background 212 and the foreground 211, of the image data 21A, but is not limited thereto. For example, the information processing device 20 may assume a multilayer structure of three or more layers of the image data 21A. In addition, the information processing device 20 may use a method of generating hologram data of a computer generated hologram (CGH). For example, the method may use a point filling method in which the subject space is regarded as a collection of points, that is, the object is regarded as a collection of point objects, and the hologram data 21D is generated by adding the wavefront of a point light source. For example, the method may use a method in which the object is represented by a polygon, and the hologram data 21D is generated by adding the wavefront of a point light source.

[0037] [Processing procedure of the information processing device according to the embodiment] Fig. 5 is a flowchart showing an example of an object light generation process executed by the information processing device 20 according to the embodiment. Fig. 6 is a flowchart showing an example of a wavefront propagation calculation process executed by the information processing device 20 according to the embodiment. Fig. 7 is a flowchart showing an example of an interference fringe generation process executed by the information processing device 20 according to the embodiment. The processing procedures in Figs. 5 to 7 are realized by the control unit 22 of the information processing device 20 executing a program.

[0038] [Object light generation processing] 5, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). For example, the control unit 22 acquires the amplitude and coordinates of the object light based on the RGB, distance, etc. of the image data 21A. When the process of step S11 ends, the control unit 22 advances the process to step S12.

[0039] The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). For example, the control unit 22 executes a process of converting the light ray information to match the specifications of the hologram to be generated, generates an image according to the layer, and generates object light data 21B based on the image. The control unit 22 can use a known method for converting the light ray information, for example. An example of the known method is integral photography. After the control unit 22 stores the object light data 21B in the memory unit 21, the process proceeds to step S13.

[0040] Control unit 22 sets an initial phase (step S13). For example, control unit 22 acquires a complex amplitude of the amplitude and phase of object light for each pixel by uniformly changing the phase according to the XY coordinates for the pixel values ​​of object light data 21B. Control unit 22 sets the acquired phase as an initial phase in object light data 21B. When the process of step S13 ends, control unit 22 ends the process procedure shown in FIG. 5. Control unit 22 realizes object light generation unit 23 by executing the process procedure shown in FIG. 5.

[0041] [Wavefront propagation calculation processing] The processing procedure shown in Fig. 6 is executed by control unit 22 of information processing device 20 when the object light generation processing shown in Fig. 5 is completed. Control unit 22 acquires the amplitude and phase obtained by modeling (step S21). For example, control unit 22 acquires the amplitude and phase for each image of a layer based on object light data 21B. When the processing of step S21 is completed, control unit 22 advances the processing to step S22.

[0042] The control unit 22 calculates the wavefront propagation using the diffraction formula (step S22). For example, the control unit 22 converts the light ray information into a complex amplitude distribution for each of the object light data 21B of the layers based on the above-mentioned diffraction formula. For example, when the Rayleigh-Sommerfeld diffraction formula is used, the control unit 22 calculates the wavefront propagation between adjacent layers, between a layer and the hologram surface H1, etc. When the angular spectrum method is used, for example, the control unit 22 executes a Fourier transform process using the intensity information of the image for each of the object light data 21B, converts the light ray information into a complex amplitude, and calculates the wavefront information. When the process of step S22 is completed, the control unit 22 advances the process to step S23.

[0043] The control unit 22 outputs the calculated complex amplitude (step S23). For example, the control unit 22 outputs wavefront data 21C indicating the calculated complex amplitude to the interference fringe generating unit 25. When the process of step S23 ends, the control unit 22 ends the process procedure shown in Fig. 6. The control unit 22 realizes the wavefront propagation calculation unit 24 by executing the process procedure shown in Fig. 6.

[0044] [Interference fringe generation process] The processing procedure shown in Fig. 7 is executed by the control unit 22 of the information processing device 20 when the wavefront propagation calculation processing shown in Fig. 6 is completed. The control unit 22 acquires a complex amplitude based on the wavefront data 21C (step S31). For example, the control unit 22 acquires a complex amplitude for each layer based on the wavefront data 21C. When the processing of step S31 is completed, the control unit 22 advances the processing to step S32.

[0045] The control unit 22 modulates the amplitude or phase (step S32). For example, the control unit 22 modulates the amplitude or phase of the image using a phase modulation method so that the complex amplitude is expressed by only the amplitude or phase in order to display on the display medium 11. The phase modulation method includes, for example, a double phase method. For example, the control unit 22 calculates a map of the hologram by calculating interference fringes between the object light and the reference light, which are indicated by the amplitude or phase of the hologram surface H1 calculated for each image of the layer. When the process of step S32 is completed, the control unit 22 advances the process to step S33.

[0046] Control unit 22 outputs the map of amplitude or phase (step S33). For example, control unit 22 outputs hologram data 21D indicating the calculated hologram map to storage unit 21, thereby storing it in storage unit 21. For example, control unit 22 may output hologram data 21D to hologram display unit 10. When the process of step S33 ends, control unit 22 ends the process procedure shown in Fig. 7. Control unit 22 realizes interference fringe generation unit 25 by executing the process procedure shown in Fig. 7.

[0047] [Example of measures against occlusion regions in the information processing device according to the embodiment] Information processing device 20 according to the embodiment executes object light generation processing, wavefront propagation calculation processing, and interference fringe generation processing to generate hologram data 21D from image data 21A. Hereinafter, a case where information processing device 20 executes a countermeasure example for occlusion region 213 in object light generation processing (object light generator 23) will be described.

[0048] [Measures for the information processing device according to the embodiment (1)] FIG. 8 is a diagram for explaining an outline of a measure (1) of the information processing device 20 according to the embodiment. As shown in the left diagram of FIG. 8, in the occlusion region 213 of the object light data 21B, ringing may occur from an amplitude edge 214 at the boundary with the background 212. In contrast, it has been found that, in the occlusion region 213, as shown in the right diagram of FIG. 8, by appropriately retracting the amplitude edge 214 to the inside of the occlusion region 213, ringing does not leak out to the region of the foreground 211. The amplitude edge 214 means, for example, the amplitude of an edge portion of an image. The information processing device 20 is configured to be able to provide a measure (1) for the amplitude edge 214.

[0049] [Countermeasures (1-1)] Measure (1-1) is to expand the amplitude of the background image. Specifically, measure (1-1) is to expand the amplitude edge 214 of the image of the background 212 toward the inside of the occlusion region 213. Fig. 9 is a flowchart in which measure (1-1) is added to the object light generation process shown in Fig. 5. The processing procedure shown in Fig. 9 is realized by the control unit 22 of the information processing device 20 executing a program.

[0050] 9, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S111.

[0051] The control unit 22 extends the amplitude edge 214 of the boundary with the occlusion region 213 of the object light data 21B having the occlusion region 213 toward the inside of the occlusion region 213 (step S111). For example, the control unit 22 specifies the occlusion region 213 from among the multiple object light data 21B based on the front-back relationship of the object. Then, the control unit 22 applies a dilation filter or the like to the amplitude of the background 212 indicated by the object light data 21B, and extends the background 212 toward the inside of the occlusion region 213. For example, the control unit 22 fills in pixel values ​​near the boundary of the occlusion region 213 with 0, and when there is one or more pixels with a pixel value of 1 or more within a predetermined region (kernel) near the boundary, the control unit 22 sets the pixel value of the pixel of interest of the image of the background 212 to the average value of the pixels. As a result, the control unit 22 extends the image of the background 212 toward the inside of the occlusion region 213, thereby changing the amplitude in the object light data 21B near the boundary with the occlusion region 213. The control unit 22 takes measures for the object light data 21B for each of the multiple layers. Note that the process of step S111 is skipped for the object light data 21B that does not have the occlusion region 213. When the process of step S111 ends, the control unit 22 advances the process to step S13. Note that the control unit 22 functions as the identification unit 23A and the change unit 23B by executing step S111.

[0052] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 9. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 9.

[0053] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 expands the amplitude of the boundary of the occlusion region 213 by the measure (1-1), and therefore can generate hologram data 21D in which leakage of the wavefront at the boundary of the occlusion region 213 is suppressed. As a result, even when the information processing device 20 reproduces the hologram data 21D, leakage of the wavefront from the boundary of the occlusion region 213 can be suppressed.

[0054] [Countermeasures (1-2)] Measure (1-2) is to expand the amplitude of the background image. Specifically, measure (1-2) is to expand the amplitude edge 214 of the image of the background 212 by filling the inside of the occlusion region 213. Fig. 10 is a flowchart in which measure (1-2) is added to the object light generation process shown in Fig. 5. The processing procedure shown in Fig. 10 is realized by the control unit 22 of the information processing device 20 executing a program.

[0055] 10, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S112.

[0056] The control unit 22 fills in an edge area extending from the boundary of the occlusion region 213 to the inside of the object light data 21B having the occlusion region 213 (step S112). For example, the control unit 22 specifies the occlusion region 213 from among a plurality of object light data 21B based on the front-to-back relationship of the object. Then, the control unit 22 executes an inpainting process or the like on the amplitude of the background 212 indicated by the object light data 21B, and fills in an area extending from the boundary of the occlusion region 213 to the inside. The area extending from the boundary of the occlusion region 213 to the inside may be set in consideration of the results of machine learning, simulation, or the like of the occurrence of ringing. For example, the control unit 22 replaces the value of one pixel on the neighboring area to be corrected with a weighted sum of pixel values ​​of pixels whose pixel values ​​are already known among the surrounding pixels. As a result, the control unit 22 changes the amplitude in the object light data 21B near the boundary with the occlusion region 213 by expanding the image of the background 212 toward the inside of the occlusion region 213. The control unit 22 takes measures for the object light data 21B for each of the multiple layers. Note that the process of step S112 is skipped for the object light data 21B that does not have the occlusion region 213. When the process of step S112 ends, the control unit 22 advances the process to step S13. Note that the control unit 22 functions as the identification unit 23A and the change unit 23B by executing step S112.

[0057] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 10. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 10.

[0058] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 expands the amplitude of the boundary of the occlusion region 213 by the measure (1-2), and therefore can generate hologram data 21D in which leakage of the wavefront at the boundary of the occlusion region 213 is suppressed. As a result, even when the information processing device 20 reproduces the hologram data 21D, leakage of the wavefront from the boundary of the occlusion region 213 can be suppressed.

[0059] [Countermeasures (1-3)] Countermeasure (1-3) is to expand the amplitude of the background image. The process of expanding the amplitude requires a large amount of calculation. Therefore, countermeasure (1-3) is a countermeasure for suppressing the amount of calculation of the process of expanding the amplitude and expanding the amplitude of the background image. FIG. 11 is a flowchart in which countermeasure (1-3) is added to the object light generation process shown in FIG. 5. The processing procedure shown in FIG. 11 is realized by the control unit 22 of the information processing device 20 executing a program.

[0060] 11, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S113.

[0061] For the object light data 21B having the occlusion region 213, the control unit 22 reduces the object light data 21B and expands the edge of the boundary with the occlusion region 213 toward the inside of the occlusion region 213 to restore the size of the object light data 21B (step S113). For example, when the control unit 22 specifies the occlusion region 213 from among the multiple object light data 21B based on the front-to-back relationship of the object, the control unit 22 executes the processing procedure shown in FIG.

[0062] FIG. 12 is a diagram for explaining an example of a measure (1-3) in the object light generation process. As shown in FIG. 12, the control unit 22 executes a process of reducing the object light data 21B at a first reduction ratio (step ST1). The control unit 22 executes a process of reducing the reduced object light data 21B-1 at a second reduction ratio (step ST2). The control unit 22 executes a process of expanding the amplitude of the background image for the reduced object light data 21B-2 (step ST3). The process of expanding the amplitude may be a process of the response (1-1) or the response plan (1-2). The control unit 22 executes a process of expanding the object light data 21B-3, which has been subjected to the process of expanding the amplitude, at a second expansion ratio (step ST4). The second expansion ratio is a magnification for restoring the second reduction ratio. The control unit 22 executes a process of expanding the amplitude of the expanded object light data 21B-4, and expands the data at a first expansion ratio (step ST5). The first enlargement ratio is a magnification for restoring the first reduction ratio. The control unit 22 suppresses an increase in the amount of calculation and obtains object light data 21B' in which the image of the background 212 is expanded toward the inside of the occlusion region 213. As a result, the control unit 22 expands the image of the background 212 toward the inside of the occlusion region 213, thereby changing the amplitude in the object light data 21B near the boundary with the occlusion region 213.

[0063] 11, the control unit 22 takes measures against the object light data 21B for each of the multiple layers. Note that the process of step S113 is skipped for the object light data 21B that does not have the occlusion region 213. When the process of step S113 ends, the control unit 22 advances the process to step S13. Note that the control unit 22 functions as the identification unit 23A and the change unit 23B by executing step S113.

[0064] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 11. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 11.

[0065] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 expands the amplitude of the boundary of the occlusion region 213 by the measure (1-3), and therefore can generate hologram data 21D in which leakage of the wavefront at the boundary of the occlusion region 213 is suppressed. Moreover, the information processing device 20 can also suppress an increase in the amount of calculation related to the measure (1-3). As a result, the information processing device 20 can suppress leakage of the wavefront from the boundary of the occlusion region 213 even when reproducing the hologram data 21D.

[0066] [Measures for the information processing device according to the embodiment (2)] As described in the above measure (1), in the occlusion region 213 of the object light data 21B, ringing may occur from the amplitude edge 214 at the boundary with the background 212. In response to this, it has been found that the occurrence of ringing in the occlusion region 213 can be suppressed by smoothing the change in amplitude at the boundary of the occlusion region 213. The information processing device 20 is configured to be able to provide measure (2) for smoothing the amplitude of the background.

[0067] Fig. 13 is a flowchart in which measure (2) is added to the object light generation process shown in Fig. 5. The process procedure shown in Fig. 13 is realized by the control unit 22 of the information processing device 20 executing a program.

[0068] 13, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S121.

[0069] The control unit 22 averages the amplitude of the boundary with the occlusion region 213 for the object light data 21B having the occlusion region 213 (step S121). For example, the control unit 22 specifies the occlusion region 213 from among the plurality of object light data 21B based on the front-back relationship of the object. Then, the control unit 22 expands the background image near the boundary of the occlusion region 213, applies a low pass filter or the like to the boundary vicinity, and smoothes the amplitude of the background image near the boundary of the occlusion region 213. As a result, the control unit 22 changes the amplitude in the object light data 21B near the boundary with the occlusion region 213 by smoothing the change in the amplitude of the background image near the boundary of the occlusion region 213. The control unit 22 takes measures against the object light data 21B for each of the plurality of layers. Note that the process of step S121 is skipped for the object light data 21B not having the occlusion region 213. When the process of step S121 ends, the control unit 22 advances the process to step S13. Note that the control unit 22 functions as the specifying unit 23A and the changing unit 23B by executing step S121.

[0070] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 13. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 13.

[0071] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 smoothes the boundary of the occlusion region 213 by the measure (2), and therefore can generate hologram data 21D in which the occurrence of ringing at the boundary of the occlusion region 213 is suppressed. As a result, even when the information processing device 20 reproduces the hologram data 21D, the occurrence of ringing at the boundary of the occlusion region 213 can be suppressed.

[0072] In the measure (2) of the present embodiment, the control unit 22 of the information processing device 20 performs the smoothing process after expanding the object light data 21B, but the present invention is not limited to this. For example, the control unit 22 may be configured to perform the smoothing process without expanding the object light data 21B.

[0073] [Measures for the information processing device according to the embodiment (3)] The amplitude expansion of measure (1) and the amplitude expansion and smoothing processes of measure (2) require a large amount of calculation. When the vicinity of the boundary of the occlusion region 213 is flat, the effect of the smoothing of measure (2) is not noticeable even if amplitude expansion is not performed. For this reason, the information processing device 20 is configured to be able to provide measure (3) that switches measures based on the amplitude distribution near the boundary of the occlusion region 213.

[0074] [Countermeasures (3-1)] Measure (3-1) is to switch the amplitude processing for the background image. Specifically, measure (3-1) is to switch the amplitude processing based on the amplitude distribution near the boundary of the occlusion region 213. Fig. 14 is a flowchart in which measure (3-1) is added to the object light generation processing shown in Fig. 5. The processing procedure shown in Fig. 14 is realized by the control unit 22 of the information processing device 20 executing a program.

[0075] 14, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S131.

[0076] The control unit 22 selects an amplitude processing method for the occlusion region 213 for each of the plurality of object light data 21B (step S131). For example, the control unit 22 identifies the occlusion region 213 for each of the plurality of object light data 21B based on the front-back relationship of the object. Then, when the control unit 22 identifies the occlusion region 213, it selects an amplitude processing method based on a selection condition. The selection condition includes, for example, a condition for selecting smoothing when the distribution of the amplitude near the occlusion region 213 is flat, and a condition for selecting either amplitude expansion or amplitude expansion and smoothing when the distribution of the amplitude is not flat. Note that the selection condition may further include a condition for selecting either amplitude expansion or amplitude expansion and smoothing when the distribution of the amplitude is not flat. When the control unit 22 stores the selection result of step S131 in the storage unit 21, the control unit 22 advances the process to step S132.

[0077] The control unit 22 executes the amplitude processing of the selected method for each of the plurality of object light data 21B (step S132). For example, the control unit 22 executes the amplitude processing by smoothing for the object light data 21B for which smoothing has been selected. For example, the control unit 22 executes the amplitude processing by amplitude expansion or amplitude expansion and smoothing for the object light data 21B for which either amplitude expansion or amplitude expansion and smoothing has been selected. In this way, the control unit 22 takes measures against the object light data 21B for each of the plurality of layers by executing the amplitude processing suitable for the state of the amplitude distribution near the boundary of the occlusion region 213, and changes the amplitude in the object light data 21B near the boundary with the occlusion region 213. When the process of step S132 is completed, the control unit 22 advances the process to step S13. The control unit 22 functions as the identification unit 23A and the change unit 23B by executing steps S131 and S132.

[0078] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 14. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 14.

[0079] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 expands the amplitude at the boundary of the occlusion region 213 according to the amplitude distribution by the measure (3-1), and therefore can generate hologram data 21D in which leakage of the wavefront at the boundary of the occlusion region 213 is suppressed. As a result, the information processing device 20 can optimize the effect of suppressing ringing near the boundary of the occlusion region 213 and suppress the amount of calculation.

[0080] [Countermeasures (3-2)] Countermeasure (3-2) is to switch the amplitude processing for the background image. Specifically, countermeasure (3-2) is to switch the amplitude processing depending on the type of occlusion region 213 of object light data 21B. Fig. 15 is a flowchart in which countermeasure (3-2) is added to the object light generation processing shown in Fig. 5. The processing procedure shown in Fig. 15 is realized by the control unit 22 of the information processing device 20 executing a program.

[0081] 15, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S141.

[0082] The control unit 22 specifies the type of the occlusion region 213 for each of the plurality of object light data 21B (step S141). For example, the occlusion region 213 includes types such as self-occlusion and mutual occlusion. The self-occlusion includes occlusion occurring due to a front-to-back relationship within the same object. The same object includes, for example, a relationship between a human face and a hand. The mutual occlusion includes occlusion occurring due to a front-to-back relationship between different objects. For example, the control unit 22 specifies the occlusion region 213 for each of the plurality of object light data 21B based on the front-to-back relationship of the object. Then, the control unit 22 specifies the type of each occlusion region 213 based on the front-to-back relationship of the occlusion region 213 of the object light data 21B for each of the plurality of layers. The control unit 22 distinguishes between self-occlusion and mutual occlusion based on the plane coordinates and the depth range. The control unit 22 specifies a region in which both the plane coordinates and the depth are close to each other as self-occlusion. After storing the identification result in step S141 in the storage unit 21, the control unit 22 advances the process to step S142.

[0083] The control unit 22 executes amplitude processing according to the identified type for each of the plurality of object light data 21B (step S142). For example, the information processing device 20 performs amplitude processing by expansion when the type is mutual occlusion, and performs amplitude processing by projection when the type is self-occlusion. In this case, when the identified result is mutual occlusion, the control unit 22 executes processing to expand the amplitude near the boundary of the occlusion region 213 for each of the plurality of object light data 21B. When the identified result is self-occlusion, the control unit 22 executes processing to parallel project the image of the foreground onto the occlusion region 213.

[0084] FIG. 16 is a diagram for explaining an example of a measure (3-2) according to the type of occlusion region. The left diagram of FIG. 16 shows an example of processing images for each layer of mutual occlusion. The left diagram of FIG. 16 shows an example of dividing images showing the front-to-back relationship of different objects into layers. The right diagram of FIG. 16 shows an example of processing images for each layer of self-occlusion. The right diagram of FIG. 16 shows an example of dividing images showing the front-to-back relationship of the same object into layers. In FIG. 16, the images 221, 222, and 223 for each layer are farther from the hologram surface H1 in this order. In the image 222, the portion of the image 221, which is the foreground, is the occlusion region 213. In the image 223, the portions of the images 221 and 222, which are the foreground, are the occlusion region 213.

[0085] When the control unit 22 determines that the type of the occlusion region 213 is mutual occlusion, the control unit 22 executes a process of extending the amplitude edge 214 near the boundary of the occlusion region 213 to the inside of the occlusion region 213, as shown in the left diagram of FIG. 16. When the control unit 22 determines that the type of the occlusion region 213 is self-occlusion, the control unit 22 executes a process of parallel projecting the foreground image onto the occlusion region 213, as shown in the right diagram of FIG. 16. For example, the control unit 22 extends the occlusion region 213 of the image 222 to fill it with an image 221' obtained by parallel projecting the image 221. The control unit 22 extends the occlusion region 213 of the image 223 to fill it with an image 222' obtained by parallel projecting the image 221' and the image 222 onto the background image 223. The control unit 22 executes amplitude processing suitable for the type of the occlusion region 213, thereby taking measures suitable for the object light data 21B for each of the multiple layers. The control unit 22 performs amplitude processing on the object light data 21B for each of the multiple layers. As a result, the control unit 22 changes the amplitude in the object light data 21B near the boundary with the occlusion region 213 by expanding the image of the background 212 toward the inside of the occlusion region 213, or by filling the inside of the occlusion region 213 with a foreground image. Returning to FIG. 15, when the process of step S142 is completed, the control unit 22 advances the process to step S13. Note that the control unit 22 functions as the identification unit 23A and the change unit 23B by executing steps S141 and S142.

[0086] Controller 22 sets an initial phase (step S13). When controller 22 finishes the process of step S13, controller 22 ends the process procedure shown in Fig. 15. Controller 22 realizes object light generator 23 by executing the process procedure shown in Fig. 15.

[0087] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 expands the amplitude of the boundary of the occlusion region 213 by the measure (3-2), and therefore can generate hologram data 21D in which leakage of the wavefront at the boundary of the occlusion region 213 is suppressed. As a result, the information processing device 20 can optimize the effect of suppressing ringing near the boundary of the occlusion region 213 and suppress the amount of calculation.

[0088] [Measures for the information processing device according to the embodiment (4)] The information processing device 20 is configured to be able to provide a measure (4) for setting an initial phase near the boundary so that a wavefront generated from the boundary of the occlusion region 213 of the object light data 21B does not spread into the foreground region.

[0089] Fig. 17 is a flowchart in which measure (4) is added to the object light generation process shown in Fig. 5. The process procedure shown in Fig. 17 is realized by the control unit 22 of the information processing device 20 executing a program.

[0090] 17, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S151.

[0091] The control unit 22 sets an initial phase that suppresses the spread of the wavefront generated from the boundary of the occlusion region 213 (step S151). For example, the control unit 22 acquires a complex amplitude of the amplitude and phase of the object light for each pixel by uniformly changing the phase according to the XY coordinates for the pixel value of the object light data 21B. The control unit 22 sets the acquired phase as an initial phase in the object light data 21B. Then, the control unit 22 identifies the occlusion region 213 from among the multiple object light data 21B based on the front-back relationship of the object. When the object light data 21B has the occlusion region 213, the control unit 22 fills the amplitude of the background occlusion region 213 with a value larger than 0, and sets an initial phase that provides a focusing effect that converges toward the center of the occlusion region 213 near the boundary of the background occlusion region 213. For example, a quadratic phase or the like can be given as the initial phase that provides a focusing effect. As a result, control unit 22 changes the phase in object light data 21B near the boundary of occlusion region 213. When the process of step S151 ends, control unit 22 ends the process procedure shown in Fig. 17. Note that control unit 22 realizes object light generation unit 23 by executing the process procedure shown in Fig. 17, and functions as identification unit 23A and change unit 23B.

[0092] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 can generate hologram data 21D in which leakage of the wavefront near the boundary of the occlusion region 213 is suppressed, since the information processing device 20 sets the initial phase near the boundary of the occlusion region 213 by the measure (4). As a result, even when the information processing device 20 reproduces the hologram data 21D, leakage of the wavefront from the boundary of the occlusion region 213 can be suppressed.

[0093] [Measures for the information processing device according to the embodiment (5)] It is known that the initial phase of the hologram H uses a publicly known random phase in order to increase the spatial frequency and diffuse the light. However, it is known that speckle noise occurs when the random phase is used for the hologram H. The information processing device 20 is configured to be able to provide a measure (5) that imparts a random phase only near the boundary of the occlusion region 213 of the object light data 21B.

[0094] Fig. 18 is a flowchart in which measure (5) is added to the object light generation process shown in Fig. 5. The process procedure shown in Fig. 18 is realized by the control unit 22 of the information processing device 20 executing a program.

[0095] 18, the control unit 22 of the information processing device 20 acquires the amplitude and coordinates of the object light (step S11). The control unit 22 models the object light based on the acquired amplitude and coordinate information (step S12). After generating the object light data 21B, the control unit 22 advances the process to step S152.

[0096] The control unit 22 sets an initial phase for diffusing a wavefront generated from the boundary of the occlusion region 213 (step S152). For example, the control unit 22 acquires a complex amplitude of the amplitude and phase of the object light for each pixel by uniformly changing the phase according to the XY coordinates for the pixel value of the object light data 21B. The control unit 22 sets the acquired phase as an initial phase for the object light data 21B. Then, the control unit 22 identifies the occlusion region 213 from among the multiple object light data 21B based on the front-back relationship of the object. When the object light data 21B has the occlusion region 213, the control unit 22 sets an initial phase for limiting the region where the speckle noise occurs only to the vicinity of the boundary of the occlusion region 213 in the background by applying a random phase only to the vicinity of the boundary of the occlusion region 213. When the process of step S152 ends, the control unit 22 ends the process procedure shown in FIG. 18. Note that control unit 22 realizes object light generating unit 23 by executing the processing procedure shown in FIG. 18, and functions as specifying unit 23A and changing unit 23B.

[0097] When the execution of the object light generation process is completed, the information processing device 20 sequentially executes the wavefront propagation calculation process and the interference fringe generation process. As a result, the information processing device 20 sets an initial phase that limits the area where speckle noise occurs only to the vicinity of the boundary of the occlusion region 213 by the measure (5), and therefore can generate hologram data 21D in which the occurrence of speckle noise other than the vicinity of the boundary is suppressed. As a result, even when the information processing device 20 reproduces the hologram data 21D, it is possible to suppress the occurrence of ringing at the boundary of the occlusion region 213 and the occurrence of speckle noise other than the vicinity of the boundary.

[0098] In the above embodiment, the measures (1) to (5) may be changed, applied to other measures, or combined. For example, the information processing device 20 may change the object light data 21B by combining the amplitude expansion and the setting of the initial phase.

[0099] [Hardware configuration] The information processing device 20 according to the embodiment described above may be realized by a computer 1000 having a configuration as shown in Fig. 19, for example. The information processing device 20 according to the embodiment will be described below as an example. Fig. 19 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the information processing device 20. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. Each unit of the computer 1000 is connected by a bus 1050.

[0100] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processes corresponding to the various programs.

[0101] The ROM 1300 stores boot programs such as a basic input output system (BIOS) executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000.

[0102] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, which is an example of program data 1450.

[0103] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.

[0104] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading a program or the like recorded on a predetermined recording medium. The medium may be, for example, an optical recording medium such as a DVD (Digital Versatile Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0105] For example, when the computer 1000 functions as the information processing device 20 according to the embodiment, the CPU 1100 of the computer 1000 executes a program loaded on the RAM 1200 to realize functions of the identifying unit 23A, the changing unit 23B, etc. Also, the HDD 1400 stores the program according to the present disclosure and data in the storage unit 21. Note that the CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, these programs may be obtained from other devices via an external network 1550.

[0106] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.

[0107] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.

[0108] It is also possible to create a program to cause hardware such as a CPU, ROM, and RAM built into a computer to perform functions equivalent to those of the configuration of information processing device 20, and a computer-readable recording medium on which the program is recorded can also be provided.

[0109] In addition, each step related to the processing of the information processing device 20 in this specification does not necessarily have to be processed in chronological order according to the order described in the flowchart. For example, each step related to the processing of the information processing device 20 may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

[0110] In the present embodiment, the layer data is described as object light data 21B, but is not limited thereto. For example, the layer data is different data depending on the original data for generating hologram data 21D. For example, when a point filling method is used to generate hologram data 21D, the layer data is data in which a set of point objects is layered. For example, the layer data is data in which data expressing an object as a polygon is layered.

[0111] (effect) The information processing device 20 includes an identification unit 23A that identifies an occlusion region 213 that is lost due to a foreground image of layer data of another hierarchy from a plurality of layer data that can gradually express object light of a three-dimensional object, and a modification unit 23B that modifies at least one of the amplitude and phase in the layer data of the boundary with the identified occlusion region 213 so as to suppress leakage of the object light to the outside of the occlusion region 213.

[0112] Thereby, when the information processing device 20 specifies the occlusion region 213 in the layer data, it can change the layer data so as to suppress leakage of the object light to the outside of the occlusion region 213. As a result, the information processing device 20 can suppress the occurrence of ringing in the hologram H having the front-back relationship of the object by creating the hologram data 21D based on the changed layer data.

[0113] In the information processing device 20, the modification unit 23B modifies the boundary of the amplitude of the surrounding region relative to the occlusion region 213 in the layer data so as to expand toward the inside of the occlusion region 213.

[0114] Thereby, the information processing device 20 can suppress leakage of the wavefront from the boundary of the occlusion region 213 by expanding the amplitude of the boundary of the occlusion region 213 in the layer data. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0115] In the information processing device 20, the modification unit 23B modifies the amplitude of the layer data so as to fill in the boundary region of the occlusion region 213 in the layer data.

[0116] Thereby, the information processing device 20 fills in the vicinity of the boundary of the occlusion region 213 in the layer data and expands the amplitude of the boundary of the occlusion region 213, thereby making it possible to suppress leakage of the wavefront from the boundary of the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0117] In the information processing device 20, the modification unit 23B reduces layer data having an occlusion region 213, modifies the amplitude boundary of the reduced layer data so as to expand toward the inside of the occlusion region 213, and restores the size of the modified layer data.

[0118] Thereby, the information processing device 20 expands the boundary of the amplitude of the reduced layer data and restores the size of the changed layer data, thereby reducing the amount of calculation and suppressing leakage of the wavefront from the boundary of the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0119] In the information processing device 20, the modification unit 23B modifies the boundary of the amplitude between the occlusion region 213 and the surrounding region in the layer data so as to smooth it.

[0120] Thereby, since the information processing device 20 smoothes the boundary of the occlusion region 213, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0121] In the information processing device 20, if the amplitude distribution of the surrounding area near the boundary with the occlusion area 213 in the layer data is flat, the modification unit 23B modifies the amplitude boundary to smooth it, and if the amplitude distribution is not flat, the modification unit 23B modifies the amplitude boundary to expand it toward the inside of the occlusion area.

[0122] As a result, the information processing device 20 changes the processing in accordance with the amplitude distribution near the boundary of the occlusion region 213 and expands the amplitude at the boundary of the occlusion region 213, so that it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213 with a calculation amount appropriate for the amplitude distribution. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0123] In the information processing device 20, the change unit 23B identifies the type of the occlusion region 213, and changes the boundary of the amplitude by an extension method according to the type.

[0124] Thereby, the information processing device 20 extends the amplitude of the boundary of the occlusion region 213 by an extension method according to the type of the occlusion region 213, and therefore, with an appropriate amount of calculation, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0125] In the information processing device 20, the occlusion region 213 has a type of self-occlusion and a type of mutual occlusion. When the change unit 23B identifies the type of the occlusion region 213 as self-occlusion, the change unit 23B projects a foreground image corresponding to the occlusion region 213 onto the occlusion region to change the amplitude boundary. When the change unit 23B identifies the type of the occlusion region 213 as mutual occlusion, the change unit 23B changes the amplitude boundary so as to expand toward the inside of the occlusion region 213.

[0126] As a result, the information processing device 20 extends the amplitude of the boundary of the occlusion region 213 by an extension method according to whether the type of the occlusion region 213 is self-occlusion or mutual occlusion, and therefore, with an appropriate amount of calculation, can suppress leakage of the wavefront from the boundary of the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it can suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0127] In the information processing device 20, the modification unit 23B modifies the phase of the boundary portion with the occlusion region 213 of the layer data so that a wavefront generated from the boundary between the occlusion region 213 in the layer data and the surrounding region does not spread into the occlusion region 213.

[0128] Thereby, the information processing device 20 can suppress leakage of the wavefront from the boundary of the occlusion region 213 by changing the phase in the layer data to one in which the wavefront does not spread from the boundary of the occlusion region 213 into the occlusion region 213. As a result, even when the information processing device 20 reproduces the hologram data 21D created based on the changed layer data, it is possible to suppress leakage of the wavefront from the boundary of the occlusion region 213.

[0129] In the information processing device 20, the modification unit 23B modifies the phase of the boundary portion between the layer data and the occlusion region so as to diffuse a wavefront generated from the boundary between the occlusion region 213 in the layer data and the surrounding region.

[0130] As a result, the information processing device 20 changes the phase of the boundary with the occlusion region 213 in the layer data to a phase that diffuses the wavefront, and therefore can suppress leakage of the wavefront from the boundary of the occlusion region 213. That is, the information processing device 20 can suppress the occurrence of speckle noise other than near the boundary of the occlusion region 213. As a result, even when reproducing the hologram data 21D created based on the changed layer data, the information processing device 20 can suppress the occurrence of ringing at the boundary of the occlusion region 213 and speckle noise other than near the boundary.

[0131] The information processing device 20 includes an object light generation unit 23 that generates layer data indicating the object light, a wavefront propagation calculation unit 24 that calculates wavefront propagation based on the amplitude and phase of the layer data, and an interference fringe generation unit 25 that generates interference fringes based on the calculation results of the wavefront propagation, and the object light generation unit 23 includes an identification unit 23A and a modification unit 23B.

[0132] As a result, the information processing device 20 expands the amplitude at the boundary of the occlusion region 213, and can generate interference fringes of the hologram H that suppress leakage of the wavefront at the boundary of the occlusion region 213. As a result, the information processing device 20 can suppress leakage of the wavefront from the boundary of the occlusion region 213 even when reproducing the hologram data 21D having the generated interference fringes.

[0133] The information processing method of the information processing device 20 includes identifying an occlusion region 213 that is missing due to a foreground image of layer data of another hierarchical level from a plurality of layer data capable of gradually expressing object light of a three-dimensional object, and modifying at least one of the amplitude and phase in the layer data of the boundary with the identified occlusion region 213 so as to suppress leakage of the object light outside the occlusion region 213.

[0134] Thereby, when the information processing method identifies occlusion region 213 in the layer data, it is possible to modify the layer data so as to suppress leakage of the object light to the outside of occlusion region 213. As a result, the information processing method creates hologram data 21D based on the modified layer data, thereby making it possible to suppress the occurrence of ringing in hologram H having a front-to-back relationship of the object.

[0135] The information processing program of the information processing device 20 causes the computer to identify an occlusion region 213 that is lost due to a foreground image of layer data of another hierarchical level from a plurality of layer data capable of gradually expressing object light of a three-dimensional object, and to modify at least one of the amplitude and phase in the layer data of the boundary with the identified occlusion region 213 so as to suppress leakage of the object light to the outside of the occlusion region 213.

[0136] Thereby, when the information processing program specifies occlusion region 213 in the layer data, it can cause the computer to change the layer data so as to suppress leakage of the object light to the outside of occlusion region 213. As a result, the information processing program can cause the computer to create hologram data 21D based on the changed layer data, thereby suppressing the occurrence of ringing in hologram H having a front-back relationship of the object.

[0137] Note that the following configurations also fall within the technical scope of the present disclosure. (1) A specifying unit that specifies an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; An information processing device comprising: (2) The modification unit modifies a boundary of the amplitude of a surrounding region of the occlusion region in the layer data so as to extend toward an inside of the occlusion region. The information processing device according to (1). (3) The modification unit modifies the amplitude of the layer data so as to fill a boundary region of the occlusion region in the layer data. The information processing device according to (1) or (2). (4) The modification unit reduces the layer data having the occlusion region, modifies the boundary of the amplitude of the reduced layer data so as to expand toward the inside of the occlusion region, and restores the size of the modified layer data. The information processing device according to any one of (1) to (3). (5) The modification unit modifies a boundary between the amplitude of the occlusion region and a surrounding region in the layer data so as to smooth the boundary. The information processing device according to any one of (1) to (4). (6) When the amplitude distribution of the surrounding area near the boundary with the occlusion area in the layer data is flat, the modification unit modifies the amplitude boundary to smooth the amplitude boundary, and when the amplitude distribution is not flat, modifies the amplitude boundary to expand toward the inside of the occlusion area. The information processing device according to any one of (1) to (5). (7) The change unit identifies a type of the occlusion region and changes the amplitude boundary using an extension method according to the type. The information processing device according to any one of (1) to (6). (8) The occlusion region has a type of self-occlusion and a type of mutual occlusion, The change unit is When the type of the occlusion region is identified as the self-occlusion, the foreground image corresponding to the occlusion region is projected onto the occlusion region to change the amplitude boundary; When the type of the occlusion region is identified as the mutual occlusion, the amplitude boundary is changed so as to extend toward the inside of the occlusion region. The information processing device according to (7) above. (9) The modification unit modifies a phase of a boundary portion of the layer data with the occlusion region so that a wavefront generated from a boundary between the occlusion region in the layer data and a surrounding region does not spread into the occlusion region. The information processing device according to any one of (1) to (8). (10) The modification unit modifies a phase of a boundary portion of the layer data with the occlusion region so as to diffuse a wavefront generated from a boundary between the occlusion region in the layer data and a surrounding region. The information processing device according to any one of (1) to (9). (11) an object light generating unit that generates the layer data indicating the object light; a wavefront propagation calculation unit that calculates a wavefront propagation based on the amplitude and phase of the layer data; an interference fringe generation unit that generates an interference fringe based on a calculation result of the wavefront propagation, The object light generating unit includes the specifying unit and the changing unit. The information processing device according to any one of (1) to (10). (12) The computer Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; An information processing method comprising: (13) On the computer, Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; An information processing program that executes the above. (14) On the computer, Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; A computer-readable recording medium having recorded thereon an information processing program for executing the above. [Explanation of symbols]

[0138] 1. Information Processing Systems 10 Hologram display unit 11 Display media 12 light source 20 Information processing device 21 Memory section 21A Image data 21B Object light data 21C Wavefront Data 21D hologram data 22 Control section 23 Object light generation section 23A Specific part 23B Changes 24 Wavefront Propagation Calculation Section 25 Interference fringe generating section 211 Foreground 212 Background 213 Occlusion Area H Hologram H1 Hologram surface

Claims

1. a specifying unit that specifies an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit modifies a boundary of the amplitude of a surrounding region of the occlusion region in the layer data so as to extend toward an inside of the occlusion region. Information processing device.

2. The modification unit modifies the amplitude of the layer data so as to fill a boundary region of the occlusion region in the layer data. The information processing device according to claim 1 .

3. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit reduces the layer data having the occlusion region, modifies the boundary of the amplitude of the reduced layer data so as to expand toward the inside of the occlusion region, and restores the size of the modified layer data. Information processing device.

4. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit modifies a boundary between the amplitude of the occlusion region and a surrounding region in the layer data so as to smooth the boundary. Information processing device.

5. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with When the amplitude distribution of the surrounding area near the boundary with the occlusion area in the layer data is flat, the modification unit modifies the amplitude boundary to smooth the amplitude boundary, and when the amplitude distribution is not flat, modifies the amplitude boundary to expand toward the inside of the occlusion area. Information processing device.

6. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit specifies a type of the occlusion region, and modifies the amplitude boundary using an extension method according to the type; The occlusion region has a type of self-occlusion and a type of mutual occlusion, The change unit is When the type of the occlusion region is identified as the self-occlusion, the foreground image corresponding to the occlusion region is projected onto the occlusion region to change the amplitude boundary; When the type of the occlusion region is identified as the mutual occlusion, the amplitude boundary is changed so as to extend toward the inside of the occlusion region. Information processing device.

7. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit modifies a phase of a boundary portion of the layer data with the occlusion region so that a wavefront generated from a boundary between the occlusion region in the layer data and a surrounding region does not spread into the occlusion region. Information processing device.

8. A determination unit that determines an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can gradually express object light of a three-dimensional object; A modification unit that modifies at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Equipped with The modification unit modifies a phase of a boundary portion of the layer data with the occlusion region so as to diffuse a wavefront generated from a boundary between the occlusion region in the layer data and a surrounding region. Information processing device.

9. an object light generating unit that generates the layer data indicating the object light; a wavefront propagation calculation unit that calculates a wavefront propagation based on the amplitude and phase of the layer data; an interference fringe generation unit that generates an interference fringe based on a calculation result of the wavefront propagation, The object light generating unit includes the specifying unit and the changing unit.

9. An information processing apparatus according to claim 1.

10. The computer Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Including, The modifying step further includes modifying a boundary of the amplitude of a surrounding region of the layer data that is adjacent to the occlusion region so as to extend toward the inside of the occlusion region. Information processing methods.

11. On the computer, Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Run the command, The modifying step further includes modifying a boundary of the amplitude of a surrounding region of the layer data that is adjacent to the occlusion region so as to extend toward the inside of the occlusion region. Information processing program.

12. A computer comprising: Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Including, The modifying step modifies a boundary between the amplitude of the occlusion region and the surrounding region in the layer data so as to smooth the boundary. Information processing methods.

13. A computer comprising: Identifying an occlusion area that is lost due to a foreground image of layer data of another layer from a plurality of layer data that can express object light of a three-dimensional object in a stepwise manner; changing at least one of an amplitude and a phase in the layer data of the boundary with the identified occlusion region so as to suppress leakage of the object light to the outside of the occlusion region; Run the command, The modifying step modifies a boundary between the amplitude of the occlusion region and the surrounding region in the layer data so as to smooth the boundary. Information processing program.

Images