Rapid hologram calculation method based on macular region optimized segmentation sub-holograms

Through the method of optimizing segmentation based on macular area, the problem of insufficient hologram calculation speed is solved, faster hologram generation time is achieved, and the application of dynamic holographic display is supported.

CN118963089AActive Publication Date: 2024-11-15BEIHANG UNIV

Patent Information

Application Number
CN202411003507.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-25
Publication Date
2024-11-15
Estimated Expiration
2044-07-25

AI Technical Summary

Technical Problem

The existing hologram calculation methods are difficult to meet the speed requirements of real-time dynamic holographic display, resulting in limited holographic display applications.

Method used

Using a fast calculation method of optimizing segmented sub-holograms based on macular area, the initial sub-holograms are generated by layering 3D objects and calculating the diffraction distance of each 2D plane based on depth information, and optimized segmentation according to macular area size to reduce Redundant information improves computing speed.

Benefits of technology

It significantly reduces the calculation time of the hologram and improves the calculation speed, making dynamic holographic display more feasible.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963089A_ABST
    Figure CN118963089A_ABST
Patent Text Reader

Abstract

The invention provides a rapid hologram calculation method based on a macular region optimization segmentation sub-hologram, and the method comprises the following three steps: 1, carrying out the layering processing of a 3D object according to depth information, obtaining 2D planes with different depth information, and calculating the diffraction distance of each 2D plane; 2, generating an initial sub-hologram corresponding to each 2D plane based on a Fresnel diffraction theory, and performing optimized segmentation analysis on the initial sub-holograms according to the viewing position, the size of a macular region and the diffraction distance of the 2D plane to obtain an effective sub-hologram of each 2D plane; and step 3, superposing the effective sub-holograms corresponding to each 2D plane to obtain a final 3D hologram. The 3D hologram is loaded to the spatial light modulator for optical reconstruction, and when the spatial light modulator is irradiated by the light source, a reproductive image of the 3D object is seen.
Need to check novelty before this filing date? Find Prior Art

Description

1. Technical Field

[0001] The present invention relates to holographic display technology, and more specifically, to a fast hologram calculation method based on optimized segmentation of sub-holograms in the macular area. 2. Background Technology

[0002] Holographic 3D display technology records all the wavefront information of 3D objects based on the principle of interference and reconstructs it based on the principle of diffraction, avoiding the problem of visual fatigue caused by the conflict between convergence and accommodation. It is one of the most ideal 3D display technologies. However, due to the huge amount of information of 3D objects, the calculation of holograms takes a lot of time, which limits the application of holographic 3D display and hinders the further development of dynamic holographic display. In order to improve the calculation speed of holograms, researchers have proposed a new lookup table method, which describes 3D objects as independent point light sources and groups them according to depth. During the calculation process, only the central stripe pattern of each group needs to be pre-calculated and stored, thereby greatly reducing the calculation time required for the traditional lookup table method to generate holograms. Subsequently, some researchers proposed a separation lookup table method, which reduces the amount of data storage and shortens the calculation time of holograms by simplifying the mathematical expression of spherical waves. Some researchers also optimize the segmentation of holograms by analyzing the effective viewing area of ​​the reconstructed image, thereby reducing the amount of calculation of the hologram and improving the calculation speed. With the development of computer technology, more fast hologram generation methods based on different principles have been proposed, such as phase tracking method, facet method and hardware acceleration method. However, the existing hologram calculation speed is still difficult to meet the requirements of real-time dynamic holographic display. How to achieve fast calculation of holograms is still a hot issue in the field of holographic display. III. Summary of the invention

[0003] The present invention proposes a fast hologram calculation method based on the optimized segmentation of sub-holograms in the macular area. Figure 1 As shown, the method includes the following three steps: the first step is to layer the 3D object according to the depth information to obtain 2D planes with different depth information, and calculate the diffraction distance of each 2D plane; the second step is to generate the initial sub-hologram corresponding to each 2D plane based on the Fresnel diffraction theory, and optimize the segmentation analysis of the initial sub-hologram according to the viewing position, the size of the macular area and the diffraction distance of the 2D plane to obtain the effective sub-hologram of each 2D plane; the third step is to superimpose the effective sub-hologram corresponding to each 2D plane to obtain the final 3D hologram. The 3D hologram is loaded onto the spatial light modulator for optical reconstruction, and when the spatial light modulator is illuminated by a light source, the reconstructed image of the 3D object is seen. The method proposed in the present invention analyzes the size of the effective sub-hologram corresponding to each 2D plane of the reconstructed image based on the size of the macular area, thereby reducing the amount of calculation and improving the calculation speed.

[0004] In step 1, according to the depth information, the 3D object is divided into N 2D planes with different depth information, and the size of the nth layer of 2D plane is recorded as M n , the diffraction distance is recorded as Z n , where n = 1, 2, 3…N.

[0005] In step 2, taking the nth layer 2D plane as an example, the optimization segmentation analysis principle of the sub-hologram is as shown in the attached figure. Figure 2 As shown, A and B are the two endpoints of the nth layer 2D plane, K is an arbitrary point on the 2D plane, and A', B' and K' are the reconstructed image points corresponding to points A, B and K. According to the Fresnel diffraction principle, the viewing angle of the reconstructed image of the 2D plane is limited by the maximum diffraction angle θ of the spatial light modulator:

[0006]

[0007] Among them, λ is the wavelength of the light source used, and p is the pixel pitch of the spatial light modulator. Figure 2 As shown in (a), when the viewer is located at a distance L behind the spatial light modulator, the CD area is the viewing area of ​​object point A when the initial sub-hologram n is reconstructed, and the EF area is the viewing area of ​​object point B when the initial sub-hologram n is reconstructed. Therefore, the ED area is the complete viewing area of ​​the nth layer 2D plane when the initial sub-hologram n is reconstructed. The OQ area is the effective area of ​​the macular area of ​​the human eye. In the complete viewing area ED, the OQ area is significantly smaller than the ED area. The viewer can only view the reconstructed image when and only when the reconstructed information enters the macular area of ​​the human eye. Therefore, the reconstruction information corresponding to the areas other than the macular area of ​​the human eye is redundant information, which affects the calculation speed of the hologram.

[0008] The principle of optimizing the segmentation of the initial sub-hologram according to the size of the macular area in the present invention is as shown in the attached figure. Figure 2 (b), where S A is the effective sub-hologram size of object point A after optimized segmentation based on the macular area, S B is the effective sub-hologram size of the object point B after the optimized segmentation based on the macular area, and S is the effective sub-hologram size of any object point K on the n-th layer 2D plane after the optimized segmentation based on the macular area, which is calculated according to geometric analysis:

[0009]

[0010] Among them, R is the size of the macular area OQ. From the analysis, it can be seen that the effective sub-holograms after the optimized segmentation based on the macular area have the same size, that is, S A =S B=S, and is smaller than the size of the spatial light modulator. According to formula (2), the initial sub-hologram of each object point on the n-th layer 2D plane is optimized and segmented respectively, the area of ​​the effective sub-hologram is determined, and the effective sub-hologram of the n-th layer 2D plane is obtained by superimposing the effective sub-holograms of adjacent object points.

[0011] In step three, the effective sub-holograms corresponding to different layers of 2D planes are superimposed to obtain the final 3D hologram. In the holographic reconstruction process, the 3D hologram generated in step three is loaded on the spatial light modulator. When the spatial light modulator is illuminated by coherent parallel light, a holographic 3D reproduction image is reconstructed. IV. Description of the drawings

[0012] Attached Figure 1 The figure is a flow chart of a fast hologram calculation method based on the optimized segmentation sub-hologram of the macular area according to the present invention.

[0013] Attached Figure 2 FIG. 1 is a schematic diagram of a sub-hologram based on the optimization segmentation of the macular area of ​​the present invention. Figure 2 (a) is a schematic diagram of the reconstruction range based on the initial sub-hologram; Figure 2 (b) is a schematic diagram of optimizing the segmentation of the initial sub-hologram based on the macular area.

[0014] Attached Figure 3 This is a comparison chart of the calculation time of a fast hologram calculation method based on the optimized segmentation sub-hologram of the macular area of ​​the present invention and a traditional new lookup table method.

[0015] It should be understood that the above drawings are only schematic and are not drawn to scale. V. Specific implementation methods

[0016] The following is a detailed description of an embodiment of a fast hologram calculation method based on the optimized segmentation sub-hologram of the macular area proposed by the present invention, and further describes the present invention. It is necessary to point out that the following embodiments are only used to further illustrate the present invention and cannot be understood as limiting the scope of protection of the present invention. Personnel skilled in the art in this field may make some non-essential improvements and adjustments to the present invention based on the above invention content, which still fall within the scope of protection of the present invention.

[0017] One embodiment of the present invention is: in the process of generating a hologram, the light source uses green light with a wavelength of 532nm. The spatial light modulator used in the experiment is a reflective pure phase spatial light modulator, whose pixel pitch is 6.4μm, the resolution is 1920×1080, and the phase modulation capability is 2π, and the pixel pitch of the hologram is set accordingly. Objects with resolutions of 300×300, 400×400 and 500×500 are selected as recorded objects, the diffraction distance is set to 10cm, the distance between the observer and the spatial light modulator is set to 30cm, and the size of the macular area of ​​the human eye is 0.55cm×0.55cm. The computer used to calculate the 3D hologram is configured with the 11th Gen Intel(R) Core(TM) i7-11700KF processor (3.60GHz), and the computing software is Python 3.9.13. When the conventional new lookup table method is used for calculation, the sub-hologram resolution of each object point is equal to the resolution of the spatial light modulator, which is 1920×1080. At this time, the generation time of the hologram is 670s, 1173s and 1847s respectively. When the method of the present invention is used for calculation, the effective sub-hologram resolution of each object point is 430×430, and the generation time of the 3D hologram is 455s, 796s and 1247s respectively. The calculation time comparison is shown in the attached figure. Figure 3 As shown, compared with the traditional new lookup table method, the method of the present invention significantly improves the speed of hologram calculation.

Claims

1. A fast hologram calculation method based on the optimized segmentation of sub-holograms in the macular area, characterized in that: The method includes the following three steps: first, the 3D object is layered according to the depth information to obtain 2D planes with different depth information, and the diffraction distance of each 2D plane is calculated; second, the initial sub-hologram corresponding to each 2D plane is generated based on the Fresnel diffraction theory, and the initial sub-hologram is optimized and segmented according to the viewing position, the size of the macular area and the diffraction distance of the 2D plane to obtain the effective sub-hologram of each 2D plane; The third step is to superimpose the effective sub-holograms corresponding to each 2D plane to obtain the final 3D hologram.

2. The fast hologram calculation method based on the optimized segmentation of sub-holograms in the macular area according to claim 1 is characterized in that: In the optimization segmentation calculation of the sub-hologram, according to the depth information, the 3D object is divided into N 2D planes with different depth information, and the size of the nth layer of 2D plane is recorded as M n , the diffraction distance is recorded as Z n , where n = 1, 2, 3…N; when the viewer is located at a distance L behind the spatial light modulator, the viewer can see the reconstructed image only when the reconstructed information enters the macula of the human eye. The effective sub-hologram size of any object point on the nth layer 2D plane after the optimized segmentation of the macula is denoted as S, and is calculated based on geometric analysis: Among them, R is the size of the macular area; for any object point, the effective sub-holograms after optimized segmentation based on the macular area are of the same size and smaller than the size of the spatial light modulator; the initial sub-hologram of each object point on the n-th layer of the 2D plane is optimized and segmented separately to determine the area of ​​the effective sub-hologram, and the effective sub-hologram of the n-th layer of the 2D plane is obtained by superimposing the effective sub-holograms of adjacent object points; the effective sub-holograms corresponding to different layers of 2D planes are superimposed to obtain the final 3D hologram.

Citation Information

Patent Citations

  • Near-to-eye display equipment-based hologram calculation method and device

    CN105223796A

  • Computed hologram generation method for reducing reproductive wasted information

    CN105892258A

  • Holographic AR display method based on conical lens

    CN109917551A

  • Holographic display system that suppresses speckle noise based on beam shaping

    CN109946943A

  • Holographic speckle noise suppression method based on effective utilization of spatial light modulator

    CN110032053A

Cited By

  • Large-view-field hologram calculation method based on carrier frequency multiplexing

    CN119689818A