A metasurface dynamic color holographic display method, system, device and medium
By performing timing image splitting and color channel classification on the target video data, combining the phase superposition method and the pixel matching algorithm, dynamic color holographic display of large field of view angles is realized, solving the problems of limited view angles and system complexity in the prior art.
Patent Information
- Application Number
- CN202410162813.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-05
- Publication Date
- 2025-04-08
- Estimated Expiration
- 2044-02-05
AI Technical Summary
When realizing color holographic display, the viewing angle is limited, the system structure is complex and the cost is high, and the spatial alignment accuracy of the three-color holographic reproduction images of red, green and blue are required.
By acquiring the target video data, performing timing image splitting and color channel classification, obtaining the light intensity map and amplitude data of the images of each color channel, iteratively optimized based on the phase superposition method, obtaining the optimized holographic complex amplitude data, and sampling through the pixel matching algorithm to realize dynamic color holographic display of large field of view angles.
It realizes that only requires the amplitude information of the two-dimensional color image to restore its phase information, expands the field of view angle, and realizes a stable large field of view angle dynamic color holographic display, reducing system complexity and cost.
Smart Images

Figure CN117872698B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of optical holographic display, and in particular relates to a super-surface dynamic color holographic display method, system, equipment and medium. Background Art
[0002] Holographic display technology can completely record and reconstruct the wavefront information of 3D objects. It is one of the most promising naked-eye 3D display technologies and has attracted widespread attention. However, the pixel size of the common spatial light modulators on the market is currently at the micron level, and the maximum viewing angle for monochrome holographic 3D display internationally is ~60°. In addition, in the process of realizing color holographic display, the holograms of the three color channels of red, green and blue need to be calculated and displayed separately. For example, researchers at Bilkent University used red, green and blue lasers to illuminate three spatial light modulators loaded with red, green and blue holograms, respectively, to achieve a color holographic display effect, but the system structure required for this technology is usually more complex and costly, and the spatial alignment accuracy of the red, green and blue holographic reconstructed images is very high. Researchers at the Japan Institute of Information and Communications Technology used time-division multiplexing to build a color holographic 3D display system. Researchers at Tokyo University of Agriculture and Technology built a color holographic display system using a single high-refresh-rate digital micromirror device. In this system, red, green, and blue lasers emitted by a fiber-coupled laser diode illuminate the digital micromirror device at different angles, and then high-order diffracted light is used for holographic reconstruction. Although existing methods can achieve color holographic display based on a single or three spatial light modulators, they all have the problem of limited display viewing angle. Summary of the invention
[0003] The purpose of the present invention is to provide a metasurface dynamic color holographic display method, system, device and medium to solve the problems existing in the above-mentioned prior art.
[0004] To achieve the above object, the present invention provides a metasurface dynamic color holographic display method, comprising:
[0005] Get target video data;
[0006] Performing time-series image splitting and color channel classification on the target video data to obtain a plurality of color channel images;
[0007] Obtain a light intensity map of each color channel image with the central wavelength pixel size as a reference system;
[0008] Obtaining amplitude data of a light intensity map corresponding to each of the color channel images;
[0009] Based on the phase superposition method, the phase distribution of the amplitude data corresponding to each intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized complex amplitude data of the holographic surface is obtained;
[0010] A preliminary holographic surface phase recovery image is obtained based on the optimized holographic surface complex amplitude data, and a pixel matching algorithm is introduced into the preliminary holographic surface phase recovery image for sampling to obtain a final holographic surface phase recovery image.
[0011] Optionally, performing time-series image segmentation and color channel classification on the target video data specifically includes:
[0012] Performing image segmentation on the target video data based on the original frame rate and timing of the target video data to obtain a plurality of segmented images;
[0013] Color channel classification is performed on each of the split images to obtain a plurality of color channel images; the color channel images include three color channel images of red, green and blue.
[0014] Optionally, obtaining a light intensity map of each color channel image with the central wavelength pixel size as a reference system specifically includes:
[0015] The color channel images are pixel matched with the central wavelength as a reference system, and after the pixel matching is completed, a light intensity map of the color channel images is obtained with the central wavelength pixel size as a reference system.
[0016] Optionally, the phase distribution of the amplitude data corresponding to each intensity map is iteratively optimized based on a phase superposition method, specifically including:
[0017] Step 1: Based on the amplitude data of each light intensity image, a random phase and a phase compensation coefficient are introduced to obtain complex amplitude data of the first holographic surface;
[0018] Step 2: performing phase compensation on the phase of the complex amplitude data of the first holographic surface and performing scalar diffraction forward propagation to obtain complex amplitude data of the imaging surface;
[0019] Step 3: replacing the amplitude part of the complex amplitude data of the imaging surface with the target light intensity distribution, and obtaining the modulated complex amplitude distribution data of the imaging surface based on the phase factor of the complex amplitude data of the imaging surface and the replaced target light intensity distribution;
[0020] Step 4: performing phase compensation and scalar diffraction forward propagation on the modulated imaging surface complex amplitude distribution data in sequence to obtain the second holographic surface complex amplitude data;
[0021] Step 5: superimposing the second holographic surface complex amplitude data with the metasurface conjugate phase to obtain the third holographic surface complex amplitude data after removing the metasurface;
[0022] Step 6: Replace the amplitude part of the third holographic surface complex amplitude data with the target amplitude distribution, and obtain the fourth holographic surface complex amplitude data based on the phase factor of the third holographic surface complex amplitude data and the replaced target amplitude distribution;
[0023] Repeat steps 2 to 6 to enter an iterative loop until the preset number of iterations is reached, and then output the optimized holographic surface complex amplitude data.
[0024] Optionally, obtaining a preliminary holographic surface phase recovery image based on the optimized holographic surface complex amplitude data specifically includes:
[0025] The phase factor of the optimized holographic surface complex amplitude data is obtained, and forward propagation is performed based on the phase factor to obtain the preliminary holographic surface phase recovery map.
[0026] Optionally, a pixel matching algorithm is introduced into the preliminary holographic surface phase recovery image for sampling to obtain a final holographic surface phase recovery image, specifically including:
[0027] The preliminary holographic surface phase recovery image is subjected to low-pass filtering down-sampling and forward propagation imaging based on a pixel matching algorithm to obtain the final holographic surface phase recovery image.
[0028] A metasurface dynamic color holographic display system, comprising:
[0029] The data acquisition and processing module is used to obtain target video data, perform time-series image segmentation and color channel classification on the target video data, and obtain a plurality of color channel images; obtain a light intensity map of each color channel image with the central wavelength pixel size as a reference system;
[0030] A holographic surface complex amplitude acquisition module is used to obtain the amplitude data of the light intensity map corresponding to each color channel image; based on the phase superposition method, the phase distribution of the amplitude data corresponding to each light intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized holographic surface complex amplitude data is obtained;
[0031] The holographic surface phase recovery module is used to obtain a preliminary holographic surface phase recovery image according to the optimized holographic surface complex amplitude data, introduce a pixel matching algorithm into the preliminary holographic surface phase recovery image for sampling, and obtain a final holographic surface phase recovery image.
[0032] An electronic device includes a memory and a processor, wherein the memory is used to store a computer program, and the processor runs the computer program to enable a metasurface dynamic color holographic display method.
[0033] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the metasurface dynamic color holographic display method.
[0034] The technical effects of the present invention are:
[0035] The present invention performs independent phase hologram restoration according to the correspondence between wavelength and propagation path through three primary color channels; in this way, only the amplitude information of the two-dimensional color image is needed to restore its phase information and realize the function of large field of view holographic display.
[0036] By dynamically regulating the phase of the spatial light field loaded on the three channels, a stable dynamic color hologram with a large field of view can be achieved. By combining the characteristics of the hologram recording medium that can be loaded with a hologram (dynamically adjustable) and the characteristics of the metasurface with a subwavelength size to complement each other, this method can not only make full use of the changing refresh rate of the hologram recording medium itself, so that the displayed color is stable, but also meet the human eye's perception of continuously dynamically changing images. At the same time, the present invention utilizes the subwavelength pixel size of the metasurface device to carry a specific distribution of phases. When the incident spatial light field illuminates the metasurface homogenizing device, it can achieve the expansion of the field of view of the incident light field. Furthermore, the present invention proposes a holographic phase recovery algorithm that integrates traditional lenses with devices that have the function of expanding the field of view.
[0037] The dynamic holographic phase recovery algorithm proposed in the present invention can automatically obtain images and light intensity maps of each channel at a frame rate. Since the dynamic color holographic phase recovery algorithm of the large field of view metasurface mentioned in this method, the pixel matching algorithm of the fusion metasurface, and the R, G, B three-color light dynamic adjustable imaging map matching algorithm for dispersion compensation are irrelevant to the specific content of the image, the dynamic hologram can be directly extracted only through the light intensity map. It achieves a fast and convenient effect, and can perform dispersion compensation well at the same time. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0039] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0040] Figure 1 is a flow chart of a dynamic color holographic phase recovery algorithm in an embodiment of the present invention;
[0041] Figure 2 This is an image of light of different wavelengths after passing through a combined lens in an embodiment of the present invention;
[0042] Figure 3 This is a flow chart of an imaging image matching algorithm based on dynamic adjustable R, G, and B three-color light in an embodiment of the present invention;
[0043] Figure 4 is a flowchart of a pixel matching algorithm based on a large field of view hypersurface in an embodiment of the present invention;
[0044] Figure 5 Schematic diagram of the structure of a metasurface device capable of achieving a large field of view in an embodiment of the present invention;
[0045] Figure 6 A color holographic phase recovery algorithm and a reconstruction pattern thereof for the metasurface fusion in an embodiment of the present invention;
[0046] Figure 7 is an imaging comparison diagram in an embodiment of the present invention;
[0047] Figure 8 This is a flow chart of the metasurface dynamic color holographic display in an embodiment of the present invention. DETAILED DESCRIPTION
[0048] Various exemplary embodiments of the present invention will now be described in detail. This detailed description should not be considered as limiting the present invention, but should be understood as a more detailed description of certain aspects, features, and embodiments of the present invention.
[0049] It should be understood that the terms described in the present invention are only for describing special embodiments and are not intended to limit the present invention. In addition, for the numerical range in the present invention, it should be understood that each intermediate value between the upper and lower limits of the scope is also specifically disclosed. Each smaller range between the intermediate value in any stated value or stated range and any other stated value or intermediate value in the described range is also included in the present invention. The upper and lower limits of these smaller ranges can be independently included or excluded in the scope.
[0050] Unless otherwise indicated, all technical and scientific terms used herein have the same meanings as those of ordinary skill in the art generally understood by the present invention. Although the present invention describes only preferred methods, any method similar or equivalent to that described herein may also be used in the implementation or testing of the present invention. All documents mentioned in this specification are incorporated by reference to disclose and describe the methods related to the documents. In the event of a conflict with any incorporated document, the content of this specification shall prevail.
[0051] It will be apparent to those skilled in the art that various modifications and variations may be made to the specific embodiments of the present invention description without departing from the scope or spirit of the present invention. Other embodiments derived from the present invention description will be apparent to those skilled in the art. The present application description and examples are exemplary only.
[0052] The words “include,” “including,” “have,” “contain,” etc. used in this article are open-ended terms, meaning including but not limited to.
[0053] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0054] Embodiment 1
[0055] like Figure 1 - Figure 8 As shown, this embodiment provides a metasurface dynamic color holographic display method, including: acquiring target video data;
[0056] Performing time-series image splitting and color channel classification on the target video data to obtain a plurality of color channel images;
[0057] Obtain a light intensity map of each color channel image with the central wavelength pixel size as a reference system;
[0058] Obtaining amplitude data of a light intensity map corresponding to each of the color channel images;
[0059] Based on the phase superposition method, the phase distribution of the amplitude data corresponding to each intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized complex amplitude data of the holographic surface is obtained;
[0060] A preliminary holographic surface phase recovery image is obtained based on the optimized holographic surface complex amplitude data, and a pixel matching algorithm is introduced into the preliminary holographic surface phase recovery image for sampling to obtain a final holographic surface phase recovery image.
[0061] This embodiment uses the red (R), green (G), and blue (B) three primary color channels to perform independent phase hologram restoration according to the correspondence between the wavelength and the propagation path. In the process of simultaneous reverse propagation of the three-color light, the conjugate phase of the metasurface device that can expand the field of view angle is superimposed and reversely propagated. After Fourier spatial phase sampling, the phase of each branch light path is obtained, and finally the polarization beam splitter is used to combine the beams. In this way, only the amplitude information of the two-dimensional color image is needed to restore its phase information and realize the function of large field of view holographic display. By dynamically controlling the spatial light field phase loaded on the three channels of R, G, and B, stable large field of view dynamic color holography can be achieved.
[0062] The dynamic color holographic phase recovery algorithm based on the large field of view metasurface of this embodiment is as follows: Figure 1 As shown, specifically including:
[0063] Input the target video file; split the video file V into time-series images according to the original frame rate V = {Img 1 ,Img 2 ,Img 3 ,…,I n}, its Img i The i-th frame image in the video, and each image is processed in the subsequent steps in sequence;
[0064] Separate the color image Img into I R ,I G ,I B Red, green and blue channel images;
[0065] According to the propagation behavior of different wavelengths, the light intensity image pixels (u, v) corresponding to each color are divided into the central wavelength (λ G ) is used to redefine the reference system. The purpose is to compensate for the field angle of light of different wavelengths when propagating in the forward direction.
[0066] Get the new light intensity map I of each channel with the central wavelength (G channel) pixel size as the reference system R ,I G ,I B .
[0067] According to the relationship between light intensity and amplitude, the amplitude image A of each channel is obtained. R ,A G ,A B .
[0068] Introducing random phase φ 0 , and the phase compensation coefficient p 0 (λ).
[0069] The complex amplitude UGm of the holographic surface is obtained and enters the phase optimization loop: superposition of the metasurface phase:
[0070] The obtained phase is multiplied by the phase compensation coefficient and scalar diffraction is forward propagated to obtain the complex amplitude gn of the imaging surface; the obtained complex amplitude of the imaging surface is separated from its phase factor and amplitude distribution, where the amplitude part is replaced by the target light intensity (A) after the pixel size is changed at the corresponding wavelength R ,A G ,A B ) distribution; the obtained complex amplitude distribution is again phase compensated p 0(λ) and perform scalar diffraction back propagation to obtain the complex amplitude Gm of the new holographic surface; obtain the complex amplitude Gm2 of the image after removing the metasurface by superimposing the conjugate phase of the metasurface. Separate its phase factor and amplitude distribution, and replace the amplitude part with the target amplitude distribution A G , and obtain the distribution of the complex amplitude UGm of the new holographic surface; enter the loop again until it stops according to the preset number of iteration steps, and output the complex amplitude UGm.
[0071] The phase factor is extracted, and the phase hologram is the phase recovery hologram of the metasurface fusion optical path.
[0072] Figure 1 ② in the figure is the dynamic adjustable imaging matching algorithm based on R, G, and B three-color light in this embodiment. In fact, this method is applicable to the dispersion correction of all lights of different wavelengths passing through the same group of combined lenses to ensure the restoration of the reconstructed pattern information. Lights of different wavelengths carrying phase information pass through the same lens group. Due to the difference in wavelength, they will produce different phases after passing through the combined lens, further causing chromatic aberration, resulting in different sizes of pattern information of the same pixel on the SLM for different color channels on the imaging surface, such as Figure 3 As shown;
[0073] In order to reduce the influence of chromatic aberration caused by lens combination or other optical devices in the phase recovery process on the imaging quality, a dynamically adjustable imaging matching algorithm based on R, G, and B three-color light is proposed here. Since the color holographic phase recovery algorithm mentioned in this embodiment is obtained through the target light intensity map, this embodiment needs to perform pixel correction on the imaging targets of each color channel on the imaging surface. Here, the pixel size of each target hologram is reset with green light as the reference system. Assume that the wavelength of green light is λ G , the pixel size of the green light imaging image is (du G ,dv G ), for the pixel size of red and blue light and its corresponding modified target image (du C ,dv C ) are:
[0074] (du R ′,dv R ′)=(du R ,dv R ) G / λ R
[0075] (du B ′,dv B ′)=(du B ,dv B ) G / λ B
[0076] Figure 1 ④ in the figure is the pixel matching algorithm based on the large field of view hypersurface of this embodiment. In fact, this method is applicable to the re-matching problem of all pixel sizes. Figure 2 As shown in the figure: the hologram will pass through multiple sets of lenses during the propagation process. The magnification and reduction of the light beam by different lenses will cause the imaging of the hologram on the metasurface to be incompatible with the resolution of the metasurface. The light of each channel needs to pass through the metasurface and transmit forward. Since the pixel size will change during the transmission process, the number of points must be changed accordingly to ensure the consistency of the imaging size.
[0077] Figure 2 The distribution of elements in the figure is as follows: 1 is the transmission light loaded with phase information, 2 is the combined lens group, 3 is the large field angle metasurface, and 4 is the imaging surface. Combined lens group: all optical devices including lenses that the light path propagates through except the spatial light modulator, metasurface, and imaging surface.
[0078] Among them, the number of imaging points × imaging pixel size = imaging size. Therefore, in order to ensure the consistency of imaging size, a pixel matching algorithm needs to be introduced here.
[0079] The pixel size of the phase loaded into the SLM in a single channel is px×py, and the pixel size of the metasurface is px 1 × 1 , the two are usually not equal. In this case, a pixel matching algorithm is needed to preliminarily optimize the hologram φ c1 Perform low-pass filtering and downsampling.
[0080] Figure 4 is the matching process of the pixel matching algorithm. The algorithm uses low-pass filtering to filter out high-frequency information in the image and retain the low-frequency information of the image. The sampled image is restored to its original size by the Kronner product method, and the SLM phase px'×py' after pixel matching is finally obtained.
[0081] Figure 5 It is a metasurface device that can achieve a large field of view angle. The metasurface can achieve a large field of view angle of θ°.
[0082] Figure 6 The color holographic phase recovery algorithm and its reconstruction pattern for metasurface fusion are presented. According to the intensity information of the target image, the preliminary hologram can be recovered through the improved holographic phase recovery algorithm, and the phase image directly interacting with the metasurface can be obtained through the pixel matching algorithm, thereby superimposing the metasurface phase and performing forward propagation imaging to obtain the final reconstructed image.
[0083] Figure 7This is a comparison diagram of the imaging image matching algorithm based on the dynamic adjustable imaging image of R, G, and B three-color light mentioned in this embodiment and the imaging image without using this method and directly performing phase recovery. After the target light intensity map is divided into R, G, and B channels, the pixels are renormalized from the imaging surface with the green light transmission path as the reference system. The imaging image corresponding to the phase recovery map of this algorithm is compared with the imaging without pixel adjustment. It can be seen from the figure that this algorithm can effectively perform dispersion compensation.
[0084] This embodiment proposes a spatial light field illumination metasurface based on spatial wave multiplexing to realize dynamic color holographic recovery algorithm. The system complements the advantages of the hologram recording medium by combining the characteristics of the hologram recording medium that can be loaded with a hologram (dynamically adjustable) and the metasurface with a sub-wavelength size. This method can not only make full use of the changing refresh rate of the hologram recording medium itself, so that the displayed color is stable, but also meet the human eye's perception of continuously dynamically changing images. At the same time, this embodiment uses the sub-wavelength pixel size of the metasurface device to carry a specific distribution of phases. When the incident spatial light field illuminates the metasurface homogenizing device, it can achieve the expansion of the field of view of the incident light field. Furthermore, this embodiment proposes a holographic phase recovery algorithm that integrates traditional lenses with devices that expand the field of view.
[0085] The dynamic holographic phase recovery algorithm proposed in this embodiment can automatically obtain images and light intensity maps of each channel at a frame rate. Since the dynamic color holographic phase recovery algorithm of the large field of view metasurface mentioned in this method, the pixel matching algorithm of the fusion metasurface, and the R, G, B three-color light dynamic adjustable imaging map matching algorithm for dispersion compensation are irrelevant to the specific content of the picture, the dynamic hologram can be directly extracted only through the light intensity map. It achieves a fast and convenient effect, and can also perform dispersion compensation well.
[0086] A metasurface dynamic color holographic display system, comprising:
[0087] The data acquisition and processing module is used to obtain target video data, perform time-series image segmentation and color channel classification on the target video data, and obtain a plurality of color channel images; obtain a light intensity map of each color channel image with the central wavelength pixel size as a reference system;
[0088] A holographic surface complex amplitude acquisition module is used to obtain the amplitude data of the light intensity map corresponding to each color channel image; based on the phase superposition method, the phase distribution of the amplitude data corresponding to each light intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized holographic surface complex amplitude data is obtained;
[0089] The holographic surface phase recovery module is used to obtain a preliminary holographic surface phase recovery image according to the optimized holographic surface complex amplitude data, introduce a pixel matching algorithm into the preliminary holographic surface phase recovery image for sampling, and obtain a final holographic surface phase recovery image.
[0090] An electronic device includes a memory and a processor, wherein the memory is used to store a computer program, and the processor runs the computer program to enable a metasurface dynamic color holographic display method.
[0091] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the metasurface dynamic color holographic display method.
[0092] The above is only a preferred specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A metasurface dynamic color holographic display method, characterized in that: include: Get target video data; Performing image segmentation on the target video data based on the original frame rate and timing of the target video data to obtain a plurality of segmented images; Performing color channel classification on each of the split images to obtain a plurality of color channel images; the color channel images include red, green and blue color channel images; Perform pixel matching on each color channel image with the central wavelength as a reference system, and after the pixel matching is completed, obtain a light intensity map of each color channel image with the central wavelength pixel size as a reference system; Obtaining amplitude data of a light intensity map corresponding to each of the color channel images; Based on the phase superposition method, the phase distribution of the amplitude data corresponding to each intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized complex amplitude data of the holographic surface is obtained; Acquire a preliminary holographic surface phase recovery image based on the optimized holographic surface complex amplitude data, introduce a pixel matching algorithm into the preliminary holographic surface phase recovery image for sampling, and obtain a final holographic surface phase recovery image; The iterative optimization of the phase distribution of the amplitude data corresponding to each light intensity map based on the phase superposition method specifically includes: Step 1: Based on the amplitude data of each light intensity image, a random phase and a phase compensation coefficient are introduced to obtain complex amplitude data of the first holographic surface; Step 2: Perform phase compensation on the phase of the complex amplitude data of the first holographic surface, superimpose the metasurface phase, and perform scalar diffraction forward propagation to obtain complex amplitude data of the imaging surface; Step 3: replacing the amplitude part of the complex amplitude data of the imaging surface with the target light intensity distribution, and obtaining the modulated complex amplitude distribution data of the imaging surface based on the phase factor of the complex amplitude data of the imaging surface and the replaced target light intensity distribution; Step 4: performing phase compensation and scalar diffraction back propagation on the modulated imaging surface complex amplitude distribution data in sequence to obtain the second holographic surface complex amplitude data; Step 5: superimposing the second holographic surface complex amplitude data with the metasurface conjugate phase to obtain the third holographic surface complex amplitude data after removing the metasurface; Step 6: Replace the amplitude part of the third holographic surface complex amplitude data with the target amplitude distribution, and obtain the fourth holographic surface complex amplitude data based on the phase factor of the third holographic surface complex amplitude data and the replaced target amplitude distribution; Repeat steps 2 to 6 to enter an iterative loop until the preset number of iterations is reached, and then output the optimized holographic surface complex amplitude data; The step of obtaining a preliminary holographic surface phase recovery image based on the optimized holographic surface complex amplitude data specifically includes: Acquire the phase factor of the optimized holographic surface complex amplitude data, and perform forward propagation based on the phase factor to obtain the preliminary holographic surface phase recovery map; The step of introducing a pixel matching algorithm to perform sampling in the preliminary holographic surface phase recovery image to obtain a final holographic surface phase recovery image specifically includes: The preliminary holographic surface phase recovery image is subjected to low-pass filtering down-sampling and forward propagation imaging based on a pixel matching algorithm to obtain the final holographic surface phase recovery image.
2. A metasurface dynamic color holographic display system, characterized in that: include: The data acquisition and processing module acquires target video data, performs image segmentation on the target video data based on the original frame rate and timing of the target video data to obtain a plurality of segmented images; performs color channel classification on each of the segmented images to obtain a plurality of color channel images; the color channel images include three color channel images of red, green and blue; performs pixel matching on each of the color channel images with the central wavelength as a reference system, and after the pixel matching is completed, obtains a light intensity map of each of the color channel images with the central wavelength pixel size as a reference system; A holographic surface complex amplitude acquisition module is used to obtain the amplitude data of the light intensity map corresponding to each color channel image; based on the phase superposition method, the phase distribution of the amplitude data corresponding to each light intensity map is iteratively optimized, and when the preset number of iteration steps is met, the optimized holographic surface complex amplitude data is obtained; A holographic surface phase recovery module is used to obtain a preliminary holographic surface phase recovery image according to the optimized holographic surface complex amplitude data, introduce a pixel matching algorithm into the preliminary holographic surface phase recovery image for sampling, and obtain a final holographic surface phase recovery image; The iterative optimization of the phase distribution of the amplitude data corresponding to each light intensity map based on the phase superposition method specifically includes: Step 1: Based on the amplitude data of each light intensity image, a random phase and a phase compensation coefficient are introduced to obtain complex amplitude data of the first holographic surface; Step 2: performing phase compensation on the phase of the complex amplitude data of the first holographic surface, superimposing the metasurface phase, and performing scalar diffraction forward propagation to obtain complex amplitude data of the imaging surface; Step 3: replacing the amplitude part of the complex amplitude data of the imaging surface with the target light intensity distribution, and obtaining the modulated complex amplitude distribution data of the imaging surface based on the phase factor of the complex amplitude data of the imaging surface and the replaced target light intensity distribution; Step 4: performing phase compensation and scalar diffraction back propagation on the modulated imaging surface complex amplitude distribution data in sequence to obtain the second holographic surface complex amplitude data; Step 5: superimposing the second holographic surface complex amplitude data with the metasurface conjugate phase to obtain the third holographic surface complex amplitude data after removing the metasurface; Step 6: Replace the amplitude part of the third holographic surface complex amplitude data with the target amplitude distribution, and obtain the fourth holographic surface complex amplitude data based on the phase factor of the third holographic surface complex amplitude data and the replaced target amplitude distribution; Repeat steps 2 to 6 to enter an iterative loop until the preset number of iterations is reached, and then output the optimized holographic surface complex amplitude data; The step of obtaining a preliminary holographic surface phase recovery image based on the optimized holographic surface complex amplitude data specifically includes: Acquire the phase factor of the optimized holographic surface complex amplitude data, and perform forward propagation based on the phase factor to obtain the preliminary holographic surface phase recovery map; The step of introducing a pixel matching algorithm to perform sampling in the preliminary holographic surface phase recovery image to obtain a final holographic surface phase recovery image specifically includes: The preliminary holographic surface phase recovery image is subjected to low-pass filtering down-sampling and forward propagation imaging based on a pixel matching algorithm to obtain the final holographic surface phase recovery image.
3. An electronic device, characterized in that: It includes a memory and a processor, the memory is used to store a computer program, and the processor runs the computer program to enable the electronic device to execute a super-surface dynamic color holographic display method according to claim 1.
4. A computer-readable storage medium, characterized in that: It stores a computer program, which, when executed by a processor, implements a metasurface dynamic color holographic display method as described in claim 1.
Citation Information
Patent Citations
Time-division multiplexing-based color holographic three-dimensional display method and system
CN105938318A
Holographic image generation method, processor, and holographic image display apparatus and device
CN106842880A