Bionic integrated imaging display system based on variable density microlens array

Abstract

The invention discloses a bionic integrated imaging display system based on a variable-density micro-lens array, and relates to the field of integrated imaging, and the system comprises a high-resolution 2D display screen used for displaying a variable-information-density micro-unit image, and the variable-density micro-lens array. The variable-density microlens array is arranged on the light emitting side of the high-resolution 2D display screen; the variable-density micro-lens array is configured in a way that the density of the micro-lens array positioned in the center of the visual plane is higher than that of the micro-lens array positioned at the edge of the visual plane, and the diameter of a lens unit of the variable-density micro-lens array is increased along with the decrease of the density of the micro-lens array in the area; the numerical aperture of the lens unit is increased along with the increase of the density of the micro-lens array in the area; the variable-information-density micro-unit image corresponds to the variable-density micro-lens array, and integrated imaging 3D display is carried out through the variable-density micro-lens array. The invention provides the integrated imaging display system conforming to the visual characteristics of human eyes, the watching experience of the user is improved, and the computing power is saved.

Description

Technical Field

[0001] The present invention relates to the field of integrated imaging display, and in particular to a bionic integrated imaging display system based on a variable-density microlens array. Background Art

[0002] Visual information is a direct reflection of the real world, and images are the most direct way for humans to express information. Images can directly provide various information about an object, facilitating a more direct understanding of it. In recent years, with the rise of 3D films, traditional two-dimensional display technology has become insufficient to meet public demand. People are pursuing clearer, smarter, and more advanced 3D imaging display systems because they can display depth information, better reflect the shape of objects, and enhance the visual experience.

[0003] Integral imaging is a technology that captures and reproduces the light field information of a three-dimensional scene. It uses a microlens array (MLA) to record and reconstruct light from multiple perspectives. Its core concept is to simulate the human eye's binocular parallax and focusing mechanism, enabling the observer to perceive stereoscopic images without wearing special glasses. Three-dimensional integrated imaging display technology has attracted widespread attention from researchers due to its continuous parallax, lack of glasses, and complete field of view. This stereoscopic display can fully display scene information such as depth, layering, and position, and has become one of the most promising 3D display technologies.

[0004] However, the microlens arrays used in existing integrated imaging display technologies are generally uniform, and uniform microlens arrays are a common design. The microlens units in this array usually have the same focal length, spacing, and shape, and are arranged in regular geometric patterns (such as rectangles, hexagons, etc.). The design of a uniform microlens array is relatively simple, easy to manufacture, and can provide stable imaging quality. However, with the continuous expansion of application scenarios, the uniform microlens array will reduce the user's viewing experience because it does not conform to the visual characteristics of the human eye, which has dense information in the middle and sparse information in the periphery. At the same time, because the resources of the uniform microlens array are generally evenly distributed, it will lead to a waste of computing power. Summary of the Invention

[0005] In view of some of the above-mentioned defects in the prior art, the technical problem to be solved by the present invention is to provide a bionic integrated imaging display system based on a variable-density microlens array, aiming to provide an integrated imaging display system that conforms to the visual characteristics of the human eye, improves the user's viewing experience, and saves computing power.

[0006] To achieve the above objectives, the present invention provides a biomimetic integrated imaging display system based on a variable-density microlens array, the system comprising: a high-resolution 2D display screen for displaying micro-unit images with variable information density; and a variable-density microlens array; the variable-density microlens array is disposed on the light-exiting side of the high-resolution 2D display screen; the variable-density microlens array is configured such that, based on the biomimetic visual characteristics of the human eye, where information is dense in the center and sparse in the periphery, the microlens array density at the center of the viewing plane is higher than the microlens array density at the edge of the viewing plane; the diameter of the lens units of the variable-density microlens array increases as the density of the microlens array in that area decreases, and the numerical aperture of the lens units of the variable-density microlens array increases as the density of the microlens array in that area increases, thereby enhancing the three-dimensional effect of the display; the micro-unit images with variable information density correspond to the variable-density microlens array, and integrated imaging 3D display is performed through the variable-density microlens array.

[0007] Optionally, the system includes: the micro-unit image acquisition unit, which is used to collect a first sparse image sequence of the target object to be displayed in 3D; obtain a first main image array based on the first sparse image sequence; calculate a first mapping relationship between the first main image array and the variable information density micro-unit image based on parameters of the variable density microlens array; and obtain the variable information density micro-unit image based on the first main image array and the first mapping relationship.

[0008] Optionally, the micro-unit image acquisition unit includes: an image acquisition module, a camera pose estimation module, a format conversion module, a data storage module, a scene reconstruction module, a mapping calculation module, an image rendering module and an image output module;

[0009] The image acquisition module is used to acquire a first sparse image sequence of the target object;

[0010] The camera pose estimation module is configured to obtain a first camera pose matrix corresponding to the first sparse image sequence using a motion structure recovery algorithm;

[0011] The format conversion module is configured to convert the first camera pose matrix into a neural radiation field input format;

[0012] The data storage module is configured to write the first camera pose matrix in a neural radiance field input format and the first sharpness value of the first sparse image sequence into a JSON file;

[0013] The scene reconstruction module is configured to reconstruct the scene through neural radiance field training according to the first camera pose matrix and the first sharpness value to obtain the first main image array;

[0014] The mapping calculation module is configured to calculate the first mapping relationship between the first main image array and the variable information density micro-unit image according to the parameters of the variable density microlens array; wherein, the parameters of the variable density microlens array at least include the microlens distribution and the focal length of each microlens.

[0015] The image rendering module is configured to render each pixel of the variable information density micro-unit image using volume rendering according to the first mapping relationship.

[0016] The image output module is configured to output the rendered variable information density micro-unit image.

[0017] Optionally, the variable density microlens array is arranged in a rectangular pattern, and the rectangular pattern includes a "Sichuan character" arrangement and a "return character" arrangement; when the variable density microlens array is arranged in a "Sichuan character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays on the left and right sides of the center of the viewing plane; when the variable density microlens array is arranged in a "return character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane.

[0018] Optionally, the variable density microlens array is arranged in a hexagonal pattern, and the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane.

[0019] Optionally, the density number of the variable density microlens array is i, and the densities of the microlens arrays from the middle to the outermost are ρ1, ρ2,..., ρ i , and the density gradually decreases from the middle to both sides or all around; the diameters of the microlenses with densities ρ1, ρ2,..., ρ i are D i , and there are differences in the sizes of the microlens units in the middle region and the sizes of the microlens units in the adjacent regions to further adapt to the human eye visual characteristics; the heights of all the microlens units are the same and are h; wherein, ρ i represents the number of microlens arrays per unit area as ρ i , and there is ρ1 > ρ2 >... > ρ i , D1 < D2 <... < D i .

[0020] Optionally, the arrangement pattern of the variable density microlens array is designed according to the RGB arrangement characteristics of the high-resolution 2D display screen to improve the utilization rate of the pixels of the high-resolution 2D display screen.

[0021] Optionally, for the microlens unit with a diameter of D i , its focal length is The variable density microlens array has a total of i focal lengths, and generates i central depth planes in the integrated imaging reconstruction stage; where f i is the focal length of the microlens unit, h is the height of the microlens unit, and p is the refractive index of the material of the microlens unit.

[0022] Optionally, the variable density microlens array is prepared by a method comprising: screen printing technology, photoresist hot melting technology, and inkjet printing technology.

[0023] Optionally, the microlens units of the microlens array have different imaging focal planes with different diameters, different heights, and different numerical apertures to improve the 3D imaging depth of field.

[0024] Optionally, the variable information density micro-unit image is designed according to the density of the variable density micro-lens array to optimize the imaging effect of different areas.

[0025] The beneficial effects of the present invention are as follows: 1. The variable density microlens array of the present invention is configured such that the density of the microlens array located at the center of the viewing plane is higher than the density of the microlens array at the edge of the viewing plane. The diameter of the lens unit of the variable density microlens array increases as the density of the microlens array in the area decreases, and the numerical aperture of the lens unit increases as the density of the microlens array in the area increases. Such a structure better adapts to the visual characteristics of the bionic human eye, where information is dense in the middle and sparse in the periphery. Therefore, when performing 3D integrated imaging, it allows people to pay attention to clearer areas, highlights the content in the clear areas, and can provide users with a more comfortable viewing experience. 2. The variable density microlens array structure of the present invention effectively optimizes resource allocation, can effectively optimize information density, reduce the amount of data processed, and effectively improve depth of field; it makes the image clarity high in areas where the user's visual information is dense, and the image clarity decreases in areas where the user's visual information is sparse. Without affecting the user's viewing experience, computing power is saved through reasonable resource allocation.

[0026] In summary, the present invention provides an integrated imaging display system that conforms to the visual characteristics of the human eye, improves the user viewing experience, and saves computing power. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 1 is a schematic structural diagram of a bionic integrated imaging display system based on a variable-density microlens array provided by a specific embodiment of the present invention;

[0028] Figure 2 1 is a schematic structural diagram of a micro-unit image acquisition unit provided in a specific embodiment of the present invention;

[0029] Figure 3 1 is a schematic structural diagram of a Sichuan-shaped variable-density microlens array provided by a specific embodiment of the present invention;

[0030] Figure 4 1 is a schematic diagram of imaging simulation results of a C-shaped variable density microlens array provided by a specific embodiment of the present invention at a first image distance;

[0031] Figure 5 1 is a schematic diagram of imaging simulation results of a C-shaped variable density microlens array provided by a specific embodiment of the present invention under a second image distance;

[0032] Figure 6 1 is a schematic diagram of imaging simulation results of a C-shaped variable density microlens array at a third image distance provided by a specific embodiment of the present invention;

[0033] Figure 7 1 is a schematic structural diagram of a hexagonal variable-density microlens array provided by a specific embodiment of the present invention;

[0034] Figure 8 1 is a schematic diagram of imaging simulation results of a hexagonal variable-density microlens array at a fourth image distance provided by a specific embodiment of the present invention;

[0035] Figure 9 1 is a schematic diagram of imaging simulation results of a hexagonal variable-density microlens array at a fifth image distance provided by a specific embodiment of the present invention;

[0036] Figure 10 1 is a schematic diagram of imaging simulation results of a hexagonal variable-density microlens array at a sixth image distance provided by a specific embodiment of the present invention;

[0037] Figure 11 FIG. 1 is a schematic diagram of a simulation of a hexagonal variable-density microlens array provided by a specific embodiment of the present invention. DETAILED DESCRIPTION

[0038] The present invention discloses a bionic integrated imaging display system based on a variable-density microlens array. Those skilled in the art can refer to the contents of this article and appropriately improve the technical details for implementation. It is particularly important to point out that all similar replacements and modifications are obvious to those skilled in the art and are considered to be included in the present invention. The device and application of the present invention have been described through preferred embodiments. Relevant personnel can obviously modify or appropriately change and combine the device and application described herein without departing from the content, spirit and scope of the present invention to implement and apply the technology of the present invention.

[0039] The applicant's research found that the microlens arrays used in existing integrated imaging display technologies are generally uniform, and uniform microlens arrays are a common design. The microlens units in this array usually have the same focal length, spacing and shape, and are arranged in regular geometric patterns (such as rectangles, hexagons, etc.). The design of a uniform microlens array is relatively simple, easy to manufacture, and can provide stable imaging quality. However, with the continuous expansion of application scenarios, the uniform microlens array will reduce the user's viewing experience because it does not conform to the visual characteristics of the human eye, which has dense information in the middle and sparse information in the periphery. At the same time, because the resources of the uniform microlens array are generally evenly distributed, it will lead to a waste of computing power.

[0040] Therefore, the embodiment of the present invention provides a bionic integrated imaging display system based on a variable density microlens array 2, such as Figure 1 As shown, the system includes: a high-resolution 2D display screen 1 for displaying variable information density micro-unit images and a variable density micro-lens array 2; the variable density micro-lens array 2 is arranged on the light-emitting side of the high-resolution 2D display screen 1; the variable density micro-lens array is configured as follows: based on the visual characteristics of the bionic human eye, which has dense information in the center and sparse information in the periphery, the variable density micro-lens array 2 is configured so that the micro-lens array density at the center of the viewing plane is higher than the micro-lens array density at the edge of the viewing plane; the diameter of the lens unit of the variable density micro-lens array 2 increases as the micro-lens array density in this area decreases, and the numerical aperture of the lens unit of the variable density micro-lens array increases as the micro-lens array density in this area increases, thereby enhancing the three-dimensional display effect; the variable information density micro-unit image corresponds to the variable density micro-lens array 2, and integrated imaging 3D display is performed through the variable density micro-lens array 2.

[0041] It should be noted that the variable-density integrated imaging technology that imitates the visual characteristics of the human eye realizes an efficient perception mode of "high resolution at the gaze point + wide peripheral field of view" in the imaging system by simulating the non-uniform distribution of photoreceptor cells in the human retina (high density in the fovea and low density at the edge).

[0042] In this specific embodiment, the pixel array of the high-resolution 2D display screen 1 is m×n (m and n are natural numbers ≥16).

[0043] In this specific embodiment, the system includes: a micro-unit image acquisition unit, which is used to acquire a first sparse image sequence of a target object to be displayed in 3D; obtain a first main image array based on the first sparse image sequence; calculate a first mapping relationship between the first main image array and the variable information density micro-unit image based on parameters of the variable density microlens array 2; and obtain a variable information density micro-unit image based on the first main image array and the first mapping relationship.

[0044] Further, such as Figure 2As shown, the micro-unit image acquisition unit includes: an image acquisition module 201, a camera pose estimation module 202, a format conversion module 203, a data storage module 204, a scene reconstruction module 205, a mapping calculation module 206, an image rendering module 207 and an image output module 208;

[0045] An image acquisition module 201 is configured to acquire a first sparse image sequence of a target object;

[0046] A camera pose estimation module 202 is configured to obtain a first camera pose matrix corresponding to the first sparse image sequence using a structure-from-motion algorithm;

[0047] The format conversion module 203 is configured to convert the first camera pose matrix into a neural radiation field input format;

[0048] A data storage module 204 is configured to write the first camera pose matrix and the first sharpness value of the first sparse image sequence in a neural radiance field input format into a JSON file;

[0049] A scene reconstruction module 205 is configured to reconstruct the scene through neural radiance field training according to the first camera pose matrix and the first sharpness value to obtain a first main image array;

[0050] A mapping calculation module 206 is configured to calculate a first mapping relationship between the first main image array and the variable information density micro-unit image based on parameters of the variable density micro-lens array 2; wherein the parameters of the variable density micro-lens array 2 include at least a distribution of micro-lenses and a focal length of each micro-lens;

[0051] An image rendering module 207 is configured to render each pixel of the variable information density micro-unit image using volume rendering according to the first mapping relationship;

[0052] The image output module 208 is used to output the rendered micro-unit image with variable information density.

[0053] In this specific embodiment, the SfM algorithm includes steps such as feature extraction, feature matching, and camera pose calculation, which are used to accurately estimate the camera pose matrix.

[0054] In this specific embodiment, neural radiation field training reconstructs a realistic three-dimensional scene by learning data such as the camera pose matrix.

[0055] In this specific embodiment, the volume rendering method renders each pixel of the micro-unit image based on voxel information of the reconstructed scene to generate a high-quality micro-unit image.

[0056] It should be noted that in the embodiments of the present invention, camera parameters are obtained through sparse images and the SIM algorithm; an implicit three-dimensional radiation field is trained using NeRF, and then an EIA image is generated based on the MLA parameters and volume rendering. An end-to-end generation from two-dimensional images to three-dimensional light fields (EIA) is achieved, while ensuring that the generated variable information density micro-unit images correspond to the variable density microlens array 2.

[0057] In this specific embodiment, the variable density microlens array 2 is arranged in a rectangular pattern, and the rectangular arrangement includes a "Sichuan character" arrangement and a "return character" arrangement; when the variable density microlens array 2 is arranged in a "Sichuan character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays on the left and right sides of the center of the viewing plane; when the variable density microlens array 2 is arranged in a "return character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane. Figure 1 It is a "Sichuan character" arrangement.

[0058] In another specific embodiment, the variable density microlens array 2 is arranged in a hexagonal pattern, and the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane.

[0059] In the first specific embodiment, when the variable density microlens array 2 is arranged in a "Sichuan character" pattern, it can be as Figure 3 shown, Figure 3 There are three types of microlens units, with the diameters increasing and the densities decreasing from the inside to the outside. The focal lengths of these three microlens units from the inside to the outside are f1 = 0.6265 mm, f2 = 0.7133 mm, and f3 = 0.8515 mm respectively. When the object distance corresponding to the variable information density micro-unit image is fixed at 5 mm, for different image distances, the illuminance maps obtained by Trancepro simulation are respectively as Figure 4 , 5 , 6 shown, Figure 4 is the illuminance map when the first image distance is 0.716 mm, Figure 5 is the illuminance map when the second image distance is 0.832 mm, Figure 6 is the illuminance map when the third image distance is 1.03 mm. By observing Figure 4 , 5 , 6, it can be found that when the focal length and image distance of the corresponding lens are closer, the imaging is clearer.

[0060] In the second specific embodiment, when the variable density microlens array 2 is arranged in a "Sichuan character" pattern, it can be as Figure 7 shown, Figure 7There are three types of microlens units, with diameters increasing and densities decreasing from the inside to the outside. The focal lengths of these three microlens units from the inside to the outside are f1 = 0.6233 mm, f2 = 0.7096 mm, and f3 = 0.8477 mm respectively. When the object distance corresponding to the variable information density micro-unit image is fixed at 5 mm, for different image distances, the illumination diagrams obtained by Trancepro simulation are respectively as shown in Figure 8 and 9 , as shown in Figure 10. Figure 8 is the illumination diagram when the fourth image distance is 0.7121 mm. Figure 9 is the illumination diagram when the fifth image distance is 0.8270 mm. Figure 10 is the illumination diagram when the sixth image distance is 1.0208 mm. By observing Figure 8 and 9 , as well as Figure 10, it can be found that the "chuan" - shaped array is the same as the hexagonal array. When the focal length and image distance of the corresponding lens are closer, the imaging is clearer.

[0061] In this specific embodiment, Trancepro simulation can be carried out as shown in Figure 11 . Figure 11 It is the simulation of the hexagonal variable - density microlens array 2. Among them, 4 represents the receiving plate on different image planes, 2 represents the variable - density microlens array, and 3 represents the light source. By simulating the light source 3, with the object distance unchanged, the imaging on the receiving plate 4 on different image planes can be obtained, as shown in Figure 8 and 9 , as well as Figure 10. The same applies to the "chuan" - shaped array. Therefore, it can be concluded that when the object distance remains unchanged, by observing the images formed on the receiving plates on different image planes, it can be obtained that the designed lens array can image on different image planes. According to the reversibility of the light path, this lens array can also observe the images of different object planes on the same image plane. So this design can achieve the effect of expanding the depth of field.

[0062] In this specific embodiment, the density number of the variable - density microlens array 2 is i, and the densities of the microlens arrays from the middle to the outermost are ρ1, ρ2,..., ρ i , and the density gradually decreases from the middle to both sides or all around; the diameters of the microlenses with densities ρ1, ρ2,..., ρ i are D i . There are differences in the sizes of the microlens units in the middle region and those in the adjacent regions to further adapt to the visual characteristics of the human eye; the heights of all microlens units are the same, which is h; among them, ρ i represents the number of microlens arrays per unit area, which is ρ i , and there is ρ1 > ρ2 >... > ρ i , D1 < D2 <... < D i .

[0063] It should be noted that through the dual design of the density and size of the microlens unit, 3D imaging can be made more consistent with the visual characteristics of the human eye, thereby improving the user viewing experience.

[0064] In this specific embodiment, the arrangement of the variable density microlens array 2 is designed according to the RGB arrangement characteristics of the high-resolution 2D display screen 1 to improve the utilization rate of the pixels of the high-resolution 2D display screen 1 .

[0065] It should be noted that making the variable density micro lens array 2 correspond to the RGB arrangement can effectively avoid the waste of display resources.

[0066] In this embodiment, the diameter D i The microlens unit has a focal length of The variable density microlens array 2 has a total of i focal lengths, and generates i central depth planes in the integrated imaging reconstruction stage; where f i is the focal length of the microlens unit, h is the height of the microlens unit, and p is the refractive index of the material of the microlens unit.

[0067] In this specific embodiment, the variable density microlens array 2 is prepared by one of the following methods: screen printing, photoresist hot melting, and inkjet printing.

[0068] In this specific implementation, the microlens units of the microlens array have different imaging focal planes with different diameters, different heights, and different numerical apertures to improve the 3D imaging depth of field.

[0069] In this specific embodiment, the variable information density micro-unit image is designed according to the density of the variable density micro-lens array 2 to optimize the imaging effect of different areas.

[0070] The variable-density microlens array 2 of the present embodiment is configured such that the microlens array density at the center of the viewing plane is higher than that at the edges of the viewing plane. The diameter of the lens units in the variable-density microlens array 2 increases as the microlens array density in that area decreases, and the numerical aperture of the lens units increases as the microlens array density in that area increases. This structure better adapts to the visual characteristics of the bionic human eye, where information is dense in the center and sparse in the periphery. Therefore, during 3D integrated imaging, the user's attention is drawn to the clearest areas, which highlight the content in those clear areas, providing a more comfortable viewing experience.

[0071] The variable-density microlens array 2 structure of the embodiment of the present invention effectively optimizes resource allocation, so that the image clarity is high in areas where the user's visual information is dense, and the image clarity is reduced in areas where the user's visual information is sparse. Without affecting the user's viewing experience, computing power is saved through reasonable resource allocation.

[0072] In summary, the embodiments of the present invention provide an integrated imaging display system that conforms to the visual characteristics of the human eye, improves the user viewing experience, and saves computing power.

[0073] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0074] Each embodiment in this specification is described in a related manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For related parts, refer to the description of the method embodiment.

[0075] The above are only preferred embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A bionic integrated imaging display system based on a variable density microlens array, characterized in that: The system includes: a high-resolution 2D display screen for displaying variable information density micro-unit images and a variable density micro-lens array; the variable density micro-lens array is disposed on the light-emitting side of the high-resolution 2D display screen; the variable density micro-lens array is configured such that, based on the visual characteristics of the bionic human eye, which has dense information in the center and sparse information in the periphery, the micro-lens array has a higher density at the center of the viewing plane than at the edges of the viewing plane; the diameter of the lens units of the variable density micro-lens array increases as the density of the micro-lens array in that area decreases, and the numerical aperture of the lens units of the variable density micro-lens array increases as the density of the micro-lens array in that area increases, thereby enhancing the three-dimensional effect of the display; the variable information density micro-unit images correspond to the variable density micro-lens array, and integrated imaging 3D display is performed through the variable density micro-lens array.

2. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The system includes: a micro-unit image acquisition unit, which is used to collect a first sparse image sequence of a target object to be displayed in 3D; obtain a first main image array based on the first sparse image sequence; calculate a first mapping relationship between the first main image array and the variable information density micro-unit image based on parameters of the variable density microlens array; and obtain the variable information density micro-unit image based on the first main image array and the first mapping relationship.

3. The bionic integrated imaging display system based on a variable density microlens array according to claim 2, characterized in that: The micro-unit image acquisition unit includes: an image acquisition module, a camera pose estimation module, a format conversion module, a data storage module, a scene reconstruction module, a mapping calculation module, an image rendering module and an image output module; The image acquisition module is used to acquire a first sparse image sequence of the target object; The camera pose estimation module is configured to obtain a first camera pose matrix corresponding to the first sparse image sequence using a structure-from-motion algorithm; The format conversion module is configured to convert the first camera pose matrix into a neural radiation field input format; The data storage module is configured to write the first camera pose matrix in a neural radiance field input format and the first sharpness value of the first sparse image sequence into a JSON file; The scene reconstruction module is configured to reconstruct the scene through neural radiance field training according to the first camera pose matrix and the first sharpness value to obtain the first main image array; The mapping calculation module is configured to calculate the first mapping relationship between the first main image array and the variable information density micro-unit image based on parameters of the variable density micro-lens array; wherein the parameters of the variable density micro-lens array include at least the distribution of the micro-lenses and the focal length of each micro-lens; The image rendering module is configured to render each pixel of the variable information density micro-unit image using volume rendering according to the first mapping relationship; The image output module is used to output the rendered variable information density micro-unit image.

4. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The variable-density microlens array is arranged in a rectangular pattern, and the rectangular pattern includes a "Sichuan character" arrangement and a "return character" arrangement; when the variable-density microlens array is arranged in a "Sichuan character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays on the left and right sides of the center of the viewing plane; when the variable-density microlens array is arranged in a "return character" pattern, the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane.

5. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The variable-density microlens array is arranged in a hexagonal pattern, and the density of the microlens array at the center of the viewing plane is higher than that of the microlens arrays around the center of the viewing plane.

6. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The density number of the variable density microlens array is i, and the density of the microlens array from the middle to the outermost is ρ1, ρ2, ..., ρ i , the density gradually decreases from the middle to the sides or the surroundings; the densities are ρ1, ρ2, ..., ρ i The diameter of the microlens is D i The size of the microlens unit in the middle area is different from that of the microlens unit in the adjacent area to further adapt to the visual characteristics of the human eye; the height of all the microlens units is the same as h; Among them, ρ i The number of microlens arrays per unit area is ρ i , and ρ1>ρ2>…>ρ i , D1 <D2<…<D i .

7. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The arrangement pattern of the variable-density microlens array is designed according to the RGB arrangement characteristics of the high-resolution 2D display to improve the utilization rate of the pixels of the high-resolution 2D display.

8. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The diameter is D i The microlens unit has a focal length of The variable density microlens array has a total of i focal lengths, and generates i central depth planes in the integrated imaging reconstruction stage; where f i is the focal length of the microlens unit, h is the height of the microlens unit, and p is the refractive index of the material of the microlens unit.

9. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The preparation method of the variable-density microlens array includes one of screen printing technology, photoresist thermal melting technology, and inkjet printing technology; the microlens units of the microlens array have different imaging focal planes with different diameters, heights, and numerical apertures to increase the depth of field of 3D imaging.

10. The bionic integrated imaging display system based on a variable density microlens array according to claim 1, characterized in that: The variable-information-density micro-unit image is designed according to the density of the variable-density microlens array to optimize the imaging effects of different regions.

Images