Imaging method and system based on light field camera array

Abstract

The application relates to the imaging technical field, in particular to an imaging method and system based on a light field camera array, wherein the method comprises the following steps: light rays of an imaging target are transmitted to multiple light field cameras through a beam splitter; the multiple light field cameras shoot the same scene, but there is a slight relative position offset, dense sampling of a phase space is realized, and the number of scanning times required by scanning light field imaging is reduced; the same angle pixels of each microlens of each light field image are extracted and fused to obtain a single view image, and finally, multi-view images with dense spatial sampling are obtained. An offset matrix of the images of multiple views is calculated according to a preset strategy, and the images of multiple views are digitally offset and corrected by using the offset matrix; the corrected multi-view images are spliced and fused to obtain the final imaging result of the imaging target. Therefore, the application can effectively overcome the contradiction between the spatial resolution and the angle resolution, and effectively solve the dynamic phase difference.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of imaging technology, in particular to an imaging method and system based on a light field camera array. BACKGROUND

[0002] The scanning light field imaging technology obtains a plurality of light field images with slight positional offsets of the relative positions obtained by scanning the imaging target on the image plane during imaging, to produce virtual overlaps between adjacent small-interval microlenses; the imaging is calculated according to the light field images obtained by multiple scanning, to break through the contradiction between spatial resolution and angular resolution. Aberrations introduced by the optical system or the collected scene are calculated, and a point spread function of the imaging system is modeled based on the aberrations and wave optics theory; the point spread function after modeling is used for non-coherent aperture synthesis with a plurality of view images obtained by rearranging the plurality of light field images obtained by multiple scanning, to realize image reconstruction and three-dimensional imaging with large scenes and high resolution.

[0003] However, the scanning light field imaging technology still has deficiencies in dynamic aberration. In a high-speed dynamic imaging scene, such as atmospheric turbulence, the plurality of light field images with slight positional offsets of the relative positions obtained by scanning are not collected at the same time, which affects the accuracy of aberration estimation. Therefore, a method for fast aberration estimation is needed to better solve the problem of dynamic aberration. SUMMARY

[0004] The present application provides an imaging method and system based on a light field camera array, which can effectively improve the resolution, solve the aberration caused by complex turbulence, realize non-coherent aperture synthesis, realize fast aberration estimation, better solve the problem of dynamic aberration, and improve the level of imaging technology.

[0005] The first aspect of the present application provides an imaging method and system based on a light field camera array, comprising the following steps:

[0006] Light rays of the imaging target are transmitted to a plurality of light field cameras through a beam splitter; the plurality of light field cameras capture the same scene, but there is a slight positional offset of the relative positions, to realize dense sampling of the phase space and reduce the number of scans required by the scanning light field imaging; the same angle pixels of each microlens are extracted from each light field image and fused to obtain a single view image, and finally a plurality of view images of the dense sampling of the space are obtained; an offset matrix of the plurality of view images is calculated according to a preset strategy, and the plurality of view images are digitally offset corrected by using the offset matrix; the plurality of view images after correction are spliced and fused to obtain the final imaging result of the imaging target.

[0007] Optionally, the digital offset correction of the multiple-view images by using the offset matrix comprises: performing two-dimensional integration on the offset matrix to obtain an aberration matrix; correcting the offset matrix according to the aberration matrix, and performing the digital offset correction of the multiple-view images by using the corrected offset matrix.

[0008] Optionally, the image splicing and fusion of the corrected multiple-view images to obtain the final imaging result of the target to be imaged comprises: obtaining a relative position relationship of the corrected multiple-view images; and performing the image splicing and fusion of the corrected multiple-view images according to the relative position relationship to obtain the final imaging result of the target to be imaged.

[0009] The second aspect embodiment of the present application provides an imaging device based on a light field camera array, comprising: an acquisition module configured to obtain multiple light field images with slight relative position offsets of a target to be imaged during imaging, to realize dense sampling of a phase space, and to reduce the number of scanning times required for scanning light field imaging; extract the same angle pixels of each microlens from each light field image and fuse them to obtain a single-view image, and finally obtain multiple-view images with dense spatial sampling; a correction module configured to calculate an offset matrix of the multiple-view images according to a preset strategy, and to perform digital offset correction of the multiple-view images by using the offset matrix; and a fusion module configured to perform image splicing and fusion of the corrected multiple-view images to obtain a final imaging result of the target to be imaged.

[0010] Optionally, the imaging device further comprises a control module configured to divide imaging light rays of the target to be imaged into multiple light rays, and to control the acquisition component to simultaneously acquire the multiple light field images with slight relative position offsets.

[0011] Optionally, the correction module is further configured to: perform two-dimensional integration on the offset matrix to obtain an aberration matrix; correct the offset matrix according to the aberration matrix, and perform the digital offset correction of the multiple-view images by using the corrected offset matrix.

[0012] Optionally, the fusion module is further configured to: obtain a relative position relationship of the corrected multiple-view images; and perform the image splicing and fusion of the corrected multiple-view images according to the relative position relationship to obtain the final imaging result of the target to be imaged.

[0013] The third aspect embodiment of the present application provides a light field imaging system based on a light field camera array, comprising: an acquisition component configured to simultaneously acquire multiple light field images with slight relative position offsets of a target to be imaged during imaging; and an imaging device based on a light field camera array as described in the above embodiments.

[0014] Optionally, the acquisition component comprises a beam splitter for splitting the imaging light rays of the target to be imaged into multiple light rays; and a plurality of micro-lens array cameras, wherein each micro-lens array camera is composed of a camera integrated micro-lens array, and the plurality of micro-lens array cameras capture the same scene but with a slight relative position offset; and the light field imaging based on the array of light field cameras is used to control the plurality of micro-lens array cameras to simultaneously acquire light field images, to realize dense sampling of the phase space and to reduce the number of scans required by the scanning light field imaging.

[0015] The fourth aspect of the present application provides a vehicle, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the imaging method based on the array of light field cameras as described in the above embodiments.

[0016] The fifth aspect of the present application provides a computer readable storage medium having a computer program stored thereon, wherein the program is executable by a processor to implement the imaging method based on the array of light field cameras as described in the above embodiments.

[0017] Therefore, the present application has at least the following beneficial effects:

[0018] The plurality of light field images acquired at the same time instant can retain the angle information through light field imaging, realize fast phase difference estimation, and better solve the problem of dynamic aberration. Based on this, the adaptive optical method is used to effectively remove high-speed aberrations such as atmospheric turbulence phase difference, so that the resolution of imaging is greatly improved; at the same time, the embodiment of the present application can further realize synchronous shooting through the plurality of cameras integrated with the micro-lens array on the basis of the scanning light field imaging, and fuse the multi-view imaging through the incoherent aperture, thereby avoiding the interference of environmental changes on aberration removal caused by asynchronous shooting, more effectively removing aberration, and realizing large scene, anti-turbulence and high resolution imaging.

[0019] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0020] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, taken in conjunction with the accompanying drawings, in which:

[0021] Figure 1 A flowchart of an imaging method based on an array of light field cameras according to an embodiment of the present application is shown in FIG. 1;

[0022] Figure 2 A system block diagram of light field imaging based on an array of light field cameras according to an embodiment of the present application is shown in FIG. 2;

[0023] Figure 3 This is an example of multi-view synchronous imaging according to embodiments of this application;

[0024] Figure 4 This is an example diagram of an imaging device based on a light field camera array according to an embodiment of this application;

[0025] Figure 5 This is a schematic diagram of a light field imaging system based on a light field camera array according to an embodiment of this application;

[0026] Figure 6 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application. Detailed Implementation

[0027] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0028] High-resolution optical remote sensing technology is the primary means of acquiring large-scale, high-precision, and multi-layered spatial information about the Earth's surface, playing a crucial role in many fields such as meteorology, exploration, security, and reconnaissance. The development focus of high-resolution optical remote sensing lies in improving high-resolution wide-swath imaging and agile imaging capabilities.

[0029] In view of the problems of dynamic aberrations in scanning light field imaging mentioned in the background art, this application provides an imaging method for light field camera arrays.

[0030] The imaging method, apparatus, system, device, and storage medium based on a light field camera array according to embodiments of this application will now be described with reference to the accompanying drawings. Specifically, Figure 1 This is a schematic flowchart of an imaging method based on a light field camera array provided in an embodiment of this application.

[0031] like Figure 1 As shown, the imaging method based on a light field camera array includes the following steps:

[0032] In step S101, the light from the imaging target is transmitted to multiple light field cameras through a beam splitter; the multiple light field cameras capture the same scene, but there is a slight relative positional offset, which achieves dense sampling of the phase space and reduces the number of scans required for scanning light field imaging.

[0033] It is understood that the embodiments of this application can form multi-view images, and the imaging can be used to evaluate dynamic phase difference at high speed.

[0034] In the embodiment of the present application, the plurality of light field images obtained by simultaneously collecting the target to be imaged during imaging include: dividing the imaging light of the target to be imaged into a plurality of light beams, and controlling the collection assembly to simultaneously collect the plurality of light beams to obtain a plurality of light field images.

[0035] As shown in Figure 2 The collection assembly can include a plurality of microlens array cameras, each of which is integrated with a microlens array.

[0036] As shown in Figure 3 For example, the eight microlens array cameras, the embodiment of the present application can realize multi-angle collection through a plurality of microlens array cameras, each of which is integrated with a microlens array. The imaging information is shown by the arrow to enter the beam splitter, and the light is divided into eight beams by the beam splitter. The eight microlens array cameras simultaneously collect the imaging. Finally, it can be synchronized without scanning, realizing dense spatial sampling, ensuring spatial resolution, time resolution and angular resolution.

[0037] In step S102, the offset matrix of the images of the plurality of views is calculated according to a preset strategy, and the images of the plurality of views are digitally offset corrected using the offset matrix.

[0038] In the embodiment of the present application, the offset matrix is used to digitally offset correct the images of the plurality of views, including: two-dimensional integration of the offset matrix to obtain an aberration matrix; correcting the offset matrix according to the aberration matrix, and digitally offset correcting the images of the plurality of views using the corrected offset matrix.

[0039] It can be understood that the embodiment of the present application can estimate the offset of the multi-view by the correlation method or the optical flow method to obtain the offset matrix, and two-dimensional integration of the offset matrix to obtain the aberration matrix. The accurate offset matrix is obtained by removing the Zernike defocus term and two-dimensional difference of the aberration matrix, so as to realize the digital offset correction of the multi-view images.

[0040] Specifically, the embodiment of the present application can estimate the aberration of the multi-view imaging queue by using the digital adaptive optical method, and correct the aberration. The specific steps are as follows: the embodiment of the present application can use the meta-imaging technology to adaptively extract the global spatial non-uniform wavefront phase information from the high-dimensional light signal, further realize the dynamic aberration correction of a large range and multiple regions, and effectively improve the optical remote sensing imaging capability in complex turbulent environment; at the same time, the embodiment of the present application can apply the principle of computational imaging to realize the accurate measurement and correction of large-aperture system optical aberration at low cost and miniaturization on the basis of existing lens manufacturing level and existing system, and effectively improve the level of remote sensing imaging technology.

[0041] In step S103, the images of the corrected plurality of views are spliced and fused to obtain the final imaging result of the target to be imaged.

[0042] In the embodiment of the present application, the image stitching and fusion of the corrected multiple-view images is performed to obtain the final imaging result of the target to be imaged, including: obtaining the relative position relationship of the corrected multiple-view images; performing the image stitching and fusion of the corrected multiple-view images according to the relative position relationship to obtain the final imaging result of the target to be imaged.

[0043] It can be understood that the embodiment of the present application can directly perform the image stitching and fusion of the offset images according to the relative position relationship of the offset to generate the final imaging result of the target to be imaged.

[0044] Specifically, the embodiment of the present application can use the meta-imaging technology, break through the traditional photoelectric sensor architecture based on micro-nano optical devices, and propose a new efficient coupling collection mechanism of high-resolution light field imaging to synthesize the aperture of incoherent light beams and realize super-long distance high-resolution perception in a complex turbulent environment, so that the image stitching and fusion of the corrected multiple-view images can be performed through the incoherent aperture to realize high-resolution imaging.

[0045] According to the imaging method based on the light field camera array proposed in the embodiment of the present application, the angle information can be retained through light field imaging, and the adaptive optical method can be used to effectively remove the aberration of atmospheric turbulence, so as to solve the problem of aberration caused by complex turbulence and greatly improve the resolution in astronomical remote sensing imaging. Meanwhile, the embodiment of the present application further realizes synchronous shooting through multiple integrated microlens array cameras, and realizes the fusion of multi-view imaging through the incoherent aperture, thereby avoiding the interference of environmental changes on aberration removal caused by asynchronous shooting, more effectively removing the aberration, and realizing large scene, anti-turbulence and high-resolution imaging.

[0046] Secondly, the imaging device based on the light field camera array according to the embodiment of the present application is described with reference to the accompanying drawings.

[0047] Figure 4 is the block schematic diagram of the imaging device based on the light field camera array in the embodiment of the present application.

[0048] As shown in Figure 4 , the imaging device based on the light field camera array 100 includes an acquisition module 110, a correction module 120 and a fusion module 130.

[0049] The acquisition module 110 is configured to acquire multiple-view images with improved spatial sampling rate by simultaneously collecting the target to be imaged to obtain multiple relative position light field images and performing pixel extraction and stitching; the correction module 120 is configured to calculate the offset matrix of the multiple-view images according to a preset strategy, and perform digital offset correction on the multiple-view images by using the offset matrix; and the fusion module 130 is configured to perform image stitching and fusion of the corrected multiple-view images to obtain the final imaging result of the target to be imaged.

[0050] In the embodiment of the present application, the control module is further configured to divide the imaging light of the target to be imaged into multiple beams of light, control the acquisition assembly to simultaneously acquire the multiple beams of light to obtain multiple light field images of different relative positions, and obtain a multi-view image with improved spatial sampling rate by pixel extraction and splicing.

[0051] In the embodiment of the present application, the correction module 120 is further configured to perform two-dimensional integration on the offset matrix to obtain an aberration matrix, correct the offset matrix according to the aberration matrix, and perform digital offset correction on the multiple-view images by using the corrected offset matrix.

[0052] In the embodiment of the present application, the fusion module 130 is further configured to obtain a relative position relationship of the corrected multiple-view images, and perform splicing and fusion on the corrected multiple-view images according to the relative position relationship to obtain a final imaging result of the target to be imaged.

[0053] It should be noted that the foregoing explanation and description of the embodiment of the imaging method based on the light field camera array also applies to the embodiment of the imaging device based on the light field camera array, which will not be described herein again.

[0054] The imaging device based on the light field camera array provided in the embodiment of the present application can retain angle information through light field imaging, effectively remove the aberration caused by atmospheric turbulence by using an adaptive optical method, solve the problem of aberration caused by complex turbulence, and greatly improve the resolution in astronomical remote sensing imaging. Meanwhile, the embodiment of the present application can further realize synchronous shooting through multiple cameras integrated with micro-lens arrays on the basis of scanning light field imaging, and fuse multiple-view imaging through incoherent apertures, thereby avoiding the interference of environmental changes on aberration removal caused by asynchronous shooting, more effectively removing aberration, and realizing large-scene, turbulence-resistant and high-resolution imaging.

[0055] Figure 5 A schematic diagram of a light field imaging system based on a light field camera array is provided in the embodiment of the present application. As shown in the figure, Figure 5 The light field imaging system based on the light field camera array 10 includes a light field device based on a light field camera array 100 and an acquisition assembly 200.

[0056] The acquisition assembly 200 is configured to simultaneously acquire multiple-view images of a target to be imaged during imaging.

[0057] In the embodiment of the present application, as Figure 2As shown, the acquisition component 200 includes a beam splitter and a plurality of microlens array cameras; the imaging apparatus 100 based on the light field camera array is used to acquire a plurality of light field images of different relative positions of the target to be imaged by simultaneously acquiring the target to be imaged during imaging, to splice the images by pixel extraction to obtain a multi-view image with improved spatial sampling rate, to calculate the actual aberration during imaging according to the images of the plurality of views, and to perform optical correction on the images of the plurality of views based on the actual aberration; and to perform multi-view imaging fusion on the corrected images to obtain the final imaging result of the target to be imaged.

[0058] The beam splitter is used to divide the imaging light rays of the target to be imaged into a plurality of light rays; each microlens array camera of the plurality of microlens array cameras is composed of a camera integrated microlens array and is used to acquire a light field image of one view by acquiring any one light ray; and the imaging apparatus 100 based on the light field camera array is used to control the plurality of microlens array cameras to simultaneously acquire the plurality of light rays to obtain a plurality of light field images of different relative positions.

[0059] It should be noted that the foregoing explanation and description of the imaging method based on the light field camera array also apply to the light field imaging system based on the light field camera array of this embodiment, which will not be described here again.

[0060] The light field imaging system based on the light field camera array according to the embodiments of the present application can retain angle information through light field imaging and effectively remove the aberration caused by atmospheric turbulence by using an adaptive optical method, so as to solve the problem of aberration caused by complex turbulence and greatly improve the resolution in astronomical remote sensing imaging; meanwhile, the embodiments of the present application can further realize synchronous shooting through a plurality of cameras integrated with microlens arrays on the basis of scanning light field imaging, and can fuse multi-view imaging through incoherent apertures, thereby avoiding the interference of environmental changes on aberration removal caused by asynchronous shooting, more effectively removing the aberration, and realizing large-scene, anti-turbulence and high-resolution imaging.

[0061] Figure 6 The structure of the electronic device provided by the embodiments of the present application is shown in the figure. The electronic device can include:

[0062] The memory 601, the processor 602, and the computer program stored in the memory 601 and executable on the processor 602.

[0063] The processor 602 executes the program to implement the imaging method based on the light field camera array provided in the above embodiments.

[0064] Further, the electronic device further includes:

[0065] The communication interface 603 is used for communication between the memory 601 and the processor 602.

[0066] The memory 601 is configured to store a computer program capable of being executed on the processor 602.

[0067] The memory 601 can include a high-speed RAM (Random Access Memory) memory, and can further include a nonvolatile memory such as at least one disk memory.

[0068] If the memory 601, the processor 602 and the communication interface 603 are independently implemented, the communication interface 603, the memory 601 and the processor 602 can be connected with each other through a bus and complete communication between each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 6 In the figure, only one thick line is used to represent the bus, but it does not mean that there is only one bus or only one type of bus.

[0069] Optionally, in a specific implementation, if the memory 601, the processor 602 and the communication interface 603 are integrated on a chip, the memory 601, the processor 602 and the communication interface 603 can complete communication between each other through an internal interface.

[0070] The processor 602 can be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement one or more embodiments of the present application.

[0071] The embodiment of the present application further provides a computer readable storage medium, which has a computer program stored thereon, and the program is executed by a processor to implement the imaging method based on the light field camera array as described above.

[0072] In the description of the application, reference to "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" etc. means that a particular feature, structure, material or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. The illustrative appearances of the above-mentioned terms in various places in the specification are not necessarily referred to the same embodiment or example. Moreover, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples. Furthermore, in non-contradictory cases, those skilled in the art can combine and combine the features described in different embodiments or examples and the features of different embodiments or examples in the specification.

[0073] In addition, the terms "first", "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the application, the meaning of "N" is at least two, for example, two, three, etc., unless otherwise specifically limited.

[0074] Any process or method descriptions or descriptions of the flow diagrams in the specification can be understood as representing code modules, segments or portions of code which include one or more executable instructions for implementing the specified logic function(s) or process(es) and the preferred embodiments of the application include additional implementations in which the order of execution or the functions are not the same as those illustrated and described. It is therefore intended that the application embraces all such variations and modifications. The application also includes the combinations of the individual features recited in the claims.

[0075] It should be understood that parts of the application can be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. As in another embodiment, if implemented in hardware, any of the following technologies known in the art or their combinations can be used: discrete logic circuit with logic gate circuit for implementing logic functions on data signals, application specific integrated circuit with suitable combination logic gate circuit, programmable gate array, field programmable gate array, etc.

[0076] Those skilled in the art of the present technology can understand that all or part of the steps carried out by the above-mentioned embodiment method can be completed by program instructions to the relevant hardware, and the program can be stored in a computer readable storage medium. The program, when executed, includes one or a combination of steps of the method embodiment.

[0077] Although the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are exemplary and are not to be construed as limiting the present application, and that changes, modifications, substitutions and variations can be made by those skilled in the art without departing from the scope of the present application.

Claims

1. An imaging method based on an array of light field cameras, characterized in that, The method comprises the following steps: The light of the imaging target is transmitted to multiple light field cameras through a beam splitter; wherein the multiple light field cameras shoot the same scene and there is a relative position offset, realizing dense sampling of phase space; The same angle pixels of each microlens of each light field image are extracted and fused to obtain a single view image, and finally a multi-view image with spatial dense sampling is obtained; According to a preset strategy, an offset matrix of the multiple view images is calculated, and the multiple view images are digitally offset corrected by using the offset matrix, comprising: two-dimensional integration of the offset matrix to obtain an aberration matrix, correction of the offset matrix according to the aberration matrix, and digital offset correction of the multiple view images by using the corrected offset matrix; The multiple view images after correction are spliced and fused to obtain the final imaging result of the imaging target.

2. The method of claim 1, wherein, During imaging, multiple light field images with relative position offsets are obtained by simultaneously collecting the imaging target, comprising: The light of the imaging target is transmitted to multiple light field cameras through a beam splitter; The multiple light field cameras shoot the same scene and there is a relative position offset; The acquisition assembly simultaneously collects multiple light beams to obtain multiple light field images.

3. The method according to any one of claims 1-2, characterized in that, The multiple view images after correction are spliced and fused to obtain the final imaging result of the imaging target, comprising: The relative position relationship of the multiple view images after correction is obtained; According to the relative position relationship, the multiple view images after correction are spliced and fused to obtain the final imaging result of the imaging target.

4. An imaging apparatus based on an array of light field cameras, characterized in that, Comprise: The acquisition assembly simultaneously collects multiple light beams to obtain multiple light field images; the same angle pixels of each microlens of each light field image are extracted and fused to obtain a single view image, and finally a multi-view image with spatial dense sampling is obtained; The correction module is used for calculating an offset matrix of the multiple view images according to a preset strategy, and digitally offset correcting the multiple view images by using the offset matrix, comprising: two-dimensional integration of the offset matrix to obtain an aberration matrix, correction of the offset matrix according to the aberration matrix, and digital offset correction of the multiple view images by using the corrected offset matrix; The fusion module is used for splicing and fusing the multiple view images after correction to obtain the final imaging result of the imaging target.

5. The apparatus of claim 4, wherein, Further comprise: The control module is used for dividing the imaging light of the imaging target into multiple light beams, and controlling the acquisition assembly to simultaneously collect the multiple light beams to obtain multiple light field images with relative position offsets.

6. The apparatus of any of claims 4-5, wherein, The fusion module is further used for: Obtaining the relative position relationship of the multiple view images after correction; According to the relative position relationship, the multiple view images after correction are spliced and fused to obtain the final imaging result of the imaging target.

7. An imaging system based on an array of light field cameras, characterized in that, Comprise: The acquisition assembly simultaneously collects multiple light beams to obtain multiple light field images with relative position offsets; The light field camera array based imaging device according to any one of claims 4-6.

8. The system of claim 7, wherein, The acquisition component comprises: a beam splitter for splitting the imaging light rays of the target to be imaged into a plurality of light rays; a plurality of micro-lens array cameras, wherein each micro-lens array camera is composed of a camera integrated micro-lens array, but there is a relative position offset; and for acquiring any one light ray to obtain a light field image with a relative position offset; The light field camera array based imaging device is used to control the plurality of micro-lens array cameras to simultaneously acquire the plurality of light rays to obtain the plurality of light field images with a relative position offset.

9. An electronic device, comprising: comprise: a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the light field camera array based imaging method according to any one of claims 1-3.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the light field camera array based imaging method according to any one of claims 1-3.

Images