Light field camera
By using a light field camera combined with filter array and main lens optical module in a multispectral light field imaging system, combined with mask and mask technology, the problems of complex system structure and twilight crosstalk are solved, and the imaging quality is improved. Accuracy reduces assembly difficulty and cost.
Patent Information
- Application Number
- CN202411094016.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-12-03
AI Technical Summary
There is a problem of complex structure and crosstalk in multi-spectral light field imaging systems, resulting in reduced spatial resolution of microlens array imaging and waste of detector cells.
A light field camera is designed to combine the filter array and the main lens optical module to realize the segmentation and focus of the beam aperture, and use the microlens array to record the light information of different viewing angles, and in front of the filter array and the microlens array. Add masks and masks to ensure the conjugated relationship between the detector and the microlens and the unilluminated area, and avoid crosstalk of light.
It improves the imaging quality and accuracy of the light field camera, reduces the difficulty of assembly between the detector and the microlens, reduces the crosstalk of the light field information, and simplifies the structure and production cost of the optical system.
Smart Images

Figure CN119071620A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of optical imaging technology, and in particular to a light field camera. Background Art
[0002] Light field imaging is an important branch of computational imaging. The light field imaging system can obtain spatial light information or complex amplitude information, and has the function of imaging first and focusing later. It can overcome the problems of inaccurate image focusing and blurred image due to shallow depth of field in traditional imaging systems. The significant advantage of light field imaging technology is that it can obtain the three-dimensional information distribution of spatial scenes. Based on this feature, light field imaging is gradually penetrating into various fields such as aerial photography, security monitoring, scientific instruments, and stereoscopic display. Spectral imaging has (x, y, λ) three-dimensional imaging capabilities, and spectral information can reflect the chemical and molecular characteristics of substances. Therefore, spectral imaging is widely used in biomedicine, remote sensing, food quality testing and other fields.
[0003] Multispectral light field technology is a combination of light field imaging technology and spectral technology. Its optical system consists of a multispectral spectroscopic filter array, a main lens imaging system, and a microlens array. The light field information recorded in light field imaging contains the spatial and directional information of the light, which is equivalent to recording multi-dimensional information. If the directional information is represented as a spectrum, it means that the light field camera can record both spatial and spectral information at the same time, which greatly improves the imaging system's ability to obtain information and can be widely used in biological analysis, remote sensing, machine vision and other fields.
[0004] As the core device of multi-spectral light field technology, the number of pixels occupied by the unit image formed after focusing by the microlens array reflects the spatial resolution of the microlens array imaging for commonly used detection devices (CCD and COMS), which also directly determines the depth resolution, thus affecting the overall imaging quality. Limited by the array's own structure and the parameters of the imaging system, two situations may occur on the image plane: one is that the unit images produce crosstalk, which will greatly reduce the spatial resolution of the microlens array imaging; the other is that the unit images are separated far apart, at this time the unit imaging area is reduced, and the number of pixels occupied by the unit image is reduced, which will result in a waste of detector pixels. Summary of the invention
[0005] In view of this, it is necessary to provide a light field camera that can avoid stray light crosstalk in order to solve the problems of complex structure and stray light crosstalk in the current multi-spectral light field imaging system.
[0006] To solve the above problems, this application adopts the following technical solutions:
[0007] One of the purposes of the present application is to provide a light field camera, comprising: a filter array (1), a main lens optical module (2), a microlens array (3) and a detector (4), wherein the filter array (1) is located at an entrance pupil position of the main lens optical module (2), the microlens array (3) is located at an image-side focal plane position of the main lens optical module (2), the filter array (1) comprises an array structure formed by arranging a plurality of filters, and the microlens array (3) comprises an array structure formed by arranging a plurality of microlenses;
[0008] Light rays in different directions are emitted from a target object, and pass through a single filter of the filter array (1) to achieve light beam aperture segmentation. The light beams after aperture segmentation are then refracted by the main lens optical module (2) and focused on the microlens array plane (3) and diverge into multiple directional components through a single microlens. Each microlens records light rays corresponding to different viewing angles at the same position and are recorded by different units of the detector (4) to obtain light field information of the target object.
[0009] In some of the embodiments, a mask is provided on the front surface of the filter array (1), and light from the same point of the target object is divided into multiple bands by a single filter after passing through the filter array (1), and is imaged on detector areas corresponding to the multiple microlenses after passing through the main lens optical module (2).
[0010] In some of the embodiments, the detector areas corresponding to the filter array (1) and the microlens array (3) are in a conjugate relationship.
[0011] In some of the embodiments, a mask is provided on the front surface of the microlens array (3).
[0012] This application adopts the above technical solution, and its beneficial effects are as follows:
[0013] The light field camera provided by the present application emits light in different directions from a target object, passes through a single filter of the filter array (1) to achieve light beam aperture segmentation, and the light beam after aperture segmentation is refracted by the main lens optical module (2) and focused on the microlens array plane (3) and diverges into multiple directional components through a single microlens. Each microlens records light corresponding to different viewing angles at the same position and is recorded by different units of the detector (4) to obtain light field information of the target object. The light field camera has a simple structure and a low production cost, and reduces the difficulty of assembling the detector macro-pixel and the microlens.
[0014] In addition, the light field camera provided by the present application adds a mask in front of the filter array, strictly controls the conjugate relationship between the filter array and the macro-pixel on the detector, ensures that the detector and the micro-lens are in a projection relationship, so that the light passing through the filter array corresponds to the detector area one by one, prevents the occurrence of aliasing projection, and reduces the correctness of the light field information; at the same time, an aperture stop is added to the boundary between the sub-lenses and sub-lenses of the micro-lens array, that is, a mask is added in front of the micro-lens array to form a non-illuminated area between the macro-pixels. Due to the mask, the image of the boundary between the sub-lenses and sub-lenses in the micro-lens array on the detector surface also has a non-illuminated area, which reduces the difficulty of assembling the macro-pixels and micro-lenses of the detector, and reduces the crosstalk between the macro-pixels of the light field spectrum camera, ensuring the accuracy of the optical system detection. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0016] Figure 1 This is a schematic diagram of the structure of the light field camera provided in Example 1 of the present application.
[0017] Figure 2 Schematic diagram of the filter array mask provided in Example 2 of the present application.
[0018] Figure 3 This is a schematic diagram of the microlens array mask provided in Example 3 of the present application. DETAILED DESCRIPTION
[0019] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0020] In the description of the present application, it should be understood that the terms "upper", "lower", "horizontal", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.
[0021] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0022] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments.
[0023] See also Figure 1 The light field camera provided in the embodiment of the present application comprises: a filter array (1), a main lens optical module (2), a microlens array (3) and a detector (4). The specific implementation method is described in detail below.
[0024] The filter array (1) comprises an array structure formed by a plurality of filters. The filter array (1) is located at the entrance pupil position of the main lens optical module (2). The filter array (1) can achieve the segmentation of the aperture of the main lens optical module (2), and split the spectrum of light from the target, thereby obtaining different spectrum information.
[0025] The main lens optical module (2) plays a refractive role and can focus the target light on the plane of the microlens array (3).
[0026] The microlens array (3) comprises an array structure formed by a plurality of microlenses. The microlens array (3) is located at the image focal plane position of the main lens optical module (2). Each microlens array subunit can record scene images corresponding to light rays at different viewing angles at the same position.
[0027] The detector (4) can complete photoelectric signal conversion and signal output.
[0028] The light field camera provided in the embodiment of the present application works as follows:
[0029] Light rays in different directions are emitted from a target object, and pass through a single filter of the filter array (1) to achieve light beam aperture segmentation. The light beams after aperture segmentation are then refracted by the main lens optical module (2) and focused on the microlens array plane (3) and diverge into multiple directional components through a single microlens. Each microlens records light rays corresponding to different viewing angles at the same position and are recorded by different units of the detector (4) to obtain light field information of the target object.
[0030] See also Figure 2A mask is provided on the front surface of the filter array (1), and light from the same point of the target object is divided into multiple bands by a single filter after passing through the filter array (1), and is imaged on detector areas corresponding to the multiple microlenses after passing through the main lens optical module (2).
[0031] It can be understood that, in order to prevent light crosstalk, a mask is added to the front surface of the filter array (1) in this embodiment, and the light of the same point of the target is divided into multiple bands through the filter, and is imaged on the detector area corresponding to the microlens subunit of the microlens array (3) through the main lens optical module (2), that is, the filter array and the detector area corresponding to the microlens array subunit are in a conjugate relationship, ensuring that the detector and the microlens are in a projection relationship, so that the light passing through the filter array corresponds to the detector area one by one, preventing the occurrence of aliasing projection and reducing the correctness of the light field information.
[0032] See also Figure 3 , a mask is provided on the front surface of the microlens array (3). In this embodiment, an aperture stop is added to the boundary between the sub-lenses of the microlens array, that is, a mask is added in front of the microlens array, and a non-illuminated area is formed between the macro-pixels. Due to the mask, the image of the boundary between the sub-lenses in the microlens array on the detector surface also has a non-illuminated area, which reduces the difficulty of assembling the macro-pixels and micro-lenses of the detector, reduces the crosstalk between the macro-pixels of the light field spectrum camera, and ensures the accuracy of optical system detection.
[0033] The light field camera provided in the present application strictly controls the conjugate relationship between the filter array and the macro-pixels on the detector by covering the filter array and the micro-lens array with a mask, thereby blocking the crosstalk light of adjacent pixels and preventing the light from passing through the boundaries between the sub-mirrors of the micro-lens array and generating stray light.
[0034] The light field camera provided by the present application emits light in different directions from a target object, passes through a single filter of the filter array (1) to achieve light beam aperture segmentation, and the light beam after aperture segmentation is refracted by the main lens optical module (2) and focused on the microlens array plane (3) and diverges into multiple directional components through a single microlens. Each microlens records light corresponding to different viewing angles at the same position and is recorded by different units of the detector (4) to obtain light field information of the target object. The light field camera has a simple structure and a low production cost, and reduces the difficulty of assembling the detector macro-pixel and the microlens.
[0035] It can be understood that the technical features of the above-described embodiments can be arbitrarily combined. In order to make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0036] The above are only preferred embodiments of the present application, and only specifically describe the technical principles of the present application. These descriptions are only for explaining the principles of the present application and cannot be interpreted as limiting the scope of protection of the present application in any way. Based on the explanation here, any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application, and other specific implementation methods of the present application that can be associated with the technicians in this field without creative work, should be included in the scope of protection of the present application.
Claims
1. A light field camera, characterized in that: include: A filter array (1), a main lens optical module (2), a microlens array (3) and a detector (4), wherein the filter array (1) is located at an entrance pupil position of the main lens optical module (2), the microlens array (3) is located at an image-side focal plane position of the main lens optical module (2), the filter array (1) comprises an array structure formed by a plurality of filters, and the microlens array (3) comprises an array structure formed by a plurality of microlenses; Light rays in different directions are emitted from a target object, and pass through a single filter of the filter array (1) to achieve light beam aperture segmentation. The light beams after aperture segmentation are then refracted by the main lens optical module (2) and focused on the microlens array plane (3) and diverge into multiple directional components through a single microlens. Each microlens records light rays corresponding to different viewing angles at the same position and are recorded by different units of the detector (4) to obtain light field information of the target object.
2. The light field camera according to claim 1, characterized in that A mask is provided on the front surface of the filter array (1); light from the same point of the target object passes through the filter array (1) and is divided into a plurality of bands by a single filter, and is imaged on detector areas corresponding to the plurality of microlenses through the main lens optical module (2).
3. The light field camera according to claim 2, characterized in that The detector areas corresponding to the filter array (1) and the microlens array (3) are in a conjugate relationship.
4. The light field camera according to claim 1, wherein: The front surface of the microlens array (3) is provided with a mask.
Citation Information
Patent Citations
Multispectral light-field camera
CN103234527A
Digital zooming spectrum imager based on self-adaptive micro-lens array sensor
CN105806480A
Method for realizing wide-spectrum hyperspectral detection based on spectrum coding device
CN116222785A
