Method and system for characterizing an optical lens for correcting optical aberrations introduced by said optical lens in an image

EP4505156A1Pending Publication Date: 2025-02-12FOGALE NANOTECH SA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
EP2023716308
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-04-01
Filing Date
2023-03-31
Publication Date
2025-02-12

AI Technical Summary

Technical Problem

Current methods for characterizing optical lenses to correct optical aberrations are either time-consuming, imprecise, or fail to account for manufacturing parameters and interactions between optical elements, leading to suboptimal image quality.

Method used

A method involving optical measurement and digital modeling of the lens to determine an aberration matrix through simulation, which accounts for geometric parameters of optical interfaces and interactions, allowing for precise correction of optical aberrations in images.

Benefits of technology

This approach enables faster and more accurate characterization of optical aberrations, resulting in improved image quality by accounting for individual lens specifications and manufacturing defects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 1.1
    Figure 1.1
Patent Text Reader

Abstract

The invention relates to a method (400) for characterizing an optical lens that comprises a stack of several optical elements and is intended to be associated with an image sensor for acquiring images, the method comprising: - determining (402), by optical measurement on the stack of optical elements, at least one data set (JG), referred to as geometric set, comprising data relating to at least one geometric parameter of at least one buried optical interface of the lens, - digitally modeling (404) the optical lens according to the geometric set, and - determining (406), by an optical wave propagation digital simulator applied to the digital model, at least one matrix, referred to as aberration matrix, representative of optical aberrations introduced by the optical lens (200) in an image. The invention also relates to a characterization device, to an image acquisition method and an image acquisition device, and to an imaging apparatus implementing such a method.
Need to check novelty before this filing date? Find Prior Art

Description

DESCRIPTION Title: Method and system for characterizing an optical lens for correcting optical aberrations introduced by said optical lens into an image.

[0001] The present invention relates to a method for characterizing an optical lens to determine a matrix of values ​​making it possible to correct at least certain optical aberrations introduced by said lens in an image produced with said lens. It also relates to a characterization device, an image acquisition method and device, and an imaging apparatus implementing such a method.

[0002] The field of the invention is the field of characterization of optical objectives used for imaging, with a view to correcting optical aberrations due to said optical objective. State of the art

[0003] Optical lenses are used in various devices, such as cameras, cameras, smartphones, etc. to image a scene.

[0004] Typically, an optical lens consists of a stack of optical elements, such as optical lenses, separated from each other by an empty space, also called an "air gap" in English, or by a spacer, also called a "spacer" in English. They are generally assembled via a device called a barrel or barrel.

[0005] To create an image, the optical lens works with a photosensitive sensor, also called an image sensor, such as a CMOS or CCD sensor. The plane of the image sensor is called the image plane, and each image sensor contains a multitude of pixels. The assembly consisting of the optical lens and the image sensor is generally referred to as an "optical module" or "camera module."

[0006] The trend toward miniaturization of camera modules mounted in electronic devices, such as smartphones, is reducing tolerances in the manufacturing of components, particularly those of the optical lens and lenses that compose it. Manufacturing defects can thus appear in the form of defects in the image obtained on the image sensor. For example, optical aberrations can result in image blurring. The brightness of a pixel in an original image is distorted and changes the brightness of an adjacent pixel in the captured image. This phenomenon can be expressed as a point spread function (PSF), indicating a degree of blurring obtained during a process in which an optical system forms an image of a scene on an image sensor.The PSF can then be used to deduce correction values, in an image, for optical aberrations due to the optical lens, for example by deconvolution.

[0007] According to a first known solution, the PSF is measured for each optical lens manufactured: this solution is time-consuming. According to a second solution, the PSF can be measured for one optical lens and reused for all optical lenses belonging to the same batch: this solution, although less time-consuming, is imprecise because it does not take into account the specifications of each optical lens.

[0008] According to a third known solution, the PSF can be estimated by calculation, for each optical lens, from the individual parameters of each optical element forming said optical lens. However, the inventors of the present invention have discovered that this solution, although less time-consuming, remains just as imprecise because it does not take into account the manufacturing parameters, and in particular those which can influence the interactions between the optical elements of an optical lens, as well as micro defects in the production of the optical elements.

[0009] An aim of the present invention is to remedy at least one of the aforementioned drawbacks.

[0010] Another aim of the invention is to propose a solution allowing better correction of optical aberrations introduced by an optical lens while being less time-consuming. Statement of the invention

[0011] The invention proposes to achieve at least one of the aforementioned aims by a method for characterizing an optical objective comprising a stack of several optical elements and intended to be associated with an image sensor for the acquisition of images, said method comprising the following steps: - determination, by optical measurement on said stack of optical elements, of at least one data set, called geometric set, comprising data relating to at least one geometric parameter of at least one buried optical interface of said objective, - digital modeling of said optical objective as a function of said geometric play, and - determination, by a digital optical wave propagation simulator applied to said digital model, of at least one matrix, called an aberration matrix, representative of optical aberrations introduced by said optical lens into an image.

[0012] Thus, the invention proposes to determine an aberration matrix whose values ​​are representative of optical aberrations introduced by the optical lens on an image taken by said optical lens, by simulation on a digital model of said optical lens and not by optical measurements carried out on said optical lens. Thus, the invention makes it possible to determine the aberration matrix in a less time-consuming manner than current solutions which carry out a measurement of these aberrations, and in particular of the PSF, on each optical lens.

[0013] Furthermore, the invention proposes to determine the aberration matrix by simulation on a digital model of the optical lens. Thus, it is possible to determine the aberration matrix individually for each optical lens, which makes it possible to obtain aberration values, and therefore correction values, individually for each optical lens, so as to obtain a more precise correction.

[0014] Above all, the invention makes it possible to determine the digital model of the optical lens as a function of the parameters of the optical interfaces of said optical lens, measured after the optical elements forming the lens have been stacked. Thus, the digital model of the optical lens takes into account the characteristics of each optical element in combination with the other optical elements of the optical lens. Such a digital model is more precise and closer to reality, makes it possible to obtain more precise representative values ​​of optical aberrations, and therefore to achieve better correction of the optical aberrations introduced into an image by said optical lens.

[0015] Optical aberration includes optical blur or optical distortion. Optical blur usually results in a spread of a light point. Distortion usually results in a displacement of the optical point.

[0016] The optical elements composing an optical lens are stacked along a stacking direction, also called the Z axis in the following, or the axis of the optical lens. The plane perpendicular to the Z axis, that is, the plane along which each optical element extends, is called the XY plane in the following.

[0017] By "geometric parameter of an optical interface" we mean, for example, and without loss of generality: - a position of the optical interface within the lens, in the Z axis; - a position of an APEX of the optical interface, in particular in the XY plane and / or - a position of an APEX of the optical interface, in particular along the Z axis, - an inclination (TIP and / or TILT) of said optical interface relative to the Z axis, - a decentering of an optical interface, or of an optical element, relative to the Z axis, in the XY plane, - a curvature or one or more terms of an equation describing an optical interface.

[0018] In the present application, by "buried optical interface" of an optical lens is meant an interface within the optical lens which is visible, or accessible, only via at least one other optical interface of the lens. The at least one other optical interface through which the buried interface is visible may be an optical interface of the same optical element, or an optical interface of another optical element than the buried interface.

[0019] The geometric set comprises data relating to at least one geometric parameter of at least one buried interface of said stack.

[0020] The estimated geometric game may further comprise data relating to at least one geometric parameter of at least one unburied interface of said stack.

[0021] According to embodiments, the method according to the invention may comprise a determination of several aberration matrices for several regions, RJ, of the image sensor associated with the optical objective.

[0022] Thus, it is possible to characterize more precisely the optical aberrations introduced by the optical lens in a particular region of the image sensor, these aberrations being able to change depending on the regions of the image sensor. Indeed, it is for example common for the optical aberrations introduced in a central region to be different from a peripheral region. Similarly, it is likely that the optical aberrations of a peripheral region differ from the optical aberrations introduced in another peripheral region.

[0023] Each aberration matrix can be determined by simulation by the digital simulator.

[0024] To do this, in the digital simulator, for each region, a test light beam is emitted. The test beam enters the optical lens, passes through the optical lens and is received on an image sensor. The received values ​​are compared with the input values, i.e. with the values ​​of the test light beam. This comparison makes it possible to deduce the aberrations introduced by the optical lens by examining each pixel of the region concerned and comparing it to the emitted beam.

[0025] In particular, aberrations can be determined by convolving a matrix of values ​​describing them with the intensities of the light points of a region of an observed scene, which makes it possible to obtain the intensity values ​​received at the image sensor in the corresponding region.

[0026] By "region" we mean a region of the image sensor in its XY plane.

[0027] At least one region can comprise a single pixel.

[0028] At least one region can consist of multiple pixels.

[0029] At least two regions can be the same size.

[0030] At least two regions can be of different sizes.

[0031] In this document, a region of the image sensor centered on the coordinates (Xi,Yi), in the plane (X,Y), may be denoted by R(Xi,Yi), or Rj.

[0032] In this document, MA denotes the aberration matrix for the entire optical lens.

[0033] MAi, or MAi(Xi,Yi) denotes the aberration matrix for the R region of the lens. The aberration matrix MA can be obtained by concatenating or adding the aberration matrices MAi.

[0034] According to embodiments, the method according to the invention may comprise, for a region of the image sensor, a calculation of an aberration matrix by interpolation of one or more aberration matrices of one or more other regions of said optical objective.

[0035] Thus, the method according to the invention makes it possible to characterize the optical objective in less time.

[0036] In particular, the aberration matrix of a region can be calculated by interpolating aberration matrices of adjacent regions.

[0037] Interpolation can be performed by any known technique, for example by averaging.

[0038] Alternatively, or in addition, the method according to the invention may comprise a determination of several aberration matrices for several values ​​of a distance, called the objective-sensor distance, noted DOC subsequently, between said optical lens and an image plane, the digital simulator taking said lens-sensor distance as input.

[0039] Thus, the method according to the invention makes it possible to quantify the optical aberrations introduced by the optical lens in an image, when the distance between the optical lens and the image plane is changing. Indeed, the inventors have noticed that, for a given lens, the optical aberrations introduced by said lens can vary depending on the distance between said lens and the image plane.

[0040] The image plane can be the plane of an image sensor associated with the lens. The image sensor can be any type of sensor, such as a CMOS sensor or a CCD sensor, etc.

[0041] To do this, for each DOQ distance, with j>l, a test light beam is emitted opposite the objective. The test beam enters the optical objective, passes through the optical objective and is received on an image sensor. The aberration matrix is ​​determined based on the received values ​​and the input values, i.e. the values ​​of the test light beam.

[0042] Multiple aberration matrices can be determined for multiple DOQ distances, for the entire optical lens.

[0043] Alternatively, multiple aberration matrices can be determined for multiple DOQ distances, for different regions of the image sensor.

[0044] Alternatively, or in addition, the method according to the invention may comprise a determination of several aberration matrices for several values ​​of a distance, called lens-scene distance, DOS, between said optical lens and a scene, the digital simulator taking said lens-scene distance as input.

[0045] Thus, the method according to the invention makes it possible to quantify the optical aberrations introduced by the optical lens in an image, when the distance between the optical lens and the imaged scene is changing. Indeed, the inventors have noticed that, for a given lens, the optical aberrations introduced by said lens can vary depending on the distance between said lens and the scene.

[0046] To do this, for each distance DOSk, with k>l, a simulated test light beam is emitted opposite the objective. The test beam enters the optical objective, passes through the optical objective and is received on an image sensor. The aberration matrix is ​​determined based on the received values ​​and the input values, i.e. the values ​​of the test light beam.

[0047] Multiple aberration matrices can be determined for multiple DOSk distances, for the entire optical lens.

[0048] Alternatively, multiple aberration matrices can be determined for multiple DOSk distances, for different regions of the image sensor.

[0049] Thus, according to embodiments, it is possible to determine a number NB=I x J x K aberration matrices for the optical objective, with: - 1>1 the number of regions considered of the image sensor, - J>1 the number of DOC distances considered, and - K>1 the number of DOS distances considered.

[0050] For example, if ten (10) regions of the image sensor are characterized for 3 DOQ distances and 5 DOSk distances, then 15 aberration matrices can be determined for each region of the image sensor, and in total 150 aberration matrices for the optical lens.

[0051] In the following, for the Rj region of the sensor, the DOQ distance and the DOSk distance: - MAijk the aberration matrix, and - MCijk is the correction matrix. Of course, when the DOC distance and / or the DOS distance are not variable then the notations MAijk and MCijk do not necessarily imply that these distances are variable.

[0052] According to embodiments, the method according to the invention may further comprise a step of calculating a matrix, called aberration kernel matrix, comprising coefficients making it possible to deduce at least one aberration matrix.

[0053] In this case, several aberration matrices can be determined. Then, from these matrices, a common matrix can be identified. This common matrix, called the aberration kernel matrix, can be stored instead of the multitude of aberration matrices, in relation to one or more relations, to allow the calculation of each aberration matrix. This avoids having to store a multitude of aberration matrices and therefore reduces the memory space used for storing aberration matrices.

[0054] The aberration kernel matrix can, according to a non-limiting exemplary embodiment, be determined in the following manner.

[0055] First, we establish a basis of FA functions allowing us to describe the values ​​of the coefficients of the aberration matrices as a function of the positions (X,Y) in the field of the image sensor, such as: MA(X,Y) = Zi aAi(X,Y) FAi(X,Y) + E(X,Y) where - 1 sweeps the basis of the FA functions, with 1 < I < L, and L> 1. - the term E(X,Y) models the differences between the combination of the FAi and MA functions.

[0056] The basis FA can preferably be chosen to be sufficiently large so that the term E(X,Y) has a negligible or even zero effect. These functions can be orthogonal to each other in the sense of a scalar product, but not necessarily. For example, the basis of functions FAi can be the basis of functions of the Zernike polynomials. To obtain the functions aAi(X,Y), it is sufficient to use a known state-of-the-art method such as a projection of MA(X,Y) onto the FAi(X,Y), in the sense of a scalar product, and to apply the appropriate matrix product to take into account their non-orthogonality, if applicable, to obtain the functions aAi(X,Y). Establishing an aberration kernel precursor (ANP) amounts to searching for a parametric model of the functions aAi(X,Y), such that for example a polynomial expression represents aAi(X,Y), for example, if I e {1, 2}, such that aAi(X,Y) = aoi.((X-xoi) 2 +(Y-yoi) 2) and aA2(X,Y) = ao2.((X- xo2)*(Y-yo2)) +zo2. The model representing the aAi(X,Y), here aAi(X,Y) and aA2(X,Y), is then the table of values ​​((aoi, xoi, yoi); (ao2, X02, yo2, Z02)) in this example. We can call this set of coefficients a precursor kernel matrix of aberrations called PNA (here which can be a matrix of 1 row x 7 columns, or 2 rows by 4 columns with a zero coefficient added to the first row). As the FAi() functions are chosen in such a way as to best model the modes of the aberrations obtained, the parametric model which represents the functions aAI(X,Y) as a function of the geometric parameters contains significantly fewer coefficients than the numerical representation of the functions FAi(X,Y). Here for example, it contains 8 coefficients instead of the 16 million coefficients which would have been necessary to represent the aberration functions represented by 4 x 4 coefficients on an X, Y field of 1000x1000 positions.There remains one last step to obtain the aberration matrix which is to represent the evolutions of the PNA coefficients as a function of the distance parameters lens sensor and lens scene DOC and DOS, which again makes a set of several parameters involved in functions modeling the PNA values ​​as a function of DOC and DOS. It is this last set of coefficients which can, advantageously, constitute the aberration kernel matrix.

[0057] According to another exemplary embodiment, the aberration kernel matrix can be a table of matrices containing the PNA coefficients, or directly the PNA for several sets of DOC and DOS parameters. The essential thing is to be able to find the aberration matrices of the lens from the geometric parameters, preferably by storing less data than these aberration matrices represent.

[0058] For example, the function basis FAi can be the function basis of Zernike polynomials.

[0059] According to embodiments, the method according to the invention may further comprise a step of calculating, as a function of at least one aberration matrix, at least one matrix, called a correction matrix, comprising values ​​for correcting an image captured with said optical objective.

[0060] In particular, a correction matrix can be calculated for each aberration matrix.

[0061] For at least one aberration matrix, the correction matrix can be obtained by inverting said matrix, which can be done for example by calculations in the spatial frequency domain.

[0062] According to exemplary embodiments, at least one correction matrix can be obtained by relationship : where Go is a function representing the form of the point dispersion function to be obtained after correction. It can be a function approaching a Dirac function in 2 dimensions, i.e. worth 1 at the center, and almost 0 around. Noting MTOBSÿk, the matrix of the test light beam as observed, and MT its native form as it is in reality during its emission, the correction matrix MCijk as follows: In a simplified form, we can assume that TF(GO) = 1, the constant function that returns 1 with zero phase at all frequencies, which is written as: with : - TF() the Fourier transform operator (in 2D) -TF -1 () the inverse Fourier transform operator (in 2D) - MCijk correction matrix for the region Ri of the image sensor, at the lens-sensor distance DO and at the lens-scene distance DOSk; - MAijk the aberration matrix obtained by simulation for the region Ri of the optical objective and the distances DO and DOSk; and - MTijk the test light beam matrix, i.e. the matrix describing the test light beam, used to measure by simulation the aberration matrix MAijk. - MTOBSijk the observed illumination matrix, obtained by simulation, in the sensor plane relative to the MTijk test matrix presented at the input of the objective.

[0063] According to embodiments, like the aberration kernel matrix calculated for the aberration matrices, the method according to the invention can further comprise a step of calculating a matrix, called the correction kernel matrix, comprising coefficients making it possible to deduce at least one correction matrix.

[0064] In this case, several correction matrices can be determined. Then, from these correction matrices, a common correction matrix, denoted MC, can be identified for example by addition or concatenation of the correction matrices MCijk. This common correction matrix can be stored in place of the multitude of correction matrices, in association with one or more relations, to allow the calculation of each correction matrix. This avoids having to store a multitude of correction matrices.

[0065] The determination of the correction kernel matrix can be determined in a manner similar to that described above for the aberration kernel matrix using the same basis of functions FAi, or another basis of functions which would be appropriate.

[0066] According to preferred embodiments, at least one aberration matrix may be a matrix, called a PSF matrix, of values ​​of a point spread function (“Point Spread Function” or “PSF” in English).

[0067] Alternatively, or in addition, at least one aberration matrix may be a matrix, called an OTF matrix, of values ​​of an optical transfer function (OTF).

[0068] Alternatively, or in addition, at least one aberration matrix may be a matrix of values ​​obtained by wavefront analysis.

[0069] When an aberration matrix is ​​a PSF matrix, then the correction matrix calculated for said aberration matrix may be a matrix of values, called an IPSF matrix, obtained by inversion of said PSF matrix.

[0070] The digital simulator can be any type of optical wave propagation simulator through several interfaces, elements, otic.

[0071] Such digital simulators are known to those skilled in the art and are widely available on the market.

[0072] For example, the digital simulator can be the OpticStudio simulator from Zemax. Of course, the invention is not limited to this simulator and any type of digital light beam propagation simulator can be used.

[0073] According to embodiments, at least one geometric game can be obtained by optical interferometry.

[0074] Alternatively, or in addition, at least one geometric set can be obtained by confocal measurement(s).

[0075] Geometric clearance can be determined from optical measurements taken only from one face, or side, of the stack of optical elements, without having to turn the stack over.

[0076] According to embodiments, at least one geometric clearance can be determined by confocal measurements carried out on the stack of optical elements of the target optical objective, preferably from one face of said stack.

[0077] Conventionally, a confocal measurement is carried out with a device that includes a first opening (orifice) imaged on the surface to be measured by means of a focusing lens. This opening is illuminated by a light beam coming from a light source and which is then directed towards the surface to be measured. When the beam is reflected by a surface, it is redirected towards the focusing lens and then towards a second lens placed in front of a detection element and so as to be the conjugate image of the illuminated point on the measured surface. The advantage of such a configuration is the reduction of the depth of field and therefore to be able to distinguish objects (or surfaces) one below the other more easily. To carry out the detection, the confocal measurement system is moved relative to the measured object. A maximum intensity is detected on the detection element when a surface enters the focal point defined by the focusing lens. A particular configuration of a confocal measurement system uses a chromatic lens to focus and image a beam from a polychromatic source. The different wavelengths thus define different focal points along the optical axis of the lens. Detection with a spectrometer of the reflected light makes it possible to recognize the reflected wavelength and deduce information on the height (or distance) between the lens and the measured surface. Such a configuration makes it possible to eliminate or reduce the movement of the confocal measurement system.In particular, when the confocal measurement system is moved along a plane perpendicular to the illumination axis of the surface to be measured, topography information of a surface can be obtained.

[0078] According to embodiments, at least one geometric clearance can be determined by optical interferometry measurements carried out on the stack of optical elements of the target optical objective, preferably from one face of said stack.

[0079] Conventionally, an optical interferometry measurement is carried out with an optical interferometry device comprising a low-coherence emitting light source. This light source emits, in the direction of the stack of optical elements, and more particularly along the Z axis, a beam of light, called the measuring beam. The measuring beam illuminates the stack of optical elements at a more or less wide measuring point depending on the focusing in the XY plane, and then travels through the stack of optical elements, in particular in the stacking direction, and crosses each optical interface in turn. At each optical interface, a part of the beam is reflected, and constitutes a reflected beam. This reflected beam is then captured by a sensor located on the same side as the emission source, and is characterized by optical interferometry with a reference beam also coming from the light source.By "coherence zone" we mean the zone in which interference between the measuring beam and the reference beam can occur. form on the sensor. The coherence zone can be moved by varying the difference in the optical path length between the two beams, for example by changing the optical length of one or both beams. The optical interferometry apparatus can selectively detect an interference signal for each interface at which the coherence zone is positioned, i.e. for each surface within the coherence zone. Preferably, the coherence length of the light source is adjusted so as to be shorter than a minimum optical distance between two adjacent interfaces of the optical element. Thus, for each measurement, only one interface is within the coherence zone, and therefore, an acquired interference signal includes the contribution of only one interface, or comes from only one interface.Interference measurements are carried out according to a field of view determined by the measuring means of the interferometric device.

[0080] According to one embodiment, the interferometric apparatus can operate in point mode by being configured to detect a point interference signal at a point in the field of view or at a point detector. The interference signal, or interferogram, obtained is an intensity signal depending on the displacement of the coherence zone along the Z axis. The interference signal can, for example, be seen as a succession of interference lines associated with each optical interface.

[0081] Alternatively or additionally, the interferometric apparatus may comprise an interferometric sensor, called a full-field interferometric sensor, configured to detect a full-field interference signal in a field of view and represented, for example, in the form of a 2D image (interference image) by the detection element.

[0082] An interface to be measured can thus be imaged according to the field of view in a single measurement or by scanning a beam.

[0083] In a particular implementation example, a measurement signal may be formed by a point interference signal associated with a pixel of the detection element whose intensity is detected following the Z displacement of the coherence zone.

[0084] In one example, the interferometric apparatus may include an interferometric sensor with a Michelson interferometer. In another example, the interferometric apparatus may include an interferometric sensor with a Mach-Zehnder interferometer.

[0085] According to embodiments, a point mode interferometric apparatus and a full field interferometric apparatus may be combined.

[0086] According to embodiments, at least one geometric set may comprise a value of at least one geometric parameter of an optical interface of the target lens.

[0087] For example, the geometric game may include, for at least one, and in particular each, optical interface of the stack: - at least one position value of the optical interface; - at least one value of decentering of the optical interface relative to the Z axis, or relative to a center position of another interface, in the XY plane; or - at least one inclination value of the optical interface relative to the Z axis, or relative to the inclination of another interface. - at least one topography or shape profile value of the optical interface, for example relative to a reference plane or axis to deduce therefrom, for example, decentering or inclination values, or shape values ​​of the interface.

[0088] The Z-axis position of an optical interface can be determined as the position of an interference line corresponding to said interface.

[0089] The thickness of an optical element, along the Z axis, can be determined by calculating the distance between the interference lines corresponding to each of the optical interfaces of said optical element.

[0090] The position of an optical interface relative to the Z axis can be determined by performing several optical interferometry measurements, in particular in a central region of the image sensor. By following, over the several measurements, the position, along the Z axis, of the interference line associated with said interface, it is possible to determine the position of the APEX of said optical interface. The position of the APEX of the optical interface makes it possible to determine the position of said interface relative to the Z axis, in the XY plane, and therefore its offset relative to the Z axis.

[0091] In another example, the position of an interface relative to the Z axis may be obtained, for example, by detecting an interference image of the interface in a central region of the image sensor and analyzing this image and / or analyzing associated amplitude or phase images, in particular to obtain a profile of this surface and the position of the APEX of said optical interface.

[0092] The position of an optical element relative to the Z axis can be determined based on the positions of its optical interfaces.

[0093] The inclination of an optical interface with respect to the Z axis can be determined by performing several optical interferometry measurements, in particular in a peripheral region of the image sensor. By following, over the several measurements, the position in the Z axis, of the interference line associated with said optical interface, it is possible to determine the position of the interface along the axis at its edges, which makes it possible to determine the inclination of said interface with respect to the Z axis.

[0094] The inclination of an optical element relative to the Z axis can be determined based on the inclinations of its optical interfaces.

[0095] It is also possible to determine each of these geometric parameters using the amplitude of an interference line, in addition to or instead of the position of the interference line.

[0096] As mentioned above, the aberration matrix can be obtained around each pixel of the sensor. In this case, the lens is illuminated by a test light beam, and then the illumination received at the image sensor is measured. This illumination received at the sensor includes the information of the optical aberrations introduced by the optical lens in each captured image.

[0097] The aberration matrix can be obtained by region of the image sensor, each corresponding to several pixels on the image sensor. In this case, an illumination pattern is presented in front of the lens, such as for example a checkerboard pattern alternating white patterns and black patterns, then the illumination received at the sensor is measured. This illumination received at the sensor includes the information of the optical aberrations introduced by the optical lens in each captured image.

[0098] A transformation of the captured images may be necessary in order to obtain, for example, the point spread function (PSF), which would correspond to, for example, a test beam coming from a single light point illuminating the lens, moved in several regions of the field visible by the lens to obtain the PSFs for several regions of the sensor. But if the simulation allows illuminating the lens from a single movable point, these transformations can generally be omitted to obtain PSFs directly.

[0099] According to another aspect of the present invention, there is provided a system for characterizing an optical objective comprising a stack of several optical elements and intended to be associated with an image sensor (704) for the acquisition of images, said system comprising: - an optical measuring device, on said stack of optical elements, of at least one data set, called geometric set, comprising data relating to at least one geometric parameter of at least one buried optical interface of said objective; - at least one computing unit configured for: ■ digitally model said optical objective based on said geometric clearance; and ■ determine, by digital simulation of optical wave propagation applied to said digital model, at least one matrix, called aberration matrix, representative of optical aberrations introduced by said optical lens in an image.

[0100] Generally speaking, the system according to the invention may comprise means configured to implement any combination of at least one of the characteristics described above with reference to the characterization method according to the invention, and which are not repeated here for the sake of brevity.

[0101] The optical measuring device may be a device comprising at least one optical interferometer, and / or at least one confocal measuring device.

[0102] The computing unit can be any type of physical or virtual machine, such as at least one server, at least one computer, at least one tablet, at least one processor, at least one computer chip, at least one calculator, etc.

[0103] The computing unit can in particular be configured to run a digital optical wave propagation simulator, such as for example OpticStudio from Zemax.

[0104] According to another aspect of the present invention, there is provided a method of acquiring an image with an apparatus comprising an optical lens and an image sensor, said method comprising the following steps: - capturing an image with said optical lens and said image sensor; and - correction of said image as a function of at least one correction matrix calculated from at least one aberration matrix obtained, for said optical objective, by the method according to the invention for characterizing an optical objective.

[0105] According to embodiments, at least one correction matrix can be calculated outside the apparatus performing the acquisition of the image.

[0106] In this case, said correction matrix can be calculated before the integration of the optical lens into the device, and in particular at the time of, during or after the design of the optical lens.

[0107] The at least one correction matrix can be calculated by a characterization method or system according to the invention.

[0108] In this case, at least one previously calculated correction matrix is ​​loaded and stored in the device.

[0109] According to embodiments, at least one correction matrix can be calculated in the apparatus performing the acquisition of the image.

[0110] In this case, the correction matrix can be calculated from: - at least one aberration matrix, - one aberration kernel matrix, or - one correction kernel matrix. [YES] In these embodiments, it is then not necessary to calculate all the correction matrices prior to the integration of the optical lens in the apparatus, and the calculation of the correction matrices is done in the apparatus, in the environment of use of the optical lens. This makes it possible to take into account specificities arising from, or dependent on, the conditions of integration of the optical lens in the apparatus, which allows greater precision.

[0112] At least one correction matrix can be calculated once and then stored in the device for multiple use.

[0113] For example, at least one correction matrix may be calculated just after the integration of the optical lens into the device, or at the time of device configuration or at the time of installation / configuration of an image acquisition application, and be stored in the device for use over time.

[0114] At least one correction matrix can be calculated, or recalculated, on the fly each time an image is acquired, or each time an image acquisition application is started.

[0115] In this case, it is not necessary to memorize at least one correction matrix, the latter being calculated on the fly.

[0116] This embodiment avoids having to memorize all the correction matrices and calculate at least one correction matrix when it is used.

[0117] For example, when acquiring an image the DOC and DOS distances can be determined and the at least one correction matrix corresponding to said distances can be determined on the fly.

[0118] The method according to the invention may further comprise a step of determining a distance, DOC, between the optical objective and an image plane, the correction taking into account said distance DOC.

[0119] DOC distance can for example be measured by a distance sensor, such as an optical sensor, a magnetic sensor, a capacitive sensor, etc.

[0120] The DOC distance can for example be calculated from information provided by a focus adjustment mechanism modifying or controlling the distance between the lens and the image sensor.

[0121] The method according to the invention may further comprise a step of determining a distance, DOS, between the optical objective and the scene, the correction taking into account said DOS distance.

[0122] DOS distance can be measured by, for example, LIDAR, time-of-flight camera, ultrasonic sensor, textured image analysis, etc.

[0123] A single DOS distance can be measured for the optical lens. Alternatively, DOS distances can be measured for different regions of the image sensor.

[0124] According to another aspect of the present invention, there is provided an image acquisition device comprising: - an optical lens comprising a stack of several optical elements, - an image sensor, and - a computing unit; configured to implement the method according to the image acquisition invention.

[0125] According to embodiments, but in no way limiting, the device according to the invention can be a camera module integrated or intended to be integrated, in a device, such as a camera, a tablet, a Smartphone, a computer, a surveillance camera, etc.

[0126] Generally speaking, the image acquisition device according to the invention may comprise means configured to implement any combination of at least one of the characteristics described above with reference to the image acquisition method according to the invention, and which are not repeated here for the sake of brevity.

[0127] The image acquisition device may optionally comprise at least one sensor for measuring at least one DOS distance for at least one region of the optical field, when acquiring an image, said at least one distance being used for image correction. Such a sensor may be an optical sensor, a LIDAR sensor, a time-of-flight camera, etc.

[0128] The image acquisition device may optionally comprise at least one means for measuring, or calculating, a DOC distance during the acquisition of an image, said distance being used for the correction of the image. The DOC distance may for example be measured by a distance sensor, such as an optical sensor, a magnetic sensor, a capacitive sensor, etc. Alternatively, the DOC distance may for example be calculated from information provided by an optical focusing mechanism modifying the distance between the optical lens and the image sensor.

[0129] According to another aspect of the present invention, there is provided an image acquisition apparatus comprising an image acquisition device according to the invention.

[0130] According to embodiments, the device according to the invention can be a camera, a tablet or a Smartphone, a camera module intended to be integrated into another device, a computer, a surveillance camera, etc. Description of figures and embodiments

[0131] Other advantages and characteristics will appear on examining the detailed description of non-limiting embodiments, and the attached drawings in which: - FIGURE 1 is a schematic representation of a non-limiting exemplary embodiment of an optical element that can be used to manufacture an optical lens; - FIGURE 2 is a schematic representation of a non-limiting exemplary embodiment of an optical objective which can be characterized by the present invention; - FIGURES 3a and 3b are schematic representations of a non-limiting example of an optical interferometry measurement embodiment that can be implemented in the present invention; - FIGURE 4 is a schematic representation of a non-limiting exemplary embodiment of a method according to the invention for characterizing an optical objective; - FIGURES 5a, 5b and 5c are schematic representations of non-limiting exemplary embodiments of a method according to the invention for acquiring an image; - FIGURE 6 is a schematic representation of a non-limiting exemplary embodiment of a system according to the invention for characterizing an optical objective; - FIGURE 7 is a schematic representation of a non-limiting exemplary embodiment of a device according to the invention for acquiring an image; and - FIGURE 8 is a schematic representation of a non-limiting exemplary embodiment of a device according to the invention for acquiring an image.

[0132] It is understood that the embodiments which will be described below are in no way limiting. In particular, it is possible to imagine variants of the invention comprising only a selection of characteristics described below isolated from the other characteristics described, if this selection of characteristics is sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art. This selection includes at least one preferably functional characteristic without structural details, or with only part of the structural details if it is this part which is only sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art.

[0133] In particular, all the variants and embodiments described can be combined with each other if there is no technical obstacle to this combination.

[0134] In the figures and in the rest of the description, the elements common to several figures retain the same reference.

[0135] FIGURE 1 is a schematic representation of a non-limiting exemplary embodiment of an optical element that may be used to manufacture an optical lens.

[0136] The optical element 100 of FIGURE 1 may be used with at least one other optical element to manufacture an optical lens. An exemplary optical lens, given by way of non-limiting example, will be described with reference to FIGURE 2.

[0137] The optical element 100 may be a lens, a blade, etc. In the following, and without loss of generality, it is considered that the optical element is a lens.

[0138] The optical lens 100 may, for example, be manufactured by injection molding. An injection molding process generally follows the following sequence of steps: - polymer injection and mold filling, - pressurization, - maintaining pressure, - cooling, and - demolding Injection lens manufacturing processes, although common, can fluctuate and generate errors in the characteristic parameters of the lenses, particularly with regard to their geometry.

[0139] The lens 100 has a given geometric shape. It comprises two interfaces 102i and 1022, each also having a given geometric shape. Thus, the geometric shape of the lens 100 is determined by: - a geometric shape of each of the optical interfaces 102i and 1022; - a center of curvature, noted CCI and CC2, of each of the optical interfaces 102i and 1022; - a position of an apex, denoted Al and A2, of each of the optical interfaces 102i and 1022; - at least one thickness, noted H1 and H2, of the lens 100 along its periphery; - an internal diameter, respectively DU and D21, and / or an external diameter, respectively D12 and D22, of each of the interfaces 1021 and 1022; - a concentricity or eccentricity value of the interfaces 102i and 1022 - a surface roughness of each of the optical interfaces 102i and 1022; - etc.

[0140] The value of at least one of these geometric parameters may be provided by the manufacturer. Alternatively, or in addition, the value of at least one geometric parameter may be measured, for example, by optical or mechanical profilometry. Alternatively, or in addition, the value of at least one geometric parameter may be determined by simulation, from a numerical modeling of the lens 100. Alternatively, or in addition, the value of at least one geometric parameter may be measured, for example, by optical interferometry.

[0141] In addition, the lens 100 has optical characteristics since it is an optical element. It is therefore characterized by at least one optical parameter such as for example: - a refractive index, noted II and 12, of each of the optical interfaces 102i and 1022; - an Abbot number, noted Ab, - etc.

[0142] FIGURE 2 is a schematic representation of a non-limiting exemplary embodiment of an optical lens that may be characterized by the present invention.

[0143] An optical lens has the function of focusing an image of a scene in an image plane, generally consisting of a photosensitive sensor such as a CMOS sensor (called "CMOS Imager System" which provides the acronym CIS), or a CCD sensor. Such an optical lens is generally made up of a stack of optical elements comprising any combination of optical elements such as lenses, spacers and opacifiers, etc.

[0144] During the manufacture of the optical lens, each optical element of said lens is individually selected and stacked with the other optical elements in an assembly barrel, in a given order. The stack is then secured to the barrel by known techniques, for example by gluing.

[0145] In FIGURE 2, and by way of non-limiting example only, the optical lens 200 comprises four lenses 202-208 stacked, in a stacking direction 210, also called the Z axis, in a barrel 212. At least two of the lenses 202-208 may be separated from each other by an empty space, called an "air gap", or by a spacer, or washer, also called a "spacer".

[0146] At least one of the lenses 202-208 may for example be the lens 100 of FIGURE 1.

[0147] Each of the lenses 202-208 has two interfaces, namely an interface, called upstream, and an interface, called downstream, in the direction of the stack 210. Thus, the lens 202 has an upstream interface 214i and a downstream interface 2142, the lens 204 has an upstream interface 2143 and an interface downstream 2144, lens 206 has an upstream interface 214s and a downstream interface 214e and lens 208 has an upstream interface 214? and a downstream interface 214s.

[0148] Thus, for the optical objective 200 of FIGURE 2, and generally for any optical objective comprising a stack of optical elements, it is possible to determine a data set, called geometric set, noted JG in the following, comprising data relating to at least one geometric parameter of at least one, and in particular of each, optical interface 214i-214s of said stack.

[0149] Such a geometric game JG may include data relating to, or values ​​of, any of the following geometric parameters: - at least one position of at least one 214i-214s optical interface of the lens 200 along the Z axis; - at least one decentering value of at least one 214i-214s optical interface relative to the Z axis, or relative to a center position of another interface, in the XY plane; or - at least one tilt value of at least one optical interface 2141-2148 relative to the Z axis, or relative to the tilt of another interface; - at least one topography or shape profile value of at least one 214i-214s optical interface.

[0150] Generally, the geometric set JG can comprise for each optical interface of the optical lens M geometric parameters with M>1 and preferably M>2. If the optical lens comprises N optical elements, each optical element comprising two interfaces, then the geometric set JG can comprise 2NxM parameters and can correspond to a matrix comprising 2N rows and M columns. Of course, the geometric set JG can comprise the same number of geometric parameters for at least two optical interfaces, or different numbers of geometric parameters for at least two optical interfaces.

[0151] The geometric game JG can directly include the values ​​of the geometric parameters. These values ​​can be measured by optical interferometry or by confocal measurement(s), preferably from one side or face of the optical lens 200, so as to avoid rotating it.

[0152] FIGURE 3a is a schematic representation of a non-limiting exemplary embodiment of an optical interferometry measurement that may be implemented in the present invention.

[0153] The optical interferometry measurement is carried out by an optical interferometry device, or interferometric device, 300 shown very schematically in FIGURE 3a. The device 300 comprises a light source 302 and an interferometry sensor 304. The source 302 emits, in the direction of the stack of optical elements, a beam 306 of coherent light, called the measurement beam, at a measurement point, or according to a field of view, 308 in the XY plane, perpendicular to the direction 210. The measurement beam 306 then travels through the stack of optical elements, in particular in the Z axis 210 and passes through each optical interface 214i in turn. At each optical interface 214i, a portion 310i of the measurement beam 306 is reflected, such that: - a 310i beam is reflected by the 214i interface, - a 310s beam is reflected by the 214s interface,

[0154] Each reflected beam 310i of the measuring beam 306 is then captured by the sensor 304 which is also optically connected to the emission source 302, and will produce an interference signal when this reflected beam 310i and a reference beam 312, also originating from the light source 302, recombine on the sensor 304, the difference in the paths traveled by the two respective beams being less than the coherence length of the emission source 302. In particular, for each reflected beam 310i the sensor 304 provides an interference line, called the main line, or an interference image, depending on the illumination and detection modes implemented, at an optical distance corresponding to the position of the interface relative to the emission source 302, or any other predetermined reference. Of course, apart from the beam 310i reflected by the first interface 214i encountered by the measuring beam 306, a part of each of the others reflected beams 3102-3108 can itself be reflected in the other direction when passing a previous interface, which can generate multiple reflection optical beams (not shown) captured by the sensor 304. These multiple reflection beams generate interference lines, called secondary lines, or secondary images, generally of lower amplitude.

[0155] Optical interferometry measurements can be performed with a measurement beam of an interferometric sensor illuminated by a low-coherence light source. For this, the optical interferometry apparatus has positioning means for relatively positioning a coherence zone of the interferometric sensor 304 at the interface to be measured. The interface to be measured can be a buried interface, i.e., one of the interfaces inside the optical element. To arrive at such a buried interface, the measurement beam must therefore pass through other interfaces of the optical objective.The interferometric device makes it possible to selectively detect an interference signal for each interface at which the coherence zone is positioned, i.e. for each surface located in the coherence zone since the coherence length of the light source is adjusted so as to be shorter than a minimum optical distance between two adjacent optical interfaces of the optical objective. Thus, preferably, for each measurement, only one interface is located in the coherence zone.

[0156] Interference measurements can be made within a field of view determined by the device's measuring means. Measurements can thus be made either in the open field or by scanning the field of view.

[0157] Digital processing means can be configured to produce, from the interference signal, the value of a geometric parameter, of the interface measured according to the field of view, and in particular the values ​​of the geometric parameters listed above with reference to FIGURE 2.

[0158] Examples of interferometric apparatuses that can be implemented within the scope of the present invention are, for example, described in document WO2020 / 245511 A1.

[0159] FIGURE 3b gives a schematic and partial representation of raw measurement data obtained for an optical interferometry measurement, such as that described with reference to FIGURE 3a.

[0160] In this implementation example, illumination according to a measurement point is used, and the coherence zone is moved along the optical axis Z 210 using displacement means.

[0161] Thus, as described with reference to FIGURE 3a, each interference measurement provides raw data, or an interference signal, 320. The interference signal 320 comprises main lines 322i, each main line corresponding to an optical interface. For example, a main line 322i is obtained for the interface 214i, a main line 3222 for the interface 2142, etc. (the interface 214s not appearing in the example illustrated by FIGURE 3b).

[0162] The interference signal 320 also includes secondary lines corresponding to multiple reflections, and associated with the interfaces 2142-2148.

[0163] The optical position of each line is given on the abscissa and the normalized amplitude of each line is given on the ordinate.

[0164] As described above, the geometric parameters of each optical interface of the optical lens can be calculated from the interference lines. In particular: - the position along the Z axis of an optical interface can be determined as being the position of an interference line corresponding to said interface; - by carrying out several optical interferometry measurements, in particular in a central zone of the optical objective, and by following, on the several measurements, the position, along the Z axis, of the interference line associated with said interface, it is possible to determine the position of the APEX of said optical interface; - the position of the APEX of an optical interface makes it possible to determine the position of said interface relative to the Z axis, in the XY plane, and therefore its offset relative to the Z axis; - the inclination of an optical interface with respect to the Z axis can be determined by carrying out several optical interferometry measurements, in particular in a peripheral zone of the optical objective. By following, on the several measurements, the position in the Z axis, of the interference line associated with said interface, it is possible to determine the position of the interface along the Z axis at its edges, which makes it possible to determine the inclination of said interface with respect to the Z axis.

[0165] Thus, the geometric parameters of each optical interface of the optical lens can be determined from one or more interferometric measurements, carried out from one side of the optical lens without having to turn said lens over.

[0166] Of course, the invention is not limited to interferometric measurements. It can implement any type of optical measurements for determining the geometric parameters of the optical interfaces of the objective, such as for example confocal measurements.

[0167] FIGURE 4 is a schematic representation of a non-limiting exemplary embodiment of a method according to the invention for characterizing an optical objective.

[0168] The method 400 of FIGURE 4 can be used to characterize any type of optical objective for image acquisition, and more particularly the objective 200 of FIGURE 2.

[0169] The method 400 comprises a step 402 of determining, by optical measurement, geometric parameters of the optical interfaces of the objective. In particular, the determination of the geometric parameters of each optical interface can be carried out by optical interferometry, as described with reference to FIGURES 3a and 3b. Thus, step 402 provides a geometric set JG comprising values ​​of the geometric parameters of each interface of the optical objective, such as: - the position in the Z axis of the optical interface, - the position of the APEX of the optical interface, - the offset of the optical interface relative to the Z axis in the XY plane; - the inclination of the optical interface relative to the Z axis in the XY plane; - etc. The JG geometric set thus includes all the geometric values ​​allowing the optical objective to be modeled in digital form.

[0170] In a step 404, the optical lens is modeled in digital form, with a modeling tool.

[0171] In a step 406, one or more aberration matrices are measured using the digital model of the optical lens in an optical wave propagation simulator.

[0172] Step 406 may determine a unique aberration matrix for the optical lens.

[0173] Alternatively, step 406 may be repeated several times in different regions, denoted RJ, of the image sensor to determine at least one aberration matrix for each region of the image sensor.

[0174] Alternatively, or in addition, step 406 may be repeated several times for different lens-image sensor distances, denoted DOCj, to determine at least one aberration matrix for each distance DOCj.

[0175] Alternatively, or in addition, step 406 may be repeated several times for different lens-imaged scene distances, denoted DOSk, to determine at least one aberration matrix for each DOSk distance.

[0176] In the example described, it is considered that the step of determining an aberration matrix is ​​carried out for each combination RJ, DOCj, DOSk}. Considering that there are I different regions, J different DOC distances and K different DOS distances, step 406 is therefore repeated I x J x K times and therefore makes it possible to determine as many aberration matrices, noted MAijk.

[0177] Each aberration matrix MAijk includes representative values ​​of the optical aberrations introduced, in a captured image, by this region Rj of the optical lens for this distance DOCj between the optical lens and the image sensor, and for this distance DOSk between the optical lens and the scene.

[0178] Steps 404 and 406 may be performed using simulation software. Such simulation software may, for example, be Zemax®'s OpticStudio® software. Of course, the invention is not limited to this software and other tools may be used.

[0179] According to embodiments, all the aberration matrices are stored and the method 400 is terminated.

[0180] According to embodiments, the method 400 may comprise an optional step 408, of calculating a matrix, called aberration kernel matrix, noted MNA, comprising coefficients making it possible to deduce each aberration matrix, from said aberration kernel matrix.

[0181] Such an aberration kernel matrix can be calculated, as described above.

[0182] Thus, the aberration kernel matrix avoids having to memorize all the aberration matrices.

[0183] According to embodiments, the method 400 may comprise an optional step 410 of calculating a matrix, called a correction matrix, for each aberration matrix. The correction matrix may comprise the values ​​used to correct an image.

[0184] For each aberration matrix MAÿk, the correction matrix, denoted MCijk, can be determined.

[0185] According to exemplary embodiments, at least one correction matrix can be obtained by the relation: where Go is a function representing the form of the point dispersion function to be obtained after correction. It can be a function approaching a Dirac function in 2 dimensions, i.e. worth 1 at the center, and almost 0 around. Noting MTOBSÿk, the matrix of the test light beam as observed, and MT its native form as it is in reality during its emission, the correction matrix MCijk as follows: In a simplified form, we can assume that TF(GO) = 1, the constant function that returns 1 with zero phase at all frequencies, which is written as: with : - TF() the Fourier transform operator (in 2D) -TF -1 () the inverse Fourier transform operator (in 2D) - MCijk correction matrix for the Ri region of the image sensor, at the lens-sensor distance DOG and at the lens-scene distance DOSi; - MAijk the aberration matrix obtained by simulation for the Ri region of the image sensor and the DOG and DOSi distances; and - MTijk the test light beam matrix, i.e. the matrix describing the test light beam, used to measure by simulation the aberration matrix MAijk. - MTOBSijk the observed illumination matrix, obtained by simulation, in the sensor plane relative to the MTijk test matrix presented at the input of the objective.

[0186] According to embodiments, all the MCijk correction matrices can be stored for later reuse to correct an image.

[0187] Alternatively, the method 400 may comprise an optional step 412 of calculating a matrix, called the correction kernel matrix, denoted MNC, comprising coefficients making it possible to deduce each correction matrix from the correction kernel matrix. Such a correction kernel matrix MNC may be calculated in the same way as the aberration kernel matrix, using the same function base FAi or another function base.

[0188] Each aberration matrix MAijk can be a matrix indicating values: - a point spread function, or PSF, and - an optical transfer function, "Optical Transfer Function" or "OTF" in English; in response a test light beam. The determination of such a matrix is ​​well known to those skilled in the art and can be carried out by digital simulators such as Optic Studio ® from Zemax ®.

[0189] In summary, a test light beam is emitted onto a region presented in front of the optical lens. The test light beam enters the optical lens, passes through it and is received on an image sensor. The received radiation values ​​are compared with the input values, i.e., with the values ​​of the test light beam. This comparison makes it possible to deduce the aberrations introduced by the optical lens for each region.

[0190] FIGURE 5a is a schematic representation of a non-limiting exemplary embodiment of a method according to the invention for acquiring an image.

[0191] The method 500 of FIGURE 5a can be implemented in any type of image acquisition device using an optical lens associated with a photosensitive sensor, and in particular the lens 200 of FIGURE 2. The photosensitive sensor can be any type of sensor such as for example a CCD sensor or a CMOS sensor.

[0192] The device can be any type of device such as an imaging module, a smartphone, a tablet, a computer, a surveillance camera, etc.

[0193] The method 500 comprises a step 502 of acquiring an image by the apparatus using the optical lens and the sensor. The acquired image is in the form of a matrix of values, provided by the sensor, and denoted IMa. The matrix IM aincludes numerical values ​​for each pixel on the sensor. For example, for an RGB image, the IMa matrix includes three values ​​for each pixel, one for each color.

[0194] The acquired image, and therefore the IMa matrix, includes the optical aberrations introduced by the optical lens, such as for example optical blur or a displacement. It can be corrected, in part or in whole, by correcting the values ​​of the IM matrix a at least for some pixels. Image correction can be achieved using at least one correction matrix deduced from at least one aberration matrix previously determined for the optical lens.

[0195] Image correction can be achieved using a single correction matrix, denoted MC, for the entire lens. Alternatively, image correction can be achieved using several MG correction matrices, each for a region Ri of the image sensor, and therefore for a part of the image. In the following, without loss of generality, we consider that several MG correction matrices are used, each to correct the aberrations introduced by a region Ri of the sensor.

[0196] In the method 500 of FIGURE 5a, it is considered that the correction matrices are previously calculated, and stored in a memory area of ​​the device carrying out the acquisition of the image. In particular, each correction matrix can be determined during a characterization of the optical objective, as described with reference to the method 400 of FIGURE 4, in particular in step 410 of the method 400.

[0197] In this case, the method 500 comprises a step 504 of reading each correction matrix MG from the memory area of ​​the device.

[0198] Then during a step 506, the captured image is corrected using each correction matrix MG.

[0199] For example, by noting IM C the matrix of values ​​representing the corrected image, the correction of the image can be obtained by convolution of the matrix IMa by each correction matrix MG for the pixels concerned by the region Ri, in turn or at the same time: IMc = conv(IM a , MCi) with i = l, .., I and I>1

[0200] FIGURE 5b is a schematic representation of another non-limiting exemplary embodiment of a method according to the invention for acquiring an image.

[0201] The method 510 of FIGURE 5b comprises the steps 502 of acquiring an image and the steps 506 of correcting the image with one or more correction matrices.

[0202] Unlike method 500, in method 510, each correction matrix MG is not previously determined and stored in a memory area of ​​the device.

[0203] The method 510 comprises a step 512 of calculating each correction matrix: - from a correction kernel matrix, - from at least one predetermined aberration matrix, or - from an aberration kernel matrix. as described with reference to FIGURE 4.

[0204] In method 510, optionally, each correction matrix may be stored in the apparatus to be reused for the correction of at least one other image. In this case, steps 502 and 506 may be repeated several times using each correction matrix calculated in step 512, without having to perform step 512 at each iteration.

[0205] Step 512 can be performed: - when integrating the optical lens into the device, - when configuring the device, - when installing a photo application in the device, - when starting the said photo application, or - during image acquisition.

[0206] In the example of FIGURE 5b, the step 512 of calculating each correction matrix is ​​performed before the image acquisition step. Of course, according to other examples not shown, the step 512 of calculating each correction matrix can be performed during the image acquisition step 502, or after the image acquisition step 502, or at any time before the correction step 506.

[0207] FIGURE 5c is a schematic representation of another non-limiting exemplary embodiment of a method according to the invention for acquiring an image.

[0208] The method 520 of FIGURE 5c may comprise an optional step of determining a distance, denoted DOC, between the optical lens and the photosensitive sensor. The distance DOC may for example be measured by a distance sensor, such as an optical sensor, a magnetic sensor, a capacitive sensor, etc. The distance DOC may for example be calculated from information provided by an optical focusing mechanism modifying / adjusting the distance between the optical lens and the image sensor.

[0209] Alternatively, or in addition, the method 520 of FIGURE 5c may comprise a step of determining a distance, denoted DOS, between the optical objective and the scene. The DOS distance may for example be measured by a LIDAR, a time-of-flight camera, an ultrasonic sensor, etc. The DOS distance may be measured for different regions Ri of the image sensor. Alternatively, a single DOS distance may be measured for the entire objective.

[0210] Then, method steps 500 or 510 may be performed to correct the image. The correction matrix(s) used to correct the image may be selected in step 504, or calculated in step 512, based on the DOC and / or DOS distances determined in steps 522 and / or 524.

[0211] Thus, the acquired image is corrected by taking into account the DOC distance and / or the DOS distance, at the time of image acquisition, which allows better image correction.

[0212] The 520 method thus allows on-the-fly correction of an image, taking into account the precise conditions in which the image was taken.

[0213] FIGURE 6 is a schematic representation of a non-limiting exemplary embodiment of a system according to the invention for characterizing an optical objective.

[0214] The system 600 of FIGURE 6 can be used to characterize any type of optical objective used for image acquisition, and more particularly the objective 200 of FIGURE 2.

[0215] The system 600 of FIGURE 6 can be used to implement a method according to the invention for characterizing an optical objective, and in particular the method 400 of FIGURE 4.

[0216] The system 600 comprises a device 602 for optical measurement of at least one geometric clearance, denoted JG, comprising data relating to at least one geometric parameter of at least one optical interface of an optical objective, such as for example the objective 200 of FIGURE 2. The device 602 may be the interferometer 300 of FIGURE 3. The device 602 may alternatively be a confocal measurement device configured to measure the geometric clearance JG.

[0217] The system 600 further comprises a computing unit 604 configured to: - digitally modeling the optical lens as a function of the geometric clearance JG provided by the optical measuring device 602; and - determining, by optical wave propagation simulation applied to said digital model of the optical lens, at least one aberration matrix, representative of optical aberrations introduced by said optical lens in an image.

[0218] The calculation unit 604 can execute a modeling interface 606 taking as input the geometric set JG and a digital optical wave propagation simulator 608 to measure the at least one aberration matrix. According to embodiments, the modeling interface 606 and the digital simulator can be integrated into the same computer tool, in particular software, such as for example the OpticStudio software from Zemax.

[0219] The calculation unit 604 may optionally comprise a calculation module 610 configured to calculate: - at least one aberration kernel matrix, - at least one correction matrix, or - at least one correction kernel matrix; from the at least one aberration matrix determined by the digital simulator 608. The calculation module 610 may be a physical module such as a processor, a chip, a calculator, or a software module such as a computer program or a software application.

[0220] The computing unit 604 may be in a hardware form, such as a computer, or a server for example. Alternatively, the computing unit 604 may be in a software form, such as one or more computer programs. According to yet another alternative, the computing unit 604 may be formed by any combination of at least one hardware means and at least one software means.

[0221] FIGURE 7 is a schematic representation of a non-limiting exemplary embodiment of a device according to the image acquisition invention.

[0222] The device 700 of FIGURE 7 can be used to implement a method according to the invention for acquiring an image, and in particular any one of the methods 500, 510 and 520 of FIGURES 5a, 5b and 5c.

[0223] The device 700 comprises an optical lens 702, which may be, for example, the optical lens 200 of FIGURE 2.

[0224] The device 700 further comprises a photosensitive sensor 704, cooperating with the optical lens 702 to take an image of a scene. The image sensor 704 is designed to provide a matrix of values, denoted IMa, representing the acquired image of the scene.

[0225] Optionally, the device 700 may comprise a sensor 706 provided for measuring the distance DOC between the optical lens and the image sensor 704. Such a sensor 706 may be a capacitive sensor, a resistive sensor or even an image sensor. This sensor 706 provides a distance value, or a value of an electrical quantity representative of the distance DOC, such as for example a voltage, a current, etc.

[0226] Optionally, the device 700 may comprise a sensor 708 intended to measure the DOS distance between the optical objective and the imaged scene. Such a sensor 708 may be a LIDAR sensor for example. This sensor 708 provides a distance value, or a value of an electrical quantity representative of this DOS distance, such as for example a voltage, a current, etc.

[0227] The device 700 further comprises a calculation unit 710 configured to correct the image captured by the sensor 704, and in particular the IM matrix a , and provide a matrix, denoted IM C , representing the corrected image, based on at least one correction matrix.

[0228] The computing unit 710 may be a hardware unit such as a processor or a computer chip. Alternatively, the computing unit may be a computer program or an application.

[0229] According to one embodiment, for example described with reference to FIGURE 5a, the at least one correction matrix can be read from a memory area, or a database, 712. In this case, the calculation unit 710 reads said at least one correction matrix, optionally the at least one matrix associated with the DOC and / or DOS distances measured during image capture.

[0230] According to one embodiment, for example described with reference to FIGURE 5b, the calculation unit 710 can further be configured to calculate the at least one correction matrix, as a function of: - a correction kernel matrix, - at least one predetermined aberration matrix, or - an aberration kernel matrix; stored in the database 712. In this case, the calculation unit reads said at least one matrix and calculates the at least one correction matrix from said at least one read matrix, and optionally the DOC and DOS distances.

[0231] The optical lens 702, the sensor 704, and optionally the sensors 706 and 708 form an imaging module, also called a camera module 714. The camera module 714 may include other components than those shown, such as for example a focus adjustment mechanism (not shown) modifying the distance between the image sensor 704 and the optical lens 702.

[0232] The computing unit 710, and optionally the database 712, can be integrated into a photo application, 716, installed or executed within a device such as a Smartphone, a tablet, a computer, etc.

[0233] FIGURE 8 is a schematic representation of a non-limiting exemplary embodiment of an image acquisition apparatus according to the invention.

[0234] The apparatus 800 comprises a device according to the invention for acquiring an image, and in particular the device 700 of FIGURE 7.

[0235] According to embodiments, the device 800 may be a camera, a tablet or a smartphone, a computer, a surveillance camera or a camera module intended to be integrated into another device, etc.

[0236] In the example shown, the device 800 is a Smartphone comprising a display screen on the front face and the optical module 714 opening onto its rear face, a photo application 716 integrating the calculation module and the database 712.

[0001] Of course, the invention is not limited to the examples which have just been described.

Claims

DEMANDS 1. A method (400) for characterizing an optical lens (200) comprising a stack of several optical elements (202-208) and intended to be associated with an image sensor (704) for image acquisition, said method (400) comprising the following steps: - determination (402), by optical measurement on said stack of optical elements, of at least one data set (JG), called geometric set, comprising data relating to at least one geometric parameter of at least one buried optical interface (2142-214s) of said objective (200), - numerical modeling (404) of said optical lens (200) as a function of said geometric clearance (JG), and - determination (406), by a digital simulator (608) of optical wave propagation applied to said digital model, of at least one matrix, called an aberration matrix, representative of optical aberrations introduced by said optical lens (200) in an image.

2. Method (400) according to the preceding claim, characterized in that it comprises a determination of several aberration matrices for several regions of the image sensor (704).

3. Method (400) according to any one of the preceding claims, characterized in that it comprises a determination of several aberration matrices for several values ​​of a distance, called lens-sensor distance, DOC, between said optical lens (200) and an image plane, the digital simulator (608) taking said lens-sensor distance as input.

4. Method (400) according to any one of the preceding claims, characterized in that it comprises a determination of several aberration matrices for several values ​​of a distance, called lens-scene distance, DOS, between said optical lens (200) and a scene, the digital simulator taking said lens-scene distance as input.

5. Method (400) according to any one of the preceding claims, characterized in that it comprises a step (408) of calculating a matrix, called kernel aberration matrix, comprising coefficients allowing at least one aberration matrix to be deduced.

6. Method (400) according to any one of the preceding claims, characterized in that it further comprises a calculation step (410) of calculating, as a function of at least one aberration matrix, at least one correction matrix comprising values ​​for correcting an image captured with said optical lens (200).

7. A method (400) according to any one of the preceding claims, characterized in that at least one aberration matrix is: - a matrix, called the PSF matrix, of values ​​of a point spread function (or "PSF" in English), and / or - a matrix, called an OTF matrix, of values ​​of an optical transfer function (“Optical Transfer Function” or “OTF” in English).

8. A method according to any one of the preceding claims, characterized in that at least one geometric set (JG) is obtained by optical interferometry, or by confocal measurement(s).

9. A system (600) for characterizing an optical lens (200) comprising a stack of several optical elements (202-208) and intended to be associated with an image sensor (704) for image acquisition, said system (600) comprising: - an optical measuring device (602;300), on said stack of optical elements (202-208), of at least one data set (JG), said geometric set, comprising data relating to at least one geometric parameter of at least one buried optical interface (2142-2148) of said objective (200); - at least one computing unit (604) configured for: ■ to numerically model said optical objective (200) as a function of said geometric set (JG); and ■ determine, by numerical simulation of optical wave propagation applied to said numerical model, at least one matrix, called aberration matrix, representative of optical aberrations introduced by said optical lens (200) in an image.

10. Method (500;510;520) for acquiring an image with a device (800) comprising an optical lens (200;702) and an image sensor (704), said method (500;510;520) comprising the following steps: - capturing (502) an image with said optical lens (200;702) and said image sensor (704); and - correction (506) of said image as a function of at least one correction matrix calculated from at least one aberration matrix obtained, for said optical lens (200;702), by the method (400) of characterizing an optical lens according to any one of claims 1 to 8.

11. Method (510;520) according to the preceding claim, characterized in that it comprises a step (512) of calculating at least one correction matrix within said apparatus (800).

12. Method (520) according to any one of claims 10 or 11, characterized in that it further comprises a step (522) of determining a distance, DOC, between the optical objective (200;702) and an image plane, the correction taking into account said distance DOC.

13. Method (520) according to any one of claims 11 to 13, characterized in that it further comprises a step (200;702) of determining a distance, DOS, between the optical objective (200;702) and a scene, the correction taking into account said distance DOS.

14. Image acquisition device (700) comprising: - an optical lens (200;702) comprising a stack of several optical elements (202-208), - an image sensor (704), and - a computing unit; configured to implement the process (500;510;520) according to any one of claims 10 to 13.

15. Image acquisition device (800), such as a camera, tablet or smartphone, comprising an image acquisition device (700) according to the preceding claim.