METHOD AND CAMERA FOR CORRECTING Geometric aberrations IN IMAGE RECORDING

By establishing a deformation model and utilizing the geometric relationship of the image sensor, the problem of image sensor positioning and correction in digital cameras is solved, and the precise correction of geometric aberrations is achieved, and imaging accuracy and image quality are improved.

CN118922856APending Publication Date: 2024-11-08VEXCEL IMAGING GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380026422.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-09
Filing Date
2023-03-07
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

In high-precision imaging applications, it is difficult to achieve simple and accurate positioning and correction of image sensors, resulting in the impact of imaging accuracy by geometric aberrations, especially the deformation caused by the pressure difference between the sensor housing and the cover is difficult to effectively compensate.

Method used

By establishing a deformation model, correcting the pressure difference and deformation relationship of the image sensor during recording, the geometric shape relationship between the transparent cover and the sensor layer is determined and corrected to ensure that the object point is imaged on the expected image point .

Benefits of technology

Simple and precise correction of geometric aberrations in digital cameras is achieved, the quality of image recording is improved, and imaging accuracy is enhanced, especially in high-precision applications such as geospatial informatics and photogrammetry.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118922856A_ABST
    Figure CN118922856A_ABST
Patent Text Reader

Abstract

In order to accurately correct the influence on the imaging accuracy of the camera occurring during the operation of the camera, a deformation (V) of the transparent cover (5) and / or of the sensor layer (4) caused by a pressure difference (D) between the internal pressure (pi) in the sensor recess (3) and the ambient pressure (P2) of the camera (10) is modeled by means of a deformation model (20), during image recording (B ') by means of the camera (10), a currently prevailing pressure difference (D) is determined on the basis of an internal pressure (p1) of the camera (10) known during image recording (B') and an ambient pressure (p2), and a deformation (V) of the transparent cover (5) and / or of the sensor layer (4) during image recording (B ') is determined using the determined pressure difference (D) by means of a deformation model (20), from the determined deformation (V) and a known geometric dimension of the image sensor (1), a displacement of the imaging of the object point (G) caused by the deformation (V) onto the actual image point (P ") generated in the image record (B ') is determined as a geometric aberration (A), and the determined geometric aberration (A) in the image record (B') is corrected in order to determine a corrected image record (B).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for correcting geometric aberrations of a camera having an image sensor, the sensor consisting of a sensor housing, a sensor layer arranged in a sensor recess of the sensor housing and having a plurality of image points (pixels), and a transparent cover sealingly closing the sensor housing relative to the outside, wherein (one) object point of an object photographed (recorded) by the camera is imaged onto (one) image point (pixel) of the sensor layer. The invention also relates to a correspondingly formed camera.

[0002] In digital cameras, image sensors, such as CCD (charge coupled device) sensors or active pixel sensors (often also referred to as "CMOS sensors"), are used to record (shoot) digital images. The image sensor is arranged in the image plane of the digital camera and converts the incident light (photons) into electrical signals, which are sensed and represent digital images. The image sensor is usually composed of a suitable sensor housing and a transparent cover that closes the sensor housing. The sensor housing is usually composed of a ceramic material, in which an electro-optical sensor composed of a thin electro-optical sensor layer is arranged. The sensor layer is usually glued into the housing and connected to the housing. In order to be able to capture clear images, it is important to arrange the image sensor in alignment with the optical system of the digital camera and in a defined position so that the object captured by the digital camera can be accurately imaged in the image plane. In particular, the application of digital cameras in the fields of large-format photography, geospatial informatics or photogrammetry places high demands on the imaging accuracy.

[0003] Therefore, it is known to arrange image sensors in digital cameras with high precision. For example, WO 2021 / 069382A1 describes a sensor holder adapted to an image sensor so that the image sensor can be positioned with high precision in a digital camera with the aid of the sensor holder. EP 1 475960A2 describes aligning a cover of an image sensor with the image sensor. A disadvantage here is that the initial alignment or positioning is fixed and can no longer be changed subsequently.

[0004] Therefore, it is also known to arrange image sensors in digital cameras in a movable or adjustable manner. This is shown, for example, in EP 2 485 474 A1. On the one hand, such an adjustment is complex in construction. On the other hand, such a mechanical adjustment can hardly achieve the highly precise orientation (alignment) or positioning required for the above-mentioned applications. Last but not least, in the case of active adjustment, the deviation from the target position must also be determined in order to be able to compensate for it by adjustment, which further increases the complexity.

[0005] DE 100 13 567 A1 follows a similar approach, which however leads to the same difficulties. From this document it is known to counteract focus drift by shifting the focus as a function of temperature and air pressure in order to improve the image sharpness of an aerial camera (aerial survey camera). Here, the required focus shift is simulated with the aid of a correction table, wherein a piezoelectric shifter is controlled with the aid of a suitable control signal so that the focal plane is shifted along the optical axis to counteract the focus drift.

[0006] The influences on imaging accuracy that occur during the use of digital cameras can either not be compensated at all using known methods (such as in WO 2021 / 069382A1 or EP 1 475 960 A2), or can only be compensated to a limited extent or with great effort (such as in EP 2 485 474 A1 or DE 100 13 567A1).

[0007] Therefore, it is necessary to perform simple but accurate correction on the influence on the imaging accuracy of the digital camera that occurs during the operation of the digital camera.

[0008] This object is achieved by the method mentioned at the outset and by the digital camera mentioned at the outset having the features of the independent claims.

[0009] It has been recognized that the image sensor, in particular the transparent cover and / or the sensor layer, undergoes mechanical (mechanical) deformation due to the pressure difference between the pressure in the sensor recess of the image sensor and the ambient pressure of the camera at the moment of image recording. This deformation causes the imaging of the object point captured by the camera in the image recording (or at the sensor layer) to shift in the form of geometric aberrations. This displacement (amount) can be modeled so that the displacement (amount) can be determined based on the pressure difference acting at the moment of image recording and can be corrected during image recording. A deformation model is used for modeling, which models the relationship between the pressure difference acting at the moment of image recording and the deformation (amount). The deformation model can be calibrated in advance for a specific image sensor, for example based on measurements (values) at the image sensor, and can then be used when the camera is in operation.

[0010] In this way, geometrical aberrations in the image recording can be corrected, which have not been corrected to date. The quality of the image recording (image acquisition) can thereby be improved.

[0011] Advantageously, the geometrical aberration is determined as the displacement between the imaging of the object point onto the expected image point in the case of an undeformed transparent cover and / or an undeformed sensor layer and the actual imaging of the object point onto the actual image point generated due to the deformation. This can be realized in a simple manner because simple geometric relationships at the image sensor are taken into account in this case, taking into account the laws of refraction.

[0012] The quality of the image recording can be further improved if the deviation caused by the optical refraction at the undeformed transparent cover is also taken into account in the geometrical aberrations. Thus, a geometrical aberration known to date can also be corrected in the same step.

[0013] Correction of geometric aberrations in the image acquisition can be achieved in a simple manner by shifting the image of an object point onto the actual image point generated in the image acquisition to another image point in the corrected image acquisition with geometric aberrations.

[0014] In the following we will refer to Figures 1 to 6 To explain the present invention in more detail, Figures 1 to 6 The advantageous design of the present invention is shown by way of example, schematically and not restrictively. The accompanying drawings show:

[0015] Figure 1 An embodiment of an image sensor having a sensor housing, a sensor layer and a transparent cover is shown.

[0016] Figure 2 shows the geometric aberration caused by the deformation of the transparent cover,

[0017] Figure 3 shows the geometric aberration caused by the deformation of the sensor layer,

[0018] Figure 4 shows the use of image sensors in cameras,

[0019] Figure 5 shows a simplified diagram for correcting geometric aberrations, and

[0020] Figure 6 An arrangement for determining or calibrating a deformation model is shown.

[0021] Figure 1, an image sensor 1 is shown in a typical embodiment. A sensor layer 4 is arranged in a sensor recess 3 of a sensor housing 2, which forms an electric field optical sensor. The sensor housing 2 is usually made of a ceramic material. The sensor housing 2 is completely sealed and closed relative to the external environment by a transparent cover 5 (usually made of glass). Except for the part closed by the transparent cover 5, the sensor recess 3 is surrounded by the sensor housing 2. The sensor layer 4 is usually connected to the sensor housing 2, for example glued at the bottom of the sensor recess 3, usually opposite the transparent cover 5. For simplicity, Figure 1 Not shown are the electrical connections known per se which are necessary for making electrical contact with the sensor layer 4 from the outside.

[0022] The sensor layer 4 comprises an arrangement (structure) of a plurality of electric field optical detectors, each of which forms an image point (pixel) of the sensor layer 4 and thus also a pixel of the image recording (image acquisition) B.

[0023] The sensor layer 4 can also be designed with multiple channels, for example as an RGB sensor. The individual electro-optical detectors of the sensor layer 4 can also be provided with different color filters accordingly, so that separate wavelength ranges of light can be imaged by means of the image sensor 1. Such embodiments of the image sensor 1 are sufficiently known.

[0024] Due to the known optical properties of the optical system of the camera 10 with the image sensor 1 and also due to the known geometry of the image sensor 1 and the camera 10 as well as the positioning of the image sensor 1 in the camera 10, each object point G of an object recorded (photographed) by the camera 10 with the image sensor 1 (see also Figure 4 ) are imaged onto the image point P of the sensor layer 4 in the image plane 7, i.e. they can be assigned to the image point P of the camera 10. Figure 1 The optical system of the camera 10 includes a lens 11 and may also include other optical components, such as an aperture, an optical filter (filter), a shutter, etc. The projection center O of the lens 11 (at Figure 1 ) can be arranged at a known focal length f from the image plane 7 B The sensor layer 4 of the image sensor 1 is arranged in an image plane 7 .

[0025] The projection center O does not have to be arranged centrally relative to the sensor layer 4 , but the sensor layer 4 can also be arranged off-center and / or asymmetrically to the projection center O. It is also conceivable that a plurality of image sensors 1 are arranged in the camera 10 , which can also result in an image sensor 1 or its sensor layer 4 being arranged off-center relative to the projection center O and relative to the optical axis, which extends through the projection center O and orthogonally to the image plane 7 .

[0026] A light ray 6 starting from an object point G at the photographed object and travelling through the projection centre O is refracted at the transparent cover 5 according to known laws of refraction and meets (impacts) the image plane 7 at the image point P' instead of at the actual image point P with an offset L, depending on the current, known refractive indices (e.g. the transition from air to glass at the outer interface 5a and from glass to air at the inner interface 5b).

[0027] However, the lens 11 naturally transmits, in a known manner, all the light rays emanating from the object point G at the object being photographed that travel through the lens 11 (see Figure 4 ) is focused on the image point P. However, for simplicity, Figure 1 Only the light ray 6 in the light beam extending through the projection center O is shown.

[0028] It should also be noted that the refractive index at the outer interface 5a of the transparent cover 5 is not necessarily the same as the refractive index at the inner interface 5b from the transparent cover 5 into the sensor housing 2. However, it can be assumed that the refractive indices at both optical interfaces 5a, 5b are known.

[0029] The offset L results from the known refractive index on the basis of the laws of refraction and the known geometrical dimensions of image sensor 1 , in particular the thickness of transparent cover 5 and the distance between inner surface 5 b of transparent cover 5 and sensor layer 4 .

[0030] It is known that the influence of the optical refraction at the transparent cover 5 of the image sensor 1 on the recorded image can be mathematically mapped (mathematically reflected) and compensated in the image record B, for example by shifting the image of the object point G from the point P' in the image record B' by an offset L to the image point P ( Figure 1 ). The more the incident angle δ1 of the light ray 6 deviates from the surface normal of the transparent cover 5, the greater this geometric (shape) aberration caused by refraction. Therefore, the offset L is usually not constant over the entire image plane 7.

[0031] The image sensor 1 or the sensor layer 4 is usually two-dimensional, so that the displacement L in the image plane 7 is caused by refraction in two coordinate directions (eg x and y, see Figure 6 The offset L at the image point P in the image plane 7 (in both coordinate directions) results as a function of the angle of incidence δ1 of the light ray 6, the current refractive index and the geometry of the image sensor 1 and, if applicable, also of the position of the image sensor 1 in the camera 10 (in particular when the image sensor is arranged eccentrically with respect to the optical axis).

[0032] However, in (high) precision applications such as geomatics or photogrammetry, it has been found that despite compensation of the refraction-induced deviations L, there are still discernible geometrical aberrations A in the image recording B, which limit the quality of the image recording B. It has been recognized that the geometrical aberrations A that are present are due to the embodiment of the image sensor 1.

[0033] After the sensor recess 3 in which the sensor layer 4 is arranged is sealed by the transparent cover 5, a certain gaseous medium and a certain internal pressure p1 are present in the sensor recess 3 due to production. For example, if an image is taken from an aircraft with the image sensor 1, an ambient pressure p2 different from the internal pressure p1 prevails in the area of ​​the camera 10 in the aircraft with the image sensor 1. Since the image sensor 1 is produced at a much lower altitude than the flight altitude of the aircraft during the image acquisition, the internal pressure p1 enclosed in the sensor recess 3 is usually greater than the ambient pressure p2 when the camera 10 is used. However, the internal pressure p1 can of course also be less than the ambient pressure p2 when the camera 10 is used. In this case, the transparent cover 5 is deformed due to the pressure difference D. If the internal pressure p1 in the sensor recess 3 is greater than the ambient pressure p2, the transparent cover 5 is, for example, bulged outwards. If the sensor housing 2 is not strong enough, the sensor housing 2 and thus the sensor layer 4 can also be deformed, for example, bulged outwards, if the internal pressure p1 is greater than the ambient pressure p2.

[0034] Preferably, the pressure difference D is expressed as a pressure difference value (p2-p1), or as a power of the pressure difference value, or as a quotient of two pressures (p2 / p1), wherein the pressure difference D may also be expressed in other ways. The pressure difference D may also be expressed as the difference between the pressure difference value at a first altitude and the pressure difference value at another altitude.

[0035] However, the internal pressure p1 can also be influenced by other physical effects, in particular by the temperature in the region of the image sensor 1. According to Amontons law, the pressure of a gas enclosed in a constant volume depends on the temperature T according to the following relationship: p1(T)=p0(1+γ0(T1-T0)). Therein, p1 denotes the pressure at temperature T1, corresponding to the prevailing internal pressure p1, T0 denotes the initial temperature (e.g. the temperature prevailing during the manufacture of the image sensor or some assumed temperature), and γ0 denotes the volume expansion coefficient at the initial temperature T0, which can be assumed to be known for the gas enclosed in the image sensor 1. The temperature T can be measured, for example, by means of a temperature sensor 13 at the image sensor 1. Amontons law can also be expressed in a simplified form application.

[0036] For the application of Amonton's law, the volume in the image sensor 1 can be considered approximately constant, since the image sensor 1 deforms only slightly. However, one can also model this effect together, for example by applying the known thermal state equation for an ideal gas.

[0037] The consequences of the deformation caused by the pressure difference D in the image sensor 1 will be described with reference to Figure 2 and Figure 3 An explanation is given, wherein this effect is shown greatly exaggerated for the sake of illustration.

[0038] exist Figure 2 , a portion of the transparent cover 5 is shown in dashed lines in an undeformed initial position. Due to the law of refraction, a light ray 6 arriving from an object point G is refracted at the transparent cover 5, at the two interfaces 5a, 5b, and leaves the transparent cover 5 in the form of a light ray 6', which encounters (hit) the sensor layer 4 at the image point P'. Due to the deformation of the transparent cover 5 caused by the pressure difference D, in the example shown, the transparent cover 5 is arched outwards and the orientation of the normals to the interfaces 5a, 5b changes. As a result, the angle δ1 of the incident light ray 6 relative to the normal of the outer interface 5a is also changed, and the angle δ3 of the outgoing light ray 6" relative to the normal of the inner interface 5b is also changed. Therefore, due to the deformation, the refraction of the light 6 is different compared to the undeformed transparent cover 5. Therefore, the outgoing light ray 6" encounters (hit) the sensor layer 4 at another image point P", which causes a geometric (shape) aberration A. Therefore, the object point G is no longer imaged onto the image point P' (as expected), but is imaged onto another actual image point P" of the sensor layer 4.

[0039] The reference numerals 6 ′, 6 ″ are used to denote the refracted light ray, the emerging light ray, for illustrative purposes only. However, the light ray 6 remains unchanged of course.

[0040] exist Figure 3 , the undeformed sensor housing 2 and a part of the undeformed sensor layer 4 are shown as dashed lines. The light ray 6 arriving from the object point G encounters (hit) the undeformed sensor layer 4 at the image point P'. However, due to the deformation of the sensor layer 4 caused by the pressure difference D, in the example shown, the sensor layer 4 arches outwards and the light ray 6 encounters (hit) the sensor layer 4 at the image point P", which also leads to a geometric (shape) aberration (geometrischer Abbildungsfehler) A. As a result, the object point G is no longer imaged onto the image point P' (as expected), but onto another actual image point P" of the sensor layer 4.

[0041] The geometrical aberration A is therefore understood to be a shift of the image of the object point G from an expected image point P′ of the sensor layer 4 to another actual image point P″ of the sensor layer 4 .

[0042] Reference Figure 2 and Figure 3 The two effects of the deformation explained can occur simultaneously (which is usually the case), but can also occur separately. The geometrical aberration A can therefore be caused by one of these effects or by both effects. The resulting geometrical aberration A manifests itself, for example, as a distortion and / or a distortion of the captured image. Such a geometrical aberration A can occur in every image point P of the image plane 7, or can also occur only in certain image points P, but is not constant in the entire image plane 7.

[0043] Due to the prevailing (prevailing) pressure difference D between the internal pressure p1 in the sensor recess 3 and the ambient pressure p2 of the camera 10 at the time of image recording with the camera 10 having the image sensor 1, knowledge of the deformation V of the transparent cover 5 and / or the sensor layer 4 in the sensor housing 2 can be used to correct the geometrical aberration A caused thereby in the image recording B' to obtain a corrected image recording B. For this purpose, an evaluation unit 21 can be provided, which can also be part of the camera 10.

[0044] For example, the start of exposure, or the end of exposure, or a time between the start of exposure and the end of exposure can be regarded as the time of image recording B′.

[0045] The geometrical aberration A can be determined and corrected for each image point P (pixel) of the digital recording (digital recording), but it does not necessarily have to be determined and corrected for each image point P.

[0046] Here, as will be done below, reference may also be made to Figure 4 and Figure 5 .

[0047] At the time of image recording B', the internal pressure p1 in the image sensor 1 can be assumed to be known. For example, the internal pressure p1 corresponds to the pressure at the time of production of the image sensor 1, which can also be approximated by standard conditions (T0 = 273 K, p1 = 1.01325 bar). For example, possible temperature influences on the internal pressure p1 can be determined with the aid of Amonton's law. For this purpose, the temperature currently present in the image sensor 1 at the time of image recording B' can be sensed by the temperature sensor 13 and the current internal pressure p1 can be calculated.

[0048] Likewise, at the moment of image recording B', the ambient pressure p2 at the image sensor 1 or at the camera 10 can be assumed to be known. For example, the camera 10 is fastened to a vehicle 12, such as an aircraft. The ambient pressure p2 can be sensed by a pressure sensor, for example in the case of a road vehicle, or can be determined from the known flight altitude h according to the barometric altitude formula, for example in the case of an aircraft. Of course, the ambient pressure p2 can also be sensed with the aid of a pressure sensor in the case of an aircraft. If the camera 10 is arranged in a pressurized cabin of the aircraft, the ambient pressure p2 corresponds, for example, to the pressure in the pressurized cabin. However, the camera 10 does not necessarily have to be arranged at the vehicle 12.

[0049] Therefore, the pressure difference D currently existing at the time of the image recording B′ can also be assumed to be known or determined (calculated).

[0050] A deformation model 20 is used, which models the deformation (amount) V of the transparent cover 5 and / or the sensor layer 4 caused by the pressure difference D between the internal pressure p1 in the sensor recess 3 of the image sensor 1 and the ambient pressure p2 of the image sensor 1 or the camera 10. The deformation (amount) V can be generally expressed as a function f of the pressure difference D, i.e., V=f(D) by the deformation model 20. The deformation model 20 describes the relationship between the pressure difference D and the deformation (amount) V of the transparent cover 5 and / or the sensor layer 4.

[0051] For example, the deformation model 20 can be implemented in the evaluation unit 21 ( Figure 5 ). The evaluation unit 21 can be a computer or microprocessor-based hardware. An implementation as an integrated circuit, such as an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit) is also conceivable. The deformation model 20 can be implemented as software executed on a microprocessor, but can also be stored in a table form or as a mathematical formula or function.

[0052] How the deformation model 20 is specifically implemented is not important to the invention and various modelings are conceivable, as will be explained in more detail further below.

[0053] With the aid of deformation model 20 , a deformation (amount) V of transparent cover 5 and / or sensor layer 4 at the time of image recording B′ can be determined from the pressure difference D known at the time of image recording B′.

[0054] From the determined deformation (amount) V and the known geometric dimensions of the image sensor 1, it can be determined (calculated) at which image point P" of the sensor layer 4 the light 6 sensed by the camera 10 actually encounters (hit) the sensor layer 4, and at which image point P' the light 6 should impinge (encounter) the sensor layer 4 without the deformation V. Since these are simple geometric shape relationships, they can be easily determined. This determined shift (amount) between the actual image point P" and the expected image point P' represents the geometric aberration A of the image point P, which can be corrected in the image record B' to correct the geometric aberration A. To this end, the imaging of the object point G is shifted from the image point P" in the image record B', for example, with the geometric aberration A to the image point P' of the corrected image record B. In the process, on the undeformed image sensor 1 (see above) Figure 1 ) can also be corrected. This offset L can also be corrected later. However, this offset L can also be taken into account in the geometric aberration A so that it is corrected to the image point P together with the geometric aberration A.

[0055] Although in the description, for simplicity, the geometric aberration A of the image point P is described as a shift in one coordinate direction (x or y), it is obvious that due to the deformation amount V, the geometric aberration A usually occurs in two coordinate directions of the sensor layer 4 for the image point P. When it comes to the correction of the geometric aberration A, it is understood that it is the following two items, that is, the shift in only one coordinate direction or the shift in two coordinate directions of the sensor layer 4 (which is the usual case).

[0056] Correction of geometrical aberrations A in the image recording B' due to deformations V of the transparent cover 5 and / or the sensor layer 4 can be carried out in the correction unit 22. The correction unit 22 can be integrated in the evaluation unit 20 and can be implemented, for example, in the form of software. However, the correction unit 22 can also be hardware (computer, microprocessor-based hardware, integrated circuit) separate from the evaluation unit 21.

[0057] The image record B corrected with respect to the geometrical aberration A can then be used further as desired, for example by subjecting the corrected image record B to further optical corrections, such as known deblurring, or by evaluating the corrected image record depending on the application scenario.

[0058] The correction of the geometric aberration A of the image point P" can be performed immediately after the image recording B' or at a later time. If the correction is performed at a later time, the pressure difference D existing at the time of the image recording B' is also stored together with the image recording B', so that the deformation (amount) V can be determined later.

[0059] To determine the deformation model 20, one can refer to Figure 6 , as is done below.

[0060] The image sensor 1 is arranged in a pressure chamber 30, and a certain pressure p is set in the pressure chamber 30. D If necessary, a certain temperature can also be set (adjusted) in the pressure chamber 30, or the temperature can be kept constant. A measuring device 31 is provided in or on the pressure chamber 30, by means of which the deformation (amount) V of the transparent cover 5 and / or the sensor layer 4 or the part of the sensor housing on which the sensor layer 4 is mounted is measured.

[0061] The measurement of the deformation (amount) V can be carried out by means of any direct or indirect, preferably contactless, measuring device 31 suitable for this purpose. Examples of suitable measuring devices include: mechanical measuring devices that determine the shape by means of tactile scanning (sensing), such as micrometers (micrometers) or calipers (gauges / gauges); optical measuring systems with image sensors, line sensors and / or pixel sensors, such as one-dimensional, two-dimensional and three-dimensional laser displacement sensors; measuring devices with imaging sensors, in which the determination of the deformation is carried out by image evaluation; and measuring devices that use the above-mentioned measuring methods in combination. A preferred example of the measuring device 31 is an optomechanical measuring device, in which the positioning of the image sensor 1 is carried out mechanically and the measurement is carried out optically. For example, the opto-mechanical measurement of the image sensor 1 can be carried out by known industrial optical three-dimensional measuring systems. An example of a usable optomechanical measuring device is a device manufactured by the American company Micro Vu in Windsor, CA under the name "Vertex 251UC".

[0062] In order to be able to carry out (the measurement of) the deformation V of the transparent cover 5 by means of optical methods, visible points can also be arranged on the transparent cover 5 during the measurement.

[0063] By means of the measuring device 31, the pressure difference D set in the pressure chamber 20 is measured at a plurality of measuring points M ( Figure 6 The deformation V of the transparent cover 5 and / or the sensor layer 4 is shown in FIG. 1 . A plurality of measuring points M are distributed in the plane of the transparent cover 5 and / or the sensor layer 4 (in FIG. 1 ). Figure 6 The deformation V is thus also depicted (imaged) two-dimensionally. The position of the measuring point M can be given, for example, with respect to a coordinate system at the image sensor 1 .

[0064] However, it is not important with which measured variable the deformation V is depicted (imaged). For example, the deformation V can be measured as the distance between an undeformed reference position and the actual position of the measuring point of the transparent cover 5 and / or the sensor layer 4 (e.g., along Figure 6 In the Z direction). Thus, for the transparent cover 5, the normals of the interfaces 5a, 5b of the deformed transparent cover 5 can also be determined. In the undeformed reference position and at a certain pressure difference D, the difference between the normals of the interfaces 5a, 5b can also be determined and depicted (imaged) by the deformation (amount) V. The normal can be given, for example, as a vector in the coordinate system of the image sensor 1.

[0065] The deformation amounts V measured at the measuring points M may be stored in a table format and used as the deformation model 20. Then, when the deformation model 20 is used, interpolation between the measuring points M may be performed.

[0066] However, of course, a mathematical function can also be used as the deformation model 20, which approximates the determined deformation (amount) V at the measuring point M. The measuring point M or the selection of the measuring point M should be interpolated by a mathematical function. To this end, it may be advantageous to arrange the measuring points M in a grid-like manner in a plane. For example, a polynomial of a certain order (e.g., a sixth-order polynomial) or a free (form) curve, such as a Bezier curve, a piecewise polynomial function (spline curve), etc., can be used as a mathematical function. Approximation of predetermined sampling points (measuring points M) of a curve by means of such a mathematical function is well known and does not need to be further explained here. Of course, this can also be extended to a surface, i.e. a two-dimensional approximation. For this purpose, a two-dimensional mathematical function is used, such as a two-dimensional polynomial of a certain order or a free (form) surface, which models a surface.

[0067] In order to map (depict) the deformation amount V of the entire transparent cover 5 and / or the sensor layer 4 in the deformation model 20, multiple mathematical functions can be used, which respectively cover a specific area of ​​the transparent cover 5 and / or the sensor layer 4. For example, multiple mathematical functions distributed along the y direction are used, wherein each mathematical function is used at a certain y coordinate and approximates multiple measurement points M along the x direction at the y coordinate. When using multiple mathematical functions distributed along the x direction and along the y direction, this can also be done two-dimensionally. With the help of such two-dimensional modeling, the accuracy of the deformation model 20 can be improved.

[0068] The mathematical functions in both directions can be connected multiplicatively. At any position of the image sensor 1 covered by the mathematical functions, the deformation can be determined accordingly by the two mathematical functions and then multiplied to obtain the total effect at this position.

[0069] In an exemplary embodiment of the deformation model 20, a sixth-order polynomial (or also a polynomial of another order) can be used to approximate a plurality of measuring points M in a certain direction (e.g., in the x-direction or in the y-direction). In this case, a plurality of such polynomials are obtained in the xy plane of the image sensor 1, which model the deformation V in this plane. Of course, the measuring points M are selected appropriately for this purpose. Interpolation can be performed between the measuring points with the aid of the polynomial. The polynomial can be stored in the form of its polynomial parameters, which are determined during the curve approximation.

[0070] To improve the accuracy, a sixth-order polynomial (or also a polynomial of other orders) can be used in two directions, ie, for example, the x-direction and the y-direction. Thus, the deformation V in the (multiple) surfaces can also be modeled more accurately.

[0071] If mathematical functions are used to approximate the deformation V, then, if the deformation V of both the transparent cover 5 and the sensor layer 4 are modeled, they are naturally usually approximated by different functions. Here, "different" can also mean that the same function class (e.g., a sixth-order polynomial) is used, but the function parameters are different.

[0072] The deformation amount V of the transparent cover 5 and / or the sensor layer 4 is modeled by the deformation model 20, preferably for different pressure differences D. For this purpose, the deformation (amount) V can be measured for different pressure differences D, for example, by means of the measuring device 31, and modeled in the deformation model 20 for each used pressure difference D. In use, it is possible to interpolate between the determined deformation (amount) V for certain pressure differences D, or to use the deformation (amount) V of the closest pressure difference D stored in the deformation model 20 for the current pressure difference D.

Claims

1. A method for correcting geometric aberrations (A) of a camera (10), the camera having an image sensor (1), the image sensor comprising a sensor housing (2), a sensor layer (4) arranged in a sensor recess (3) of the sensor housing (2) and having a plurality of image points (P), and a transparent cover (5) sealingly closing the sensor housing (2) relative to the outside, wherein: The object point (G) of the object recorded by the camera (10) is imaged onto the image point (P) of the sensor layer (4), characterized in that the internal pressure (p i ) and the ambient pressure (p2) of the camera (10), a deformation (V) of the transparent cover (5) and / or the sensor layer (4) caused by a pressure difference (D) between the internal pressure (p1) and the ambient pressure (p2) of the camera (10) is modeled by a deformation model (20), at the moment of image recording (B') by means of the camera (10), the currently existing pressure difference (D) is determined based on the internal pressure (p1) and the ambient pressure (p2) of the camera (10) known at the moment of image recording (B'), and the pressure difference (D) determined is used to generate a pressure signal. D) determining a deformation (V) of the transparent cover (5) and / or the sensor layer (4) at the time of the image recording (B'), determining a displacement of the image from the object point (G) to the actual image point (P") generated in the image recording (B') caused by the determined deformation (V) and the known geometrical dimensions of the image sensor (1) as a geometric aberration (A), and correcting the determined geometric aberration (A) in the image recording (B') to determine a corrected image recording (B).

2. The method according to claim 1, characterized in that The geometrical aberration (A) is determined as a shift between the imaging of the object point (G) onto the expected image point (P') in the case of the undeformed transparent cover (5) and / or the undeformed sensor layer (4) and the actual imaging of the object point (G) onto the generated actual image point (P") due to the deformation (V).

3. The method according to claim 1 or 2, characterized in that The deviation (L) caused by optical refraction at the undeformed transparent cover (5) is also taken into account in the geometrical aberration (A).

4. The method according to any one of claims 1 to 3, characterized in that The geometrical aberration (A) in the image recording (B') is corrected by the following method: the imaging of the object point (G) on the actual image point (P") generated in the image recording (B') is shifted to another image point (P, P') with the geometrical aberration (A) in the corrected image recording (B).

5. A camera having an image sensor (1), the image sensor comprising a sensor housing (2), a sensor layer (4) arranged in a sensor recess (3) of the sensor housing (2) and having a plurality of image points, and a transparent cover (5) sealing the sensor housing (2) relative to the outside, and having an evaluation unit (21) for processing an image recording (B') performed by means of the camera (10), wherein: The object point (G) of the object recorded by means of the camera (10) is imaged onto an image point (P) of the sensor layer (4), characterized in that a deformation model (20) is implemented in the evaluation unit (21), which models the deformation (V) of the transparent cover (5) and / or the sensor layer (4) caused by the pressure difference (D) between the internal pressure (p1) in the sensor recess (3) and the ambient pressure (p2) of the camera (10); the evaluation unit (21) at the time of image recording (B') by means of the camera (10) based on the internal pressure (p1) known at the time of image recording (B') and the pressure difference (D) between the camera (10) and the ambient pressure (p2) of the camera (10) 0) by using the ambient pressure (p2) to determine the currently existing pressure difference (D), and by using the deformation model (20) to determine the deformation (V) of the transparent cover (5) and / or the sensor layer (4) at the time of the image recording (B') from the determined pressure difference (D), the evaluation unit (21) determining the displacement of the image of the object point (G) to the actual image point (P") generated in the image recording (B') caused by the deformation (V) as a geometric aberration (A), and a correction unit (22) is provided, which corrects the determined geometric aberration (A) in the image recording (B') to determine a corrected image recording (B).

6. The camera according to claim 5, characterized in that The evaluation unit (21) determines the geometrical aberration (A) as a shift between the imaging of the object point (G) onto the expected image point (P') in the case of the undeformed transparent cover (5) and / or the undeformed sensor layer (4) and the actual imaging of the object point (G) onto the generated actual image point (P") which occurs due to the deformation (V).

7. The camera according to claim 5 or 6, characterized in that The evaluation unit (21) also takes into account the displacement (L) caused by optical refraction at the undeformed transparent cover (5) in the geometrical aberration (A).

8. A camera as claimed in any one of claims 5 to 7, characterized in that The correction unit (22) corrects the geometric aberration (A) in the image recording (B') by the following method: the correction unit (22) shifts the imaging of the object point (G) on the actual image point (P") generated in the image recording to another image point (P, P') in the corrected image recording (B) with the geometric aberration (A).