Camera for a means of transport, method, computer program and device for preparing a camera for installation in a means of transport, as well as means of transport

By shifting the imaging system relative to the image sensor to compensate for windshield optical influences, the camera system in vehicles effectively addresses the challenge of windshield interference, improving image quality and reducing manufacturing complexity.

DE102023210491B3Active Publication Date: 2024-11-14VOLKSWAGEN AG
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102023210491
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-24
Publication Date
2024-11-14
Estimated Expiration
2043-10-24

AI Technical Summary

Technical Problem

Existing camera systems in vehicles face challenges in reducing the optical influence of vehicle windshields, which are often laminated and require costly manufacturing techniques to minimize refractive forces and modulation transfer function (MTF) impacts.

Method used

The camera system is adjusted by shifting the imaging system relative to the image sensor by a distance of 1 to 10 micrometers to compensate for the optical influence of the windshield, using a defocused approach that accounts for the windshield's optical properties.

Benefits of technology

This method improves the overall optics of the system without increasing the demands on individual camera components, enhancing image detection and contrast while simplifying the manufacturing process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The present invention relates to a camera (1) for a means of transportation, as well as a method, a computer program with instructions, and a device for preparing a camera (1) for installation in a means of transportation. The invention also relates to a means of transportation with such a camera (1). The camera (1) has an image sensor (2) and an imaging system (3). The imaging system (3) is defocused with respect to the image sensor (2) such that an optical influence of a disc (41) of the means of transportation, behind which the camera (1) is installed, is at least partially compensated.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a camera for a means of transportation, as well as to a method, a computer program with instructions, and a device for preparing a camera for installation in a means of transportation. The invention also relates to a means of transportation with a camera according to the invention.

[0002] Means of transport, such as motor vehicles, are increasingly equipped with camera systems that provide information for various assistance systems or (semi-)autonomous driving functions. Such a camera system often includes at least one camera located behind the windshield of the vehicle. This camera is used to optically capture the surroundings through the windshield, e.g., for a lane detection system. For aesthetic reasons, but possibly also to define the camera's field of view, a decorative print made of a material opaque to visible light is typically used.

[0003] The windshields of common motor vehicles consist of laminated glass with an outer and an inner glass pane, which are connected to one another by a film arranged between them. For example, DE 10 2005 062 272 B4 describes a lane detection system for a motor vehicle, comprising a camera system with a camera arranged behind a windshield of the motor vehicle. The windshield consists of laminated glass with an outer glass pane and an inner glass pane, which are connected by a film arranged between the two glass panes. In an area of ​​the windshield opposite the camera, a material opaque to visible light is arranged, except for a portion of this area that defines a field of view of the camera.

[0004] Typically, attempts are made to minimize the refractive power and the windshield's influence on the modulation transfer function (MTF), which result from the windshield's inclusion in the optical beam path. This requires cost-intensive designs and manufacturing techniques.

[0005] For example, US 2018 / 0 137 629 A1 describes an imaging system that can be arranged behind a windshield of a vehicle. At least one lens in an imaging lens of the imaging system is movable along the optical axis to adjust the focus.

[0006] DE 10 2020 132 825 A1 describes a method for operating a camera device arranged behind a vehicle window in a vehicle. In the method, an image of an object arranged in front of the vehicle window is captured and the image is focused by correcting the optical properties of the vehicle window.

[0007] It is an object of the invention to provide simpler solutions for reducing the optical influence of a window of a means of transport on a camera arranged behind the window.

[0008] This object is achieved by a camera having the features of claim 1, by a method having the features of claim 4, by a computer program with instructions according to claim 6, by a device having the features of claim 7, and by a means of transport according to claim 8. Preferred embodiments of the invention are the subject of the dependent claims.

[0009] According to a first aspect of the invention, a camera for a means of transportation comprises an image sensor and an imaging system. The imaging system is defocused with respect to the image sensor in such a way that an optical influence of a window of the means of transportation, behind which the camera is installed, is at least partially compensated. For this purpose, the imaging system is shifted relative to the image sensor by a distance in the range of 1 µm to 10 µm relative to a nominal position to a target position.

[0010] According to a further aspect of the invention, a method for preparing a camera for installation in a means of transport comprises the steps: - Determining the optical influence of a window of the vehicle behind which the camera is installed; - determining a target position for the imaging system which deviates from a nominal position and at which the optical influence of the disc is at least partially compensated; and - Adjusting the imaging system to the target position, whereby the imaging system is shifted relative to the image sensor by a distance in the range of 1 µm to 10 µm relative to the nominal position.

[0011] According to a further aspect of the invention, a computer program comprises instructions which, when executed by a computer, cause the computer to perform the following steps for preparing a camera for installation in a means of transport: - Determining the optical influence of a window of the vehicle behind which the camera is installed; - determining a target position for the imaging system which deviates from a nominal position and at which the optical influence of the disc is at least partially compensated; and - Adjusting the imaging system to the target position, whereby the imaging system is shifted relative to the image sensor by a distance in the range of 1 µm to 10 µm relative to the nominal position.

[0012] The term "computer" should be understood broadly. In particular, it also includes workstations, distributed systems, and other processor-based data processing devices. Furthermore, the individual steps are not necessarily performed directly by the computer. It is also possible for the computer to control or access external components to perform individual steps.

[0013] The computer program may, for example, be made available for electronic retrieval or stored on a computer-readable storage medium.

[0014] According to a further aspect of the invention, a device for preparing a camera for installation in a means of transport comprises: - an evaluation module for determining an optical influence of a window of the means of transport behind which the camera is installed; - a calculation module for determining a target position for the imaging system which deviates from a nominal position and at which the optical influence of the disc is at least partially compensated; and - a control module for outputting a control signal to an adjustment device for adjusting the target position, wherein the adjustment device is configured to displace the imaging system with respect to the image sensor by a distance in the range of 1 µm to 10 µm relative to the nominal position.

[0015] The inventive solution is based on the idea that the disk acts as a weak lens which shifts the position of the optimal focal point along the optical axis. This shift is taken into account by changing the position of the image sensor relative to the imaging system, e.g. relative to a camera lens, along the optical axis, i.e. by refocusing. In other words, the focal length of the sensor system is corrected by deliberately changing the position of the image sensor as the active optical element in the beam path. In this way, the optics of the overall system are improved without increasing the demands on the individual components of the camera or the disk. According to the invention, the imaging system is shifted from the nominal position with respect to the image sensor by a distance in the range of 1 µm to 10 µm. Shifts in this range are useful for compensating for the optical influence of the disk.

[0016] In particular, the windshield can be the vehicle's windshield. Since the environment in front of the vehicle is particularly relevant for many driving functions, cameras are often mounted behind the windshield. In many cases, the windshield has a significant curvature, so compensating for the resulting influences on the image is advisable.

[0017] According to one aspect of the invention, the optical influence of the disk is calculated or determined by measurement. Since the parameters of the disk and the imaging system are usually known, the optical influence of the disk can be calculated using suitable simulations. Alternatively, the optical influence can also be determined experimentally, either individually for each disk or for one or more disks representing a batch of disks.

[0018] Intentional defocusing can be performed not only based on a focal length calculation, but also by taking other image aberrations into account or to improve the MTF of the overall system. For example, a metrological evaluation of the MTF can be performed to improve detailed object detection and the contrast of the optical image by deliberately shifting the image sensor plane.

[0019] A solution according to the invention is particularly advantageously used in a means of transportation. The means of transportation can be, for example, a motor vehicle, e.g., a passenger car or a commercial vehicle. The use of the solution according to the invention has the advantage of improving the optics of the overall system without increasing the requirements for the individual components of the camera or the windshield.

[0020] Further features of the present invention will become apparent from the following description and the appended claims taken in conjunction with the figures. Fig. 1 shows schematically a camera arranged behind a window of a means of transport; Fig. Figure 2 shows schematically a method for preparing a camera for installation in a means of transport; Fig. 3 shows a first embodiment of a device for preparing a camera for installation in a means of transport; Fig. 4 shows a second embodiment of a device for preparing a camera for installation in a means of transport; and Fig. Figure 5 schematically shows a means of transport in which a solution according to the invention is implemented.

[0021] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. It is understood that the invention is not limited to these embodiments and that the described features may also be combined or modified without departing from the scope of the invention as defined in the appended claims.

[0022] Fig. 1 schematically shows a camera 1 arranged behind a window 41 of a means of transport. In the example shown, the window 41 is the windshield. The camera 1 has an image sensor 2 and an imaging system 3, represented here by a simple lens. The imaging system 3 is located at a distance s on the optical axis OA of the camera 1 in front of the window 41. The focal length f2 of the imaging system 3 defines a nominal position P. However, the window 41 also has a focal length f1 and therefore an optical influence on the camera. This is at least partially compensated for by the imaging system 3 being shifted with respect to the image sensor 2 by a distance Δz relative to the nominal position P.

[0023] The magnitude of the distance Δz will be calculated using an example below. The windshield and the camera lens can be considered as a system of two coupled lenses at a distance s with refractive powers D1 and D2 and focal lengths f1 and f2, respectively. The refractive power D s of such a system is given by Ds=D1+D2−s⋅D1⋅D2.

[0024] For the focal length f s of the system applies accordingly 1fs=1f1+1f2−sf1⋅f2.

[0025] The distance Δz is then calculated as Δz=fs−f2 ⇒Δz=(1f1+1f2−sf1⋅f2)−1−f2.

[0026] Assume a windshield with a typical refractive power D1 = 100 mDpt and a camera lens with a focal length f2 = 16 mm. The distance of the lens to the windshield on the optical axis OA of camera 1 is s = 20 mm. The focal length f sof the system is calculated from (2) to be 16.0064 mm, which according to (3) results in a distance Δz of 0.0064 mm for the correction.

[0027] Fig. 2 schematically shows a method for preparing a camera for installation in a means of transport. In a first step, a nominal position of an imaging system of the camera relative to an image sensor of the camera can be determined 10, if necessary. This can be done by an appropriate measurement or by using the optical data of the camera. In addition, an optical influence of a window of the means of transport, behind which the camera is installed, is determined 11. This can, for example, be calculated or determined by measurement. The window can, in particular, be the windshield. Subsequently, a target position for the imaging system that deviates from the nominal position and at which the optical influence of the window is at least partially compensated is determined 12.The imaging system is then adjusted to this target position 13, whereby the imaging system is shifted relative to the image sensor by a distance in the range of 1 µm to 10 µm relative to the nominal position.

[0028] Fig. 3 shows a simplified schematic representation of a first embodiment of a device 20 for preparing a camera for installation in a means of transport. The device 20 has an input 21 via which measurement data MD of a measuring system 50 or measurement data MD or design data KD from a database 51 can be received. An evaluation module 22 is configured to determine an optical influence of a window of the means of transport, behind which the camera is installed. This can be done on the basis of measurement data MD of a corresponding measurement or by recourse to the design data KD of the window and the camera. The window can be, in particular, the windshield. The evaluation module 22 can also be configured to determine a nominal position P of an imaging system of the camera relative to an image sensor of the camera based on the measurement data MD or the design data KD.A computing module 23 is configured to determine a target position P' for the imaging system, which deviates from the nominal position P and at which the optical influence of the pane is at least partially compensated. The target position P' determined in this way or the setting values ​​EW derived therefrom can be output for further use via an output 27 of the device 20. Alternatively or additionally, a control module 24 can be provided, which outputs a corresponding control signal S to an adjustment device 52 for setting the target position P'. The adjustment device 52 is configured to shift the imaging system with respect to the image sensor by a distance in the range of 1 µm to 10 µm relative to the nominal position.

[0029] The evaluation module 22, the computing module 23, and the control module 24 can be controlled by a control module 25. Settings of the evaluation module 22, the computing module 23, the control module 24, or the control module 25 can be changed via a user interface 28. The data generated in the device 20 can be stored in a memory 26 if necessary, for example, for later evaluation or for use by the components of the device 20. The evaluation module 22, the computing module 23, the control module 24, and the control module 25 can be implemented as dedicated hardware, for example, as integrated circuits. Of course, they can also be partially or completely combined or implemented as software running on a suitable processor, for example, a GPU or a CPU.The input 21 and the output 27 can be implemented as separate interfaces or as a combined bidirectional interface.

[0030] Fig. 4 shows a simplified schematic representation of a second embodiment of a device for preparing a camera for installation in a means of transport. The device 30 has a processor 32 and a memory 31. For example, the device 30 is a computer or a control unit. Instructions are stored in the memory 31 which, when executed by the processor 32, cause the device 30 to carry out the steps according to one of the described methods. The instructions stored in the memory 31 thus embody a program executable by the processor 32 which implements the method according to the invention. The device 30 has an input 33 for receiving information, for example measurement results or design data. Data generated by the processor 32 are provided via an output 34. Furthermore, they can be stored in the memory 31.The input 33 and the output 34 can be combined to form a bidirectional interface.

[0031] The processor 32 may include one or more processor units, such as microprocessors, digital signal processors, or combinations thereof.

[0032] The memories 26, 31 of the described embodiments can have both volatile and non-volatile memory areas and can comprise a wide variety of storage devices and storage media, for example hard disks, optical storage media or semiconductor memories.

[0033] Fig.5 schematically illustrates a means of transport 40 in which a solution according to the invention is implemented. In this example, the means of transport 40 is a motor vehicle. The motor vehicle has an image recognition system 42 arranged behind a window 41, which uses a camera 1 according to the invention. The camera 1 is arranged here behind the windshield of the motor vehicle. The information provided by the image recognition system 42 is used by an assistance system 43 of the motor vehicle, e.g., for lane detection. By means of a data transmission unit 44, connections to a backend can be established, e.g., for exchanging data or receiving updated software for the components of the motor vehicle. A memory 45 is provided for storing data. The data exchange between the various components of the motor vehicle takes place via a network 46. List of reference symbols 1 camera 2 image sensors 3 Imaging system 10 Determining a nominal position 11 Determining the optical influence of a disc 12 Determining a target position that deviates from the nominal position 13 Setting the target position 20 Device 21 Entrance 22 Evaluation module 23 Calculation module 24 Control module 25 Control module 26 storage 27 Exit 28 User interface 30 Device 31 storage 32 processor 33 Entrance 34 Exit 40 means of transport 41 disc 42 Image recognition system 43 Assistance system 44 Data transmission unit 45 storage 46 Network 50 measuring system 51 Database 52 Adjustment device Δz distance EW setting value f2 focal length of the imaging system KD design data MD measurement data OA Optical Axis P Nominal Position P' Target position s distance to the disc S control signal

Claims

[1] Camera (1) for a means of transport (40), with an image sensor (2) and an imaging system (3), wherein the imaging system (3) is defocused with respect to the image sensor (2) in such a way that an optical influence of a pane (41) of the means of transport (40), behind which the camera (1) is installed, is at least partially compensated by the imaging system (3) being shifted with respect to the image sensor (2) by a distance (Δz) in the range from 1 µm to 10 µm relative to a nominal position (P). [2] Camera (1) according to claim 1, wherein the optical influence of the disc (41) is calculated or determined by measurement. [3] Camera (1) according to claim 1 or 2, wherein the window (41) of the means of transport (40) is the windshield (41) of the means of transport (40). [4] Method for preparing a camera (1) for installation in a means of transport (40), comprising the steps: - determining (11) an optical influence of a pane (41) of the means of transport (40) behind which the camera (1) is installed; - determining (12) a target position (P') for the imaging system (3) which deviates from a nominal position (P) and in which the optical influence of the disc (41) is at least partially compensated; and - Adjusting (13) the imaging system (3) to the target position (P'), wherein the imaging system (3) is displaced with respect to the image sensor (2) by a distance (Δz) in the range from 1 µm to 10 µm relative to the nominal position (P). [5] Method according to claim 4, wherein the optical influence of the disc (41) is calculated or determined by measurement. [6] A computer program comprising instructions which, when executed by a computer, cause the computer to carry out the steps of a method according to any one of claims 4 or 5 for preparing a camera (1) for installation in a means of transport (40). [7] Device (20) for preparing a camera (1) for installation in a means of transport (40), comprising: - an evaluation module (22) for determining (11) an optical influence of a window (41) of the means of transport (40), behind which the camera (1) is installed; - a computing module (23) for determining (12) a target position (P') for the imaging system (3) which deviates from the nominal position (P), in which the optical influence of the disc (41) is at least partially compensated; and - a control module (24) for outputting a control signal (S) to an adjustment device (52) for adjusting (13) the target position (P'), wherein the adjustment device (52) is configured to displace the imaging system (3) with respect to the image sensor (2) by a distance (Δz) in the range from 1 µm to 10 µm relative to the nominal position (P). [8] Means of transport (40), wherein the means of transport (40) comprises a camera (1) arranged behind a window (41) of the means of transport (40) according to one of claims 1 to 3.

Citation Information

Patent Citations

  • windshield and lane detection system for a motor vehicle

    DE102005062272B4

  • Processing apparatus, imaging apparatus and automatic control system

    US20180137629A1

  • METHOD FOR OPERATING A CAMERA DEVICE, VEHICLE AND COMPUTER PROGRAM PRODUCT

    DE102020132825A1