OPTICAL ASSEMBLY, CAMERA SYSTEM, CAMERA MONITOR SYSTEM, VEHICLE AND METHOD USING IT
The camera system integrates two lenses with different viewing angles onto a shared imager, using a UV adhesive for alignment, reducing components and optimizing data stream efficiency, and enabling high-resolution, high-frame-rate image processing for enhanced driving safety and predictive assistance.
Patent Information
- Application Number
- DE102024112387
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-05-02
- Publication Date
- 2025-11-06
AI Technical Summary
Existing camera systems for vehicles require multiple cameras and components to provide different viewing angles, leading to increased costs, complexity, and bandwidth requirements for data transmission and processing, while failing to offer high-resolution displays in all viewing ranges.
A camera system with an optical assembly combining two lenses projecting different fields of view onto a shared imager, using a UV adhesive for precise alignment and a modular design to reduce components and optimize data stream efficiency.
This configuration allows for high-resolution, high-frame-rate image processing with reduced components and costs, enabling efficient data transmission and analysis for enhanced driving safety through overlapping fields of view and integration of artificial intelligence for predictive driving assistance.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to an optical assembly for a camera system for a vehicle. The present invention further relates to a camera system, a camera monitor system comprising the camera system, and a vehicle comprising the camera system. Furthermore, a method for aligning such an optical assembly and a method for analyzing and processing image data from at least one camera system are provided.
[0002] When driving a vehicle, it is particularly important to be able to perceive the vehicle's surroundings. Rearview mirrors, for example, can provide a view of the sides of the vehicle. However, some areas of vision remain obscured, such as blind spots. Furthermore, there are areas of vision, for example, in the immediate vicinity of the vehicle at the front, rear, or sides, which are not visible to the driver or even with rearview mirrors.
[0003] Furthermore, distant areas may appear very small and sometimes unclear to the driver when using rear-view devices. In particular, the behavior of other road users, whether in close proximity or at a distance, can lead to dangerous situations. Recognizing these situations can be impaired by the driver's cognitive abilities and / or experience, or by a lack of concentration. Generally, careful driving requires paying attention to other vehicles or obstacles positioned in front of, behind, to the side of, etc., the vehicle.
[0004] Therefore, various camera systems are used in vehicles to support drivers, for example, by providing supplementary rearview mirrors or by transmitting specific fields of vision. Due to the requirements for safe and anticipatory driving, both the near and far areas around a vehicle must be covered.
[0005] A system for monitoring the surroundings of a vehicle by recording the vehicle's surroundings using cameras mounted at the front, rear, left and right of the vehicle, and a system for detecting a blind spot were proposed.
[0006] WO 2023 / 006832 A1 relates to a camera monitor system for a motor vehicle, in particular in the form of a truck, preferably with a trailer, comprising: a camera designed to be mounted on a motor vehicle and having at least one field of view (FOV) and a controller, wherein the camera comprises a lens with a lens central axis and an imager, and wherein the imager has an imaging center aligned with the lens central axis and a pixel array divided into a first imager area and a second imager area, the first imager area having a first imager area center offset from the lens central axis.The first imager area is an active imager area defined by an array subset of activated pixels; the second imager area is an inactive imager area defined by an array subset of deactivated pixels; and the controller only receives image data from the activated pixels in the active imager area and not from the deactivated pixels in the inactive imager area.
[0007] US patent 10 666 908 B2 discloses a camera module containing a plurality of lenses mounted in different directions to form each image, an image sensor unit mounted to be moved into appropriate positions for each image formed by the plurality of lenses, a guide part that selectively moves the image sensor unit, and an image processor that processes an image signal input from the image sensor unit.
[0008] EP 1 263 213 A1 relates to a camera system comprising a first imaging lens and a second imaging lens with different image acquisition directions, a reflection element for changing the beam path of an image captured with an imaging lens such that the image formation directions of the first imaging lens and the second imaging lens are aligned in the same direction, an imaging device having imaging surfaces on which images captured with the first imaging lens and the second imaging lens are formed, a signal processing element for processing an image signal converted into an electrical signal by the imaging device, a display section for displaying the image signal undergoing signal processing by the signal processing element, and a selection element for selecting the image signal.which corresponds to one of the first imaging lenses and the second imaging lens in order to display it on the display section.
[0009] Common camera systems require multiple cameras, each equipped with a lens and an imager. The multiple cameras and their imagers result in a large bandwidth for reading the video streams from the respective imagers, allowing the target areas within the camera's field of view to be output, processed, and / or digitally analyzed at high resolution and frame rate.
[0010] If a vehicle occupant requires different viewing areas, such as the view from a Class I Intelligent Rear View Mirror (IRVM) and a reversing view according to R158, the hardware must be provided twice. This requires, for example, two separate cameras and therefore two camera mounts, two video cables, two heating cables, two video cable connectors, and / or two video deserializers on a single electronic control unit (ECU). Furthermore, the installation requires approximately twice the effort compared to installing a single camera system, significantly increasing costs. Additionally, a sensor resolution sufficient to provide both the Class I (and wide pan) and R158 viewing areas with adequate resolution is necessary.
[0011] Furthermore, each camera requires its own integrated SerDes circuit and cable to transmit image data from the camera to the control unit. However, since the viewing angle of a camera module used in the system to monitor the vehicle's surroundings differs from the viewing angle of a camera module used in the system to detect a blind spot, a camera module must be used that can ensure different viewing angles for each driver assistance system and / or camera monitor system.
[0012] Furthermore, there is the problem that it is not possible to provide high-resolution displays of a Class IV area on one display.
[0013] In view of the aforementioned and other disadvantages inherent in the current state of the art, the objective of this disclosure is to further develop the known camera system for vehicles in order to overcome at least some of these disadvantages. In particular, the objective is to provide a multifunctional camera system in order to reduce the number of camera systems mounted on a vehicle. Furthermore, the objective is to optimize the efficiency of the data stream and the limiting bandwidth of the mounted camera systems for reading the video streams, thereby saving transmission and processing capacity while simultaneously providing high resolution and frame rate. A further objective is to reduce the material, components, and costs of the camera systems required for mounting and assembling the system in a vehicle.
[0014] This problem is solved according to the invention by an optical assembly for a camera system for a vehicle, in particular a truck, comprising: at least one first lens designed to project at least one first field of view, at least one second lens designed to project at least one second field of view, at least one first lens holder, at least one first lens tube designed to support the first lens, and at least one second lens tube designed to support the second lens, wherein (i) the first and / or the second lens is / are at least partially connected to the first lens tube, the second lens tube, and / or the lens holder, and / or (ii) the first lens tube and / or the second lens tube is / are at least partially connected to the lens holder. Preferred optical assemblies of the present disclosure are described in claims 2 to 5.
[0015] In one embodiment, the connections of the first and / or the second lens to the first lens tube, the second lens tube and / or the lens holder and / or of the first lens tube and / or the second lens tube to the lens holder comprise at least partially at least one UV adhesive; the first lens may comprise at least one seating section; the second lens may comprise at least one seating section, wherein the seating section may preferably be at least partially connected to the first lens tube, the second lens tube and / or the lens holder by the UV adhesive; and / or the first tube may comprise at least one seating section; and / or the second tube may comprise at least one seating section, wherein the seating section may preferably be at least partially connected to the lens holder by the UV adhesive.and / or the use of the UV adhesive, particularly in an uncured state of the adhesive, may enable a relative alignment between the first lens and / or the second lens and / or the first lens tube and / or the second lens tube.
[0016] According to various aspects, the first and / or second field of view, in particular the first field of view, can be a close-range field of view, preferably covering at least an area that can include at least a part of the vehicle, which can be at least partially adjacent to the optical assembly and / or the vehicle, and / or which can be a maximum of 0.2, 0.5, 1, 2, 3, 5 or 10 meters away from the optical assembly and / or the vehicle.
[0017] According to another aspect, the first and / or second field of view, in particular the first field of view (20), may at least partially include at least one area of a field of view group that includes ECE R159 MOIS, ECE R151 BSIS, ECE R158, ECE R46, the blind spot area according to ISO 17387, mirror class area I, mirror class area II, mirror class area IV and / or mirror class area V and / or the SVS area around the optical assembly; in particular, the first field of view is different from the second field of view and / or the first field of view includes one of the areas of the field of view group, whereas the second field of view includes a different area of the field of view group.
[0018] It may also be advantageous that the first and / or second field of view, in particular the second field of view, may be a long-range field of view, preferably covering at least an area that begins at a distance from the optical assembly (2) and / or the vehicle of at least three meters, five meters and / or seven meters.
[0019] In another embodiment, the first and / or second field of view, in particular the second field of view, can cover at least an area that is a maximum of 10, 20, 30, 50, 70, 100 or 300 meters away from the optical assembly and / or the vehicle.
[0020] In another aspect, the first and second fields of vision may overlap at least partially, or they may not overlap at all.
[0021] In various embodiments, the optical axis of the first and / or second lens, in particular the first lens, can be substantially horizontal, in particular horizontal and / or parallel to a supporting floor of the vehicle, to a principal plane of the optical assembly and / or the camera system; optionally, an optical axis of an imager of the camera system and / or the optical axis of the first and / or second lens, in particular the second lens, can be inclined in the direction of a horizontal plane of the optical assembly, in particular parallel to the supporting floor of the vehicle, a principal plane of the optical assembly and / or the camera system, optionally an optical axis of an imager of the camera system, preferably by 30° to 60°, more preferably by 52°, and / or can in particular be inclined in the direction of a region of the near field of view;In particular, the first lens and the second lens are inclined at correspondingly different angles in the direction of the horizontal plane of the optical assembly in order to optionally provide at least one rear view and / or to include a first field of view covering a mirror class II area and / or a second field of view covering an R158 area.
[0022] In one embodiment, the first and / or second lens can be heated, in particular by at least one heat source, wherein the heat source can optionally comprise at least one first heating element for the first lens and at least one second heating element for the second lens, and wherein preferably at least one, optionally each, heating element can be at least partially formed in a ring shape and / or can at least partially enclose the first and / or second lens.
[0023] In a further embodiment, the first lens can have a first opening angle, preferably 63.54° x 44°, and / or the second lens can have a second opening angle, which is optionally wider than the first opening angle, preferably 168° x 148°, or the second lens can have a first opening angle, preferably 63.54° x 44°, and / or the first lens can have a second opening angle, which is optionally wider than the first opening angle, preferably 168° x 148°.
[0024] The present disclosure also provides a camera system comprising a previously described optical assembly and at least one imager.
[0025] In one embodiment, the UV adhesive, particularly in an uncured state, can enable relative alignment between the first and / or second lens and / or the first and / or second lens tube, especially before the first and second lens and / or the first and second lens tube are attached, relative to the imager by curing the UV adhesive; the first lens and / or the second lens can be configured to project its field of view onto the common imager, and / or the imager can provide at least a first area that receives at least part of the first field of view, and at least a second area that receives at least part of the second field of view, wherein the first and second areas may or may not overlap.
[0026] It may be preferred that the lens plane of the first and / or second lens, in particular the first lens, may be substantially perpendicular to an optical axis of the imager and / or that the first and / or second field of view, in particular the second field of view, is / are projected onto the imager by at least one light guiding element and / or light deflecting element, preferably at least one mirror, more preferably at least one deflecting mirror.
[0027] According to various embodiments, the optical assembly can be designed to adjust the first and / or second field of view, in particular by moving the first lens and / or moving the second lens, wherein the movement of the first and / or second lens can preferably be provided by at least one hinge section, which preferably consists of and / or is connected to the lens holder, the first lens, the second lens, the first lens tube and / or the second lens tube;and / or a movement, in particular a rotation, of the lens holder, in particular together with the imager and / or relative to a mounting position on the vehicle, and / or of the first and / or second lens tube, in particular relative to each other and / or relative to the lens holder and / or relative to the mounting position on the vehicle, and / or of the first and / or second lens, in particular relative to the imager, wherein in particular a movement of the first and / or second lens, especially relative to the first lens tube, to the second lens tube and / or to the lens holder, and / or a movement of a third and / or fourth lens may enable a zoom-in or zoom-out effect and / or a change in the depth of field.
[0028] It may further be preferred that the camera system may comprise at least two optical assemblies, wherein the at least two optical assemblies can interact, preferably by aligning the optical assemblies, and / or at least part of the image data of the at least one imager of the at least two optical assemblies can be read out at least partially together, and / or the image data of the at least two optical assemblies can be read out, transmitted, displayed, analyzed and / or processed at least partially together, and / or can form at least one rear-view device, in particular a rear-view mirror and / or a rear-view camera.
[0029] The present disclosure is also directed to a camera monitor system comprising at least one camera system as shown above and at least one monitor and / or at least one electronic control unit.
[0030] The present disclosure further relates to a vehicle, in particular a truck, comprising at least one camera monitor system as shown above and / or at least one optical assembly as shown above, wherein at least two camera systems may be mounted on opposite sides of the vehicle and / or the camera system may be configured to capture at least partially ECE R159 MOIS, ECE R151 BSIS, ECE R158, ECE R46, the blind spot area according to ISO 17387, the mirror class II area, the mirror class IV area and / or the mirror class V area and / or the SVS area around the camera.
[0031] The present disclosure further provides a method for aligning the optical assembly, as described above, and / or the camera system, as described above, comprising the following steps: Providing at least one first lens and at least one second lens, Providing at least one first lens tube and at least one second lens tube, Providing at least one lens holder, Providing at least one UV adhesive, Optionally providing at least one imager, Applying the UV adhesive to a surface, in particular the seating section, of the first lens, the first lens tube, the second lens, the second lens tube and / or the lens holder, in particular an interface with another element, and Aligning the first and second lenses, the first and second lens tubes and / or the lens holder relative to each other, optionally relative to the imager.
[0032] In one embodiment, the alignment method further comprises the step of acquiring data provided by the imager, wherein the alignment step includes analyzing the data, in particular checking and / or modifying the data, by means of the alignment.
[0033] According to another embodiment, the alignment method may further include the step of curing the UV adhesive, optionally using light in the UV range, particularly after completion of the alignment step.
[0034] In one embodiment, the present disclosure further relates to a method for analyzing and processing image data of at least one camera system as described above, comprising the following steps: Defining, in particular dynamically, at least one target field of view of the camera system, wherein the target field of view preferably includes at least partially the first and / or second field of view, and analyzing, modifying and / or processing the data provided by the camera system based on the target field of view.
[0035] It is further proposed that the step of defining at least one target field of view may include adjusting and / or setting the target field of view, in particular depending on the sensor data, the mounting position of the camera system, especially during the mounting of the camera system on the vehicle, the driver input data and / or the software feedback.
[0036] In one embodiment, the adjustment step may include a movement of at least one element of the camera system, in particular the optical assembly, optionally the first lens, the first lens tube, the second lens, the second lens tube, the lens holder and / or the imager, and / or the adjustment of a readout area of the imager.
[0037] In yet another embodiment, the data processing can comprise the following: defining, in particular dynamically, at least one first readout area of the first area of the imager; defining, in particular dynamically, at least one second readout area of the second area of the imager; processing the image data readout from the imager; reading out image data from the first and / or second readout area; transferring the image data from the first and / or second readout area to at least one electronic control unit; processing the image data from the first and / or second readout area, preferably in the electronic control unit; and / or at least partially displaying the processed image data from the first and / or second readout area on at least one monitor, wherein the step of defining the first and / or second readout area is preferably determined by the sensor data, the mounting position of the optical assembly, and / or the camera system.the driver input data and / or software feedback, the field of view of interest, in particular a Class IV field of view, the required frame rate, in particular 50 fps or 30 fps, wherein the processing step preferably comprises the mirroring of the received image data of the read-out mirrored image data of the first and / or second read-out area, wherein the processing step in a first configuration preferably comprises the use of a first second field of view and a second second field of view read-out with a first frame rate from a first area of the sensor, and in a second configuration the use of a first second field of view and a second second field of view read-out with a second frame rate that is optionally below the first frame rate, and the merging of a read-out of a further area of the sensor, optionally a wide field of view area,with the second second field of view readout, wherein the display step preferably comprises displaying a field of view, in particular the wide field of view area, with a first video effect, wherein the first video effect preferably comprises a somewhat blurred display, and / or wherein the image data of the first and second readout areas, which are at least partially displayed, can optionally be displayed individually or in combination, the combined display preferably forming an essentially panoramic view of the vehicle and / or its surroundings.
[0038] Furthermore, the present disclosure proposes that the method can be adapted for use in predictive and / or resource-saving driving and / or that the adaptation of the target field of view can result in a substantially front view, side view, rear view, panoramic view and / or combined view, preferably depending on the main direction of travel of the vehicle, the sensor data, the status of the shifting, the status of the transmission, the driver input and / or combinations thereof, wherein the first lens and / or the second lens can selectively project a near area in front of or to the side of the vehicle and / or the second lens and / or the first lens can project a far area in front of and / or to the side of the vehicle and / or around the vehicle, wherein the method can further preferably include the following steps: analyzing the image data of the second readout area, in particular the far area,by means of software and / or at least one processor, preferably comprising artificial intelligence and / or machine learning, for at least one assistance system for predictive and / or resource-saving driving, wherein the assistance system may preferably include in particular lane / traffic sign recognition, a brake assist, autonomous driving and / or a collision warning, and / or analyzing the image data of the first readout area of the near field, optionally by means of software and / or at least one processor, preferably comprising artificial intelligence and / or machine learning, for one or more assistance systems for outputting warning displays, such as visual warning displays of the area in front of, to the side of and / or behind the vehicle, and / or a distance assist system.wherein, in particular, the processing step for the second readout area can be implemented at least partially by artificial intelligence and / or machine learning to enable and / or improve predictive driving, in particular by detecting at least one object, one vulnerable road user and / or a pattern specifically of hazardous situations and / or a behavior pattern of at least one road user, wherein the behavior pattern is preferably braking behavior, wherein, in particular, the processing step for the first readout area, in particular the immediate vicinity, can be implemented at least partially by artificial intelligence and / or machine learning to enable and / or improve predictive driving, in particular by detecting at least one object, one vulnerable road user and / or a road user,and preferably sending a warning and / or information to the driver specifically by displaying the detected object, vulnerable road user and / or road user as illustrated and / or by means of an optical and / or acoustic signal, detecting and / or locating at least one part of the vehicle and / or at least one attachment of the vehicle, in particular a trailer and / or the end of the trailer, and preferably sending a warning and / or information to the driver in particular by means of an optical and / or acoustic signal, a start assist which in particular can send a warning to the driver and / or influence the driving behavior of the vehicle when at least one vulnerable road user and / or a stop and / or go situation is detected,wherein the processed and / or analyzed data of the first and / or second readout area can optionally be output at least partially as at least one CAN signal and / or wherein the processed and / or analyzed data of the first and / or second readout area can optionally be used for the step of defining, adapting and / or adjusting the target field of view, in particular by means of artificial intelligence.
[0039] Combining two lenses with different fields of view in a single optical assembly of a vehicle's camera system offers numerous advantages in terms of efficiency and performance. For example, a short-range and a long-range camera can be combined within a single system. This allows certain elements of the camera system to be shared by the different lenses, particularly a common imager that can project images across the lenses' fields of view. Consequently, image data from all projecting lenses combined in the camera can be read and transmitted simultaneously. Unlike the previous two-camera setup with two imagers and two data cables, this approach requires only one camera system with two lenses and two fields of view, but only one imager and one data cable.Simultaneous image data readout optimizes the bandwidth constraints for reading, transmitting, processing, and analyzing the video stream. Target areas of the camera's field of view can be output quickly, with less processing power, in high resolution, and at a high frame rate. This increases the efficiency and performance of the data stream.
[0040] Generally, a person skilled in the art understands a near-field of view either as a field of view in the immediate vicinity of the vehicle, or alternatively as covering parts of the vehicle, whereas a far-field of view is understood either as a field of view focused on the surroundings of the vehicle, or alternatively as including areas at a greater distance from the vehicle. The terms near-field and far-field of view are used based on this general understanding of the person skilled in the art.
[0041] The subject matter of the present disclosure further leads to a compact design through the reduction of components, such as the use of a common lens holder, by combining two cameras in one camera system while simultaneously maintaining different fields of view and thus providing different functionalities depending on the different fields of view. It also leads to reduced costs and less time required for the assembly of the camera system and for mounting the camera system on a vehicle.
[0042] The UV adhesive enables cost-effective and, in particular, accurate assembly of the camera system. The camera system components, especially the lens tubes, can be aligned at the appropriate position on the lens holder while the UV adhesive is still uncured. Once aligned, the adhesive can be activated and / or cured by UV light to join the elements of the optical assembly and secure them in a desired position relative to each other, especially the first and second lens tubes relative to the common lens holder. Active, time-controlled activation of the adhesive is particularly possible. The alignment process of the elements can be carried out in parallel or sequentially.The adhesive can be activated and / or cured with UV light once one or both lens tubes are correctly positioned on the respective lens holder seat, thus completing the attachment between the lens holder and the respective lens tube(s).
[0043] Furthermore, the UV adhesive allows the lens holder to provide two seats designed to support the first and second lens tubes. This configuration enables the modular design of the claimed camera system. The lens holder can be combined with various tubes, particularly tubes of different lengths and shapes, and conversely, a single tube can be combined with different lens holders. In this way, the number of components required can be reduced, since, unlike a multitude of different complete components where various permutations of possible lens holders and lens tubes are combined, only a limited number of basic components need to be kept on hand.
[0044] Within this document, the term alignment refers to a step during the manufacture of the optical assembly, whereas the term adjustment or adaptation refers to a movement during the use of the optical assembly and / or the camera with the optical assembly.
[0045] The term “dynamic” refers to a change in the constitution and / or condition, whereby the change is related to a time factor, such as the driver's driving behavior.
[0046] The overlapping fields of view of the different lenses of the camera system, as well as the overlap of the first and second areas of the imager, provide numerous opportunities for processing and analyzing the image data. For example, the different fields of view can be combined and / or aligned to display a 360-degree view and / or a combined image to the driver.
[0047] Heating elements enhance the camera system's safety features. The heat they generate removes water and / or ice from the lenses. The ring shape of the heating elements ensures even heat distribution.
[0048] Changing the field of view of one or more lenses provides the possibility to adapt the field of view as well as the processing and analysis of the image data to the driver and / or the vehicle behavior, as well as to the traffic, the environment and / or driving situations.
[0049] Artificial intelligence and / or machine learning can improve the process of changing the field of view as well as analyzing and processing image data. In particular, pattern recognition can be used, for example, based on driving behavior or the movement patterns of objects / road users, or the detection of specific objects or situations, to enable predictive and safe driving. The use of artificial intelligence and / or machine learning is independent of the driver's concentration or cognitive abilities. Due to the efficiency and performance of the data stream of the camera system according to the invention, the artificial intelligence and / or machine learning can react faster and thus improve the vehicle's driving safety.
[0050] It can be assumed that each of the described features and / or embodiments of the disclosure can be used separately or in combination with other disclosed features and / or embodiments. The term "at least one" refers to one or more and can even be understood as "all".
[0051] Other aspects, advantages, and outstanding features of the present disclosure will become apparent to the person skilled in the art from the detailed description below, which discloses one or more embodiments of the present disclosure solely by means of examples which, in conjunction with the accompanying drawings, reveal exemplary embodiments of the disclosure. It shows / show: Fig. 1 a schematic representation of an embodiment of an optical assembly of a camera system according to the invention; Fig. 2 a schematic representation of a cross-section of the optical assembly of the in Fig. 1 camera system shown; Fig. 3 the projected first and second fields of view captured by a camera system according to the invention; Fig. 4 a diagram of an embodiment of the method for analyzing and processing image data of at least one camera system according to the invention; Fig. 5 a schematic diagram of an application of the optical assembly; Fig. 6a the application of a camera system Fig. 5 captured projected first and second fields of vision; Fig. 6b to 6e different display combinations of the two fields of view; Fig. 7 the projected first and second field of view captured by a camera system according to a further embodiment of the invention, which allows a display with a first frame rate; Fig. 8 the camera system according to the invention in the embodiment of Fig. 7 captured projected first and second fields of view, which allows a display with a second frame rate that is increased compared to the first.
[0052] The drawings to which this description refers are not to be understood as being drawn to scale unless explicitly stated, and such drawings are merely exemplary.
[0053] The aforementioned objects, features, and advantages of the present disclosure will become even clearer from the detailed description below in conjunction with the accompanying drawings. However, various modifications to the present disclosure are possible, and the present disclosure may include various embodiments of the present invention. Specific embodiments of the present disclosure, illustrated in the drawings, are described in detail below.
[0054] In the drawings, the thickness of layers and regions may be exaggerated for clarity. When it is stated that an element or layer is "on" or "above" another element or layer, this includes a case where another layer or element is located between them and a case where the element or layer is located directly above the other element or layer. Generally, reference numerals denote elements throughout the patent specification. In the following description, the same reference numerals are used to designate elements that have the same function within the context of the same concept illustrated in the drawings of each embodiment of the present disclosure.
[0055] If a detailed description of known functions or configurations in connection with the present disclosure is considered to unnecessarily obscure the core of the disclosure, such a detailed description will be omitted. Similarly, numerical terms used in the description herein (e.g., first, second, etc.) are merely identifiers to distinguish one element from another.
[0056] Furthermore, the terms “module” and “unit”, which refer to elements in the description below, are only specified or used in combination for the sake of simplicity in the formulation of the patent specification, and the terms themselves have no particular meaning or function.
[0057] Furthermore, the use of a singular term, such as "one," should not be interpreted as limiting the number of components or details of specific components. Moreover, various terms and / or phrases describing or indicating a positional or directional reference, including "top," "bottom," "front," "back," "forward," "backward," "end," "outer," "inner," "left," "right," "vertical," "horizontal," etc., may refer to one or more specific components as they are generally perceived from a user's point of view during use or operation. Such terms and / or phrases are not to be interpreted as limiting, but merely as a representative basis for describing the disclosure to a person skilled in the art.Furthermore, the suffixes “area”, “part”, “unit” for a component used in the description below are only specified in combination or mixed, taking into account a simple formulation of the patent specification, and have no meaning or function that distinguishes them from one another.
[0058] The present disclosure relates to an optical assembly for a camera system and to a camera system for a vehicle, in particular a truck with an attachment, for example a trailer. In general, the word "vehicle" in this disclosure refers to a vehicle as well as to a vehicle with an attachment and / or trailer. Furthermore, the term "object," particularly in the context of "detecting an object," refers to - any material and / or any tangible object, such as at least one tree, one stone, one wall, one street, one road layout, one sidewalk, one traffic light and the like, - non-material objects such as color or colored information (e.g. pedestrian crossing, warning color), light (e.g. in connection with traffic lights or the sun or the brake light of a vehicle) and the like, - but also every road user, such as vulnerable road users (e.g. cyclists, pedestrians, animals), every type of vehicle, driver or passenger of these vehicles, such as motorcyclists and the like.
[0059] Fig. 1 is an embodiment of an optical assembly 2 of a camera system 1 according to the invention in an embodiment of the present disclosure, in which two lenses 10, 12 are integrated which are designed to project their field of view onto a common imager 3.
[0060] Fig. Figure 2 illustrates a cross-section of the embodiment of the optical assembly 2 of the camera system 1 according to Fig. 1. The following description is made with reference to the Fig. 1 and Fig. 2.
[0061] The camera system 1 according to the illustrated embodiments of the Fig. 1 and Fig. The optical assembly 2 comprises the optical assembly 2 – with a lens holder 5 – and an imager 3, which are attached to each other. The lens holder 5 provides two seats designed to support a first lens tube 7 and a second lens tube 9. The first and second lens tubes 7, 9 are attached to the lens holder 5 with a UV adhesive. The UV adhesive is applied to the lens holder 5 and / or the lens tubes 7, 9 during the assembly of the optical assembly 2. The UV adhesive allows for active image alignment while the adhesive is in an uncured state, meaning that the elements of the optical assembly 2 and the camera system 1 can be precisely positioned relative to each other before attachment. This alignment is achieved by actively and precisely activating and / or curing the adhesive using light in the UV spectrum.This alignment can include the relative alignment between lenses 10, 12 and / or a mirror 14, as well as the alignment of these elements relative to the imager 3. The alignment of lenses 10, 12 can be performed in parallel or sequentially. Therefore, once one or both lens tubes 7, 9 are correctly positioned on their respective seats of the lens holder 5, the adhesive can be activated and / or cured with UV light, thus hardening / sealing the bond between the lens holder 5 and the lens tubes 7, 9.
[0062] A first end of the first and second lens tube 7, 9 is attached to the lens holder 5, wherein an opposite second end of the first and second lens tube 7, 9 is designed to carry the first and second lens 10, 12 respectively.
[0063] According to the embodiment of the Fig. 1 and Fig. In the first lens 10, the first lens is designed to capture a first field of view 20 for a near range, and the second lens 12 is designed to capture a second field of view 22 for a far range. The far range of the second field of view 22 is designed to capture a portion of the vehicle's surroundings at a distance greater than the near range of the first field of view 20, which is designed to capture at least a portion of the immediate vicinity of the vehicle. In various embodiments, the first and second fields of view 20 and 22 can encompass at least part of the area defined in ECE R159 MOIS, ECE R151 BSIS, ECE R158, ECE R46, the blind spot area according to ISO 17387, the mirror class II area, the mirror class IV area, and / or the mirror class V area, and / or the SVS area around the camera. The ECE standards refer to the corresponding UN regulation regarding direct vision.According to various embodiments, the first field of view 20 and the second field of view 22 overlap at least partially or do not overlap.
[0064] The first field of view 20 is projected by the first lens 12 onto a first area 24 of the imager 3, whereas the second field of view 22 is projected onto a second area 26 of the imager 3. The optical axis of the first lens 10 is essentially horizontal and perpendicular to the imager 3. The optical axis of the second lens 12 is inclined. According to various embodiments, the optical axis of the second lens 12 can be inclined towards the ground or towards a side or the rear of the vehicle or its trailer. The first field of view 10 is projected directly onto the first area 24 of the imager 3, whereas the second field of view 22 is projected onto the second area 26 of the imager 3 by means of a deflecting mirror 14. The ratio of the size of the first area 24 to the size of the second area 26 depends on the image resolution required for the first and second fields of view 20 and 22.The higher the required resolution, the larger the area on the imager 3 needs to be for the respective field of view. According to various embodiments, the size of the first and second areas 24, 26 can be changed by an adjustable deflecting mirror 14.
[0065] According to the embodiment of the Fig. 1 and Fig. 2. The first and second lenses 10, 12 are equipped with a heat source comprising a first and second heating element 100, 102, respectively. The heating elements 100, 102 are arranged in a ring and surround the first and second lenses 10, 12 to provide heat evenly to both lenses. Providing heat can be particularly helpful for removing ice, snow, or water from the lenses 10, 12.
[0066] According to various embodiments, the heating elements 100, 102 can at least partially provide the fastening between the lens tube 7, 9 and the lens 10, 12. Furthermore, the attachment of the lens 10, 12 to the lens tube 7, 9 can preferably be sealed.
[0067] According to the embodiment of the optical assembly 2 of the Fig. 1 and Fig. In 2, the lenses 10, 12 and the lens tubes 7, 9 are fixed relative to the lens holder 5. In other embodiments, at least one lens 10, 12 and / or one lens tube 7, 9 can be movable relative to each other and / or to the lens holder 5 even after activation of the UV adhesive, for example, by using a hinge. In yet another embodiment, the lens holder 5 can be movable relative to the imager 3 in order to change at least one field of view 20, 22 and / or at least one area 24, 26 of the imager 3.
[0068] The optical assembly 2 of a vehicle-mounted camera system 1 can change the field of view 20, 22 by rotating about an axis and / or changing its position on the vehicle.
[0069] The optical assembly 2 of the Fig. 1 and Fig. 2 can be part of a camera system 1 comprising multiple optical assemblies 2 and / or imagers 3. In such a camera system 1 with more than one optical assembly 2 and / or more than one imager 3, two or more optical assemblies 2 and / or imagers 3 can interact. In another embodiment, the image data from two or more imagers 3 of such a camera system 1 are at least partially read out, transmitted, displayed, analyzed, and / or processed together. The optical assembly 2 and / or the imager 3 of the Fig. 1 and Fig. 2 and / or the camera system 1 may further be part of a camera monitor system, wherein at least part of the recorded image data of at least one imager 3 is displayed on at least one monitor.
[0070] The optical assembly 2 and / or the camera system 1 according to the embodiment of the Fig. 1 and Fig. 2. These are designed to be mounted on a vehicle. In particular, this can be a vehicle in the form of a truck, and more specifically, a truck that has at least one trailer attached to it.
[0071] Fig. Figure 3 schematically represents an embodiment of a recording of the first and second fields of view 20, 22 of an optical assembly 2 according to the invention. On the left side of Fig. Figure 3 shows the first field of view 20 with a wide opening angle of approximately 168° × 148°. On the right side of Fig. Figure 3 shows the second field of view 22 with a narrow opening angle of approximately 63.54° × 44°. The potentially usable digital image data of the first and second fields of view 20, 22 are limited by the active imager zone 28. The active imager zone 28 defines the areas of the recorded first and second fields of view 20, 22 that are perceived by the imager 3 as an image sensor and thus correspond to the first and second areas 24, 26 of the imager 3. According to various embodiments, the active zone 28 is defined by the design of the imager 3, the software, and / or the calibration. Fig. Figure 3 shows, by way of example, the different areas of mirror class II, IV and V within the recorded fields of view 20, 22.
[0072] According to Fig. Figure 4 provides an embodiment of a method for analyzing and processing image data from at least one imager 3 and / or camera system 1. In a first step 500, the first and / or second field of view 20, 22 can be adapted to a defined target field of view, in particular according to the sensor data, the mounting position, the driver input, and / or the software feedback. The software feedback is to be understood as any signal that is output by software and / or a processor that processes and / or analyzes data, e.g., from the vehicle, the driver, or, in particular, image data from a camera system 1. In this step, the fields of view 20, 22 must be adapted according to the driver's safety requirements and personal needs, or depending on a driving situation, in order to take the current driving situation into account. The field of view depends, for example, on the main direction of travel.Therefore, the first step must be performed dynamically according to the changed driving situation and / or is calibrated after the camera system 1 has been mounted on the vehicle.
[0073] In a second step 502 of the procedure, the first and second readout areas 24 and 26 on the imager 3 must be defined. According to various embodiments, the size of the first and / or second readout area can be zero and / or non-zero. This step can be part of a calibration after the camera system 1 has been mounted on the vehicle. In another embodiment, this step is performed analogously to the first step 500, according to the driving situation. Depending on the installation side of the camera system 1, the first and / or second readout area ("active sensor area") is determined, for example, by software, so that the area covered by the camera system 1, extending away from the vehicle, is captured, and no additional areas of the vehicle that are not of interest are captured.
[0074] The second step, 502, ensures that only the required portion of the first and second areas 24 and 26 of the imager 3 is read. Optimizing the data stream and the image data processing time ensures that the driver's needs and the driving situation are met.
[0075] In a third step (504), the image data from the first and second readout areas are read out and transferred to an electronic control unit. The control unit can be part of a camera monitor system or part of the vehicle.
[0076] In a fourth step 506, the image data read out from the first and second readout areas are processed. According to various embodiments, the processing step 506 is performed at least partially in the electronic control unit. In other embodiments, a further processing unit is necessary to process the readout image data. If a field of view 20, 22 is projected onto the imager 3 via a mirror and / or the field of view is mirrored by another optical or digital effect, the processing step includes reflecting the readout mirrored image data back onto the imager. Furthermore, the processing step includes cropping, distorting, and / or colorizing at least a portion of the readout image data.Furthermore, step 506, the fourth step, can include removing and / or correcting certain parts of the read image data, such as removing recorded objects, image defects, or unimportant image sections, and / or correcting exposure errors, color errors, or reflections, and / or resizing at least part of the image to be displayed. Additionally, step 506 can include adding image data, such as highlighting certain objects or areas of the image to be displayed, or adding new image data in the form of signals, such as a warning symbol.
[0077] In a fifth step (508), the processed image data and / or extracted raw image data are analyzed to generate further information for the driver and / or a vehicle assistance system. In particular, the generated information is used for predictive and resource-saving driving. It can also be used for autonomous driving.
[0078] Step 508 of the analysis is performed using software, in particular software based on artificial intelligence and / or machine learning. The software can be designed to detect objects and / or patterns (e.g., of the driving situation, the environment, driving behavior, the behavior of other road users) and, in particular, to recognize potential hazards. According to various embodiments, the software is designed to recognize the different fields of view of the first and second readout areas, in particular to distinguish between the near and far fields of view. The assistance system, equipped with information from analysis step 508, can include lane / traffic sign recognition, brake assist, autonomous driving, distance assist, and / or collision warning.The assistance systems containing information can change depending on whether image data from the near or far field of view is being analyzed.
[0079] In particular, the information from analysis step 508 can be sent to the control unit and / or processing unit of step 506 to add, remove, and / or modify image data to be displayed. For example, warnings can be issued in the form of visual and / or audible signals. Visual output can take the form of highlighting a detected object of interest and / or a vehicle part of interest, or any other area of the image to be displayed. Visual output can also take the form of a letter, text, symbol, and / or image, with the processed image being overlaid by these visual outputs.
[0080] In a further embodiment, step 508 of the analysis process comprises detecting and / or locating at least one part of the vehicle, in particular an attachment, such as a trailer and / or the end of the trailer, in order to send a warning and / or information to the driver by means of a visual and / or acoustic signal. This function allows the driver to track the location of the attachment and / or the trailer. Especially in the case of trucks with at least one large trailer, it is important for the driver to know the position of the trailer and to predict its behavior while driving. This is important in reversing or parking situations where the driver might misjudge their driving behavior in relation to the trailer's movement.This step 508 can, for example, prevent the angle between the trailer and the truck from being too narrow or the driver's driving behavior from leading to a collision of the trailer with another object.
[0081] In yet another embodiment, the image data is used for a launch assist system. This system supports the driver during startup by issuing warnings and / or influencing and / or adjusting the vehicle's behavior. The launch assist can be used in stop-and-go situations, for example, near intersections, traffic lights, and / or traffic jams, to prevent obstructing traffic by keeping the vehicle stationary longer than necessary. The launch assist can also warn the driver and / or influence the vehicle's behavior if vulnerable road users, such as cyclists and / or pedestrians (e.g., children playing), are detected.
[0082] In a sixth step 510, the processed image data from the first and / or second readout area are displayed, at least partially, on at least one monitor. The image data from the first and / or second readout area can be displayed, at least partially, together in a combined image or individually. In embodiments with an at least partially combined image of the first and / or second image data, at least part of a panoramic view of the vehicle and / or trailer can be displayed.
[0083] According to various embodiments, the camera system 1 and / or the electrical control unit can output at least some of the results of steps 506 and 508 of processing and / or analyzing the first and / or second readout area as a CAN signal. In another embodiment, the results are output via a monitor of a camera monitor system and / or via a device for outputting an acoustic signal, such as a loudspeaker.
[0084] With the help of Fig. Sections 5 to 6e describe an application of the optical assembly 2'. The Fig. The elements shown in Figures 5 to 6c, which correspond to the elements of the camera system 1 and the optical assembly 2 respectively, have the same reference numerals, but with an apostrophe. The optical assembly 2' contains a camera system 1' and is used to simultaneously provide a digital intelligent rearview mirror (IRVM) that displays the Class I field of view represented by the second field of view 22', and a reversing view according to R158, which is represented by the first field of view 20' with a sensor. The claimed optical assembly 2' particularly allows a camera system 1' to be provided that comprises a single camera with a single sensor and linear lenses capable of providing the second (Class I) field of view 22' and the first (R158) field of view 20' at sufficient resolution.
[0085] To achieve this, the single camera 1', which has two lenses in lens tubes 7', 9', is optionally connected via an ECU 30' to an internal rearview display that provides the correct Class I and R158 field of view 20', 22'. The dual-lens configuration allows the projection of the respective field of view 20', 22' onto two separate sensor areas 24', 26' on a single sensor. The views for the two fields of view 20', 22' can then be read out. Thus, it is possible to generate both views with just one camera system.
[0086] To provide the different field-of-view areas 20', 22', the camera system 1' is installed on a vehicle 32' such that the first lens and the second lens have an optical axis spanning a plane perpendicular to a ground surface of the vehicle 32' and / or a horizontal plane. The optical axis of the lenses is inclined at different angles relative to a horizontal direction extending parallel to the ground surface.
[0087] Reading out the individual sensor of the camera system is in Fig. Figure 6A shows two areas, 24' and 26', of an active imager area of the sensor. The first area, 24', corresponds to a Class I field of view of 22', whereas the second area, 26', corresponds to an R158 field of view of 20'.
[0088] The use of different 24' and 26' sections of the single sensor allows for a readout rate of 60 fps, providing a high frame rate and high resolution for the display. Furthermore, at this frame rate, high vertical resolution (40° total) could be provided for Class I, while limited horizontal resolution would be possible. This allows for optimal sensor activation for both sections, i.e., for Class I and R158 views.
[0089] If more panning in the horizontal direction is required, the active sensor area could be adjusted according to the required readout of the intended HFoV (Horizontal Field of View) of, for example, 40°, and a range of up to 64° HFoV could be provided.
[0090] If a high-resolution panoramic view, i.e., up to 64° HFoV, had to be displayed on the screen, the frame rate could be reduced, thereby increasing and reading the active imager area.
[0091] The Fig. 6b to 6e represent different display options for the read data.
[0092] In Fig. 6b shows a display option 202b' where only the Class I field of view 22' is displayed. In particular, additional degrees could be provided around the minimum required FoV according to ECE-R46 for Class I.
[0093] In the Fig. Sections 6c to 6e show various options for simultaneously displaying the Class I field of vision (22') and the reversing field of vision (20') according to R158. Optionally, additional grades around Class I and R158 could be provided.
[0094] In Fig. 6c displays the reversing field of vision 20' as a picture-in-picture of the Class I field of vision 22'.
[0095] In Fig. 6d the reversing field of vision 20' is displayed as picture-by-picture with the Class I field of vision 22'.
[0096] In Fig. 6e the reversing field of vision 20' is displayed as a complete image, which still displays the Class I field of vision 22' in the form of a picture-in-picture.
[0097] To display a high-resolution image of the field of view, for example of a Class IV area, it is proposed that the camera system using the claimed optical assembly employ a [missing information] Fig. 7 and Fig. The technique described in section 8 is used.
[0098] Fig. Figure 7 shows the projected first field of view 20" and a second field of view formed by a first second field of view 22" and a second second field of view 23a", captured by a camera system according to a further embodiment of the invention. This embodiment allows display at a first frame rate of 30 fps together with the corresponding display shown to a user. The in Fig. 7 and Fig. The 8 elements shown, which correspond to the elements of the previously described embodiments, have the same reference numerals, but with two apostrophes.
[0099] The first field of view 22'' represents a Class V view. To generate the Class II field of view, the first second field of view 22'' is defined in step 502 and read out in step 504. To generate the Class IV field of view, the predominant part of the sensor element, in the form of the second second field of view 23a'' and an active imager zone 28a'', is defined in step 502 and read out in step 504. This results in the Class II field of view area 22'' being read out, along with almost all horizontal extensions for the Class IV field of view 23a'', including the second second field of view 23a'', in step 504. The data is then processed in step 506, allowing for a high-resolution display in step 510.
[0100] Fig. Figure 8 represents the projected first (Class V) field of view 20'' and a second field of view formed by a first second field of view 22'' and a second second field of view 23b'', captured by a camera system according to the invention. The camera system is similar to the one shown in Fig. 7 used, but allows a display in step 510 with a second frame rate of 50 fps along with the corresponding display shown to a user. To generate the Class II field of view, the first second field of view of 22'' is defined in step 502 and read out in step 504. To generate the Class IV field of view, a reduced portion of the sensor element is used compared to Fig. 7 in the form of the second field of view 23b'' and an active imager zone 28b'' is defined in step 502 and read out in step 504. This results in a readout of the Class II field of view 22'' together with a plurality of horizontal extensions for the Class IV field of view 23b' in step 504, which allows a high-resolution display in step 510, whereas in comparison to the one in Fig. In the configuration shown in 7, at least one further area 29'' outside the active imager area 28b'' of the sensor element is read from the wide field of view and combined in step 506 to display the correct part of Fig. 8. This will generate the display shown. In this way, it will be possible in step 510 to display the important parts of the Class IV view with an increased frame rate and high resolution.
[0101] As described above, although the embodiments are described by the limited embodiments and the drawings, various modifications and changes can be made by a person skilled in the art, starting from the above description. For example, suitable results can also be obtained if the described techniques are carried out in a different sequence than in the described procedure and / or components of the described system(s), structure, device, circuit, etc., are combined or combined in a different form than in the described procedure, or are replaced or substituted by other components or equivalents.
[0102] Therefore, other implementations, other embodiments according to the invention and such equivalents to the claims also fall under the claims to be described below. Reference sign 1, 1' camera system 2, 2' optical assembly 3 Imager 5 lens holders 7, 7' first lens tube 9, 9' second lens tube 10 first lens 12 second lens 14 mirrors 20, 20', 20'' first field of vision 22, 22' second field of vision 22'' first second field of vision 23a'', 23b'' second second field of vision 24, 24', 24'' first section 26, 26', 26'' second area 28, 28', 28a'', 28b'' active imager zone 29'' area 30' electronic control unit (ECU) 32' vehicle 100 first heating element 102 second heating element 500 steps of defining the field of view Step 502 of defining the readout range Step 504 of reading and transferring the image data Step 506 of processing the image data Step 508 of analyzing the image data Step 510 of displaying the image data 202b', 202c', 202d', 202e' Advertisement QUOTES INCLUDED IN THE DESCRIPTION
[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature
[0000] WO 2023 / 006832 A1
[0006] US 10 666 908 B2
[0007] EP 1 263 213 A1
[0008]
Claims
[1] Optical assembly (2) for a camera system (1) for a vehicle, in particular a truck, comprising the following: ◯at least one first lens (10) designed to project at least one first field of view (20), ◯ at least a second lens (12) designed to project at least a second field of view (22), ◯ at least one lens holder (5), ◯ at least one first lens tube (7) designed to carry the first lens (10), and ◯ at least one second lens tube (9) designed to carry the second lens (12), wherein (i) the first and / or the second lens (10, 12) is / are at least partially connected to the first lens tube (7), the second lens tube (9) and / or the lens holder (5), and / or (ii) the first lens tube (7) and / or the second lens tube (9) is / are at least partially connected to the lens holder (5). [2] Optical assembly (2) according to claim 1, wherein • the connections of the first and / or the second lens (10, 12) with the first lens tube (7), the second lens tube (9) and / or the lens holder (5) and / or of the first lens tube (7) and / or the second lens tube (9) with the lens holder (5) at least partially comprise at least one UV adhesive; • the first lens (10) comprises at least one seating section, the second lens (12) comprises at least one seating section, wherein the seating section is preferably at least partially connected to the first lens tube (7), the second lens tube (9) and / or the lens holder (5) by means of the UV adhesive, and / or the first tube (7) comprises at least one seating section and / or the second tube (9) comprises at least one seating section, wherein the seating section is preferably at least partially connected to the lens holder (5) by means of the UV adhesive, and / or • the use of the UV adhesive, especially in an uncured state of the adhesive, allows a relative alignment between the following: ◯ of the first lens (10) and / or the second lens (10) and / or ◯ the first lens tube (7) and / or the second lens tube (9). [3] Optical assembly (2) according to claim 1 or 2, wherein • the first and / or second field of view (20, 22), in particular the first field of view (22), is a close-range field of view, preferably covering at least an area that includes at least a part of the vehicle which is at least partially adjacent to the optical assembly (2) and / or the vehicle and / or is spaced a maximum of 0.2, 0.5, 1, 2, 3, 5 or 10 meters away from the optical assembly (2) and / or the vehicle, • the first and / or second field of view (20, 22), in particular the first field of view (20), at least partially comprising at least one area of a field of view group, including ECE R159 MOIS, ECE R151 BSIS, ECE R158, ECE R46, the blind spot area according to ISO 17387, the mirror class I area, the mirror class II area, the mirror class IV area and / or the mirror class V area and / or the SVS area around the optical assembly (2); in particular the first field of view is different from the second field of view and / or the first field of view comprises one of the areas of the field of view group, whereas the second field of view comprises a different area of the field of view group, • the first and / or second field of view (20, 22), in particular the second field of view (22), is a long-range field of view that covers at least an area beginning at a distance of at least three meters, five meters and / or seven meters from the optical assembly (2) and / or the vehicle, • the first and / or second field of view (20, 22), in particular the second field of view (22), covers at least an area that is at most 10, 20, 30, 50, 70, 100 or 300 metres away from the optical assembly (2) and / or the vehicle, • the first and second visual fields (20, 22) overlap at least partially or do not overlap, • the optical axis of the first and / or second lens (10, 12), in particular of the first lens (10), is substantially horizontal, in particular horizontal and / or parallel to a supporting floor of the vehicle, to a principal plane of the optical assembly (2) and / or the camera system (1), optionally an optical axis of an imager (3) of the camera system (1), is, • the optical axis of the first and / or second lens (10, 12), in particular the second lens (10), is inclined in the direction of a horizontal plane of the optical assembly (2), in particular parallel to the supporting floor of the vehicle, to a principal plane of the optical assembly (2) and / or the camera system (1), optionally to an optical axis of an imager (3) of the camera system (1), preferably by 30° to 60°, more preferably by 52°, and / or in particular is inclined in the direction of an area of the near field of view, wherein in particular the first and the second lens are inclined in the direction of the horizontal plane of the optical assembly at corresponding different angles in order to optionally provide at least one reversing view and / or to include a first field of view covering a mirror class I area and / or a second field of view covering an R158 area. [4] Optical assembly (2) according to one of the preceding claims, wherein the first and / or second lens (10, 12) is / are heatable, in particular by at least one heat source, wherein the heat supplier optionally comprises at least one first heating element (100) for the first lens (10) and at least one second heating element (102) for the second lens (12), and preferably at least one, optionally each heating element (100, 102) is at least partially formed in a ring shape and / or at least partially encloses the first and / or second lens (10, 12). [5] Optical assembly (2) according to one of the preceding claims, wherein the first lens (10) has a first opening angle, preferably 63.54° × 44°, and / or the second lens (10, 12) has a second opening angle which is optionally wider than the first opening angle, preferably 168° × 148°, or the second lens (10) has a first opening angle, preferably 63.54° × 44°, and / or the first lens (10, 12) has a second opening angle which is optionally wider than the first opening angle, preferably 63.54° × 44°. [6] Camera system (1) comprising an optical assembly (2) according to one of the preceding claims and at least one imager (3). [7] Camera system (1) according to claim 6, wherein the UV adhesive, in particular in an uncured state of the adhesive, provides a relative alignment between ◯ of the first and / or second lens (10) and / or ◯ the first and / or second lens tube (7, 9) relative to the imager (3), especially before the attachment of the first and second lens (10, 12) and / or the first and / or second lens tube (7, 9), by curing the UV adhesive, • wherein the first lens (10) and / or the second lens (12) is / are designed to project their field of view (20, 22) onto the common imager (3), and / or • wherein the imager (3) provides at least a first area (24) that receives at least part of the first field of view (20) and at least a second area (26) that receives at least part of the second field of view (22), wherein the first and second areas (24, 26) preferably overlap or do not overlap. [8] Camera system (1) according to claim 6 or 7, wherein • the lens plane of the first and / or second lens (10, 12), in particular of the first lens (10), is substantially perpendicular to an optical axis of the imager (3), and / or • the first and / or second field of view (20, 22), in particular the second field of view (22), is / are projected onto the imager (3) by at least one light guiding element and / or a light deflecting element, preferably at least one mirror, more preferably at least one deflecting mirror (14). [9] Camera system (1) according to any one of claims 6 to 8, wherein the optical assembly (2) is designed to adjust the first and / or second field of view (20, 22), in particular by moving the first lens (10) and / or moving the second lens (12), wherein the movement of the first and / or second lens (10, 12) is preferably provided by the following: • at least one hinge section, preferably consisting of or connected to the lens holder (5), the first lens (10), the second lens (12), the first lens tube (7) and / or the second lens tube (9); and / or • a movement, especially a rotation, ◯ of the lens holder (5), in particular together with the imager (3) and / or relative to a mounting position on the vehicle, and / or ◯ of the first and / or second lens tube (7, 9), in particular relative to each other and / or relative to the lens holder (5) and / or relative to the mounting position on the vehicle, and / or ◯ of the first and / or second lens (10, 12), in particular relative to the imager (3), wherein in particular a movement of the first and / or second lens (10, 12), especially relative to the first lens tube (7), the second lens tube (9) and / or the lens holder (5), and / or a movement of a third and / or fourth lens enables a zoom-in or zoom-out effect and / or a change in the depth of field. [10] Camera system (1) according to any one of claims 6 to 9, wherein the camera system (1) • comprises at least two optical assemblies (2), preferably ◯ the at least two optical assemblies (2) interact, preferably by aligning the optical assemblies (2), and / or at least part of the image data of the at least one imager (3) of the at least two optical assemblies (2) is read out at least partially together, and / or ◯ the image data of the at least two optical assemblies (2) are at least partially read out, transmitted, displayed, analyzed and / or processed together, and / or • at least one rear-view device, in particular a rear-view mirror and / or a rear-view camera. [11] Camera monitor system comprising the following: at least one camera system (1) according to one of the preceding claims and at least one monitor and / or at least one electronic control unit. [12] Vehicle, in particular truck, comprising at least one camera monitor system according to claim 11, at least one camera system (1) according to any one of claims 6 to 10 and / or at least one optical assembly according to any one of claims 1 to 5, wherein at least two camera systems (1) are mounted on opposite sides of the vehicle, and / or the camera system (1) is designed to capture at least part of the ECE R159 MOIS, ECE R151 BSIS, ECE R158, ECE R46, the blind spot area according to ISO 17387, the mirror class I area, the mirror class II area, the mirror class IV area and / or the mirror class V area and / or the SVS area around the camera. [13] Method for aligning the optical assembly (2) according to any one of claims 1 to 5 and / or the camera system (1) according to any one of claims 6 to 10, comprising the following steps: • Providing at least one first lens (10) and at least one second lens (12), • Providing at least one first lens tube (7) and at least one second lens tube (9), • Provide at least one lens holder (5), • Providing at least one UV adhesive, • Optional provision of at least one imager, • Applying the UV adhesive to a surface, in particular the seating section, of the first lens (10), the first lens tube (7), the second lens (12), the second lens tube (9) and / or the lens holder (5), in particular an interface to another element, and • Aligning the first and second lens (10, 12), the first and second lens tube (7, 9) and / or the lens holder (5) relative to each other, optionally relative to the imager (3). [14] The method of claim 13, further comprising: Acquiring data provided by the imager (3), wherein the alignment step includes analyzing the data, in particular checking and / or modifying the data by alignment. [15] Method according to claim 13 or 14, comprising the step of curing the UV adhesive, optionally using light in the UV range, in particular after completion of the alignment step. [16] Method for analyzing and processing image data of at least one camera system (1) according to any one of claims 6 to 10, comprising the following steps: • Define (500), in particular dynamically, at least one target field of view of the camera system (1), wherein the target field of view preferably includes at least partially the first and / or second field of view (20, 22), and • Analyzing, modifying and / or processing the data provided by the camera system (1) based on the target field of view. [17] Method according to claim 16, wherein the step of defining at least one target field of view comprises: Adjusting and / or setting the target field of view, in particular depending on the sensor data, the mounting position of the camera system (1), especially during the mounting of the camera system (1) on the vehicle, the driver input data and / or the software feedback. [18] Method according to claim 17, wherein the adjustment step comprises: • a movement of at least one element of the camera system (1), in particular the optical assembly (2), optionally the first lens (10), the first lens tube (7), the second lens (12), the second lens tube (9), the lens holder (5) and / or the imager (3), and / or • Adjusting a readout range of the imager (3). [19] Method according to any one of claims 16 to 18, wherein • the processing of the data includes the following: ◯ Define (502), in particular dynamically, at least one first readout area of the first area (24) of the imager (3), ◯ Define (502), in particular dynamically, at least one second readout area of the second area (26) of the imager (3), ◯ Processing the image data readout from the imager (3), ◯ Read (504) the image data of the first and / or second readout area, ◯ Transfer (504) the image data of the first and / or second readout area to at least one electronic control unit, ◯ Processing (506) the image data of the first and / or second readout area, preferably in the electronic control unit, and / or ◯ Display (510), at least partially, the processed image data of the first and / or second readout area on at least one monitor, wherein the step of defining (502) the first and / or second readout area preferably depends on the sensor data, the mounting position of the optical assembly (2) and / or the camera system (1), the driver input data, the software feedback, the field of view of interest, in particular a Class IV field of view, the required frame rate, in particular 50 fps or 30 fps, wherein the processing step (506) preferably includes mirroring back the received image data of the read-out mirrored image data of the first and / or second read-out area, wherein the processing step (506) preferably comprises in a first configuration the use of the readout of a first second field of view and a second second field of view with a first frame rate from a first area of the sensor and in a second configuration the use of the readout of a first second field of view and a second second field of view with a second frame rate which is optionally below the first frame rate, and the merging of a readout of a further area of the sensor, optionally a wide field of view area, with the readout of the second second field of view, wherein step (510) of displaying preferably comprises displaying a field of view, in particular the wide field of view, with a first video effect, wherein the first video effect optionally comprises a slightly blurred display, and / or wherein the at least partially displayed image data of the first and second readout area are optionally displayed individually or in combination, wherein the combined display preferably forms an substantially panoramic view of the vehicle and / or its surroundings. [20] Method according to any one of claims 16 to 19, wherein the procedure is designed for use in anticipatory and / or resource-saving driving, and / or the adaptation of the target field of view to a substantially front view, side view, rear view, panoramic view and / or combined view, preferably depending on the main direction of travel of the vehicle, the sensor data, the status of the shifting, the status of the transmission, the driver input and / or combinations thereof, leads to wherein the first lens (10) and / or the second lens (12) optionally projects a near area in front of or to the side of the vehicle and / or the second lens (12) and / or the first lens (10) projects a far area in front of and / or to the side of the vehicle and / or around the vehicle, wherein the method preferably further comprises the following steps: • Analyzing (508) the image data of the second readout area, in particular the far area, using software and / or at least one processor, preferably comprising artificial intelligence and / or machine learning, for at least one assistance system for predictive and / or resource-saving driving, wherein the assistance system preferably includes in particular lane / traffic sign recognition, a brake assist, autonomous driving and / or a collision warning, and / or • Analyzing (508) the image data of the first readout area of the near field, optionally using software and / or at least one processor, preferably comprising artificial intelligence and / or machine learning, for one or more assistance systems to output warning indications, such as visual indications of the area in front, to the side and / or behind the vehicle, and / or a distance assistant, wherein in particular the processing step (506) for the second readout area is implemented at least partially by artificial intelligence and / or machine learning to enable and / or improve predictive driving, in particular by detecting at least one object, one vulnerable road user and / or a pattern specifically of hazardous situations and / or a behavior pattern of at least one road user, wherein the behavior pattern is preferably a braking behavior, wherein in particular step (506) of processing for the first readout area, especially the near area, is implemented at least partially by artificial intelligence and / or machine learning to enable and / or improve predictive driving, in particular by • Detecting at least one object, vulnerable road user and / or road user and preferably sending a warning and / or information to the driver, specifically by displaying the detected object, vulnerable road user and / or road user as highlighted and / or by a visual and / or audible signal, • Detecting and / or locating at least one part of the vehicle and / or at least one attachment of the vehicle, in particular a trailer and / or the end of the trailer, and preferably sending a warning and / or information to the driver, in particular by means of a visual and / or acoustic signal, • a start assist system that, in particular, sends a warning to the driver and / or influences the vehicle's driving behavior when at least one vulnerable road user and / or a stop-and-go situation is / are detected, wherein the processed and / or analyzed data of the first and / or second readout area are preferably at least partially output as at least one CAN signal and / or wherein the processed and / or analyzed data of the first and / or second readout area are optionally used for the step of defining, adapting and / or adjusting the target field of view, in particular by means of artificial intelligence.
Citation Information
Patent Citations
Stereo camera system for driver assistance system used in motor vehicle, has common sensor that is provided in sensor assembly for processing images received through two lens units
DE102010063403A1
Image acquisition device for a vehicle and method for manufacturing an image acquisition device
DE102021200954A1
Camera mounted on automobile
JP2003169233A
Imaging system for a vehicle and mirror assembly comprising an imaging system
US20090284599A1
Vehicular camera and lens assembly
US20140022657A1
Cited By
Assembly for a camera system and rearview camera; camera monitor system and vehicle with it
DE102025100632A1
VEHICLE IMAGE SYSTEM, CAMERA SURVEILLANCE SYSTEM AND VEHICLE
DE102025111759B3