Automotive image processing methods

Abstract

The present invention provides an image processing method that includes capturing an image of an area surrounding a vehicle using an imaging unit, processing the image data, detecting at least one object, and controlling the illumination direction of a light source adapted to illuminate at least a portion of the area. [Solution] The method further includes controlling the illumination direction to increase illumination in separate areas depending on the position of at least one detected object so that at least one detected object is illuminated. The method further includes capturing images of separate areas by an imaging unit and / or a further imaging unit, and processing the image data representing the illuminated object to determine object information.

Description

TECHNICAL FIELD

[0001] The present invention relates to an image processing method for a motor vehicle, the method comprising: capturing an image of a region surrounding the motor vehicle by an imaging unit; processing, by a processing unit, image data provided by the imaging unit on the basis of the captured image; detecting, by a detection unit, at least one object in the processed image data; and controlling, by a control unit, an illumination direction of a light source, wherein the light source is adapted to illuminate at least a part of the region surrounding the motor vehicle. The present invention further relates to a data processing apparatus, a device, a driver assistance system, and an automated driving system for a motor vehicle, as well as to a motor vehicle.

BACKGROUND ART

[0002] Systems for autonomous / automated driving (AD) and advanced driver assistance systems (ADAS) are well known in the prior art. These systems are often based on object detection for determining the extent, distance, and / or type of objects in a scene surrounding the motor vehicle, in particular vehicles, pedestrians, or obstacles in front of the motor vehicle.

[0003] German Patent Application No. 10060734 A1 describes a motor vehicle provided with means for illuminating traffic signs, which are detected by a camera. Headlights are controlled by a control unit such that the signs are illuminated in specific traffic situations.

SUMMARY OF THE INVENTION

[0004] An object of the present invention is to improve the operation of a vehicle.

[0005] The present invention solves the problem by the features of the independent claims. Further preferred embodiments of the present invention can be found in the dependent claims, the associated description, and the drawings.

[0006] A method for processing images of an automobile is provided, which includes capturing an image of an area surrounding the automobile by an imaging unit; processing image data provided by the imaging unit based on the captured image by a processing unit; detecting at least one object in the processed image data by a detection unit; and controlling the illumination direction of a light source by a control unit, wherein the light source is adapted to illuminate at least a portion of the area surrounding the automobile. It is proposed to control the illumination direction to increase illumination in a separate area depending on the position of at least one detected object so that at least one detected object is illuminated by the light source. It is further proposed to capture an image of a separate area by an imaging unit and / or a further imaging unit, and to process image data provided by the imaging unit representing the illuminated object in order to determine object information.

[0007] This invention is based on the finding that scanning a scene for the purpose of detecting and classifying objects while an automobile is in motion places a high dynamic load on the scanning system. Generally, more light is required for classification than for detection. The solution according to the present invention solves this problem by illuminating specific areas based on the location of the detected objects. For sufficient object classification, only image data representing the illuminated objects needs to be processed. Therefore, high-speed scanning to cover the entire scene with a high update rate is not required.

[0008] The present invention is further based on the understanding that, in low-light conditions, the limitations of the signal-to-noise ratio (SNR) of the sensor system, along with other limitations such as the fidelity of optical components and other components, blur the edges of small objects detected on the road, reducing the system's ability to determine the actual size of objects on the road.

[0009] At the same time, the level of illumination generated by the low beams of a vehicle's headlights is limited by regulations to reduce glare for other road users.

[0010] This invention solves these problems by illuminating separate areas based on the location of detected objects. This improves the signal-to-noise ratio of the image data representing the illuminated objects. In particular, the boundaries of objects depicted in the image become sharper. This allows for more accurate determination of object information and enables better classification of those objects.

[0011] The method according to the present invention is preferably used in combination with an object detection system.

[0012] The operation of an automobile preferably includes the automated and / or autonomous operation of the vehicle. Autonomously operating and / or automated vehicles are often referred to as autonomous or self-driving vehicles. This includes all levels of the classification system of the Society of Automotive Engineers.

[0013] The term "light" will be understood by those skilled in the art to include all types of electromagnetic waves, including those outside the visible spectrum.

[0014] The imaging unit for capturing images of the area surrounding the vehicle preferably includes a camera. The camera may be a visible light camera and / or an infrared camera.

[0015] The region surrounding the vehicle is preferably the region located in the direction of travel ahead of the vehicle. This includes the space that the vehicle passes through as it travels in a certain direction, for example, the space on the road in front of the vehicle. It further includes adjacent spaces, for example, the space beside the road. The imaging unit preferably captures images within its field of view (FoV) which is part of the region surrounding the vehicle.

[0016] A processing unit for processing image data preferably comprises a computer having a computer program that can be executed by the computer. The computer program that is executed preferably processes the data using a neural network.

[0017] A detection unit for detecting at least one object preferably comprises a computer and a computer program that can be executed by the computer. The computer program that is executed preferably detects objects by a neural network.

[0018] The light source for illuminating a separate area is preferably a laser light source, and more preferably an infrared laser light source. More preferably, the light source for illuminating a separate area is part of a LIDAR system (LIDAR: light detection and ranging).

[0019] Directionalizing the light source is preferably achieved by a MEMS mirror system (MEMS: Micro-Electro-Mechanical System). The MEMS mirror system preferably directs the light source based on control signals received from a control unit. The control unit for controlling the illumination direction of the light source is preferably part of the MEMS mirror system. Directionalizing the light source is alternatively or additionally enabled by at least one voice coil, galvanometer scanner and / or rotating polygon.

[0020] Processing of image data representing an illuminated object for determining object information is preferably performed by a processing unit. This processing unit may be the processing unit described above and / or further processing units.

[0021] The imaging unit for capturing a separate region may include a LiDAR system, a stereo camera, an infrared camera, radar, and / or a mono camera. The imaging unit may preferably include a foveal imaging unit. The term “foveal imaging” is understood by those skilled in the art as a digital image processing technique in which the image resolution or amount of detail varies across the image. Preferably, the separate region represents the highest resolution region of the image, or the highest detail in the image processing of the captured image. The latter can be achieved by a higher image signal-to-noise ratio (SNR), which is enabled by higher illumination in the region. Such a technique is named after the center of the retina of the eye, the fovea.

[0022] In a preferred embodiment of the method according to the present invention, illuminating a separate area includes pulsed illumination of the separate area by a light source, during which the pulsed illumination light is directed to the separate area. The method further includes receiving the reflected portion of the pulsed illumination light by a receiving unit and determining the distance between a detected object and a vehicle based on the reflected portion of the pulsed illumination light by measuring the time of flight of the pulsed illumination light and the reflected portion of the pulsed illumination light.

[0023] This embodiment provides a suitable method for obtaining further object information, namely the distance between an object and a vehicle.

[0024] Preferably, the light source and / or receiving unit is part of the LIDAR system.

[0025] In a further preferred embodiment of the method according to the present invention, illuminating a separate area includes transmitting a frequency-modulated continuous electromagnetic wave by a frequency-modulated electromagnetic wave source. The method further includes receiving a reflected portion of the frequency-modulated continuous electromagnetic wave by a receiving unit and determining the distance between the detected object and the vehicle based on the reflected portion of the frequency-modulated continuous electromagnetic wave.

[0026] This allows frequency modulated continuous wave (FMCW) technology to be used both for providing directed illumination on an object and for simultaneously evaluating the distance between the detected object and the motor vehicle.

[0027] The distance between the detected object and the motor vehicle is preferably determined on the basis of the transmitted frequency modulated continuous electromagnetic wave and the reflected portion of the frequency modulated continuous electromagnetic wave.

[0028] Preferably, the receiving unit is a light receiving unit. Preferably, the light source and / or the receiving unit are part of an FMCW light system.

[0029] In a further preferred development of the method according to the invention, processing the image data representing the illuminated object comprises measuring the dimensions of the detected and illuminated object.

[0030] This obtains information that is particularly relevant for the safe operation of the vehicle, since the dimensions can be relevant for determining whether the object is a passable object that can be overtaken without causing undue risk to vehicle occupants or other road users, as specified in UN ECE R157.

[0031] The dimensions of the detected object may also be referred to as the size, particularly the height, of the detected object. Accurate height assessment of the detected object benefits from concentrated illumination of the separate region in question.

[0032] In an advantageous embodiment of the method according to the invention, the light source comprises at least two light sources. The controlling comprises controlling the illumination direction of each of the at least two light sources such that each light source illuminates a separate region.

[0033] Therefore, when a scene with a specific field of view (FoV) needs to be illuminated, the illumination of a separate area can be divided or distributed among several less powerful light sources. This has a significant advantage because the intensity of each light source can be selected to be lower than in a configuration where a single light source is used to illuminate a separate area. In other words, sufficient illumination is achieved by two or more light sources of lower intensity compared to the intensity of a single light source for the same amount of illumination.

[0034] A further development of the method according to the present invention includes an eye-safe infrared laser light source in each of the at least two light sources.

[0035] This allows for sufficient illumination while simultaneously limiting exposure to the eyes. For example, if the detected object is a human, strict limits on the maximum permissible exposure (MPE) to the human eye must be met. Using more than one infrared laser light source distributes the exposure across several light sources.

[0036] Furthermore, the use of infrared light provides illumination outside the visible spectrum, eliminating the need to consider glare limitations, thus offering advantages for development.

[0037] Preferably, each of at least two light sources is a Class 1 laser of a classification system as defined by IEC 60825-1. Additionally or alternatively, each of at least two light sources is an eye-safe light-emitting diode (LED) as defined by IEC 62471.

[0038] In a further preferred embodiment of the method according to the present invention, each of the at least two light sources includes an optical element of an automobile matrix headlight.

[0039] This provides a compact solution in which the light source is integrated into the automotive headlight assembly. Control of the illumination direction is achieved by selecting at least one of the optical elements of the matrix headlight that provides the corresponding preset illumination direction.

[0040] Preferably, the first of the two light sources is an LED element of the matrix headlight, and the second of the two light sources is another LED element of the matrix headlight. More preferably, the first light source is an LED element of the left headlight, and the second light source is an LED element of the right headlight.

[0041] According to a further preferred embodiment of the method according to the present invention, at least a portion of the area surrounding the automobile is illuminated by the automobile's headlights, and a separate area is illuminated by a light source, which is a light source separated from the headlights.

[0042] This embodiment is based on the finding that the level of illumination produced by the low beam of a vehicle's headlights is limited by regulations to reduce glare to other traffic users. Therefore, it is advantageous to use a separate light source to illuminate a distinct area, thereby increasing the signal-to-noise ratio (SNR) at this location.

[0043] In a further preferred embodiment of the method according to the present invention, illuminating a separate area includes pulsed illumination of the separate area by the headlights of an automobile.

[0044] This allows for increased lighting in separate areas while simultaneously meeting regulations to reduce glare for other traffic users.

[0045] Preferably, pulsed illumination is performed only by the selected LED elements of the matrix headlight described above.

[0046] According to a further preferred embodiment of the method according to the present invention, image data representing an illuminated object is provided by an imaging unit that captures a separate region, and the imaging unit directs the field of view (FoV) to the separate region.

[0047] This further improves the processing of object information, as image data can be provided with greater accuracy by the oriented view of the imaging unit. Furthermore, this embodiment offers additional advantages due to oriented illumination of separate areas. It has been noted above that high-speed scanning to cover the entire scene with a high update rate is not required for the solution according to the present invention. This results in a lower dynamic load on the scanning system. And the reduction in dynamic load leads to a reduction in sensitivity to inertia (of the scanning system). The reduction in sensitivity allows for larger mirrors in the MEMS mirror system. Such larger mirrors can also reach larger receiving apertures, thereby improving light-gathering ability.

[0048] In a further preferred improvement, the field of view of the imaging unit and the illumination direction of the light source are controlled by a common mirror configuration. This allows the imaging unit to be positioned in the same location as the light source, preferably in a monostatic design where the light source and receiving aperture can be combined on a single scanning mirror.

[0049] In a further preferred embodiment, the imaging unit preferably comprises a MEMS mirror system (MEMS: microelectromechanical system) for orienting the field of view of the imaging unit. The imaging unit preferably comprises a sensor array for capturing light received from the MEMS mirror system. An exemplary embodiment of the imaging unit is described in "FoveaCam: A MEMS Mirror-Enabled Foveating Camera" by Brevin Tilmon, Eakta Jain, Silvia Ferrari, and Sanjeev Koppal, published on pages 1-11 of the IEEE International Conference on Computational Photography (ICCP) 2020, St. Louis, MO, USA. The authors refer to the described design as a foveal camera design. This camera design distributes resolution to a region of interest by imaging reflections from a microelectromechanical system (MEMS) mirror for scanning. A MEMS swivel mirror is used to orient the field of view of the foveal camera.

[0050] To solve the above problems, a data processing device for an automobile is proposed, comprising a processing unit adapted to process image data provided by an imaging unit based on an image, wherein the image is an image of the area surrounding the automobile captured by the imaging unit. The data processing device further comprises a detection unit adapted to detect at least one object in the processed image data. The data processing device further comprises an output unit adapted to output control data for controlling the illumination direction of a light source, wherein the light source is adapted to illuminate at least a portion of the area surrounding the automobile. The control data is provided to control the illumination direction to increase illumination in a separate area depending on the position of at least one detected object, such that at least one detected object is illuminated by the light source, and the processing unit and / or further processing units are adapted to process image data representing the illuminated object in order to determine object information.

[0051] To solve the above problems, a device for automobiles is proposed. This device comprises an imaging unit adapted to capture an image of the area surrounding the automobile. The device further comprises a processing unit adapted to process the image data provided by the imaging unit based on the captured image. The device further comprises a detection unit adapted to detect at least one object in the processed image data. The device further comprises a control unit adapted to control the illumination direction of a light source, the light source adapted to illuminate at least a portion of the area surrounding the automobile. The control unit is adapted to control the illumination direction to increase illumination in separate areas depending on the location of at least one detected object, so that at least one detected object is illuminated by the light source. The processing unit and / or further processing units are adapted to process the image data representing the illuminated object in order to determine object information.

[0052] To solve the above problems, a driver assistance system for automobiles equipped with the aforementioned device is proposed.

[0053] Driver assistance systems preferably include advanced driver assistance systems (ADAS). Those skilled in the art will understand this term as a group of functions for assisting the driver in the safe operation of a vehicle. The driver is fully responsible for safe operation, and the system interacts with the driver through a human-machine interface. ADAS uses imaging units such as cameras and radar coupled to a processing unit to detect nearby obstacles or driver errors. ADAS comprises collision avoidance technologies such as lane departure warning and various levels of lane keeping, adaptive cruise control, blind spot applications, and driver assistance such as night vision and driver alertness.

[0054] To solve the above problems, an autonomous driving system for automobiles equipped with the above-mentioned devices is proposed.

[0055] Those skilled in the art will understand the term Automated Driving System (ADS) as a system for operating a vehicle without a human driver in various levels of Operational Design Domain (ODD).

[0056] To solve the above problems, an automobile is proposed that is equipped with the driver assistance system described above and / or the autonomous driving system described above.

[0057] For details regarding data processing devices, driver assistance systems, and autonomous driving systems for automobiles, as well as the advantages, embodiments, and design details of automobiles, refer to the above description of the corresponding method features of the image processing method for automobiles according to the present invention. [Brief explanation of the drawing]

[0058] The present invention will be described below based on preferred embodiments with reference to the accompanying drawings. [Figure 1] A schematic top view of a first embodiment of an automobile according to the present invention is shown. [Figure 2] A schematic design of a first embodiment of the device according to the present invention is shown. [Figure 3] This diagram shows a flowchart illustrating a first embodiment of the automobile operating method according to the present invention. [Figure 4] A schematic design of a second embodiment of the device according to the present invention is shown. [Figure 5] A schematic design of a third embodiment of the device according to the present invention is shown. [Figure 6] A schematic design of a fourth embodiment of the device according to the present invention is shown. [Modes for carrying out the invention]

[0059] Figure 1 shows a schematic top view of a vehicle 10 traveling in the direction of travel 12. The vehicle 10 includes a driver assistance system 14 and an autonomous driving system 16, each of which can be used for a desired operating mode of the vehicle 10. Figure 2 shows a schematic design of a device 18 for operating the vehicle 10 shown in Figure 1. Figure 3 shows a schematic flowchart representing the steps of the method for operating the vehicle 10 shown in Figure 1.

[0060] In the situation shown in Figure 1, the vehicle 10 is operated in a driving mode in which the vehicle 10 travels in the direction of travel 12 according to the first method step A. In the illustrated driving mode, the headlights 13 may be switched on to illuminate the scene in the direction of travel 12 ahead of the vehicle 10.

[0061] While driving, according to step B of the method, an image of the region 15 surrounding the vehicle 10 is captured by the imaging unit 20. The imaging unit 20 is a camera. The imaging unit 20 generates image data representing the captured image. Region 15 includes a scene in the direction of travel 12 in front of the vehicle 10. Object 40 is located within region 15. In particular, object 40 is within the field of view (FoV) of the imaging unit 20. Object 40 is a pylon that could collide with the vehicle 10 if the vehicle 10 maintains its current direction of travel and speed.

[0062] According to step C of the method, the processing unit 30 processes the image data. The processing unit 30 includes a computer having a computer program that can be executed by the computer. The computer program to be executed preferably processes the data using a neural network.

[0063] According to step D of the method, the detection unit 35 detects an object 40 in the processed image data. The detection unit 35 for detecting at least one object 40 preferably comprises a computer and a computer program that can be executed by the computer. The computer program to be executed preferably uses a neural network to detect the object 40.

[0064] The automobile 10 includes light sources 60 and 62 that are physically separated from the headlights 13. Light sources 60 and 62 are each adapted to illuminate a portion of the area 15 surrounding the automobile 10. Light source 60 is an infrared laser light source 61, and light source 62 is an infrared laser light source 63. Examples of infrared laser light sources 61 and 63 are infrared light-emitting diodes (IR LEDs), respectively.

[0065] According to step E1 of the method, the illumination direction 64 of the light source 60 is controlled by the control unit 50 to illuminate a separate area 70 at the location of the detected object 40. According to step E2 of the method, the illumination direction 66 of the light source 62 is controlled by the control unit 50 to illuminate a separate area 70 at the location of the detected object 40. The control unit 50 is part of a MEMS system having a mirror configuration for directing the illumination light to illumination directions 64 and 66, respectively. Additionally or alternatively, the control unit 50 is part of a voice coil controlled mirror configuration.

[0066] By illuminating a separate region 70, the signal-to-noise ratio (SNR) of the captured image representing object 40 increases. In particular, the boundaries of object 40 shown in the image become sharper.

[0067] According to a further step F, an image of a separate region 70 in which the illuminated object 40 is located is captured by the imaging unit 20. The imaging unit 20 generates image data representing the detected object 40. An exemplary imaging unit 20 is adapted to orient its field of view towards the separate region 70. That is, the imaging unit 20 includes a micro-electromechanical system (MEMS) that can orient the field of view of the imaging unit 20 in a desired direction.

[0068] According to further method step G, image data representing the illuminated object 40 is processed to determine object information 72.

[0069] The processing according to step G is performed by the processing unit 30. Processing of the image data representing the illuminated object 40 is performed to determine object information 72. The processing includes measuring the dimensions 73 of the detected and illuminated object 40, in particular the height of the object 40.

[0070] Figure 4 shows a schematic design of a device 118 for operating an automobile according to a second embodiment. Device 118 is similar to device 18 shown in Figure 2. Equal elements and elements having the same function are referred to by the same reference numerals as in Figures 1 and 2.

[0071] Device 118 includes an imaging unit 20 that captures an image of a region 15 surrounding the automobile 10 shown in Figure 1. A processing unit 30 processes the image data provided by the imaging unit 20 based on the captured image. A detection unit 35 detects an object 40 in the processed image data. A control unit 50 controls the illumination directions 64 and 66 of light sources 60 and 62, respectively, to illuminate separate regions 70 depending on the position of the object 40. Light sources 60 and 62 are infrared laser light sources 61 and 63, respectively.

[0072] The illumination of a separate area according to the second embodiment is pulsed illumination, with pulsed illumination light emitted by infrared laser light sources 61 and 63, respectively. The device 118 further includes receiving units 80 and 82, respectively, which receive the reflected portion of the pulsed illumination light. This includes the reflected portion reflected by object 40.

[0073] The distance between object 40 and automobile 10 is determined based on the reflected portion of the pulsed illumination light. The distance is calculated by measuring the time of flight of the pulsed illumination light and the reflected portion of the pulsed illumination light. That is, the time of flight of the pulsed illumination light traveling the distance from light sources 60, 62 to object 40 and the time of flight of the reflected portion traveling the distance from object 40 to receiving units 80, 82 are measured. Each of the infrared laser light sources 61 and 63, and each of the receiving units 80 and 82, are part of a LIDAR system (LIDAR: light detection and ranging).

[0074] The receiving units 80 and 82 provide image data representing images captured by the receiving units 80 and 82. The receiving units function as further imaging units 120 for capturing images of separate regions 70. The image data is processed by the processing unit 130 to determine object information 72. The processing includes measuring the dimensions 73 of the detected and illuminated object 40, in particular the height of the object 40.

[0075] Figure 5 shows a schematic design of a device 218 for operating an automobile according to a third embodiment. Device 218 is similar to device 118 shown in Figure 4. Equal elements and elements having the same function are referred to by the same reference numerals as in Figures 1 and 4.

[0076] Device 218 includes an imaging unit 20 that captures an image of a region 15 surrounding the automobile 10 shown in Figure 1. A processing unit 30 processes the image data provided by the imaging unit based on the captured image. A detection unit 35 detects an object 40 in the processed image data. A control unit 50 controls the illumination directions 64 and 66 of light sources 60 and 62, respectively, to illuminate separate regions 70 depending on the position of the object 40. Light sources 60 and 62 are frequency-modulated electromagnetic wave sources 261 and 263, respectively.

[0077] Illumination of a separate area according to the third embodiment is achieved by transmitting frequency-modulated continuous electromagnetic waves (FMCW) by frequency-modulated electromagnetic wave sources 261 and 263. Device 218 further includes receiving units 280 and 282, respectively, which receive the reflected portion of the FMCW light. This includes the reflected portion reflected by object 40. Receiving units 280 and 282 are light receiving units, respectively.

[0078] The distance between object 40 and automobile 10 is determined based on the transmitted FMCW light and the reflected portion of the FMCW light. The distance is calculated by FMCW light measurement. Frequency-modulated electromagnetic wave sources 261 and 263, as well as receiving units 280 and 282, are part of the FMCW system, respectively.

[0079] The receiving units 280 and 282 provide image data representing images captured by the receiving units 280 and 282. The image data is processed by the processing unit 230 to determine object information 72. The processing may include measuring the dimensions 73 of the detected and illuminated object 40, in particular the height of the object 40.

[0080] Figure 6 shows a schematic design of a device 318 for operating the automobile 10 according to the fourth embodiment. Device 318 is similar to device 18 shown in Figure 2. Equal elements and elements having the same function are referred to by the same reference numerals as in Figures 1 and 2. The automobile 10 has matrix headlights 313 and 314 that function as light sources 60 and 62, respectively.

[0081] The control unit 50 controls the illumination directions 64 and 66 of the light sources 60 and 62, respectively, to illuminate separate areas 70 according to the position of the object 40. Illumination direction 64 is achieved by selecting the light element 315 of the left headlight 313 to increase illumination. The light element 315 has a fixed illumination direction corresponding to the desired illumination direction 64 (other light elements have different illumination directions). Illumination direction 66 is achieved by selecting the light element 316 of the right headlight 314 to increase illumination. The light element 316 has a fixed illumination direction corresponding to the desired illumination direction 66. Light elements 315 and 316 are LED elements. Illuminating separate areas 70 with light elements 315 and 316 is, for example, pulsed illumination.

[0082] Although the present invention has been illustrated and described in detail in the embodiments described above, it should be understood that the present invention is not limited to the specific embodiments disclosed, and other modifications can be made by those skilled in the art without departing from the spirit and scope of the invention. [Explanation of Symbols]

[0083] Reference list 10. Automobiles 12 Direction of travel 13 Headlights 14. Driver assistance systems 15 areas 16. Autonomous driving systems 18, 118, 218, 318 devices 20, 120 imaging units 30, 130, 230 processing units 35 detection units 50 control units 60, 62 light source 61, 63 Infrared laser light source 64, 66 Lighting direction 70 Separate domains 72 Object information 73 Dimensions 80, 82 Receiving Unit 261, 263 Frequency-modulated electromagnetic wave sources 280, 282 Receiving Units 313, 314 Headlights 315, 316 Optical elements A, B, C, D, E1, E2, F, G Method Steps

Claims

1. An image processing method for an automobile (10), - Capture an image of the area (15) surrounding the automobile (10) using the imaging unit (20) (B), - Processing the image data provided by the imaging unit (20) based on the captured image (C) by the processing unit (30), - The detection unit (35) detects at least one object (40) in the processed image data (D), - Controlling the illumination direction (64, 66) of the light sources (60, 62) by a control unit (50) (E1, E2), wherein the light sources (60, 62) are adapted to illuminate at least a portion of the area (15) surrounding the automobile (10), - Controlling the illumination directions (64, 66) (E1, E2) to increase illumination in separate regions (70) depending on the position of the at least one detected object (40) so that the at least one detected object (40) is illuminated by the light sources (60, 62), - Capturing an image of the separate region (70) by the imaging unit (20) and / or a further imaging unit (120) (F), - To determine object information (72), process (G) image data provided by the imaging unit (20) that represents the illuminated object (40), A method characterized by the following.

2. Illuminating the separate region (70) includes pulsed illumination of the separate region (70) by the light sources (60, 62), during which pulsed illumination light is directed toward the separate region (70). - The receiving units (80, 82) receive the reflected portion of the pulse illumination light, By measuring the flight time of the pulsed illumination light and the reflected portion of the pulsed illumination light, the distance between the detected object (40) and the automobile (10) is determined based on the reflected portion of the illumination light. The method according to claim 1, further comprising:

3. - Illuminating the separate region (70) includes transmitting frequency-modulated continuous electromagnetic waves by frequency-modulated electromagnetic wave sources (261, 263), - The receiving units (280, 282) receive the reflected portion of the frequency-modulated continuous electromagnetic wave, - Determining the distance between the detected object (40) and the automobile (10) based on the reflected portion of the frequency-modulated continuous electromagnetic wave, The method according to claim 1 or 2, further comprising:

4. Processing image data representing the illuminated object (40) is characterized by including measuring the dimensions (73) of the detected and illuminated object (40). The method according to claim 1 or 2.

5. - The light source includes at least two light sources (60, 62), The method according to claim 1 or 2, characterized in that the control (E1, E2) includes controlling the illumination direction (64, 66) of each of the at least two light sources (60, 62) so that each light source (60, 62) illuminates the separate area (70).

6. The method according to claim 5, characterized in that each of the at least two light sources (60, 62) includes an eye-safe infrared laser light source (61, 63).

7. The method according to claim 5, characterized in that each of the at least two light sources includes optical elements (315, 316) of the matrix headlights (313, 314) of the automobile (10).

8. - The headlights (13) of the automobile (10) illuminate at least a portion of the area (15) surrounding the automobile (10), The method according to claim 1 or 2, characterized in that the separate region (70) is illuminated by the light sources (60, 62), wherein the light sources (60, 62) are light sources separated from the headlight (13).

9. - Illuminating the separate area (70) includes pulsed illumination of the separate area (70) by the headlights (13, 313, 314) of the automobile (10). The method according to claim 1 or 2, characterized in that

10. The method according to claim 1 or 2, wherein the image data representing the illuminated object (40) is provided by an imaging unit (20) that captures the separate region (70), and the imaging unit (20) directs its field of view to the separate region (70).

11. The method according to claim 10, characterized in that the field of view of the imaging unit (20) and the illumination direction (64, 66) of the light sources (60, 62) are controlled by a common mirror configuration.

12. The method according to claim 10, characterized in that the imaging unit (20) comprises a micro-electromechanical system (MEMS) for directing the field of view of the imaging unit (20).

13. A data processing device for an automobile (10), - A processing unit (30) adapted to process image data provided by an imaging unit (20) based on an image, wherein the image is an image of a region (15) surrounding the automobile (10) captured by the imaging unit (20), - A detection unit (35) adapted to detect at least one object (40) in the processed image data, - An output unit adapted to output control data for controlling the illumination direction (64, 66) of light sources (60, 62), wherein the light sources are adapted to illuminate at least a portion of the area surrounding the automobile (10), and the output unit comprises: - The control data is provided to control the illumination directions (64, 66) to increase illumination in separate regions (70) according to the position of the at least one detected object (40) so that the at least one detected object (40) is illuminated by the light sources (60, 62), A data processing apparatus characterized in that the processing unit (30) and / or further processing units (130, 230) are adapted to process image data representing the illuminated object (40) in order to determine object information (72).

14. A device for an automobile (10), - An imaging unit (20) adapted to capture an image of the area (15) surrounding the automobile (10), - A processing unit (30) adapted to process image data provided by the imaging unit (20) based on the captured image, - A detection unit (35) adapted to detect at least one object (40) in the processed image data, - A control unit (50) adapted to control the illumination direction (64, 66) of light sources (60, 62), wherein the light sources (60, 62) are adapted to illuminate at least a portion of the area (15) surrounding the automobile (10), and the control unit (50) comprises - The control unit (50) is adapted to control the illumination directions (64, 66) to increase illumination in separate areas (70) depending on the position of the at least one detected object (40) so that the at least one detected object (40) is illuminated by the light sources (60, 62), A device characterized in that the processing unit (30) and / or further processing units (130, 230) are adapted to process image data representing the illuminated object (40) in order to determine object information (72).

15. A driver assistance system (14) for an automobile (10), comprising the devices (18, 118, 218, 318) according to claim 14.

16. An autonomous driving system (16) for an automobile (10), comprising the devices (18, 118, 218, 318) according to claim 14.

17. An automobile (10) equipped with the driver assistance system (14) according to claim 15 or the autonomous driving system (16) according to claim 16.

Images