Monitoring device for a vehicle and method for monitoring a vehicle

Abstract

Monitoring device (1) for a vehicle (2) with a light control unit (3) which is configured to control a light (4-1, 4-2) and / or high beam (5-1, 5-2) of the vehicle (2), with an image acquisition device (6) which is configured to acquire image data (7) for an area (8) in front of the vehicle (2) which is illuminated by the light (4-1, 4-2) and / or high beam (5-1, 5-2) in a switched-on state of the light (4-1, 4-2) and / or high beam (5-1, 5-2), and to output the image data (7); with a computing device (9) which is coupled to the image acquisition device (6) and is designed to monitor whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is switched on correctly after receiving a switching signal (10); wherein the computing device (9) is configured to output a warning signal (11) if the light (4-1, 4-2) and / or high beam (5-1, 5-2) is not switched on correctly after receiving the switching signal (10) and wherein the computing device (9) is configured to detect, based on the image data (7), whether there is fog in front of the vehicle (2) and, if there is fog in front of the vehicle (2), to generate a switching signal (10) for the light (4-1, 4-2) and / or high beam (5-1, 5-2) which switches it on for a duration which is below a predetermined limit.

Description

[0001] The present invention relates to a monitoring device for a vehicle and a corresponding method.

[0002] JP 2010 - 137 757 A discloses a fault detection device for detecting a fault in a lighting device attached to a vehicle.

[0003] JP 2014 - 908 A describes a pattern determination unit for determining a pattern of an illumination state of the light source based on an operating state for indicating the illumination state of the plurality of light sources.

[0004] DE 10 2013 110 840 A1 relates to a method for detecting defective LEDs in an LED array system of a matrix beam headlight.

[0005] DE 10 2007 035 553 A1 describes a switching device for automatically switching a rear fog light on and off on a vehicle. Technical field

[0006] In modern vehicles, a variety of driver assistance systems support the driver in operating the vehicle. For example, a driver assistance system can automatically switch the lights or high beams on and off at night.

[0007] Such a driver assistance system monitors the area of ​​the road in front of the vehicle, for example using a camera. If an oncoming vehicle is detected, the headlights or high beams can then be switched off automatically. Disclosure of the invention

[0008] It is an object of the present invention to provide a means of monitoring the correct function of a driver assistance system which controls the light or high beam of a vehicle.

[0009] Accordingly, the present invention discloses a monitoring device having the features of independent claim 1 and a method having the features of independent claim 7. Accordingly, the following is planned:

[0010] A monitoring device for a vehicle comprising a lighting control unit configured to control a headlight and / or high beam of the vehicle, an image acquisition device configured to acquire image data for an area in front of the vehicle illuminated by the headlight and / or high beam when the headlight and / or high beam is switched on, and to output the image data, and a computing device coupled to the image acquisition device configured to monitor whether the headlight and / or high beam is switched correctly after receiving a switching signal, wherein the computing device is configured to output a warning signal if the headlight and / or high beam is not switched correctly after receiving the switching signal. Furthermore, the following is planned:

[0011] A method for monitoring a vehicle with a lighting control unit configured to control a headlight and / or high beam of the vehicle, comprising capturing image data for an area in front of the vehicle illuminated by the headlight and / or high beam in a switched-on state, monitoring whether the high beam is switched correctly after receiving a switching signal, based on the image data, and issuing a warning signal if the high beam is not switched correctly after receiving the switching signal. Description of the invention

[0012] The underlying insight of the present invention is that it is difficult for today's driver assistance systems, such as a light or high beam assistant, to check whether a light control unit switches accordingly to the switching commands.

[0013] The underlying idea of ​​the present invention is to take this finding into account and to provide an image acquisition device to check whether the headlights and / or high beams in the vehicle are switched on correctly. "Correctly" in this context means, for example, that a lighting control unit switches the headlights or high beams on or off according to a provided switching signal.

[0014] The image capture device records an area in front of the vehicle and generates corresponding image data, which a computer can then use to identify whether the headlights or high beams have been switched on correctly. Switching a light on or off typically produces a change in brightness in the image data, which can then be analyzed.

[0015] If the control unit detects that the vehicle's headlights or high beams have not been switched on correctly, it can issue a warning signal. This warning signal could be, for example, a signal to the driver, an entry in the vehicle's fault memory, or something similar.

[0016] The present invention thus enables the simple detection of faults in automatically switching lighting systems.

[0017] Advantageous embodiments and further developments are described in the dependent claims and in the description with reference to the figures.

[0018] In one embodiment, the computing device can be configured to monitor, based on the brightness distribution of the image data, whether the headlights and / or high beams are switched on correctly after receiving a switching signal. The brightness distribution in an image or the image data provides direct feedback about the illumination lighting the objects in the image. For example, the computing device can compare the brightness distribution in image data acquired before and after the headlights or high beams are switched on.

[0019] In one embodiment, the computing device can be configured to calculate the brightness distribution in the image data based on a variance or a variance distribution of the image data. This enables easy detection of the light distribution or changes in the light distribution within the image data. Variance distribution refers to the deviation of a pixel from the mean of its neighboring pixels. The variance is defined (using the shift theorem) as Var(X) = E(X^2) - (E(X))^2. In the image, the expected value E(X) corresponds to a smoothing effect, for example, using: 1 / 9

[111]

[111]

[111]

[0020] If E(X^2) and (E(X))^2 are calculated from the original image and subtracted from each other, a variance image is obtained. In an image area with many structures (e.g., a bush at the edge of the road), the variance values ​​in this area tend to be high. For homogeneous structures, the values ​​tend to be low. The basic idea is to determine, based on the structures present in the image, whether an area is illuminated or not. One way to do this is via the variance.

[0021] In one embodiment, the computing device can be configured to separately check, for image areas that can be illuminated separately from the light and / or high beam, whether the light and / or high beam is correctly switched on in the corresponding areas after receiving the corresponding switching signal. This makes it possible to use the present invention with modern headlight systems that can illuminate individual areas separately or selectively.

[0022] According to the invention, the computing device is designed to detect, based on image data, whether there is fog in front of the vehicle and, if so, to generate a switching signal for the headlights and / or high beams, which activates them for a duration below a predetermined threshold. In one embodiment, the threshold is set so low that the activation of the lights is imperceptible to the human eye. For example, the threshold can be less than 1 ms. Even if the driver does not activate the high beams in fog, this allows, for example, the function of the high beams or the illumination of individual areas in adaptive headlight systems to be checked while driving.

[0023] In one embodiment, the computing unit can be configured to generate a corresponding switching signal for at least one of the areas that can be illuminated separately from the light and / or high beam. The computing unit can, for example, generate switching signals in a sequence that control all separately controllable areas sequentially. The control unit can also generate control signals that simultaneously control several of the separately controllable areas, whereby adjacent areas are not controlled simultaneously.

[0024] In one embodiment, the computing unit can be configured to detect deviations between the areas actually illuminated by the light and / or high beam and the expected illuminated areas, and to transmit a calibration signal to the lighting control unit. This calibration signal identifies the deviation, enabling the lighting control unit to correct it. For example, if the computing unit detects in the image data that an area is not illuminated correctly—perhaps because the light is emitted too high, too low, or laterally shifted—it can output corresponding calibration data. This calibration data informs the lighting control unit of the deviation, allowing it to compensate for it.

[0025] The above embodiments and further developments can be combined with one another as appropriate. Further possible embodiments, further developments, and implementations of the invention also include combinations of features of the invention described previously or subsequently with regard to the exemplary embodiments, even if not explicitly mentioned. In particular, the person skilled in the art will also add individual aspects as improvements or additions to the respective basic form of the present invention. Brief description of the drawings

[0026] The present invention will be explained in more detail below with reference to the exemplary embodiments shown in the schematic figures of the drawings. These show: Fig. 1 a block diagram of an embodiment of a monitoring device according to the invention; Fig. 2 a flowchart of an embodiment of a method according to the invention; and Fig. 3 a flowchart of a further embodiment of a method according to the invention.

[0027] In all figures, identical or functionally equivalent elements and devices have been provided with the same reference numerals, unless otherwise specified. Embodiments of the invention

[0028] Fig. Figure 1 shows a block diagram of an embodiment of a monitoring device according to the invention.

[0029] The monitoring device 1 is arranged in a vehicle 2, which has two low beam headlights 4-1, 4-2 and two high beam headlights 5-1, 5-2. One of the low beam headlights 4-1, 4-2 and one of the high beam headlights 5-1, 5-2 are, for example, arranged together in a headlight on the right and left sides of the vehicle's front. The low beam headlights 4-1, 4-2 and the high beam headlights 5-1, 5-2 are coupled to a lighting control unit 3, which automatically controls them when it receives a corresponding switching signal 10. The source of the switching signal 10 is in Fig. 1 is not shown because the switching signal can originate from a variety of different control systems in the vehicle 2. For example, a high-beam assist system can send a switching signal to activate the high beams when it is dark outside the vehicle and no oncoming or preceding vehicle has been detected.

[0030] By way of example only, a forward-facing image capture device 6, e.g., a camera 6, is arranged in the center of the vehicle's front, which captures the area 8 in front of the vehicle 2 that is illuminated by the low beam headlights 4-1, 4-2 and the high beam headlights 5-1, 5-2 when these are switched on. The camera 6 generates image data 7 of the captured area and outputs this data to the computer 9.

[0031] Based on the image data 7, the computer 9 monitors whether the light control unit 3 is controlling the low beams 4-1, 4-2 and the high beams 5-1, 5-2 according to the activation signal 10. For this purpose, the computer 9 also receives the switching signal 10. Alternatively, the computer 9 can also send the switching signal 10 to the light control unit 3, meaning it is already aware of the switching signal 10. The switching signal 10 can vary depending on the type of headlights used. In the simplest case, the switching signal 10 is a binary signal indicating whether the low beams 4-1, 4-2 or the high beams 5-1, 5-2 are switched on or off. In adaptive headlight systems, where individual areas in front of the vehicle 2 can be selectively illuminated, the switching signal 10 can specify the individual areas that should be illuminated or not.

[0032] If the computing unit 9 detects that the area 8 in front of the vehicle 2 is not illuminated according to the switching signal 10, the computing unit 9 outputs an error signal 11. Fig. 1. The computer unit 9 outputs the warning signal 11 to the light control unit 3. The computer unit 9 can also output the warning signal 11 to other participants in a vehicle bus system in the vehicle 2. For example, the warning signal 11 can be entered into a central fault memory.

[0033] The computing unit 9 can also analyze the illumination of area 8 in detail. For example, the computing unit 9 can identify brightness gradients or illumination limits, or the like, in the image data and determine whether these brightness gradients or illumination limits are located where they are expected. If the identified brightness gradients or illumination limits are located in different places than expected, or if they exhibit higher or lower intensities than expected, the computing unit 9 can generate a corresponding calibration signal 12 and provide it to the lighting control unit 3. The calibration signal 12 contains data that enables the lighting control unit 3 to compensate for the deviations.

[0034] The computing unit 9 can calculate the calibration signal 12 not only for the entire area 8. Rather, the computing unit 9 can also calculate the calibration signal 12 for individual sub-areas of the area 8, which can be illuminated individually, for example, by an adaptive headlight system.

[0035] For example, the computing unit 9 can use the image data 7 to detect whether there is fog, a wall, or another object in front of the vehicle 2 that can be illuminated. If this is the case, the computing unit 9 generates a switching signal 10 for the lighting control unit 3, which causes it to switch the low beam 4-1, 4-2 or the high beam 5-1, 5-2 on or off. The computing unit 9 generates the switching signal 10 in such a way that the respective lighting is only switched on or off for such a short time that the human eye cannot perceive this or can only perceive it very briefly. In this way, for example, the function of the headlights of the vehicle 2 can be tested while driving in fog.

[0036] The computing device 9 can, in particular, be any embodiment of the method which is used to Fig. 2 and Fig. Execute as described in section 3.

[0037] Fig. Figure 2 shows a flowchart of an embodiment of a method according to the invention for monitoring a vehicle 2 which has a light control unit 3 to control a light 4-1, 4-2 and / or high beam 5-1, 5-2 of the vehicle 2.

[0038] For the analysis of the vehicle lighting, the acquisition, S1, of image data 7 is provided for an area 8 in front of the vehicle 2, which is illuminated by the light 4-1, 4-2 and / or high beam 5-1, 5-2 when the light 4-1, 4-2 and / or high beam 5-1, 5-2 is switched on. It is also possible, for example, to acquire only sections of the area 8.

[0039] Based on the image data 7, the system then monitors, S2, whether the lights 4-1, 4-2 and / or high beams 5-1, 5-2 are switched on correctly after receiving a switching signal 10. If the lights 4-1, 4-2 and / or high beams 5-1, 5-2 are switched on correctly, the procedure returns to S1 after decision E1. However, if the lights 4-1, 4-2 and / or high beams 5-1, 5-2 are not switched on correctly, a warning signal 11 is issued, S3, after decision E1.

[0040] Such a warning signal 11 can be transmitted, for example, to the light control unit 3, the driver of the vehicle 2, or a central fault memory in the vehicle 2, or the like.

[0041] Fig. Figure 3 shows a flowchart of another embodiment of a method according to the invention.

[0042] The procedure of Fig. 3 is based on the procedure of Fig.2. However, in step S2, a brightness distribution in the image data 7 or a variance of the image data 7 is evaluated (S4). Furthermore, for image areas that can be illuminated separately from the light 4-1, 4-2 and / or high beam 5-1, 5-2, it is checked separately whether the light 4-1, 4-2 and / or high beam 5-1, 5-2 is correctly switched on in the corresponding areas after receiving the corresponding switching signal 10. Separately illuminated areas can occur, for example, in adaptive headlight systems.

[0043] In parallel with monitoring the brightness distribution or variance, S4, and the output, S3, of the warning signal 7, it is also provided to check whether the headlights of vehicle 2 are correctly adjusted. To check this, it is necessary to capture the light pattern produced by the lights 4-1, 4-2 and / or high beams 5-1, 5-2. This light pattern can be captured, for example, if there is fog in front of vehicle 2. It is therefore provided to detect, based on the image data 7, S5, whether there is fog in front of vehicle 2. If there is fog in front of vehicle 2, the procedure continues upon decision E2, and a switching signal 10 is generated for the lights 4-1, 4-2 and / or high beams 5-1, 5-2, S6, which switches them on for a duration that is below a predefined threshold. The duration or the limit value is chosen to be so short that switching on the light 4-1, 4-2 or 4-2 is possible.the high beam 5-1, 5-2 is not or only barely visible to a human observer.

[0044] Finally, a deviation of the areas actually illuminated by the light 4-1, 4-2 and / or high beam 5-1, 5-2 from the expected illuminated areas is detected, S7, and a calibration signal 12 is transmitted to the light control unit 3, S8. The calibration signal 12 indicates the detected deviation so that the light control unit 3 can correct the deviation.

[0045] Although the present invention has been described above with reference to preferred embodiments, it is not limited thereto, but can be modified in many ways. In particular, the invention can be altered or modified in many ways without deviating from the core of the invention. REFERENCE MARK 1 monitoring device 2 vehicles 3 Light control unit 4-1, 4-2 light 5-1, 5-2 High beam 6 Image capture device 7 image data Area 8 9 Computer equipment 10 Switching signal 11 Warning signal 12 Calibration signal S1 - S8 process steps E1, E2 decision

Claims

[1] Monitoring device (1) for a vehicle (2) with a light control unit (3) which is configured to control a light (4-1, 4-2) and / or high beam (5-1, 5-2) of the vehicle (2), with an image acquisition device (6) which is configured to acquire image data (7) for an area (8) in front of the vehicle (2) which is illuminated by the light (4-1, 4-2) and / or high beam (5-1, 5-2) in a switched-on state of the light (4-1, 4-2) and / or high beam (5-1, 5-2), and to output the image data (7); with a computing device (9) which is coupled to the image acquisition device (6) and is designed to monitor whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is switched on correctly after receiving a switching signal (10); wherein the computing device (9) is configured to output a warning signal (11) if the light (4-1, 4-2) and / or high beam (5-1, 5-2) is not switched on correctly after receiving the switching signal (10) and wherein the computing device (9) is configured to detect, based on the image data (7), whether there is fog in front of the vehicle (2) and, if there is fog in front of the vehicle (2), to generate a switching signal (10) for the light (4-1, 4-2) and / or high beam (5-1, 5-2) which switches it on for a duration which is below a predetermined limit. [2] Monitoring device (1) according to claim 1, wherein the computing device (9) is configured to monitor, based on a brightness distribution of the image data (7), whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is switched correctly after receiving a switching signal (10). [3] Monitoring device (1) according to claim 2, wherein the computing device (9) is configured to calculate the brightness distribution in the image data (7) based on changes in structures in the image data (7), in particular based on the variance and / or the variance distribution of the image data. [4] Monitoring device (1) according to one of the preceding claims, wherein the computing device (9) is configured to separately check, for image areas that can be illuminated separately by the light (4-1, 4-2) and / or high beam (5-1, 5-2), whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is switched on correctly in the corresponding image areas after receiving the corresponding switching signal (10). [5] Monitoring device (1) according to claims 1 and 4, wherein the computing device (9) is configured to generate a corresponding switching signal (10) for at least one of the image areas that can be illuminated separately by the light (4-1, 4-2) and / or high beam (5-1, 5-2). [6] Monitoring device (1) according to claim 5, wherein the computing device (9) is configured to detect a deviation of the areas actually illuminated by the light (4-1, 4-2) and / or high beam (5-1, 5-2) from the expected illuminated areas and to transmit a calibration signal (12) to the light control unit (3), wherein the calibration signal (12) indicates the deviation so that the light control unit (3) can correct the deviation. [7] Method for monitoring a vehicle (2) with a light control unit (3) configured to control a light (4-1, 4-2) and / or high beam (5-1, 5-2) of the vehicle (2), comprising: Acquisition (S1) of image data (7) for an area (8) in front of the vehicle (2) which is illuminated by the light (4-1, 4-2) and / or high beam (5-1, 5-2) in a switched-on state of the light (4-1, 4-2) and / or high beam (5-1, 5-2); Monitor (S2) whether the headlight (4-1, 4-2) and / or high beam (5-1, 5-2) is correctly switched on after receiving a switching signal (10), based on the image data (7); Output (S3) of a warning signal (11) if the light (4-1, 4-2) and / or high beam (5-1, 5-2) is not switched on correctly after receiving the switching signal (10), whereby based on the image data (7) it is detected (S5) whether there is fog in front of the vehicle (2) and, if there is fog in front of the vehicle (2), a switching signal (10) for the light (4-1, 4-2) and / or high beam (5-1, 5-2) is generated (S6) which switches it on for a duration that is below a specified limit. [8] Method according to claim 7, wherein, based on a brightness distribution of the image data (7), it is monitored (S2) whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is correctly switched on after receiving a switching signal (10). [9] Method according to claim 8, wherein the brightness distribution in the image data (7) is calculated based on changes in structures in the image data (7), in particular based on the variance and / or the variance distribution of the image data. [10] Method according to any of the preceding claims 7 to 9, wherein for image areas that can be illuminated separately by the light (4-1, 4-2) and / or high beam (5-1, 5-2), it is checked separately whether the light (4-1, 4-2) and / or high beam (5-1, 5-2) is correctly switched on in the corresponding image areas after receiving the corresponding switching signal (10) (S2). [11] Method according to claims 7 and 10, wherein a corresponding switching signal (10) is generated for at least one of the image areas that can be illuminated separately by the light (4-1, 4-2) and / or high beam (5-1, 5-2). [12] Method according to claim 11, wherein a deviation of the areas actually illuminated by the light (4-1, 4-2) and / or high beam (5-1, 5-2) from the expected illuminated areas is detected (S7) and a calibration signal (12) is transmitted to the light control unit (3) (S8), wherein the calibration signal (12) indicates the deviation so that the light control unit (3) can correct the deviation.

Images