Apparatus for detecting contamination of camera lens in vehicle and method thereof

The vehicle camera lens contamination detection device uses vehicle headlights to accurately detect and restore images by comparing pre- and post-illumination images, addressing the challenge of night-time contamination detection for autonomous driving.

KR103043383B1Active Publication Date: 2026-11-06HYUNDAI MOTOR CO LTD +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
KR1020210034734
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-17
Publication Date
2026-11-06
Estimated Expiration
2041-03-17

AI Technical Summary

Technical Problem

Existing camera lens contamination detection technologies struggle to accurately identify contamination on vehicle lenses in dark conditions, which is critical for autonomous driving, as they often fail to function properly at night and can lead to errors in object recognition.

Method used

A vehicle camera lens contamination detection device and method that utilizes a light source, such as vehicle headlights, to irradiate the surroundings, acquire images before and during illumination, and compare pixel values to detect contamination, with additional features like ambient light sensing and vehicle speed control to enhance accuracy.

Benefits of technology

Enables high-accuracy detection of camera lens contamination at night without additional costs, allowing for reliable obstacle identification during nighttime autonomous driving and image restoration using other cameras.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112021031443596-PAT00002_ABST
    Figure 112021031443596-PAT00002_ABST
Patent Text Reader

Abstract

The present invention relates to an apparatus and method for detecting contamination of a camera lens using a light source of a vehicle. According to the present invention, light is irradiated around a vehicle, an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings during the light is irradiated are obtained, and by comparing the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings during the light is irradiated, it is possible to determine whether contamination exists on the camera lens. Through the present invention, the effect of improving the difficulty of detecting camera lens contamination in dark nights by using a light source of a vehicle can be provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a vehicle camera lens contamination detection device and method, and more specifically, to a device and method for detecting contamination of a camera lens using a light source of a vehicle. Background Technology

[0002] Existing technology includes a method that calculates a histogram of camera images and identifies contamination if it falls below a threshold; however, this is difficult to apply to vehicles where images constantly change while driving. Additionally, while existing technologies involve periodically acquiring and comparing camera images to identify contamination if an unchanging area exceeds a threshold, their effectiveness decreases in dark nighttime conditions compared to daytime. Current technologies for detecting contamination on vehicle camera lenses are focused on daytime conditions. Due to the darkness at night, detection technologies frequently fail to function properly. However, since cameras need to recognize objects in close proximity, lens contamination must be continuously verified even in dark conditions. In autonomous driving, where technology is used to detect objects around the vehicle via camera images, the presence of contamination on the camera lens can cause critical errors, thereby highlighting the importance of technology for detecting lens contamination.

[0003] Therefore, in autonomous driving technology that can be used even at night, there is a need for technology capable of detecting contamination of vehicle camera lenses even in dark conditions at night. The problem to be solved

[0004] An embodiment of the present invention aims to provide an apparatus and a method for detecting contamination of a camera lens using a light source of a vehicle.

[0005] Another embodiment of the present invention aims to provide a vehicle camera lens contamination detection device and a method for improving the difficulty of detecting camera lens contamination in dark nights using a vehicle light source.

[0006] Another embodiment of the present invention aims to provide a vehicle camera lens contamination detection device and a method that provide high-accuracy camera lens contamination detection even at night without additional cost by utilizing headlights, etc., equipped in existing vehicles.

[0007] Another embodiment of the present invention aims to provide a vehicle camera lens contamination detection device and a method that accurately detects camera lens contamination even at night, thereby enabling the identification of surrounding obstacles by camera images even during nighttime autonomous driving.

[0008] Another embodiment of the present invention aims to provide a vehicle camera lens contamination detection device and a method thereof, which can restore a camera image by replacing the contaminated portion of the camera image with an image from another camera when camera lens contamination is detected.

[0009] The technical problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0010] A vehicle camera lens contamination detection device according to one embodiment of the present invention may include a light source unit that irradiates light around a vehicle, a camera provided in the vehicle that acquires an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated, and a control unit that compares the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated to determine whether contamination exists on the lens of the camera.

[0011] In one embodiment, the sensor unit for acquiring the ambient light of the vehicle is further included, and the control unit can set the intensity of the light to exceed a predetermined threshold to the extent that it is determined that the difference in the ambient light caused by the light can be detected.

[0012] In one embodiment, the control unit can acquire the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle during the light is irradiated through the camera at a time interval such that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle during the light is irradiated are judged to be similar according to a preset standard.

[0013] In one embodiment, the control unit controls the speed of the vehicle to a speed that is determined to be similar to the speed of surrounding vehicles according to a preset standard, and can acquire an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated through the camera.

[0014] In one embodiment, when there are no surrounding vehicles of the vehicle, the control unit reduces the speed of the vehicle to a level where it is determined that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated can be compared according to a preset standard, and can acquire the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated through the camera.

[0015] In one embodiment, the control unit can determine whether contamination exists on the lens of the camera based on the difference in pixel values ​​between the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated.

[0016] In one embodiment, the sensor unit further includes acquiring the ambient light around the vehicle and acquiring whether it is raining, and the control unit can detect contamination on the lens of the camera under conditions where the ambient light is lower than a threshold and the rain is determined not to be in a rain state.

[0017] In one embodiment, the control unit may periodically detect contamination of the lens of the camera, or detect contamination of the lens of the camera at a time when it is determined that there is a difference between whether an obstacle is detected through the image of the camera and whether an obstacle is detected through a sensor provided in the vehicle, or detect contamination of the lens of the camera at a time when it is determined that there is no change in the image acquired through the camera while the vehicle is driving.

[0018] In one embodiment, the control unit can detect contamination of the lens of the camera under conditions where it is determined that an object exists at a distance where light irradiated from the light source unit reaches, through at least one of navigation map information and a sensor equipped in the vehicle.

[0019] In one embodiment, the control unit controls the vehicle to drive autonomously so that the vehicle maintains a distance determined to be close to a surrounding vehicle within the distance where light irradiated from the light source unit reaches according to a preset standard, and can detect contamination of the lens of the camera.

[0020] In one embodiment, when the control unit determines that contamination exists on the lens of the camera, it outputs a notification to the user including that contamination exists on the lens of the camera, and can transmit information regarding the parts of the image of the camera where contamination exists to the system of the vehicle using the image of the camera.

[0021] In one embodiment, the control unit can restore the part where contamination exists in the image of the camera using an image captured by another camera of the vehicle.

[0022] A method for detecting contamination of a vehicle camera lens according to another embodiment of the present invention may include the steps of: irradiating light around a vehicle; acquiring an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated; and comparing the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated to determine whether contamination exists on the lens of the camera.

[0023] In one embodiment, the method further includes the step of obtaining an illuminance around the vehicle, and the step of irradiating light around the vehicle may include the step of setting the intensity of the light to exceed a predetermined threshold to the extent that a difference in illuminance caused by the light can be detected.

[0024] In one embodiment, the step of acquiring an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated may include acquiring the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated through the camera at a time interval such that the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated are judged to be similar according to a preset standard.

[0025] In one embodiment, the step of acquiring an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated may include controlling the speed of the vehicle to a speed determined to be similar to the speed of surrounding vehicles according to a preset standard, and acquiring the image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated through the camera.

[0026] In one embodiment, the step of determining whether contamination exists on the lens of the camera by comparing the surrounding image of the vehicle before the light is irradiated with the surrounding image of the vehicle while the light is irradiated may include the step of determining whether contamination exists on the lens of the camera based on the difference in pixel values ​​between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated.

[0027] In one embodiment, the method may further include the step of periodically detecting contamination on the lens of the camera, or detecting contamination on the lens of the camera at a time when it is determined that there is a difference between whether an obstacle is detected through the image of the camera and whether an obstacle is detected through a sensor provided in the vehicle, or detecting contamination on the lens of the camera at a time when it is determined that there is no change in the image acquired through the camera while the vehicle is driving.

[0028] In one embodiment, the method may further include the step of autonomously controlling the vehicle to maintain a distance determined to be close to a surrounding vehicle within the distance where light irradiated from the light source unit reaches according to a preset standard, and detecting contamination on the lens of the camera.

[0029] In one embodiment, the method may further include the steps of: outputting a notification to a user that the lens of the camera has contamination; transmitting information about the part of the image of the camera in which contamination exists to a system of the vehicle using the image of the camera; and restoring the part of the image of the camera in which contamination exists through an image captured by another camera of the vehicle. Effects of the invention

[0030] The effects of the vehicle camera lens contamination detection device and method according to the present invention are described as follows.

[0031] According to at least one embodiment of the present invention, an apparatus and method for detecting contamination of a camera lens using a light source of a vehicle can be provided.

[0032] In addition, according to at least one embodiment of the present invention, a vehicle camera lens contamination detection device and a method thereof can be provided to improve the difficulty of detecting camera lens contamination in dark nights using a light source of a vehicle.

[0033] In addition, according to at least one embodiment of the present invention, a vehicle camera lens contamination detection device and a method thereof can be provided, which provide high-accuracy camera lens contamination detection even at night without additional cost by utilizing headlights, etc., equipped in an existing vehicle.

[0034] In addition, according to at least one embodiment of the present invention, a vehicle camera lens contamination detection device and method can be provided, which accurately detects camera lens contamination even at night, thereby enabling the identification of surrounding obstacles by camera images even during nighttime autonomous driving.

[0035] In addition, according to at least one embodiment of the present invention, a vehicle camera lens contamination detection device and a method thereof can be provided, which can recover a contaminated portion of a camera image by replacing it with an image from another camera when camera lens contamination is detected.

[0036] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing

[0037] FIG. 1 is a block diagram showing a vehicle camera lens contamination detection device according to one embodiment of the present invention. FIG. 2 is a drawing showing a vehicle camera lens contamination detection device and other devices of a vehicle according to one embodiment of the present invention. FIG. 3 is a drawing showing the area captured by the camera of a vehicle camera lens contamination detection device according to one embodiment of the present invention. FIG. 4 is a diagram showing a vehicle camera lens contamination detection device according to one embodiment of the present invention comparing two images to determine contamination of the camera lens. FIG. 5 is a flowchart illustrating a method for detecting contamination of a vehicle camera lens according to one embodiment of the present invention. FIG. 6 is a flowchart illustrating a method for detecting contamination of a vehicle camera lens according to another embodiment of the present invention. Specific details for implementing the invention

[0038] Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. It should be noted that in assigning reference numerals to the components of each drawing, the same components are given the same reference numeral whenever possible, even if they are shown in different drawings. Furthermore, in describing the embodiments of the present invention, if it is determined that a detailed description of related known components or functions would hinder understanding of the embodiments of the present invention, such detailed description is omitted.

[0039] In describing the components of the embodiments of the present invention, terms such as first, second, A, B, (a), (b), etc., may be used. These terms are intended merely to distinguish the components from other components, and the essence, order, or sequence of the components is not limited by the terms. Furthermore, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0040] Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 to 6.

[0041] FIG. 1 is a block diagram showing a vehicle camera lens contamination detection device according to one embodiment of the present invention.

[0042] Referring to FIG. 1, a vehicle camera lens contamination detection device (100) may include a light source unit (110), a camera (120), and a control unit (130).

[0043] The vehicle camera lens contamination detection device (100) according to the present invention may be implemented inside or outside a vehicle. In this case, the vehicle camera lens contamination detection device (100) may be formed integrally with the internal control units of the vehicle, or it may be implemented as a separate hardware device and connected to the control units of the vehicle by means of a connection means.

[0044] For example, the vehicle camera lens contamination detection device (100) may be implemented as a unit with the vehicle, or as a separate component installed / attached to the vehicle, or some parts may be implemented as a unit with the vehicle and other parts installed / attached to the vehicle as a separate component.

[0045] The light source (110) can emit light around the vehicle.

[0046] For example, the light source unit (110) may include a vehicle headlight system.

[0047] For example, the light source unit (110) can illuminate the surroundings of the vehicle using a light source such as the vehicle's headlights, high beam, or AFLS (Adaptive Front Lighting System) through the vehicle's headlight system.

[0048] The light source unit (110) may preferably be implemented including a headlight, but is not limited thereto, and may be implemented including a high beam, low beam, fog light, turn signal, etc. provided in the vehicle.

[0049] For example, the light source (110) can be implemented to illuminate a shooting range according to the angle of view of the camera (120).

[0050] For example, the light source (110) may be implemented to emit light during the time the camera (120) captures an image for lens contamination detection.

[0051] For example, the light source unit (110) can concentrate light from a light source, such as the headlights of a vehicle or a high beam, while the camera (120) is capturing an image to detect lens contamination.

[0052] A camera (120) is provided in the vehicle and can acquire an image of the vehicle's surroundings before light is irradiated and an image of the vehicle's surroundings while light is irradiated.

[0053] For example, the camera (120) may include a vehicle’s SVM (Surround View Monitor) camera, DVRS (Digital Video Recording System) camera, CMS (Camera Monitor System) camera, or lane detection camera.

[0054] For example, the camera (120) is connected to the control unit (130) and can transmit the acquired image to the control unit (130).

[0055] For example, the camera (120) can acquire the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated at short time intervals such that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated are judged to be similar according to a preset standard.

[0056] The control unit (130) can perform overall control so that each component can perform its function normally. This control unit (130) may be implemented in the form of hardware, software, or a combination of hardware and software. Preferably, the control unit (130) may be implemented as a microprocessor, but is not limited thereto. In addition, the control unit (120) can perform various data processing and calculations, etc., as described below.

[0057] The control unit (130) can determine whether there is contamination on the lens of the camera (120) by comparing the surrounding image of the vehicle before the light is irradiated with the surrounding image of the vehicle while the light is irradiated.

[0058] If there is a part of contamination on the lens of the camera (120), the part of contamination will not be affected by light in the image under dark conditions (before light is irradiated) and the image under bright conditions (while light is irradiated), so it is possible to determine whether there is contamination on the lens of the camera (120) by comparing the image under dark conditions and the image under bright conditions.

[0059] For example, the control unit (130) can determine whether there is contamination on the lens of the camera (120) based on the difference in pixel values ​​between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated.

[0060] The process by which the control unit (130) determines whether there is contamination on the lens of the camera (120) based on the difference in pixel values ​​between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated will be explained in detail in FIG. 4.

[0061] The control unit (130) can acquire the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated through a camera at short time intervals such that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated are judged to be similar according to a preset standard.

[0062] For example, a time interval short enough to determine that two videos are similar based on a pre-set standard can be set to 0.1 seconds.

[0063] Here, the time interval of 0.1 seconds is an arbitrarily chosen value for the purpose of example, and in reality, it can be set to a different value that is short enough to judge the two videos to be similar.

[0064] If the time interval for acquiring two images through the camera (120) becomes too long, the lens contamination detection result may become inaccurate due to changes in the image caused by driving, so the control unit (130) can acquire two images through the camera (120) at a time interval short enough that the two images are judged to be similar according to a preset standard.

[0065] In addition, by acquiring images for lens contamination detection at short intervals, the time during which light is irradiated through the light source (110) is minimized, thereby minimizing the impact of light on the surroundings of the vehicle.

[0066] Additionally, the control unit (130) controls the speed of the vehicle to a speed that is judged to be similar to the speed of surrounding vehicles according to a preset standard, and can acquire images of the vehicle's surroundings before light is irradiated and images of the vehicle's surroundings while light is irradiated through the camera (120).

[0067] For example, a speed that is judged to be similar to the speed of surrounding vehicles according to a pre-set standard can be set to a speed that is within 10 km / h of the difference from the speed of surrounding vehicles.

[0068] Here, the speed that is within 10 km / h of the speed of surrounding vehicles is a value arbitrarily chosen for the sake of example, and in reality, it may be set to another speed that is judged to be similar to the speed of surrounding vehicles.

[0069] When the speed of a vehicle differs from the speed of surrounding vehicles, the lens contamination detection result may become inaccurate due to changes in the image resulting from the time difference in acquiring two images through the camera (120). Therefore, the control unit (130) controls the speed of the vehicle to a speed that is judged to be similar to the speed of surrounding vehicles according to a preset standard, and can acquire two consecutive images through the camera (120).

[0070] For example, the control unit (130) can control the speed of the vehicle through the vehicle's autonomous driving system to a speed that is judged to be similar to the speed of surrounding vehicles according to a preset standard.

[0071] Additionally, when there are no surrounding vehicles, the control unit (130) reduces the speed of the vehicle to a level where it is determined that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated can be compared according to a preset standard, and can acquire the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated through the camera (120).

[0072] For example, the vehicle speed at which two videos can be compared according to a pre-set standard can be set to within 10 km / h.

[0073] Here, the value of within 10 km / h is an arbitrarily chosen value for the sake of example, and in reality, it can be set to a slow speed that is judged to allow comparison of two videos according to a pre-set standard.

[0074] When the speed of the vehicle is too fast, the lens contamination detection result may become inaccurate due to changes in the image resulting from the time difference in acquiring two images through the camera (120). Therefore, the control unit (130) reduces the speed of the vehicle to a level where it is determined that the two images can be compared according to a preset standard, and acquires two consecutive images through the camera (120).

[0075] The control unit (130) can restore the parts where contamination exists in the image of the camera (120) through an image taken by another camera of the vehicle.

[0076] For example, if a part of the image of the camera (120) that has contamination overlaps with a part captured by another camera, the control unit (130) can restore the image of the camera (120) by replacing the part of the image of the camera (120) that has contamination and overlaps with the image of the other camera.

[0077] In this process, information regarding the overlapping image shooting areas between vehicle cameras may be stored in memory in advance, and the control unit (130) can determine whether the part of the image of the camera (120) where contamination exists overlaps with the part captured by another camera based on the information regarding the overlapping image shooting areas between vehicle cameras stored in memory.

[0078] The overlapping image capturing area between vehicle cameras will be explained through Fig. 3.

[0079] FIG. 2 is a drawing showing a vehicle camera lens contamination detection device and other devices of a vehicle according to one embodiment of the present invention.

[0080] The vehicle sensor (201) is equipped in the vehicle and connected to the control unit (203), and can transmit and receive information directly or indirectly through wireless or wired communication.

[0081] For example, the vehicle sensor (201) may include radar, lidar, ultrasonic sensor, etc.

[0082] For example, a vehicle sensor (201) can detect whether there is an object around the vehicle and can transmit information about whether there is an object around the vehicle to a control unit (203).

[0083] The camera (202) is equipped in the vehicle and connected to the control unit (203), and can transmit and receive information directly or indirectly through wireless or wired communication.

[0084] For example, a camera (202) is provided in the vehicle to obtain an image of the vehicle's surroundings before light from the light source (207) is irradiated and an image of the vehicle's surroundings while light is irradiated.

[0085] The control unit (203) is connected to at least one of a vehicle sensor (201), a camera (202), a sensor unit (204), a light source unit (207), a peripheral device for using camera images (208), a camera cleaning device (209), and a notification device (210), and can transmit and receive information directly or indirectly through wireless or wired communication.

[0086] The control unit (203) can set the intensity of the light irradiated through the light source unit (207) to exceed a predetermined threshold to the extent that it is determined that a difference in illuminance due to light can be detected.

[0087] For example, the control unit (203) can adjust the intensity of the light irradiated through the light source unit (207) to be higher as the illuminance detected by the sensor unit (204) increases, thereby enabling the detection of changes in illuminance caused by the light from the light source unit (207).

[0088] That is, the threshold value determined to the extent that a difference in illuminance due to light can be detected can be set higher as the illuminance detected by the sensor unit (204) increases.

[0089] The control unit (203) can determine when to check whether there is contamination on the lens of the camera (202).

[0090] For example, the control unit (203) can detect contamination of the lens of the camera (202) under conditions where the illuminance detected through the sensor unit (204) is lower than a threshold and the rainfall detected through the sensor unit (204) is determined not to be a rainfall state.

[0091] The control unit (203) detects lens contamination by comparing the brightness difference between two images using a light source of the vehicle, so if the illuminance is higher than a threshold, the lens contamination detection result may be inaccurate, and thus can detect contamination of the lens of the camera (202) under conditions where the illuminance is lower than a threshold.

[0092] For example, the threshold value may be a value set based on the illuminance that serves as a standard for determining whether lens contamination can be detected through image comparison based on the presence or absence of light from a light source.

[0093] Additionally, the control unit (203) can detect contamination on the lens of the camera (202) under conditions where it is determined not to be raining, because when raindrops fall on the camera (202), the brightness caused by light decreases and the lens contamination detection result may become inaccurate.

[0094] The control unit (203) may periodically detect contamination of the lens of the camera (202), or detect contamination of the lens of the camera (202) at a time when it is determined that there is no change in the image acquired through the camera (202) while the vehicle is driving.

[0095] For example, the control unit (203) can detect contamination of the lens of the camera (202) by comparing two images according to the light of the light source unit (207) at predetermined specific intervals.

[0096] For example, the control unit (203) can determine the presence, movement, or type of obstacles around the vehicle detected through the image of the camera (202) and compare the result with the presence, movement, or type of obstacles around the vehicle detected through the vehicle sensor (201). If they are different, the control unit can compare the two images based on the light of the light source unit (207) to detect contamination of the lens of the camera (202).

[0097] For example, when the image acquired through the camera (202) does not change even while the vehicle is driving, the control unit (203) can compare two images based on the light of the light source unit (207) to detect contamination of the lens of the camera (202).

[0098] The control unit (203) can detect contamination of the lens of the camera (202) under conditions where it is determined that an object exists at a distance where light irradiated from the light source unit (207) reaches, through at least one of the navigation map information and the vehicle sensor (201).

[0099] If there is no object at a distance where the light irradiated from the light source (207) can reach and be reflected, the change in the image depending on the presence or absence of light is small, so it may not be accurate to detect contamination by comparing two images.

[0100] Accordingly, the control unit (203) can detect contamination of the lens of the camera (202) under conditions such that as large an object as possible around the vehicle is included in the image screen through navigation map information, communication, or vehicle sensor (201), etc.

[0101] For example, the control unit (203) can detect lens contamination of the camera (202) by comparing images obtained through the camera (202) in places with many vehicles, traffic signs, etc., through navigation map information, communication, or vehicle sensors (201), etc.

[0102] The control unit (130) controls the vehicle to drive autonomously so that the vehicle maintains a distance that is determined to be close to surrounding vehicles within the distance where light irradiated from the light source unit (207) reaches according to a preset standard, and can detect contamination on the lens of the camera (202).

[0103] For example, the distance at which a vehicle is judged to be close to surrounding vehicles within the range of light emitted from a light source according to a preset standard can be set to 20m.

[0104] Here, the distance of 20m is an arbitrarily determined value for the purpose of example, and in reality, it can be determined as the distance at which a vehicle is judged to be close to surrounding vehicles within the distance where light emitted from the light source reaches according to a pre-set standard.

[0105] For example, the control unit (203) can autonomously control the vehicle to maintain a distance determined to be close to surrounding vehicles within the distance where light emitted from the light source unit (207) reaches, according to a preset standard, through the vehicle's autonomous driving system.

[0106] When the control unit (203) determines that contamination exists on the lens of the camera (202), it outputs a notification to the user that contamination exists on the lens of the camera (202) and can transmit information about the parts of the image of the camera (202) that are contaminated to the camera image usage peripheral device (208).

[0107] For example, if the control unit (203) determines that there is contamination on the lens of the camera (202), it can output a notification to the user through the notification device (210) that there is contamination on the lens of the camera (202).

[0108] The sensor unit (204) may include at least one of an illuminance sensor (205) and a rain sensor (206).

[0109] Additionally, the sensor unit (204) is provided in the vehicle and is connected to the control unit (203), and can transmit and receive information directly or indirectly through wireless or wired communication.

[0110] For example, the sensor unit (204) can obtain the illuminance around the vehicle through the illuminance sensor (205).

[0111] For example, the sensor unit (204) can obtain whether it is raining through the rain sensor (206).

[0112] The light source (207) can emit light around the vehicle.

[0113] For example, the light source unit (207) may include at least one of a vehicle's headlight system, headlight light, high beam, AFLS, high beam, low beam, fog light, and turn signal, and may be controlled by a control unit (203) to irradiate light around the vehicle.

[0114] A peripheral device (208) that uses camera images may be part of an autonomous driving system of a vehicle that analyzes images captured through a camera (202) to determine the presence, movement, or type of obstacles around the vehicle.

[0115] The camera image usage peripheral device (208) is connected to the control unit (203) and can transmit and receive information directly or indirectly through wireless or wired communication.

[0116] For example, if the camera image usage peripheral device (208) receives information about a part of the image of the camera (202) that is contaminated through the control unit (203), it can prevent an error in the vehicle system by not using the data about the part where the contamination exists.

[0117] Additionally, when the camera image usage peripheral device (208) receives information about a part of the image of the camera (202) that is contaminated through the control unit (203), it may request restoration of the image or detect surrounding obstacles through other sensors of the vehicle.

[0118] The camera cleaning device (209) can clean the lens of the camera (202) by spraying washer fluid onto the lens of the camera (202) or by operating a wiper, etc.

[0119] The camera cleaning device (209) is connected to the control unit (203) and can transmit and receive information directly or indirectly through wireless or wired communication.

[0120] For example, when the camera cleaning device (209) receives information about a part of the image of the camera (202) that is contaminated through the control unit (203), it can perform lens cleaning of the camera (202).

[0121] The notification device (210) can output a notification to the user that there is contamination on the lens of the camera (202).

[0122] For example, the notification device (210) is connected to the control unit (203) and can transmit and receive information directly or indirectly through wireless or wired communication.

[0123] For example, the notification device (210) can output a notification to the user that there is contamination on the lens of the camera (202) by using tactile, auditory, visual, etc., through haptics, warning sounds, warning displays, etc.

[0124] FIG. 3 is a drawing showing the area captured by the camera of a vehicle camera lens contamination detection device according to one embodiment of the present invention.

[0125] Referring to Fig. 3, the range that can be captured according to the field of view of each vehicle camera is indicated.

[0126] The cameras equipped in the vehicle may include a front SVM camera (301), a rear SVM camera (302), a front DVRS camera (303), a rear DVRS camera (304), a left front CMS camera (305), a right front CMS camera (306), a left rear CMS camera (307), and a right rear CMS camera (308).

[0127] Among the displayed areas, ① may represent an area corresponding to the field of view range of one camera.

[0128] For example, ① area may include an area corresponding only to the field of view of the front SVM camera (301), an area corresponding only to the field of view of the rear SVM camera (302), an area corresponding only to the field of view of the left front CMS camera (305), an area corresponding only to the field of view of the right front CMS camera (306), an area corresponding only to the field of view of the left rear CMS camera (307), and an area corresponding only to the field of view of the right rear CMS camera (308).

[0129] For example, area ② may include an area where the field of view of the front DVRS camera (303) and the field of view of the left front CMS camera (305) overlap, an area where the field of view of the front DVRS camera (303) and the field of view of the right front CMS camera (306) overlap, an area where the field of view of the rear DVRS camera (304) and the field of view of the left rear CMS camera (307) overlap, an area where the field of view of the rear DVRS camera (303) and the field of view of the right rear CMS camera (308) overlap, an area where the field of view of the left front CMS camera (305) and the field of view of the left rear CMS camera (307) overlap, and an area where the field of view of the right front CMS camera (306) and the field of view of the right rear CMS camera (308) overlap.

[0130] For example, area ③ may include an area where the field of view ranges of the front SVM camera (301), front DVRS camera (303), and left front CMS camera (305) overlap, an area where the field of view ranges of the front SVM camera (301), front DVRS camera (303), and right front CMS camera (306) overlap, an area where the field of view ranges of the rear SVM camera (302), rear DVRS camera (304), and left rear CMS camera (307) overlap, and an area where the field of view ranges of the rear SVM camera (302), rear DVRS camera (304), and right rear CMS camera (308) overlap.

[0131] For example, area ④ may include an area where the viewing angle ranges of the front SVM camera (301), front DVRS camera (303), left front CMS camera (305), and right front CMS camera (306) overlap, and an area where the viewing angle ranges of the rear SVM camera (302), rear DVRS camera (304), left rear CMS camera (307), and right rear CMS camera (308) overlap.

[0132] The vehicle camera lens contamination detection device (100) can restore the parts where contamination exists in the image of the camera through an image taken from another camera of the vehicle.

[0133] The vehicle camera lens contamination detection device (100) can restore the parts of the camera image where contamination exists by replacing them with images taken from other cameras of the vehicle, based on information about areas ①, ②, ③, and ④ that are stored.

[0134] Information regarding area ①, area ②, area ③, and area ④ can be stored in memory during vehicle development.

[0135] Although Figure 3 is illustrated in two dimensions, the actual information may be stored in memory for a three-dimensional area of ​​the vehicle.

[0136] FIG. 4 is a diagram showing a vehicle camera lens contamination detection device according to one embodiment of the present invention comparing two images to determine contamination of the camera lens.

[0137] A vehicle camera lens contamination detection device (100) can determine whether contamination exists on the camera lens through an image of the vehicle's surroundings (401) before light is irradiated and an image of the vehicle's surroundings (402) while light is irradiated.

[0138] For example, a vehicle camera lens contamination detection device (100) can compare the surrounding image (401) of the vehicle before light is irradiated and the surrounding image (402) of the vehicle while light is irradiated, investigate an area where no difference is determined according to a preset standard, and if the difference between each pixel value is lower than a threshold, it can be determined that contamination exists on the camera lens.

[0139] For example, a vehicle camera lens contamination detection device (100) can calculate an area (404) that is determined to have no difference according to a preset standard in a surrounding image (401) of a vehicle before light is irradiated, and calculate an area (404) that is determined to have no difference according to a preset standard in a surrounding image (402) of a vehicle while light is irradiated.

[0140] Additionally, the vehicle camera lens contamination detection device (100) can calculate a virtual image (403) for determining contamination by subtracting the pixel value of the vehicle's surrounding image (402) while light is being irradiated from the pixel value of the vehicle's surrounding image (401) before light is irradiated.

[0141] And, the vehicle camera lens contamination detection device (100) can calculate an area (406) in which no difference is determined according to a preset standard in a virtual image (403) for determining contamination.

[0142] A vehicle camera lens contamination detection device (100) can determine that contamination exists in the camera lens if the sum of the pixel values ​​in an area (406) that is determined to have no difference according to a preset standard in a virtual image (403) for determining contamination is lower than a threshold.

[0143] For example, a vehicle camera lens contamination detection device (100) can determine whether the sum of pixel values ​​is lower than a threshold value through the following [Equation 1].

[0144] [Mathematical Formula 1]

[0145]

[0146] For example, a vehicle camera lens contamination detection device (100) can calculate the R (Red), G (Green), and B (Blue) components of the pixel values ​​of an area (406) in a virtual image (403) that is determined to have no difference according to a preset standard, and thereby determine whether the sum of the values ​​obtained by multiplying each Gain and Difference is lower than a threshold.

[0147] In [Equation 1], G1 may represent the gain of the R component of the pixel value, G2 the gain of the G component of the pixel value, G3 the gain of the B component of the pixel value, DR the difference of the R component of the pixel value, DG the difference of the G component of the pixel value, and DB the difference of the B component of the pixel value.

[0148] For example, a vehicle camera lens contamination detection device (100) can determine that contamination exists in the camera lens if all pixels in an area (406) that is determined to have no difference according to a preset standard in a virtual image (403) or if the pixel values ​​of pixels above a certain ratio satisfy the condition of [Equation 1].

[0149] FIG. 5 is a flowchart illustrating a method for detecting contamination of a vehicle camera lens according to one embodiment of the present invention.

[0150] Referring to FIG. 5, the vehicle camera lens contamination detection device (100) can check whether the current state is a rainy state (S501).

[0151] For example, a vehicle camera lens contamination detection device (100) can determine whether the current condition is rainy through a rain sensor equipped in the vehicle or AVN (Audio, Video, Navigation) weather information.

[0152] The vehicle camera lens contamination detection device (100) checks whether the current state is a rainy state (S501), and if the current state is confirmed to be a rainy state, it can determine contamination by comparing lens raindrop images (S502).

[0153] For example, a vehicle camera lens contamination detection device (100) can determine whether there is contamination on the camera lens by comparing image images through deep learning when raindrops fall on the camera and the brightness is reduced by light.

[0154] The vehicle camera lens contamination detection device (100) checks whether the current state is a rainy state (S501), and if it is confirmed that the current state is not a rainy state, it can check whether the illuminance is lower than a threshold (S503).

[0155] For example, a vehicle camera lens contamination detection device (100) can check whether the current illumination outside the vehicle is lower than a threshold value through an illumination sensor equipped in the vehicle.

[0156] The vehicle camera lens contamination detection device (100) checks whether the illuminance is lower than a threshold (S503), and if it is confirmed that the illuminance is lower than the threshold, it can check whether the conditions for the contamination detection time of the camera lens are satisfied (S504).

[0157] For example, a vehicle camera lens contamination detection device (100) can check whether the contamination detection time is determined according to a preset period, a contamination detection time condition in which the detection of an obstacle through the camera image and the detection of an obstacle through a sensor equipped in the vehicle are different, or a contamination detection time condition in which the image acquired through the camera during the vehicle's driving is determined to be satisfied.

[0158] For example, a vehicle camera lens contamination detection device (100) can determine whether there is no change in the coordinates, size, or color of an image acquired through a camera while the vehicle is driving.

[0159] The vehicle camera lens contamination detection device (100) checks whether the illuminance is lower than a threshold (S503), and if it is confirmed that the illuminance is not lower than the threshold, it can check again whether the current state is a rain state (S501).

[0160] For example, when the vehicle camera lens contamination detection device (100) is not lower than a threshold, the effect on the image is minimal even when light is irradiated through a vehicle light source, making it difficult to compare images based on the presence or absence of light, so contamination detection of the camera lens can be performed when the illuminance is lower than a threshold.

[0161] The vehicle camera lens contamination detection device (100) checks whether the conditions for detecting contamination of the camera lens are satisfied (S504), and if it is confirmed that the conditions for detecting contamination of the camera lens are satisfied, it can determine the location of the vehicle (S505).

[0162] For example, a vehicle camera lens contamination detection device (100) can perform contamination detection at a location where it is determined that an object exists at a distance where light irradiated from a light source reaches, through at least one of navigation map information and a sensor equipped in the vehicle.

[0163] After the vehicle camera lens contamination detection device (100) checks whether the conditions for detecting contamination of the camera lens are satisfied (S504), if it is confirmed that the conditions for detecting contamination of the camera lens are not satisfied, it can check again whether the current state is a rain condition (S501).

[0164] The vehicle camera lens contamination detection device (100) can acquire a camera image after determining the position of the vehicle (S505) (S506).

[0165] For example, a vehicle camera lens contamination detection device (100) can acquire an image of the vehicle's surroundings before light is irradiated through the camera and an image of the vehicle's surroundings while light is irradiated.

[0166] After the vehicle camera lens contamination detection device (100) acquires a camera image (S506), it can determine whether there is contamination (S507).

[0167] For example, a vehicle camera lens contamination detection device (100) can determine whether there is contamination on the camera lens by comparing an image of the vehicle's surroundings before light is irradiated with an image of the vehicle's surroundings while light is irradiated.

[0168] The vehicle camera lens contamination detection device (100) checks whether there is contamination (S507), and if there is contamination, it can notify the user of the contamination (S508).

[0169] For example, a vehicle camera lens contamination detection device (100) can provide tactile, visual, or auditory notifications through a cluster, AVN, etc.

[0170] The vehicle camera lens contamination detection device (100) checks whether there is contamination (S507), and if there is no contamination, it can check again whether the current state is rain (S501).

[0171] After the vehicle camera lens contamination detection device (100) notifies the user of the contamination (S508), the image can be restored through the image of another camera that has an overlapping contamination area (S509).

[0172] For example, if a vehicle camera lens contamination detection device (100) determines that contamination exists on the lens of a camera, it receives data from an overlapping area of ​​another camera and can restore an image based on the received data.

[0173] FIG. 6 is a flowchart illustrating a method for detecting contamination of a vehicle camera lens according to another embodiment of the present invention.

[0174] Referring to FIG. 6, a method for detecting contamination in a vehicle camera lens may include the step of irradiating light around a vehicle (S610), the step of obtaining an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated (S620), and the step of comparing the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated to determine whether contamination exists in the lens of the camera (S630).

[0175] The step of illuminating the surroundings of the vehicle (S610) may include illuminating the surroundings of the vehicle with a light intensity set to exceed a threshold value determined to the extent that a difference in the ambient illumination of the vehicle can be detected by the light.

[0176] The step (S620) of acquiring surrounding images of the vehicle before the light is irradiated and surrounding images of the vehicle while the light is irradiated may include acquiring surrounding images of the vehicle before the light is irradiated and surrounding images of the vehicle while the light is irradiated through a camera at a time interval such that the surrounding images of the vehicle before the light is irradiated and surrounding images of the vehicle while the light is irradiated are judged to be similar according to a preset standard.

[0177] The step (S630) of determining whether contamination exists on the camera lens by comparing the surrounding image of the vehicle before the light is irradiated with the surrounding image of the vehicle while the light is irradiated may include determining whether contamination exists on the camera lens based on the difference in pixel values ​​between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated.

[0178] The above description is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations within the scope of the essential characteristics of the present invention.

[0179] Accordingly, the embodiments disclosed in this invention are intended to illustrate, not limit, the technical concept of the invention, and the scope of the technical concept of the invention is not limited by these embodiments. The scope of protection of this invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of this invention.

Claims

Claim 1 A light source unit that irradiates light around the vehicle; a camera provided in the vehicle that acquires an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated; The control unit includes a control unit that determines whether contamination exists on the lens of the camera by comparing the surrounding image of the vehicle before the light is irradiated with the surrounding image of the vehicle while the light is irradiated. The control unit calculates the difference between the pixel values ​​of the surrounding image of the vehicle before the light is irradiated and the pixel values ​​of the surrounding image of the vehicle while the light is irradiated to produce a virtual image for contamination determination, calculates an area in the virtual image where no difference is determined according to a preset standard, and determines that contamination exists on the lens of the camera if the sum of the pixel values ​​in the area where no difference is determined according to the preset standard is lower than a threshold. The determination of whether the sum of the pixel values ​​is lower than the threshold is made based on the difference in pixel values ​​by RGB component and the gain by RGB component between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated, wherein a first value obtained by multiplying the gain of the R component of the pixel value and the difference of the R component of the pixel value, and the gain of the G component of the pixel value and the difference of the G component of the pixel value A vehicle camera lens contamination detection device characterized by obtaining a second value multiplied by the first value and a third value multiplied by the gain of the B component of the pixel value and the difference of the B component of the pixel value, and determining whether contamination exists in the lens of the camera based on whether the sum of the first value, the second value, and the third value is lower than the threshold. Claim 2 A vehicle camera lens contamination detection device according to claim 1, further comprising a sensor unit for acquiring ambient light intensity of the vehicle, wherein the control unit sets the intensity of the light to exceed a predetermined threshold to the extent that it is determined that the difference in ambient light intensity caused by the light can be detected. Claim 3 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit acquires the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle during the light is irradiated through the camera at time intervals such that the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle during the light is irradiated are judged to be similar according to a preset standard. Claim 4 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit controls the speed of the vehicle to a speed determined to be similar to the speed of surrounding vehicles according to a preset standard, and acquires an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated through the camera. Claim 5 A vehicle camera lens contamination detection device according to claim 4, wherein the control unit reduces the speed of the vehicle to a degree such that, when there are no surrounding vehicles of the vehicle, the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated can be compared according to a preset standard, and acquires the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated through the camera. Claim 6 delete Claim 7 A vehicle camera lens contamination detection device according to claim 1, further comprising a sensor unit that acquires ambient light levels around the vehicle and acquires whether it is raining, and the control unit performs detection of contamination on the lens of the camera under conditions where the ambient light is lower than a threshold and the rain status is determined not to be a rain state. Claim 8 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit periodically performs detection of contamination on the lens of the camera, or performs detection of contamination on the lens of the camera at a time when it is determined that there is a difference between whether an obstacle is detected through the image of the camera and whether an obstacle is detected through a sensor provided in the vehicle, or performs detection of contamination on the lens of the camera at a time when it is determined that there is no change in the image acquired through the camera while the vehicle is driving. Claim 9 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit performs detection of contamination on the lens of the camera under conditions in which it is determined that an object exists at a distance reached by light irradiated from the light source unit through at least one of navigation map information and a sensor equipped in the vehicle. Claim 10 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit controls the vehicle to autonomously drive so that the vehicle maintains a distance determined to be close to a surrounding vehicle within the distance where light irradiated from the light source unit reaches according to a preset standard, and performs detection of contamination on the lens of the camera. Claim 11 A vehicle camera lens contamination detection device according to claim 1, wherein the control unit outputs a notification to a user containing the content that contamination exists on the lens of the camera when it is determined that contamination exists on the lens of the camera, and transmits information regarding the part of the image of the camera where contamination exists to a system of the vehicle using the image of the camera. Claim 12 In claim 1, the control unit is a vehicle camera lens contamination detection device that restores a part where contamination exists in the image of the camera through an image captured by another camera of the vehicle. Claim 13 A step of illuminating the surroundings of a vehicle with light; a step of acquiring an image of the surroundings of the vehicle before the light is illuminating and an image of the surroundings of the vehicle while the light is illuminating; The method includes a step of determining whether contamination exists on the camera lens by comparing the surrounding image of the vehicle before the light is irradiated with the surrounding image of the vehicle while the light is irradiated, wherein the step of determining whether contamination exists on the camera lens comprises calculating the difference between the pixel values ​​of the surrounding image of the vehicle before the light is irradiated and the pixel values ​​of the surrounding image of the vehicle while the light is irradiated to produce a virtual image for contamination determination, calculating an area in the virtual image where no difference is determined according to a preset standard, and determining that contamination exists on the camera lens if the sum of the pixel values ​​in the area where no difference is determined according to the preset standard is lower than a threshold, wherein the determination of whether the sum of the pixel values ​​is lower than the threshold is determined based on the difference in pixel values ​​by RGB components and the gain by RGB components between the surrounding image of the vehicle before the light is irradiated and the surrounding image of the vehicle while the light is irradiated, wherein a first value obtained by multiplying the gain of the R component of the pixel value and the difference of the R component of the pixel value, and the gain of the G component of the pixel value and A method for detecting contamination in a vehicle camera lens, characterized by obtaining a second value obtained by multiplying the difference of the G component of the pixel value and a third value obtained by multiplying the gain of the B component of the pixel value and the difference of the B component of the pixel value, respectively, and determining whether contamination exists in the lens of the camera based on whether the sum of the first value, the second value, and the third value is lower than the threshold. Claim 14 A method for detecting contamination of a vehicle camera lens according to claim 13, further comprising the step of acquiring an illuminance around the vehicle, and the step of irradiating light around the vehicle comprising the step of setting the intensity of the light to exceed a threshold value determined to the extent that a difference in illuminance caused by the light can be detected. Claim 15 A method for detecting contamination of a vehicle camera lens according to claim 13, wherein the step of acquiring an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated comprises acquiring the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated through the camera at a time interval such that the image of the vehicle's surroundings before the light is irradiated and the image of the vehicle's surroundings while the light is irradiated are judged to be similar according to a preset standard. Claim 16 A method for detecting contamination of a vehicle camera lens according to claim 13, wherein the step of acquiring an image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated comprises controlling the speed of the vehicle to a speed determined to be similar to the speed of surrounding vehicles according to a preset standard, and acquiring the image of the vehicle's surroundings before the light is irradiated and an image of the vehicle's surroundings while the light is irradiated through the camera. Claim 17 delete Claim 18 A method for detecting contamination of a vehicle camera lens according to claim 13, further comprising the step of periodically detecting contamination of the lens of the camera, or detecting contamination of the lens of the camera at a time when it is determined that there is a difference between whether an obstacle is detected through the image of the camera and whether an obstacle is detected through a sensor provided in the vehicle, or detecting contamination of the lens of the camera at a time when it is determined that there is no change in the image acquired through the camera while the vehicle is driving. Claim 19 A method for detecting contamination of a vehicle camera lens according to claim 13, further comprising the step of autonomously driving the vehicle to maintain a distance determined to be close to a surrounding vehicle within the distance where the irradiated light reaches according to a preset standard, and performing detection of contamination on the lens of the camera. Claim 20 A method for detecting contamination in a vehicle camera lens according to claim 13, further comprising: a step of outputting a notification to a user including that contamination exists in the lens of the camera; a step of transmitting information about the part of the image of the camera where contamination exists to a system of the vehicle using the image of the camera; and a step of restoring the part of the image of the camera where contamination exists through an image captured by another camera of the vehicle.

Citation Information

Patent Citations

  • Apparatus and method for detecting dirt on camera

    JP2003259358A

  • On-vehicle imaging apparatus

    JP2007282106A

  • Image processing system

    JP2017092622A

  • In-vehicle camera device and in-vehicle camera dirt detection method

    JP2020092365A

  • Vehicle and controlling method of vehicle

    KR1020210009199A