Vehicle-mounted sensor cleaning device and vehicle-mounted sensor cleaning method

By using the position information set in the vehicle and the visual confirmation probability correlation value to determine the automatic cleaning conditions, the problem of on-board sensor cleaning affecting the sharpness of the driver's observation image is solved, and the automatic cleaning frequency is reduced when the driver's observation frequency is high effect.

CN114513630BActive Publication Date: 2024-11-29TOYOTA JIDOSHA KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202111346596.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-15
Publication Date
2024-11-29
Estimated Expiration
2041-11-15

AI Technical Summary

Technical Problem

When the existing vehicle-mounted sensor cleaning device performs automatic cleaning, it is easy to affect the clarity of the driver's observation peripheral images, and automatic cleaning is difficult to avoid in places where the driver has a high observation frequency, affecting the accuracy of monitoring information.

Method used

By setting a position information acquisition device and a control unit in the vehicle, the stored area position information and the visual confirmation probability correlation value determine the conditions for automatic cleaning, and only perform automatic cleaning when the driver does not observe the peripheral image is low, and adjusts Clean the threshold to reduce the cleaning frequency.

Benefits of technology

It effectively reduces the frequency of automatic cleaning of on-board sensors in places where the driver observes images at high frequency, ensures the clarity of peripheral images, and optimizes the consumption of cleaning liquid.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114513630B_ABST
    Figure CN114513630B_ABST
Patent Text Reader

Abstract

The present invention relates to a vehicle-mounted sensor cleaning device and a vehicle-mounted sensor cleaning method. The vehicle-mounted sensor cleaning device is applied to a vehicle (SV). The vehicle (SV) is provided with a front camera (11) and a rear camera (12), a central display (20) and an electronic rearview mirror (30) for displaying peripheral images obtained via the front camera (11) and the rear camera (12). The vehicle-mounted sensor cleaning device comprises an ECU (10), a position information acquisition device (14) and a cleaning unit (U1). Based on the position information of the vehicle (SV), the ECU (10) acquires the visual confirmation probability Prj of an area ARj including the position of the vehicle (SV) indicated by the position information of the vehicle (SV) from a visual confirmation probability database (60b), and determines the automatic cleaning start condition according to the acquired visual confirmation probability Prj.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a vehicle-mounted sensor cleaning device and a vehicle-mounted sensor cleaning method for cleaning a detection surface through which a signal (visible light, laser, infrared, electromagnetic waves such as radio waves in the millimeter wave band, sound waves, etc.) received by a vehicle-mounted sensor passes by using a cleaning liquid. Background Art

[0002] Conventionally, there are known vehicles equipped with a device that supports the driver in a manner that enables the driver of the vehicle (the vehicle) to easily monitor the surrounding conditions of the vehicle. For example, one example of such a vehicle displays an image of the surroundings of the vehicle acquired by a camera sensor (i.e., an on-board sensor) mounted on the vehicle on a display. Furthermore, another example of such a vehicle displays surrounding monitoring support information (e.g., information indicating the approach of other vehicles) acquired by an on-board sensor such as a radar sensor and an ultrasonic sensor on a display.

[0003] Patent Document 1 discloses an on-vehicle sensor cleaning device (hereinafter referred to as a “conventional device”) that regularly cleans a detection surface of an on-vehicle sensor with a cleaning fluid (ie, regularly performs automatic cleaning).

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2019-123262 Summary of the invention

[0007] When the vehicle-mounted sensor is a camera sensor, during the execution of automatic cleaning, the cleaning fluid is reflected in the image, so that the image of the vehicle's surroundings becomes unclear. When the vehicle-mounted sensor is a sensor other than a camera sensor, during the execution of automatic cleaning, the detection accuracy of the vehicle-mounted sensor decreases due to the cleaning fluid that cleans the detection part of the vehicle-mounted sensor, so that the surrounding monitoring support information obtained by the vehicle-mounted sensor may be inaccurate. Therefore, when the vehicle is located in a place where the driver has a high frequency (likelihood) of observing at least one of the surrounding image and the surrounding monitoring support information, it is required to avoid performing automatic cleaning of the vehicle-mounted sensor as much as possible.

[0008] However, the conventional device periodically performs automatic cleaning. Therefore, the conventional device is likely to perform automatic cleaning at a location where the driver frequently observes at least one of the surrounding image and the surrounding monitoring support information.

[0009] The present invention is made to address the above-mentioned problems. That is, one of the purposes of the present invention is to provide a vehicle-mounted sensor cleaning device and a vehicle-mounted sensor cleaning method that can make it difficult to perform automatic cleaning of a vehicle-mounted sensor when the vehicle is located in a place where the driver is likely to observe at least one of the images and information obtained through the vehicle-mounted sensor. Hereinafter, the vehicle-mounted sensor cleaning device of the present invention is sometimes referred to as the "cleaning device of the present invention." The vehicle-mounted sensor cleaning method of the present invention is sometimes referred to as the "cleaning method of the present invention."

[0010] The cleaning device of the present invention is applied to a vehicle (SV), which comprises: a vehicle-mounted sensor (11, 12) for acquiring information about the periphery of the vehicle based on electromagnetic waves or sound waves detected by a face exposed outside the vehicle; and a display device (20, 30) for displaying an image or displaying information generated based on the information acquired by the vehicle-mounted sensor.

[0011] The cleaning device of the present invention has:

[0012] A cleaning unit (U1) configured to perform a cleaning process of cleaning the detection surface of the vehicle-mounted sensor using a cleaning fluid;

[0013] A position information acquisition device (14) for acquiring vehicle position information indicating the position of the vehicle; and

[0014] A control unit (10) is configured to use a storage device (60, 102) that stores in association area position information capable of determining the positions of a plurality of areas set on the ground and visual confirmation probability correlation values ​​correlated with the probability that the driver of the vehicle visually confirms the display device in each of the plurality of areas, obtains a result of a determination as to whether an automatic cleaning start condition is satisfied based on the visual confirmation probability correlation values ​​for the following areas (steps 505 to 530), and when the result of the determination indicates that the automatic cleaning start condition is satisfied (the determination is "yes" in step 530), controls the cleaning unit to perform the cleaning process (step 535), wherein the area is one of the plurality of areas and includes a specific position (determined position) of the vehicle indicated by the obtained vehicle position information.

[0015] The cleaning device of the present invention performs cleaning processing when the result of the determination of whether the automatic cleaning start condition is satisfied indicates that the automatic cleaning start condition is satisfied. The automatic cleaning start condition is determined based on a value related to the visual confirmation probability of the location where the vehicle is located. Thus, the cleaning device of the present invention can reduce the frequency of automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a location where the driver of the vehicle is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0016] One aspect of the cleaning device of the present invention further comprises the storage device (60) mounted on the vehicle.

[0017] In one embodiment of the cleaning device of the present invention, the control unit is configured to obtain the visual confirmation probability correlation value for the area including the specific position of the vehicle from the storage device based on the obtained vehicle position information (steps 505 to 515), determine the automatic cleaning start condition based on the obtained visual confirmation probability correlation value (step 520), and determine whether the automatic cleaning start condition is met, thereby obtaining the result of the determination (step 530).

[0018] According to the above scheme, the automatic cleaning start condition is determined based on the visual confirmation probability correlation value obtained from the storage device mounted on the vehicle. Thus, the above scheme can make it difficult to perform automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a place where the driver is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0019] One embodiment of the cleaning device of the present invention further comprises a wireless communication device (110) which is mounted on the vehicle and is capable of communicating with an information processing device which exists outside the vehicle and includes the storage device (102).

[0020] In one embodiment of the cleaning device of the present invention, the control unit is configured to: communicate with the information processing device by using the wireless communication device, obtain the visual confirmation probability related value for the area including the specific position of the vehicle from the storage device based on the obtained vehicle position information, determine the automatic cleaning start condition based on the obtained visual confirmation probability related value, and determine whether the automatic cleaning start condition is met, thereby obtaining the result of the determination.

[0021] According to the above scheme, the automatic cleaning start condition is determined based on the visual confirmation probability correlation value obtained from the storage device outside the vehicle using the wireless communication device. Thus, the above scheme can make it difficult to perform automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a place where the driver is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0022] In one embodiment of the cleaning device of the present invention,

[0023] The vehicle-mounted sensor is a camera sensor (11, 12) that obtains image information by photographing the periphery of the vehicle using light as the electromagnetic wave, and the control unit is configured to: obtain a dirt index value indicating the degree of dirtiness of the detected face of the vehicle-mounted sensor based on the image information, determine whether the automatic cleaning start condition is met by comparing the dirt index value with a cleaning threshold value (step 530), determine the automatic cleaning start condition by determining the cleaning threshold value based on the obtained visual confirmation probability correlation value (step 520), and obtain the result of the determination indicating that the automatic cleaning start condition is met when the dirt index value is greater than the cleaning threshold value (the determination of "yes" in step 530).

[0024] The above scheme can determine the automatic cleaning start condition according to the visual confirmation probability by determining the cleaning threshold value to be compared with the dirt index value according to the visual confirmation probability correlation value. Thus, the above scheme can make it difficult to perform automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a place where the driver is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0025] In one embodiment of the cleaning device of the present invention, the control unit is configured as follows:

[0026] The automatic cleaning start condition is determined by changing the cleaning threshold so that it becomes larger than the cleaning threshold when the obtained visual confirmation probability correlation value is a specific value and when the obtained visual confirmation probability correlation value is smaller than the specific value (step 520).

[0027] The above scheme can make it more difficult for the automatic cleaning start condition to be satisfied when the cleaning threshold value compared with the dirt index value is changed as described above. Thus, the above scheme can make it difficult to perform automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a place where the driver is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0028] In one embodiment of the cleaning device of the present invention,

[0029] The control unit is configured to determine the automatic cleaning start condition by changing the cleaning threshold (step 1015) in the following manner: when the acquired visual confirmation probability correlation value is in a first range below the first visual confirmation probability correlation value, the cleaning threshold becomes the first threshold; when the acquired visual confirmation probability correlation value is in a second range that is larger than the first visual confirmation probability correlation value and smaller than the second visual confirmation probability correlation value and the change in the visual confirmation probability correlation value accompanying the driving of the vehicle is on an upward trend (the judgment is "yes" in step 1010), the cleaning threshold becomes the second threshold that is smaller than the first threshold.

[0030] The above aspect can reduce the consumption of the cleaning fluid by changing the cleaning threshold value compared with the contamination index value as described above, and can facilitate automatic cleaning of the vehicle-mounted sensor before the vehicle reaches an area with a relatively large visual confirmation probability correlation value.

[0031] One embodiment of the vehicle-mounted sensor cleaning device of the present invention further comprises a driver information acquisition device (13) for acquiring driver information, which is information used to determine the state of the driver of the vehicle.

[0032] In the above-mentioned embodiment, the control unit is configured to prohibit the execution of the cleaning process (the judgment is "No" in step 1205 and the judgment is "No" in step 530) while it is determined based on the driver information that the driver of the vehicle is visually confirming the display device.

[0033] The above aspect can reliably avoid the automatic cleaning from being executed while the driver is viewing at least one of the image acquired by the vehicle-mounted sensor and the display information.

[0034] One aspect of the washer of the present invention further includes a driver information acquisition device that acquires driver information, which is information used to determine the state of the driver of the vehicle.

[0035] In the above-mentioned scheme, the control unit is configured to: perform a visual confirmation judgment on whether the display device has been visually confirmed based on the driver information (step 310), determine one of the multiple areas including the position where the result of the visual confirmation judgment is obtained (step 410), calculate the visual confirmation probability related value of the determined area based on the result of the visual confirmation judgment (steps 425 to 445), establish an association between the calculated visual confirmation probability related value and the area position information representing the determined area and save it to the storage device (step 450).

[0036] In the above embodiment, it is determined whether the driver visually confirmed the display device in the area where the vehicle actually traveled, and the visual confirmation probability correlation value calculated based on the determination result is stored in the storage device. Therefore, the above embodiment can store the visual confirmation probability correlation value with high accuracy in the storage device.

[0037] The cleaning method of the present invention is applied to a vehicle (SV), the vehicle having:

[0038] On-vehicle sensors (11, 12) that acquire information about the periphery of the vehicle based on electromagnetic waves or sound waves detected by a face exposed outside the vehicle;

[0039] A display device (20, 40) for displaying an image or displaying information generated based on information obtained by the vehicle-mounted sensor;

[0040] a cleaning unit (U1) configured to perform a cleaning process of cleaning the detection surface of the vehicle-mounted sensor using a cleaning fluid; and

[0041] A position information acquisition device (14) acquires vehicle position information indicating the position of the vehicle.

[0042] The cleaning method of the present invention includes: using a storage device (60) that establishes an association to store area position information that can determine the positions of each of a plurality of areas set on the ground surface and a visual confirmation probability correlation value that is correlated with the probability that the driver of the vehicle visually confirms the display device in each of the plurality of areas, a step of obtaining the visual confirmation probability correlation value for the following area (step 515), the above-mentioned area is one of the plurality of areas and includes a specific position of the vehicle represented by the obtained vehicle position information; a step of determining an automatic cleaning start condition based on the obtained visual confirmation probability correlation value (step 520); a step of obtaining a result of determining whether the determined automatic cleaning start condition is met (step 530); and a step of controlling the cleaning unit to perform the cleaning process (step 535) when the result of the determination indicates that the automatic cleaning start condition is met (the determination is "yes" in step 530).

[0043] According to the cleaning method of the present invention, when the result of the determination of whether the automatic cleaning start condition is satisfied indicates that the automatic cleaning start condition is satisfied, the cleaning process is performed. The automatic cleaning start condition is determined based on a value related to the visual confirmation probability of the location where the vehicle is located. Thus, the cleaning method of the present invention can reduce the frequency of automatic cleaning of the vehicle-mounted sensor when the vehicle is located in a location where the driver of the vehicle is likely to observe at least one of the image and display information obtained by the vehicle-mounted sensor.

[0044] One solution of the cleaning method of the present invention comprises:

[0045] A step of obtaining driver information for determining the state of the driver of the vehicle (step 305, step 310);

[0046] a step of performing a visual confirmation determination on whether the display device is visually confirmed based on the driver information (step 310), and determining one of the plurality of areas including a position where a result of the visual confirmation determination is obtained (step 410);

[0047] a step of calculating the visual confirmation probability correlation value of the determined one area based on the result of the visual confirmation determination (steps 425 to 445); and

[0048] A step of associating the calculated visual confirmation probability correlation value with the area position information indicating the determined one area and storing the resultant in the storage device (step 450).

[0049] According to the above embodiment, it is determined whether the driver visually confirmed the display device in the area where the vehicle actually traveled, and the visual confirmation probability correlation value calculated based on the determination result is stored in the storage device. Therefore, the above embodiment can store the visual confirmation probability correlation value with high accuracy in the storage device.

[0050] In the above description, in order to help understand the present invention, the names and / or numbers used in the embodiments are added in parentheses to the configurations of the invention corresponding to the embodiments described later. However, the constituent elements of the present invention are not limited to the embodiments specified by the names and / or numbers. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 It is a schematic structural diagram of a vehicle-mounted device including a first cleaning device according to an embodiment.

[0052] Figure 2 This is a rough plan of the road.

[0053] Figure 3 This is a flowchart showing a routine executed by the CPU of the ECU of the first to third cleaning devices.

[0054] Figure 4 This is a flowchart showing a routine executed by the CPU of the ECU of the first to third cleaning devices.

[0055] Figure 5 This is a flowchart showing a routine executed by the CPU of the ECU of the first cleaning device.

[0056] Figure 6This is a diagram for explaining the outline of the operation of the first cleaning device.

[0057] Figure 7 This is a flowchart showing a routine executed by the CPU of the ECU according to the modified example of the first cleaning device.

[0058] Figure 8 This is a flowchart showing a routine executed by the CPU of the ECU according to the modified example of the first cleaning device.

[0059] Fig. 9A This is a diagram for explaining the second map Map2.

[0060] Fig. 9B This is a diagram for explaining the third map Map3.

[0061] Fig.10 This is a flowchart showing a routine executed by the CPU of the ECU of the second cleaning device.

[0062] Fig.11 This is a diagram for explaining the outline of the operation of the second cleaning device.

[0063] Fig.12 This is a flowchart showing a routine executed by the CPU of the ECU of the third cleaning device.

[0064] Fig.13 This is a diagram for explaining the outline of the operation of the third cleaning device.

[0065] Fig.14 This is a schematic diagram of the vehicle sensor cleaning system.

[0066] Description of symbols

[0067] 10…ECU, 11…front camera, 12…rear camera, 13…driver monitoring camera, 14…position information acquisition device, 20…central display, 30…electronic rearview mirror, 31…monitor unit, 40…first pump, 41…first nozzle, 50…second pump, 51…second nozzle, 60…storage device, 60b…visual confirmation probability database, TA1…tank, U1…cleaning unit. DETAILED DESCRIPTION

[0068] <<First Embodiment>>

[0069] <Composition>

[0070] like Figure 1As shown, a vehicle-mounted device including a vehicle-mounted sensor cleaning device according to a first embodiment of the present invention (hereinafter referred to as "the first cleaning device") is mounted on a vehicle SV. The vehicle-mounted device includes an ECU 10, a front camera 11, a rear camera 12, a driver monitoring camera 13, a position information acquisition device 14, a central display 20, an electronic rearview mirror 30, a cleaning unit U1, and a storage device 60. The cleaning unit U1 includes a tank TA1, a first pump 40, a first nozzle 41, a second pump 50, and a second nozzle 51. The first cleaning device includes an ECU 10, a driver monitoring camera 13, a position information acquisition device 14, a cleaning unit U1, and a storage device 60.

[0071] ECU10 is a control unit (Electronic Control Unit) having a microcomputer as a main part, also called a controller. The microcomputer includes a CPU, ROM, RAM, and an interface (I / F). The CPU implements various functions by executing instructions (programs, routines) stored in the ROM. In addition, ECU10 can also be composed of multiple ECUs.

[0072] The ECU 10 is connected to a front camera 11, a rear camera 12, a driver monitoring camera 13, and a position information acquisition device 14. Hereinafter, the front camera 11 and the rear camera 12 are each referred to as a "camera sensor (or peripheral camera device)" when there is no need to distinguish them from each other.

[0073] The front camera 11 is installed at the center of the front end of the vehicle SV. The front camera 11 is one of the vehicle-mounted sensors, and has a detection face exposed outside the vehicle SV. The front camera 11 has a light receiving element. Visible light from the area in front of the vehicle SV corresponding to the shooting range of the front camera 11 is guided to the light receiving element. The front camera 11 uses the light receiving element to obtain image information (front image data) representing the area in front of the vehicle SV. The front camera 11 sends the obtained image information to the ECU 10. The ECU 10 generates a front peripheral image including an image corresponding to its shooting range based on the image information received from the front camera 11. The front peripheral image functions as an image to support the driver in monitoring the front area of ​​the vehicle SV.

[0074] The rear camera 12 is installed in the center of the rear end of the vehicle SV. The rear camera 12 is one of the vehicle-mounted sensors and has a detection face exposed on the outside of the vehicle SV. The rear camera 12 has a light receiving element. Visible light from the area behind the vehicle SV corresponding to the shooting range of the rear camera 12 is guided to the light receiving element. The rear camera 12 uses the light receiving element to obtain image information (rear image data) representing the area behind the vehicle SV. The rear camera 12 sends the obtained image information to the ECU 10. Based on the image information received from the rear camera 12, the ECU 10 generates a rear peripheral image including an image corresponding to its shooting range. The rear peripheral image functions as an image that supports the driver in monitoring the rear area of ​​the vehicle SV. In addition, hereinafter, the front peripheral image and the rear peripheral image are each referred to as a "peripheral image" without distinguishing them from each other.

[0075] The driver monitoring camera 13 is installed at a position where it can capture the face of the driver sitting in the driver's seat of the vehicle SV. The driver monitoring camera 13 generates a driver image by capturing the driver's face within its capturing range, and transmits the generated driver image to the ECU 10. The ECU 10 obtains driver information (for example, information indicating the driver's line of sight) for determining the driver's state based on the driver image received from the driver monitoring camera 13. The driver monitoring camera 13 is also referred to as a "driver information acquisition device" for convenience.

[0076] The position information acquisition device 14 has a GNSS (Global Navigation Satellite System) receiver. The GNSS receiver receives "signals (GNSS signals) from artificial satellites constituting the GNSS" for detecting the current position (current position) of the vehicle SV. The position information acquisition device 14 obtains position information indicating the current position of the vehicle SV based on the GNSS signal. In addition, the position is represented by latitude and longitude, for example. The position information acquisition device 14 sends the obtained position information to the ECU 10.

[0077] The ECU 10 is further connected to a central display 20 , an electronic rearview mirror 30 , a first pump 40 , a second pump 50 , and a storage device 60 .

[0078] The central display 20 is a touch panel display that displays images. The central display 20 is provided near the center in the vehicle width direction of an instrument panel (not shown) in the vehicle cabin of the vehicle SV. The ECU 10 displays a front surrounding image and / or a rear surrounding image on the central display 20 .

[0079] The electronic rearview mirror 30 includes a monitor unit 31 (rearview mirror display) for displaying an image. The monitor unit 31 is arranged at a position where the driver can visually confirm (for example, the position where the conventional rearview mirror is arranged, i.e., the upper center of the inner side of the front windshield). The ECU 10 displays the rear surrounding image on the monitor unit 31 of the electronic rearview mirror 30.

[0080] The first pump 40 communicates with the tank TA1 via the liquid pipe CL1. The tank TA1 is a container for storing the cleaning liquid. The first pump 40 communicates with the first nozzle 41 via the liquid pipe CL1. The first nozzle 41 is disposed at a position capable of spraying the cleaning liquid toward the detection face of the front camera 11.

[0081] The driving state of the first pump 40 is controlled by the ECU 10. When the first pump 40 is driven by the ECU 10, the first pump 40 takes in the cleaning liquid from the tank TA1 via the liquid pipe CL1, and supplies the cleaning liquid to the first nozzle 41 via the liquid pipe CL1. The first nozzle 41 sprays the cleaning liquid supplied from the tank TA1 toward the detection face of the front camera 11. Therefore, the ECU 10 can clean the detection face of the front camera 11 by driving the first pump 40.

[0082] The second pump 50 communicates with the tank TA1 via the liquid pipe CL1. Furthermore, the second pump 50 communicates with the second nozzle 51 via the liquid pipe CL1. The second nozzle 51 is disposed at a position where the washing liquid can be sprayed toward the detection face of the rear camera 12.

[0083] The driving state of the second pump 50 is controlled by the ECU 10. When the second pump 50 is driven by the ECU 10, the second pump 50 takes in the cleaning liquid from the tank TA1 through the liquid pipe CL1, and supplies the cleaning liquid to the second nozzle 51 through the liquid pipe CL1. The second nozzle 51 sprays the cleaning liquid supplied from the tank TA1 toward the detection face of the rear camera 12. Therefore, the ECU 10 can clean the detection face of the rear camera 12 by driving the second pump 50.

[0084] The storage device 60 is a nonvolatile storage device (a hard disk in this example) capable of reading information. The ECU 10 can store information in the storage device 60 and read information stored in the storage device 60. The storage device 60 has a map information database 60a and a visual confirmation probability database 60b.

[0085] The map information database 60a stores map information, which includes information on road width, location of parking lots, intersections, branch intersections, and signals (traffic lights), in addition to information on the location of roads (location information of each lane) and road shapes.

[0086] The visual confirmation probability database 60b stores area position information for specifying the positions of "a plurality of areas ARj described later" and "visual confirmation probabilities Prj, cumulative confirmation counts NCj, and cumulative determination counts NDj" associated with the area position information for the areas ARj.

[0087] like Figure 2 As shown, the area position information is position information for determining (indicating) the position of each area ARj when the road Ro1 and parking lot (not shown) on which the vehicle SV can travel are divided into a plurality of areas ARj based on map information. The area ARj has a predetermined size and shape (a rectangle in this example). The area position information for determining the area ARj is, for example, a set of "four position data" in which the positions of the four vertices (Parj1, Parj2, Parj3, Parj4) of a rectangle of a predetermined size are represented by "latitude and longitude".

[0088] The visual confirmation probability Prj indicates the probability that the driver of the vehicle SV visually confirms (visually sees) any one of the central display 20 and the electronic rearview mirror 30 in a certain area ARj (hereinafter, also referred to as "visual confirmation probability"). In addition, the visual confirmation probability Prj may also be a value having a correlation with the visual confirmation probability, and is a visual confirmation probability correlation value that becomes larger as the visual confirmation probability increases. Moreover, each of the central display 20 and the electronic rearview mirror 30 is referred to as a "display" when there is no need to distinguish them from each other. The display is also referred to as a "display device" for convenience.

[0089] The cumulative number of confirmations NCj represents the cumulative value of the number of times the determination is made that the driver of the vehicle SV visually confirms the display when the vehicle SV passes through "a certain area ARj" (hereinafter, also referred to as the "cumulative number"). The cumulative number of determinations NDj is the cumulative value of the number of times the determination is made that the vehicle SV passes through "a certain area ARj". In other words, the cumulative number of determinations NDj is the cumulative value of the number of times the determination is made as to whether the driver visually confirms the display in "a certain area ARj". In addition, the initial values ​​of the cumulative number of confirmations NCj and the cumulative number of determinations NDj are each set to "0". The visual confirmation probability Prj is calculated by dividing the cumulative number of confirmations NCj by the cumulative number of determinations NDj (i.e., Prj=NCj / NDj).

[0090] <Overview of Cleaning Process>

[0091] When the ECU 10 determines that the detection face of the front camera 11 is dirty, it executes an automatic washing process to automatically wash the detection face. Similarly, when the ECU 10 determines that the detection face of the rear camera 12 is dirty, it executes an automatic washing process to automatically wash the detection face.

[0092] Specifically, ECU 10 obtains (detects) "an index value indicating the degree of dirtiness (hereinafter, also referred to as "dirtiness index value")" of each detected face of the front camera 11 and the rear camera 12. ECU 10 obtains the dirtiness index value of the front camera 11 based on the front peripheral image as described below, and obtains the dirtiness index value of the rear camera 12 based on the rear peripheral image as described below.

[0093] The dirt index value of the front camera 11 is “the ratio (percentage) of the area of ​​the dirty region in the front surrounding image to the entire area of ​​the front surrounding image”.

[0094] Dirt index value of the front camera 11

[0095] =100·(the area of ​​the dirty region in the front surrounding image) / (the total area of ​​the front surrounding image)

[0096] Furthermore, the dirty area in the front surrounding image is an area where the change in brightness is less than a threshold value within a predetermined time (that is, an area where the brightness does not substantially change in a plurality of temporally continuous front surrounding images).

[0097] As shown in the following equation, the dirt index value of the rear camera 12 is “the ratio (percentage) of the area of ​​the dirty region in the rear surrounding image to the entire area of ​​the rear surrounding image”.

[0098] Dirt index value of rear camera 12

[0099] =100·(area of ​​the dirty region in the rear peripheral image) / (total area of ​​the rear peripheral image)

[0100] Furthermore, the dirty area in the rear peripheral image is an area where the change in brightness is less than a threshold value within a predetermined time (that is, an area where the brightness does not substantially change in a plurality of temporally continuous rear peripheral images).

[0101] As is apparent from the above, the greater the proportion of the dirty portion in the image displayed on the display, the greater the "dirt index value".

[0102] The ECU 10 monitors whether an automatic cleaning start condition (hereinafter, also referred to as "Fr cleaning start condition") for the front camera 11 is satisfied. The Fr cleaning start condition is satisfied when the dirt index value of the front camera 11 becomes larger than the cleaning threshold value thFr. If the ECU 10 determines that the Fr cleaning start condition is satisfied, the ECU 10 drives the first pump 40 for a predetermined time (first time) to spray a predetermined amount of cleaning liquid from the first nozzle 41 to clean (automatically clean) the detection face of the front camera 11.

[0103] Similarly, the ECU 10 monitors whether the automatic cleaning start condition (hereinafter, also referred to as "Rr cleaning start condition") for the rear camera 12 is satisfied. The Rr cleaning start condition is satisfied when the dirt index value of the rear camera 12 becomes larger than the cleaning threshold value thRr. If the ECU 10 determines that the Rr cleaning start condition is satisfied, it drives the second pump 50 for a predetermined time (second time) to spray a predetermined amount of cleaning liquid from the second nozzle 51 to clean (automatically clean) the detection face of the rear camera 12.

[0104] In addition, the cleaning threshold thFr and the cleaning threshold thRr are the same in this example, and are hereinafter referred to as "cleaning threshold th". Moreover, the Fr cleaning start condition and the Rr cleaning start condition are respectively referred to as cleaning start conditions. However, the cleaning threshold thFr and the cleaning threshold thRr may be different from each other. The first time and the second time may be the same or different from each other.

[0105] <Overview of the work>

[0106] During the automatic cleaning of the detection face of the front camera 11, the cleaning fluid is sprayed to the detection face of the front camera 11, so the front peripheral image becomes unclear. In this case, it is difficult for the driver to monitor the front of the vehicle SV by visually confirming the front peripheral image. Similarly, during the automatic cleaning of the detection face of the rear camera 12, the cleaning fluid is sprayed to the detection face of the rear camera 12, so the rear peripheral image becomes unclear. In this case, it is difficult for the driver to monitor the rear of the vehicle SV by visually confirming the rear peripheral image.

[0107] Therefore, automatic cleaning of the front camera 11 and the rear camera 12 is preferably performed while the vehicle SV is in the area ARj where the possibility or necessity of the driver monitoring the periphery (front and / or rear) of the vehicle SV by visually checking the display is low.

[0108] It can be said that the smaller the visual confirmation probability Prj of the area ARj, the lower the "likelihood that the driver monitors the surrounding conditions by visually confirming the display (i.e., the surrounding image) when the vehicle SV is located in the area ARj". In other words, it can be said that the larger the visual confirmation probability Prj of the area ARj, the higher the "likelihood that the driver monitors the surrounding conditions by visually confirming the display (i.e., the surrounding image) when the vehicle SV is located in the area ARj".

[0109] Therefore, the first washing device sets the washing threshold th such that the washing threshold th is smaller as the visual confirmation probability Prj of the area ARj where the vehicle SV is located is smaller. In other words, the first washing device sets the washing threshold th such that the washing threshold th is larger as the visual confirmation probability Prj of the area ARj where the vehicle SV is located is larger.

[0110] Thus, the smaller the visual confirmation probability Prj of the area ARj where the vehicle SV is located, the easier it is for the cleaning start condition to be satisfied (that is, the smaller the dirt index value when the cleaning start condition is satisfied). Therefore, the possibility of automatic cleaning becomes higher when the vehicle SV is located in a place where the driver is less likely to observe the surrounding image displayed on the display.

[0111] In contrast, the greater the visual confirmation probability Prj of the area ARj where the vehicle SV is located, the more difficult it is for the cleaning start condition to be satisfied (that is, the greater the dirt index value when the cleaning start condition is satisfied). Therefore, when the vehicle SV is located in a place where the driver is likely to observe the surrounding image displayed on the display, the possibility of not performing automatic cleaning becomes higher.

[0112] <Specific work>

[0113] The CPU of ECU 10 (hereinafter referred to as "CPU") will Figure 3 to Figure 5 Each of the routines represented by the flowchart is executed every time a predetermined time elapses.

[0114] Therefore, when the predetermined timing is reached, the CPU Figure 3 The process starts at step 300 and proceeds to step 305 , where a driver image is acquired from the driver monitoring camera 13 , and position information of the vehicle SV at the time when the driver image is acquired is acquired from the position information acquisition device 14 .

[0115] Next, the CPU proceeds to step 310, and obtains driver information (including information indicating the direction of the driver's line of sight) based on the driver image. Furthermore, the CPU determines whether the driver is observing (visually observing, visually confirming) the display based on the driver's line of sight. More specifically, the CPU determines whether the driver's line of sight is toward either the central display 20 or the electronic rearview mirror 30. When the driver's line of sight is toward either the central display 20 or the electronic rearview mirror 30, the CPU determines that the driver is observing the display.

[0116] When the driver is observing the display, the CPU determines "yes" in step 310 and proceeds to step 315, setting the value of the confirmation flag Xf to "1". When the value of the confirmation flag Xf is "1", it indicates that the driver is observing the display. When the value of the confirmation flag Xf is "0", it indicates that the driver is not observing the display. The value of the confirmation flag Xf is set to "0" in the initialization routine executed by the CPU when the ignition key switch (not shown) of the vehicle SV is changed from the off position to the on position. Moreover, as described later, the value of the confirmation flag Xf is set to "0" when the position of the vehicle SV changes from the area ARj-1 to the area ARj adjacent to the area (refer to Figure 4 Then, the CPU enters step 320.

[0117] On the other hand, if the driver is not observing the display at the current time point, the CPU makes a “No” determination in step 310 and directly proceeds to step 320 .

[0118] In step 320 , the CPU associates the value of the confirmation flag Xf at the current time with the position information acquired in step 305 and stores the associations in the RAM, and proceeds to step 395 to terminate the present routine.

[0119] CPU connected to Figure 3 After processing, from Figure 4 The process starts at step 400, and after executing the "processing of step 405 and step 410" described below in sequence, the process proceeds to step 415.

[0120] Step 405: The CPU reads out the "position information and the value of the confirmation flag Xf" stored in the RAM in step 320.

[0121] Step 410: The CPU searches the visual confirmation probability database 60b to determine the area ARj including the position indicated by the position information obtained in step 405 (ie, the position of the vehicle SV at the current time point, the position of the vehicle SV at the time point when the driver image was obtained).

[0122] In step 415, the CPU determines whether the area ARj at the current time point determined in step 410 is different from the area ARj at the time point when this routine was executed a predetermined time ago (hereinafter referred to as "previous area ARj-1"). In other words, the CPU determines whether the vehicle SV enters a new area ARj.

[0123] If the area ARj at the current time point is the same as the previous area ARj-1, the CPU determines "No" in step 415 and directly proceeds to step 420 to save the area ARj at the current time point as the previous area ARj-1 in the RAM. Thereafter, the CPU proceeds to step 495 to end this routine once.

[0124] When the CPU starts the processing of this routine immediately after the vehicle SV enters the new area ARj, the CPU makes a "yes" determination in step 415 following steps 405 and 410 and proceeds to step 425. In step 425, the CPU determines whether the value of the confirmation flag Xf is "1".

[0125] When the value of the confirmation flag Xf is “1”, the CPU makes a “Yes” determination in step 425 , sequentially executes “the processing of steps 430 and 435 ” described below, and then proceeds to step 440 .

[0126] Step 430: The CPU increases the confirmation cumulative number NCj-1 of the previous area ARj-1 by "1", and increases the determination cumulative number NDj-1 of the previous area ARj-1 by "1".

[0127] Step 435: The CPU restores the value of the confirmation flag Xf to "0".

[0128] On the other hand, when the value of the confirmation flag Xf is "0" at the time when the CPU enters step 425, the CPU determines "No" in step 425 and enters step 445. In step 445, the CPU increases the cumulative number of determinations NDj-1 of the previous area ARj-1 by "1". However, the CPU does not change the cumulative number of confirmations NCj-1 of the previous area ARj-1 in step 445. Thereafter, the CPU enters step 440.

[0129] In step 440, the CPU obtains the visual confirmation probability Prj-1 (%) in the previous region ARj-1 by multiplying the value obtained by dividing the cumulative number of confirmations NCj-1 by the cumulative number of determinations NDj-1 (=((NCj-1) / (NDj-1)))" by 100. Next, the CPU proceeds to step 450, associates the visual confirmation probability Prj-1 with the previous region ARj-1, and stores it in the visual confirmation probability database 60b. In other words, in the visual confirmation probability database 60b, the visual confirmation probability stored corresponding to the region ARj-1 is set to the visual confirmation probability Prj-1 obtained in step 440, and the visual confirmation probability database 60b is updated (created). Thereafter, the CPU executes the processing in step 420, proceeds to step 495, and ends this routine once.

[0130] When the predetermined timing is reached, the CPU Figure 5 The process starts at step 500 (processing for executing automatic cleaning), and after executing the "processing of steps 505 to 525" described below in sequence, the process proceeds to step 530.

[0131] Step 505 : The CPU obtains the position information of the vehicle SV at the current time point from the position information obtaining device 14 .

[0132] Step 510 : The CPU searches the visual confirmation probability database 60 b to identify the area ARj (area where the vehicle SV is traveling) including the “position of the vehicle SV at the current time point” indicated by the position information acquired in step 505 .

[0133] Step 515: The CPU acquires (reads) the visual confirmation probability Prj of the specified area ARj from the visual confirmation probability database 60b.

[0134] Step 520: The CPU performs a lookup on the first map Map1 (see Figure 5 ) The cleaning threshold th is set by applying the visual confirmation probability Prj obtained in step 515. According to the first mapping Map1, the cleaning threshold th is set so that the larger the visual confirmation probability Prj is, the larger the value becomes. In other words, according to the first mapping Map1, the cleaning threshold th is set so that when the visual confirmation probability Prj is a specific value Prs, the value becomes larger than when the visual confirmation probability Prj is a value smaller than the specific value Prs.

[0135] Step 525: The CPU determines the camera sensor for which automatic cleaning is not being executed at the current time point. More specifically, the CPU determines the camera sensor corresponding to the pump that is not being driven at the current time point, among the first pump 40 and the second pump 50 .

[0136] After entering step 530, the CPU determines whether the dirt index value of the determined camera sensor is greater than the cleaning threshold value th. In the case where the determined camera sensors are both the front camera 11 and the rear camera 12, the CPU determines whether the dirt index value of the front camera 11 is greater than the cleaning threshold value th, and determines whether the dirt index value of the rear camera 12 is greater than the cleaning threshold value th. In addition, the CPU executes a routine not shown in the figure every time a predetermined time has passed, and calculates the dirt index value of each of the front camera 11 and the rear camera 12. However, the CPU suspends the calculation of the dirt index value of the front camera 11 during the driving of the first pump 40 (i.e., during the cleaning of the front camera 11), and suspends the calculation of the dirt index value of the rear camera 12 during the driving of the second pump 50 (i.e., during the cleaning of the rear camera 12).

[0137] If there is at least one camera sensor whose dirt index value is larger than the cleaning threshold value th among the determined camera sensors, the CPU determines "yes" in step 530 and proceeds to step 535. In step 535, the CPU drives the pump (first pump 40 and / or second pump 50) corresponding to the camera sensor determined to have a dirt index value larger than the cleaning threshold value th for a predetermined time. That is, the CPU performs cleaning (automatic cleaning) of the detection face of the camera sensor determined to have a dirt index value larger than the cleaning threshold value th. Thereafter, the CPU proceeds to step 595 and ends this routine once.

[0138] On the other hand, when all the determined contamination index values ​​of the camera sensors are equal to or less than the cleaning threshold value th, the CPU makes a "No" determination in step 530 and proceeds to step 595 to terminate the present routine.

[0139] use Figure 6 The operation of the first cleaning device thus configured will be described using the example shown in FIG. 1 . In this example, the visual confirmation probability Prj of each area ARj included in the interval (straight line interval) between the location P0 and the location P1 is 10%. Thus, when the vehicle SV is traveling in the interval between the location P0 and the location P1, the cleaning threshold th is set to a value corresponding to the visual confirmation probability = 10%, that is, 3%.

[0140] In this example, when the vehicle SV is traveling in the section between the point P1 and the point P2 (section before the intersection), the visual confirmation probability Prj gradually increases as the vehicle approaches the point P2. As a result, the washing threshold value th increases from 3% to 90%.

[0141] In addition, in this example, the visual confirmation probability Prj of each area ARj belonging to the section between the points P2 and P3 (intersection section) is 100%. Therefore, when the vehicle SV is traveling in the section between the points P2 and P3, the washing threshold th is maintained at 90%.

[0142] Therefore, it can be understood from this example that the closer the vehicle SV is to the intersection including the area ARj with a high visual confirmation probability Prj, the higher the washing threshold th is, so the possibility that the face detected by the camera sensor is automatically washed can be reduced.

[0143] As described above, according to the first cleaning device, when the vehicle SV is traveling in the area ARj where the visual confirmation probability Prj is low, the possibility of automatic cleaning is high. On the contrary, according to the first cleaning device, when the vehicle SV is traveling in the area ARj where the visual confirmation probability Prj is high, the possibility of automatic cleaning is low. As described above, when the vehicle SV is located in the area ARj where the probability that the driver will confirm the surroundings of the vehicle SV by visually confirming the surrounding image displayed on the display is high, it is difficult to perform automatic cleaning, so a clear surrounding image can be displayed on the display.

[0144] <<Modification of the first embodiment>>

[0145] This modification differs from the first embodiment only in that the cumulative number of determinations NDj, the cumulative number of confirmations NCj, and the visual confirmation probability Prj are updated every time a predetermined time has passed. More specifically, the CPU of this modification executes the "replacement" in order to update them. Figure 3 of Figure 7 " and "replace Figure 4 of Figure 8 "The routine represented by the flowchart in "

[0146] When the predetermined timing is reached, the CPU Figure 7 The process begins at step 700 . Figure 7 The steps 705, 710, 715 and 720 are performed in conjunction with Figure 3 The processes of "step 305, step 310, step 315 and step 320" shown in the figure are the same as the processes of the steps. When the CPU determines "no" in step 710 (that is, when it determines that the driver is not observing the display), it proceeds to step 725 and sets the value of the confirmation flag Xf to "0". Thereafter, the CPU proceeds to step 720.

[0147] CPU connected to Figure 7 After processing, from Figure 8 The process starts from step 800, and after sequentially executing the processes of "step 805 which is the same as step 405" and "step 810 which is the same as step 410", the process proceeds to step 825. In step 825, the CPU determines whether the value of the confirmation flag Xf is "1".

[0148] When the value of the confirmation flag Xf is "1", the CPU determines "yes" in step 825 and proceeds to step 830, increases the confirmation cumulative number NCj of the area ARj at the current time point determined in step 810 by "1", and increases the determination cumulative number NDj of the area ARj by "1". Thereafter, the CPU proceeds to step 840.

[0149] On the other hand, when the value of the confirmation flag Xf is "0" at the time point when the CPU proceeds to step 825, the CPU determines "No" in step 825 and proceeds to step 845. In step 845, the CPU increases the cumulative number of determinations NDj of the area ARj at the current time point determined in step 810 by "1". However, the CPU does not change the cumulative number of confirmations NCj of the area ARj in step 845. Thereafter, the CPU proceeds to step 840.

[0150] In step 840, the CPU multiplies "the value obtained by dividing the cumulative number of confirmations NCj by the cumulative number of determinations NDj (= NCj / NDj)" by 100 to obtain the visual confirmation probability Prj (%) in the area ARj at the current time point. Next, the CPU proceeds to step 850 to associate the visual confirmation probability Prj with the area ARj and save it in the visual confirmation probability database 60b. In other words, the CPU sets the visual confirmation probability stored corresponding to the area ARj in the visual confirmation probability database 60b to the visual confirmation probability Prj obtained in step 840 and updates (creates) the visual confirmation probability database 60b. Thereafter, the CPU proceeds to step 895 to end this routine once.

[0151] As described above, in this modified example, the confirmation cumulative number NCj, the determination cumulative number NDj, and the visual confirmation probability Prj are updated not at the time when the vehicle SV enters a new area ARj, but at the time when the driver is judging whether or not the display is being viewed (visual confirmation judgment). In other words, the visual confirmation probability database 60b is updated every time a predetermined time has passed. Thus, the visual confirmation probability Prj of a certain area ARj can also be appropriately updated.

[0152] <<Second Embodiment>>

[0153] The vehicle-mounted sensor cleaning device according to the second embodiment of the present invention (hereinafter referred to as “the second cleaning device”) is different from the first cleaning device only in the following point.

[0154] In the ROM of the ECU 10, instead of the first map Map1, a map Fig. 9A The lookup table shown is the second map Map2 and Fig. 9B The lookup table shown is the third map Map3.

[0155] The ECU 10 obtains the purge threshold th using the second map Map2 when the visual confirmation probability Prj tends to increase with the travel of the vehicle SV (ie, changes with the area ARj), and uses the third map Map3 when the visual confirmation probability Prj does not tend to increase.

[0156] The following description will focus on this difference.

[0157] <Specific work>

[0158] The CPU of the ECU 10 of the second embodiment executes Figure 3 and Figure 4 Furthermore, the CPU executes the routine shown in the replacement every time a predetermined time has passed. Figure 5 of Fig.10 In addition, Figure 3 and Figure 4 The routines of have been explained, so their description is omitted. Fig.10 The steps shown in Figure 5 The description of the same steps as the "steps already described regarding the processing contents" shown will be omitted.

[0159] The CPU starts the process from step 1000 and executes the processes of step 505 to step 515. Next, the CPU proceeds to step 1005 and acquires a parameter indicating the tendency of the change in the visual confirmation probability Prj (hereinafter referred to as a "change tendency parameter").

[0160] More specifically, the CPU executes a routine (not shown) to calculate the amount of change dPj in the visual confirmation probability according to the following equation every time the area where the vehicle SV is traveling changes from the previous area ARj-1 to a new area ARj.

[0161] dPj = (visual confirmation probability Prj) - (visual confirmation probability Prj-1)

[0162] In this formula, the visual confirmation probability Prj is the visual confirmation probability Prj stored in the visual confirmation probability database 60b for the new area ARj. Moreover, the visual confirmation probability Prj-1 is the visual confirmation probability Prj-1 stored in the visual confirmation probability database 60b for the previous area ARj-1. The CPU saves the change amount dPj as the change amount dP(n) of this time in the RAM.

[0163] In addition, in step 1005, the CPU also reads the change amount dP(n-1) one time ago and the change amount dP(n-2) two times ago from the RAM. The change amount dP(n-1) one time ago is the change amount of the visual confirmation probability when the area changes from ARj-2 to ARj-1. The change amount dP(n-2) two times ago is the change amount of the visual confirmation probability when the area changes from ARj-3 to ARj-2.

[0164] Then, the CPU obtains the average value of these change amounts dp(n) to dp(n-2) as the change tendency parameter K. The number of change amounts dPj used to obtain the change tendency parameter K may be one, but is preferably a predetermined number of two or more.

[0165] Next, the CPU proceeds to step 1010 to determine whether the change tendency parameter K is equal to or greater than a positive predetermined value Kth, thereby determining whether the visual confirmation probability Prj is tending to increase as the vehicle SV travels.

[0166] When the visual confirmation probability Prj is on the rise (when K is greater than Kth), the CPU determines “yes” in step 1010 and proceeds to step 1015, by increasing the visual confirmation probability Prj obtained in step 515 to Fig. 9A The second map Map2 (see the solid line a1) shown is used to determine the cleaning threshold th.

[0167] According to the second map Map2, when the visual confirmation probability Prj is greater than or equal to 0 and less than or equal to the first probability Pr1 (i.e., when the visual confirmation probability Prj is within the first probability range RP1), the cleaning threshold th is set to a constant first threshold th1. The first probability Pr1 is preferably selected from a range of greater than or equal to 20% and less than or equal to 35%, and is 35% in this example. From the perspective of reducing the consumption of the cleaning liquid, the first threshold th1 is preferably, for example, greater than or equal to 10% and less than or equal to 50%, and is 40% in this example.

[0168] Moreover, according to the second mapping Map2, when the visual confirmation probability Prj is greater than the first probability Pr1 and less than the second probability Pr2 (that is, when the visual confirmation probability Prj is within the second probability range RP2), the cleaning threshold th is set to a constant second threshold th2. The second probability Pr2 is greater than the first probability Pr1, and is preferably selected from a range of 25% or more and 50% or less. In this example, the second probability Pr2 is 50%. The second threshold th2 is set to a value smaller than the first threshold th1, which is 3% in this example.

[0169] In addition, according to the second mapping Map2, when the visual confirmation probability Prj is greater than the second probability Pr2 and less than 100% (i.e., when the visual confirmation probability Prj is within the third probability range RP3), the cleaning threshold th is a value within the range greater than the first threshold th1 and less than the third threshold th3, and is set in such a way that the cleaning threshold th is greater as the visual confirmation probability Prj is greater. In addition, the third threshold th3 is preferably selected from a range of greater than 80% and less than 95%. In this example, the third threshold th3 is 90%.

[0170] As understood from the above, when the visual confirmation probability Prj is within the second probability range RP2, when the visual confirmation probability Prj is on an upward trend, the cleaning threshold th is set to a relatively small value (second threshold th2) compared to when it is not on an upward trend. Thus, in this case, it is easy to perform automatic cleaning processing.

[0171] After the processing of step 1015, the CPU executes appropriate processing in the aforementioned steps 525 to 535, and then proceeds to step 1095 to end this routine once.

[0172] On the other hand, when the visual confirmation probability Prj is not on an upward trend (when K is less than Kth), the CPU determines "No" in step 1010 and proceeds to step 1020, by increasing the visual confirmation probability Prj obtained in step 515 to Fig. 9B The third map Map3 (see solid line b1) shown is used to determine the cleaning threshold th.

[0173] The third map Map3 differs from the second map Map2 only in that the cleaning threshold th is set to the first threshold th1 when the visual confirmation probability Prj is within the second probability range RP2. Therefore, even if the visual confirmation probability Prj is within the second probability range RP2, when the visual confirmation probability Prj is not on an upward trend, the cleaning threshold th is not set to the relatively small second threshold th2, but is set to the first threshold th1.

[0174] After the processing of step 1020, the CPU executes appropriate processing in steps 525 to 535 described above, and then proceeds to step 1095 to end this routine once.

[0175] use Fig.11The example of the operation of the second cleaning device thus constructed is described by referring to the example shown in FIG. As shown in this example, when the vehicle SV is traveling in the interval between the location P0 and the location P1, the visual confirmation probability Prj is constant (does not rise), and therefore, the cleaning threshold th is set to the first threshold th1 (=40%) based on the third mapping Map3. When the vehicle SV is traveling between the location P1 and the location P2, it is determined that the visual confirmation probability Prj is on an upward trend. Thus, in this case, the cleaning threshold th is set based on the second mapping Map2. In particular, when the vehicle SV is traveling in the interval between the location P1a and the location P1b, the visual confirmation probability Prj is greater than the first probability Pr1 and smaller than the second probability Pr2, and therefore the cleaning threshold th is set to the second threshold th2, i.e., 3%. Therefore, the possibility of automatic cleaning in this interval becomes high. Thereafter, when an increase in the visual confirmation probability Prj is no longer confirmed (that is, when the vehicle SV starts traveling in the section from the point P2 to the point P3 ), the washing threshold value th is set again based on the third map Map3 .

[0176] As described above, according to the second cleaning device, when it is determined that the visual confirmation probability Prj does not rise, the cleaning threshold th is maintained at a relatively high value (for example, 40%), so the frequency of automatic cleaning is reduced. Thus, the consumption of cleaning fluid can be reduced. Moreover, according to the second cleaning device, when it is determined that the visual confirmation probability Prj is on an upward trend, before the visual confirmation probability Prj becomes very high (that is, during the period when the visual confirmation probability Prj is greater than the first probability Pr1 and smaller than the second probability Pr2), the cleaning threshold th is set to an extremely small second threshold th2 (for example, 3%). Thus, in the case where there is a high possibility that the visual confirmation probability Prj becomes very high, automatic cleaning can be performed in advance. Moreover, in the case where the visual confirmation probability Prj is very high, the cleaning threshold th is set to a very large third threshold th3 (for example, 90%), so the possibility of automatic cleaning can be reduced.

[0177] <<Third Embodiment>>

[0178] The vehicle-mounted sensor cleaning device of the third embodiment of the present invention (hereinafter referred to as the "third cleaning device") sets the cleaning threshold value th in a manner that the cleaning threshold value th is larger as the visual confirmation probability Prj is larger, similarly to the first cleaning device. However, the third cleaning device is different from the first cleaning device only in that the cleaning threshold value th is set to the maximum value during the period when it is determined that the driver is observing the display, thereby avoiding the start of automatic cleaning and stopping the automatic cleaning in execution. That is, the third cleaning device prohibits the execution of the cleaning process during the period when it is determined that the driver is observing the display.

[0179] <Specific work>

[0180] The CPU of the ECU 10 of the third embodiment executes Figure 7 and Figure 8 Furthermore, the CPU executes the routine shown in the replacement every time a predetermined time has passed. Figure 5 of Fig.12 In addition, Figure 7 and Figure 8 The routines of have been explained, so their description is omitted. Fig.12 The steps shown in Figure 5 The description of the same steps as the "steps already described regarding the processing contents" shown will be omitted. Fig.12 The routine is similar to the one in that the processing of steps 1205, 1210 and 1215 are added. Figure 5 The routines are different.

[0181] The CPU starts the process from step 1200 and executes the processes from step 505 to step 515. Next, the CPU proceeds to step 1205 and determines whether the value of the confirmation flag Xf at the current time point is "0".

[0182] When the value of the confirmation flag Xf at the current time point is "0", the CPU makes a "Yes" determination in step 1205, executes the process of step 520 described above to determine the cleaning threshold th, and then proceeds to the process of step 525 and subsequent steps.

[0183] On the other hand, when the value of the confirmation flag Xf at the current time point is "1", the CPU makes a "No" determination in step 1205 and executes "the processes of step 1210 and step 1215" described below, and then proceeds to the processes after step 525.

[0184] Step 1210: The CPU sets the cleaning threshold value th to a value corresponding to the maximum value of the contamination index value (100% in this example). As a result, a "yes" determination is not made in step 530, and the cleaning process is not started (the cleaning process is prohibited).

[0185] Step 1215: If there is a camera sensor that is currently being cleaned automatically (or cleaned by operation of a manual switch not shown), the CPU stops (prohibits) the cleaning. More specifically, the CPU stops the driving of the first pump 40 and the second pump 50 that are currently being driven.

[0186] use Fig.13 The example shown in the figure illustrates the operation of the third cleaning device constructed in this way. Fig.13In the example, the visual confirmation probability Prj and the cleaning threshold th are simplified so as to change continuously. In this example, when the vehicle SV is traveling in the sections between the point P0 and the point P1d, between the point P1e and the point P2a, and between the point P2b and the point P2c, it is determined that the driver is not observing the display (confirmation flag Xf=0). Therefore, in these sections, the third cleaning device operates in the same manner as the first cleaning device.

[0187] On the other hand, when the vehicle SV is traveling in the sections between the points P1d and P1e, between the points P2a and P2b, and between the points P2c and P3, it is determined that the driver is observing the display (confirmation flag Xf=1). Therefore, in these sections, the third cleaning device sets the cleaning threshold value th to a value corresponding to the maximum value of the dirt index value (100% in this example), and stops driving of the first pump 40 and the second pump 50 that are being driven at each time point to stop cleaning.

[0188] According to the third cleaning device, the detection face of the camera sensor is not automatically cleaned while the driver is observing the peripheral image displayed on the display, so the peripheral image will not become unclear due to the spraying of the cleaning liquid to the detection face. Therefore, the driver can confirm the surrounding conditions by visually confirming the peripheral image that has not become unclear.

[0189] The present invention is not limited to the above-described embodiments, and various modifications can be adopted within the scope of the present invention.

[0190] For example, in each of the above-mentioned embodiments, the visual confirmation probability database 60b may also be as follows: Fig.14 As shown, the cloud 100 is arranged in the cloud 100. The cloud 100 and the plurality of vehicles SV are connected via a communication line IN1 (for example, an Internet line) so as to be able to exchange information (data). In addition, hereinafter, each of the first to third cleaning devices is simply referred to as a "cleaning device".

[0191] The cloud 100 includes a server 101 and a storage device 102. The server 101 includes a computer. The storage device 102 includes a map information database 60a and a visual confirmation probability database 60b. The server 101 can search and read data stored in each database of the storage device 102 and write data to each database.

[0192] The washer mounted on the vehicle SV includes a wireless communication device 110 instead of the storage device 60. The wireless communication device 110 is a wireless communication terminal for communicating information with the cloud 100 via the communication line IN1.

[0193] In this case, for example, the CPU of the ECU 10 executes Figure 7 However, the CPU Figure 7 After the processing of step 720 , a process is executed to transmit the data set in which “the value of the confirmation flag Xf at the current time point and the position information” are associated with each other and stored in the RAM to the cloud 100 using the wireless communication device 110 .

[0194] If the server 101 receives the above data set from a vehicle SV, it will Figure 8 In the processing of the routine shown, in step 850 , the visual confirmation probability Prj is associated with the area ARj and stored in the visual confirmation probability database 60 b of the cloud 100 .

[0195] Furthermore, the CPU of the ECU 10 Figure 5 , Fig.10 and Fig.12 In step 515 of the routine shown in FIG. 1 , a data set that associates the area ARj of the vehicle SV at the current time point with the vehicle ID that identifies the vehicle SV itself is sent to the cloud 100. When the server 101 of the cloud 100 receives the data set including the area ARj and the vehicle ID, it reads out the visual confirmation probability Prj corresponding to the area ARj from the visual confirmation probability database 60b. Furthermore, the server 101 sends the read visual confirmation probability Prj to the vehicle SV identified by the vehicle ID. Then, the CPU of the ECU 10 receives the visual confirmation probability Prj sent from the server 101 in step 515.

[0196] In addition, the server 101 may have a first map Map1, a second map Map2, and a third map Map3, etc., and use them to determine the cleaning threshold th through the same process (operation step) as the process (operation step) executed by the ECU 10 of the cleaning device described above. In this case, the server 101 may send the cleaning threshold th to the vehicle SV that has sent the vehicle ID, and the ECU 10 of the vehicle SV may receive the cleaning threshold th and use the received cleaning threshold th to perform the processing of "steps 525 to 535".

[0197] Alternatively, when the server 101 has a first map Map1, a second map Map2, and a third map Map3, and uses them to determine the cleaning threshold th by the same process as the process executed by the ECU 10 of the cleaning device, the server 101 may be further configured as follows:

[0198] The "vehicle ID, vehicle position information or area ARj of the vehicle SV at the current time point, and the contamination index value of the camera sensor of the vehicle SV" are obtained from the vehicle SV.

[0199] Get the visual confirmation probability Prj,

[0200] The cleaning threshold th is determined based on the visual confirmation probability Prj.

[0201] Determine whether the contamination index value exceeds the cleaning threshold value th (determine whether the automatic cleaning start condition is met),

[0202] The determination result is transmitted to the vehicle SV identified by the vehicle ID.

[0203] In this case, the ECU 10 of the vehicle SV performs the automatic cleaning process when the received determination result indicates that "the automatic cleaning condition is satisfied".

[0204] The vehicle SV may also be equipped with a "dirt monitoring camera" capable of photographing the detection face. In this case, the dirt index value may also be obtained by analyzing the image of the monitoring camera. Furthermore, the dirt index value may also be obtained by other known methods.

[0205] In the above-mentioned embodiment, the ease with which the automatic cleaning start condition is established is changed by changing the cleaning threshold value th based on the visual confirmation probability Prj. Instead of this, the ease with which the automatic cleaning start condition is established may be changed by correcting the dirt index value based on the visual confirmation probability Prj. In this case, for example, in the above-mentioned embodiment, under the condition that the cleaning threshold value th becomes higher, the cleaning threshold value th is maintained at a constant value and the dirt index value is corrected in a manner that makes the dirt index value smaller. And, when the corrected dirt index value exceeds the cleaning threshold value th maintained as a constant value, it is determined that the automatic cleaning start condition is established. Moreover, the ease with which the automatic cleaning start condition is established may be changed by correcting both the dirt index value and the cleaning threshold value th based on the visual confirmation probability Prj.

[0206] The above-mentioned embodiments can also be applied to the following vehicle-mounted sensor cleaning device: including other vehicle-mounted sensors other than the camera sensor and a cleaning unit for cleaning the detection face of the other vehicle-mounted sensor, and configured to display information based on information obtained by the other vehicle-mounted sensors on a display. In this case, the vehicle-mounted sensor may be a sensor such as a radar sensor and an ultrasonic sensor that receives "electromagnetic waves or sound waves" from the detection face exposed outside the vehicle SV. The electromagnetic wave includes, for example, electromagnetic waves such as visible light laser, infrared, and millimeter wave band radio waves. Sound waves include, for example, ultrasonic waves.

[0207] The front camera 11 may also be disposed inside the vehicle interior of the front windshield of the vehicle SV, and obtains front image information by using visible light passing through the front windshield. In this case, the face detected by the front camera 11 is "a portion (window portion) of the vehicle exterior of the front windshield" through which the visible light incident on the front camera 11 passes.

[0208] Similarly, the rear camera 12 may be disposed inside the vehicle interior of the rear glass of the vehicle SV, and obtain rear image information by using visible light passing through the rear glass. In this case, the face detected by the rear camera 12 is "a portion (window) of the vehicle exterior of the rear glass" through which the visible light incident on the rear camera 12 passes.

Claims

1. A vehicle-mounted sensor cleaning device, applied to a vehicle, the vehicle comprising: a vehicle-mounted sensor, which acquires information about the periphery of the vehicle based on electromagnetic waves or sound waves through a detection face exposed outside the vehicle; and a display device, which displays an image or display information generated based on the information acquired by the vehicle-mounted sensor, wherein: The vehicle-mounted sensor cleaning device comprises: a cleaning unit configured to perform a cleaning process of cleaning the detection surface of the vehicle-mounted sensor using a cleaning fluid; a position information acquisition device for acquiring vehicle position information indicating the position of the vehicle; and A control unit is configured to use a storage device that associates and stores area position information that can determine the positions of each of a plurality of areas set on the ground and a visual confirmation probability correlation value that is correlated with the probability that the driver of the vehicle visually confirms the display device in each of the plurality of areas, to obtain a result of a determination as to whether an automatic cleaning start condition is met based on the visual confirmation probability correlation value for the following area, and to control the cleaning unit so that the cleaning process is performed when the result of the determination indicates that the automatic cleaning start condition is met, wherein the area is one of the plurality of areas and includes a specific position of the vehicle represented by the obtained vehicle position information.

2. The vehicle-mounted sensor cleaning device according to claim 1, The storage device is also provided on the vehicle. The control unit is configured to obtain the visual confirmation probability related value for the area including the specific position of the vehicle from the storage device based on the obtained vehicle position information, determine the automatic cleaning start condition based on the obtained visual confirmation probability related value, and determine whether the automatic cleaning start condition is met, thereby obtaining the determination result.

3. The vehicle-mounted sensor cleaning device according to claim 1, A wireless communication device is also provided, the wireless communication device is mounted on the vehicle and can communicate with an information processing device that is located outside the vehicle and includes the storage device, The control unit is configured to communicate with the information processing device by using the wireless communication device, thereby obtaining the visual confirmation probability related value for the area including the specific position of the vehicle from the storage device based on the obtained vehicle position information, determine the automatic cleaning start condition based on the obtained visual confirmation probability related value, and determine whether the automatic cleaning start condition is met, thereby obtaining the result of the determination.

4. The vehicle-mounted sensor cleaning device according to claim 2 or 3, The vehicle-mounted sensor is a camera sensor that acquires image information by photographing the periphery of the vehicle using light as the electromagnetic wave. The control unit is composed of: obtaining a dirt index value indicating the degree of dirt on the detected face by the vehicle-mounted sensor based on the image information, and determining whether the automatic cleaning start condition is satisfied by comparing the dirt index value with a cleaning threshold value, The automatic cleaning start condition is determined by determining the cleaning threshold value based on the obtained visual confirmation probability correlation value, The result of the determination indicating that the automatic cleaning start condition is satisfied is acquired when the contamination index value is larger than the cleaning threshold value.

5. The vehicle-mounted sensor cleaning device according to claim 4, The control unit is configured to determine the automatic cleaning start condition by changing the cleaning threshold so that the cleaning threshold is larger when the acquired visual confirmation probability correlation value is a specific value than when the acquired visual confirmation probability correlation value is smaller than the specific value.

6. The vehicle-mounted sensor cleaning device according to claim 4, The control unit is configured to determine the automatic cleaning start condition by changing the cleaning threshold value in the following manner: When the acquired visual confirmation probability correlation value is within a first range equal to or less than the first visual confirmation probability correlation value, the cleaning threshold is the first threshold. When the obtained visual confirmation probability correlation value is in a second range that is larger than the first visual confirmation probability correlation value and smaller than the second visual confirmation probability correlation value and the change in the visual confirmation probability correlation value accompanying the driving of the vehicle is on an upward trend, the cleaning threshold becomes a second threshold that is smaller than the first threshold.

7. The vehicle-mounted sensor cleaning device according to any one of claims 1 to 6, The device further comprises a driver information acquisition device which acquires driver information for determining the state of the driver of the vehicle, The control unit is composed of: While it is determined based on the driver information that the driver of the vehicle is visually checking the display device, execution of the cleaning process is prohibited.

8. The vehicle-mounted sensor cleaning device according to any one of claims 1 to 6, The device further comprises a driver information acquisition device which acquires driver information for determining the state of the driver of the vehicle, The control unit is composed of: performing a visual confirmation determination based on the driver information as to whether the display device has been visually confirmed, determining one of the plurality of areas including a position where a result of the visual confirmation determination is obtained, and calculating the visual confirmation probability correlation value of the determined one area based on the result of the visual confirmation determination, The calculated visual confirmation probability correlation value is associated with the area position information indicating the identified one area and stored in the storage device.

9. A vehicle sensor cleaning method, applied to a vehicle, the vehicle having: A vehicle-mounted sensor that acquires information about the periphery of the vehicle based on electromagnetic waves or sound waves transmitted through a detection face exposed outside the vehicle; A display device for displaying an image or displaying information generated based on the information obtained by the vehicle-mounted sensor; a cleaning unit configured to perform a cleaning process of cleaning the detection surface of the vehicle-mounted sensor using a cleaning fluid; and a position information acquisition device for acquiring vehicle position information indicating the position of the vehicle; Wherein, the vehicle-mounted sensor cleaning method comprises: Using a storage device storing, in association with each other, area position information capable of identifying the positions of a plurality of areas set on the ground and a visual confirmation probability correlation value correlated with a probability that the driver of the vehicle visually confirms the display device in each of the plurality of areas, the step of obtaining the visual confirmation probability correlation value for an area that is one of the plurality of areas and includes the specific position of the vehicle indicated by the obtained vehicle position information; A step of determining an automatic cleaning start condition based on the obtained visual confirmation probability correlation value; a step of obtaining a result of determining whether the determined automatic cleaning start condition is satisfied; and A step of controlling the cleaning unit to perform the cleaning process when the result of the determination indicates that the automatic cleaning start condition is satisfied.

10. The vehicle-mounted sensor cleaning method according to claim 9, comprising: A step of obtaining driver information, which is information for determining the state of the driver of the vehicle; a step of performing a visual confirmation determination based on the driver information as to whether the display device is visually confirmed, and determining one of the plurality of areas including a position where a result of the visual confirmation determination is obtained; A step of calculating the visual confirmation probability correlation value of the determined one area based on the result of the visual confirmation determination; and A step of associating the calculated visual confirmation probability correlation value with the area position information indicating the identified one area and storing the resultant in the storage device.

Citation Information

Patent Citations

  • Washing equipment for vehicle

    JP2019123262A

  • Driving support device

    CN109094460A

  • Vehicle travel control system

    CN110281878A

  • Vehicle cleaner system and vehicle system

    CN111819119A

  • Driving support apparatus

    US20190315353A1