System and method for windshield wetting detection and automatic wiping
Capture images through vehicle cameras and dynamically control the wiper speed and sampling frequency, solving the problem of low efficiency in the prior art when the cover is unable to wipe automatically and the humidity changes in humidity, achieving more efficient and energy-saving wipers system.
Patent Information
- Application Number
- CN202410582369.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-24
- Filing Date
- 2024-05-11
- Publication Date
- 2024-11-26
AI Technical Summary
The wiper systems in existing vehicles rely on rain sensors, which cannot wipe automatically when inside the cover shield, and the wiper speed and sampling frequency are difficult to dynamically adjust when humidity changes, resulting in inefficiency and waste of energy.
Use the vehicle camera to capture images, determine the vehicle position and windshield humidity through image processing, dynamically control the wiper speed and sampling frequency, avoid activating the wiper in the cover shield, and adjust the wiper speed when humidity changes and sampling frequency.
It realizes that the wiper is not activated in the cover protective cover to save energy, and dynamically adjust the wiper speed and sampling frequency when humidity changes, improving the efficiency and accuracy of the wiper system.
Smart Images

Figure CN119018096A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to systems and methods for windshield wetness detection and automatic wiping, and more particularly to systems and methods for facilitating windshield wetness detection and wiper speed control based on images captured by a vehicle camera. Background Art
[0002] Vehicles typically include a windshield through which a driver or passenger of the vehicle can view the surrounding area. For example, a vehicle may include a front windshield through which a driver of the vehicle can view a road on which the vehicle may be traveling, and a rear windshield through which a driver of the vehicle can view objects near the rear side of the vehicle. The vehicle may additionally include wipers that can clean the windshield when there may be rain, snow, etc. on the windshield.
[0003] Modern vehicles additionally include a dedicated rain sensor or rain sensing module that detects the presence of rain on the windshield. The rain sensor facilitates the vehicle to control the movement of wipers on the windshield. For example, when the rain sensor detects the presence of rain on the windshield, the rain sensor can facilitate the vehicle to automatically activate and control the wiper speed. Summary of the invention
[0004] The present disclosure describes an automatic wiping system and method for a vehicle. A vehicle may include: a windshield; a wiper configured to clean the windshield; and one or more vehicle cameras. The vehicle camera may be configured to capture an image of the windshield, an image of the vehicle's surroundings, and an image of the ground on which the vehicle may be located. The system may obtain images from the vehicle camera at a predefined sampling frequency. The system may be configured to determine a vehicle position and a windshield humidity level based on the images obtained from the vehicle camera, and may control wiper operation based on the vehicle position and the humidity level.
[0005] In some aspects, the system may determine whether the vehicle is likely to be inside a covered protective enclosure based on the image obtained from the vehicle camera. When the system determines that the vehicle is likely to be inside the covered protective enclosure, the system may not activate wiper movement. The system may also determine whether at least one of the windshield and the ground is likely to be dry based on the obtained image. When the system determines that at least one of the windshield and the ground is likely to be dry, the system may not activate wiper movement.
[0006] On the other hand, in response to determining based on the obtained images that the vehicle may be outside the covered shield and both the windshield and the ground may be wet, the system may actuate the wipers at a predefined speed. The system may also determine whether the humidity level may increase or decrease over time based on the images obtained from the vehicle camera.
[0007] In response to determining that the humidity level may be increasing, the system may increase the wiper speed. The system may also increase the sampling frequency at which the system may obtain images from the vehicle camera. Similarly, in response to determining that the humidity level may be decreasing, the system may decrease the wiper speed and the sampling frequency.
[0008] The system may also determine whether the vehicle may have been stationary for a duration greater than a predefined threshold. When the system determines that the vehicle may have been stationary for a duration exceeding the predefined threshold, the system may reduce the sampling frequency (and / or the wiper speed).
[0009] In some aspects, the vehicle may include additional sensors, such as microphones, global positioning system (GPS) sensors / receivers, etc. In addition to obtaining images from vehicle cameras, the system may also obtain input from additional sensors to determine the vehicle location and the humidity level.
[0010] The present disclosure describes a system and method for automatic wiping in a vehicle. The system uses images obtained from a vehicle camera to control wiper movement, and thus may not require a conventional rain sensing module to control wiper movement. When the humidity level on the windshield may be low, the system further reduces the sampling frequency at which the system may obtain images from the vehicle camera, thereby saving system computing resources. In addition, when the vehicle may be located in a covered protective enclosure, the system may not activate wiper movement, thereby saving vehicle energy consumption when wiper movement may not be required.
[0011] These and other advantages of the present disclosure are provided in detail herein. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the accompanying drawings, and some elements and / or components may not be present in various embodiments. The elements and / or components in the accompanying drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms may be used interchangeably, depending on the context.
[0013] Figure 1An exemplary environment is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented.
[0014] Figure 2 A block diagram of an exemplary system for facilitating automatic wipe operation according to the present disclosure is depicted.
[0015] Figure 3 Depicted are snapshots of an exemplary vehicle having multiple sensors in accordance with the present disclosure.
[0016] Figure 4 A snapshot is depicted of an exemplary vehicle in a covered protective enclosure in accordance with the present disclosure.
[0017] Figure 5A Snapshots of an exemplary vehicle according to the present disclosure located on dry ground with a wet windshield are depicted.
[0018] Figure 5B A snapshot of an exemplary vehicle with a dry windshield located on wet terrain is depicted in accordance with the present disclosure.
[0019] Figure 6 A flow chart of an exemplary method for facilitating automatic wiping according to the present disclosure is depicted. DETAILED DESCRIPTION
[0020] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the disclosure are shown and which are not intended to be limiting.
[0021] Figure 1 An exemplary environment 100 is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented. Environment 100 may include a vehicle 102, which may take the form of any passenger or commercial vehicle, such as, for example, a car, a work vehicle, a crossover vehicle, a truck, a van, a minivan, a taxi, a bus, etc. Vehicle 102 may be a manually driven vehicle and / or may be configured to operate in a partially autonomous mode, and may include any powertrain, such as, for example, a gasoline engine, one or more electric actuation motors, a hybrid powertrain, etc. Vehicle 102 may travel on a road 104, such as a Figure 1 Shown as possibly wet. In an exemplary aspect, road 104 may be wet due to rain, snow (eg, due to snow melting), hail storms, thunderstorms, and the like.
[0022] The vehicle 102 may include a front windshield 106 and a rear windshield (not shown). The front windshield 106 and the rear windshield may also become wet due to rain, such as Figure 1The vehicle 102 may also include a front wiper 108 (or a plurality of wipers 108 ) that may be configured to clean the front windshield 106 , and a rear wiper (not shown) that may be configured to clean the rear windshield.
[0023] The vehicle 102 may also include one or more vehicle cameras and sensors (hereinafter referred to as "vehicle cameras") that may be configured to capture images, sound signals, and / or determine surrounding environmental conditions near the vehicle. Figure 2 and Figure 3 Detailed description). When a vehicle operator (not shown) activates the vehicle ignition (i.e., when the vehicle operator performs a key-on operation), the vehicle 102 may begin to obtain input from the vehicle camera (and sensor) at a first predefined sampling frequency. The vehicle 102 may be configured to automatically control wiper movement based on input obtained from the vehicle camera (and sensor).
[0024] For example, in some aspects, the vehicle 102 may automatically control wiper activation or deactivation operations based on the vehicle location and humidity levels on the windshield and / or on the road 104 where the vehicle 102 may be located. In an exemplary aspect, the vehicle 102 may deactivate or keep the wiper "auto-wipe" operation off when the vehicle 102 may be located in a covered enclosure. For example, the vehicle 102 may not activate wiper movement when the vehicle 102 may be parked in a home parking lot. The vehicle 102 may determine that the vehicle 102 may be parked in a home parking lot (i.e., a covered enclosure) based on images obtained from a vehicle exterior camera and / or real-time vehicle geolocation obtained from a vehicle geolocation module / global positioning system (GPS) receiver or sensor.
[0025] The vehicle 102 may also determine that the front windshield 106 (and / or rear windshield) may be wet, or the road 104 may be wet, or both the front windshield 106 and the road 104 may be wet based on input obtained from the vehicle camera and / or sensors when the vehicle 102 may be outside the covered protective cover. When the vehicle 102 determines that only the front windshield 106 (and / or rear windshield) may be wet, or only the road 104 may be wet, or both may be dry, the vehicle 102 may keep the "auto wipe" operation turned off. In other words, when the vehicle 102 determines that at least one of the front windshield 106 (and / or rear windshield) and the road 104 may be dry, the vehicle 102 may not activate wiper movement.
[0026] In some aspects, the vehicle 102 may activate wiper movement when the vehicle 102 determines that both the front windshield 106 (and / or rear windshield) and the road 104 or the ground on which the vehicle 102 may be located may be wet and the vehicle 102 may be outside of a covered protective enclosure. In response to such a determination, the vehicle 102 may activate the wipers 108 at a first predefined speed. While the vehicle activates wiper movement at the first predefined speed, the vehicle 102 may also continue to obtain input from the vehicle camera (and sensors) at a first predefined sampling frequency.
[0027] The vehicle 102 may determine the humidity level on the front windshield 106 (and / or rear windshield) based on the input obtained, and may determine whether the humidity level increases, decreases, or remains stable / same over time. The humidity level may be determined based on the size of water droplets on the front windshield 106 (and / or rear windshield), the shape of droplets on the front windshield 106 (and / or rear windshield), the shape of water flow, the water level on the ground / road 104, as determined based on the input obtained from the vehicle camera (and sensors). In response to determining that the humidity level may increase over time, the vehicle 102 may increase the wiper speed from a first predefined speed (e.g., to a second predefined speed). In this case, the vehicle 102 may also increase the frequency at which the vehicle 102 may obtain input from the vehicle camera from a first predefined sampling frequency to a second (higher) predefined sampling frequency.
[0028] On the other hand, in response to determining that the humidity level may decrease over time, the vehicle 102 may reduce the wiper speed from the first predefined speed (e.g., to a third predefined speed). In this case, the vehicle 102 may also reduce the frequency at which the vehicle 102 may obtain input from the vehicle camera from the first / second predefined sampling frequency to a third (lower) predefined sampling frequency.
[0029] In an exemplary aspect, when the humidity level is likely to remain stable / same over time, the vehicle 102 may maintain the wiper speed constantly at the first predefined speed. In other aspects, when the humidity level is likely to remain stable / same over time, the vehicle 102 may still increase the wiper speed. In additional aspects, when the vehicle 102 determines that there is no humidity (or zero humidity level) on the front windshield 106 (and / or rear windshield), the vehicle 102 may deactivate wiper movement.
[0030] In some aspects, the vehicle 102 may use an artificial intelligence (AI) / machine learning (ML) algorithm and pre-stored training data to determine the optimal wiper speed based on the humidity level on the front windshield 106 (and / or the rear windshield). For example, the vehicle 102 may determine the above-mentioned first predefined speed, second predefined speed, and third predefined speed based on the AI / ML algorithm, pre-stored training data, and the humidity level on the front windshield 106 (and / or the rear windshield). The vehicle 102 may similarly determine the above-mentioned first sampling frequency, second sampling frequency, and third sampling frequency based on the AI / ML algorithm, pre-stored training data, and the humidity level on the front windshield 106 (and / or the rear windshield).
[0031] In additional aspects, the vehicle 102 can reduce (or disable) the wiper speed and reduce the sampling frequency of the input obtained from the vehicle camera when the vehicle 102 is likely not to move for more than a predefined duration. For example, if the vehicle 102 is likely to be stationary for more than 2 minutes, the vehicle 102 can reduce the wiper speed and sampling frequency to save vehicle energy.
[0032] Combined with the following Figure 2 Describes further details of the vehicle's automatic wiper operation.
[0033] The vehicle 102 and / or vehicle operator implements and / or performs operations as described herein in the present disclosure in accordance with the vehicle owner's manual and safety guidelines.
[0034] Figure 2 A block diagram of an exemplary system 200 for facilitating automatic wiper operation according to the present disclosure is depicted. Figure 2 When you can refer to Figure 3 , Figure 4 , Figure 5A and Figure 5B .
[0035] System 200 may include a vehicle 202, a user device 204, and one or more servers 206 that are communicatively coupled to each other via one or more networks 208. Vehicle 202 may be coupled to a Figure 1 The user device 204 may be associated with a vehicle operator and may include, but is not limited to, a mobile phone, a laptop, a computer, a tablet, a wearable device, or any other similar device having communication capabilities. The server 206 may be part of a cloud-based computing infrastructure and may be associated with and / or include a telematics service delivery network (SDN) that provides services to the vehicle 202 and other vehicles that may be part of a commercial vehicle fleet ( Figure 2In a further aspect, the server 206 may provide real-time weather condition information to the vehicle 202 and other vehicles operating as part of a vehicle fleet. The weather condition information may include information associated with the presence, absence, and / or level of rain or snow in a geographic area where the vehicle 202 may be located, ambient temperature, and the like. In an additional aspect, the server 206 may provide training data including correlations between one or more humidity levels on a vehicle windshield (e.g., the front windshield 106) and an optimal wiper speed or sampling frequency for obtaining input from a vehicle camera. The training data is described in detail later in the following description.
[0036] The network 208 illustrates an exemplary communication infrastructure in which the connected devices discussed in the various embodiments of the present disclosure may communicate. The network 208 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as, for example, Transmission Control Protocol / Internet Protocol (TCP / IP), Wi-Fi, UWB based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and Fifth Generation (5G), to name a few examples.
[0037] The vehicle 202 may include a plurality of units including, but not limited to, a vehicle computer 210, a vehicle control unit (VCU) 212, and a wiper control system 214. The VCU 212 may include a plurality of electronic control units (ECUs) 216 arranged to communicate with the vehicle computer 210.
[0038] The user device 204 may be connected to the vehicle computer 210 and / or the wiper control system 214 via a network 208, which may communicate via one or more wireless connections, and / or the user device may communicate using a near field communication (NFC) protocol, Protocol, Wi-Fi, ultra-wideband (UWB), and other possible data connection and sharing technologies to connect directly with the vehicle 202.
[0039] In some aspects, according to the present disclosure, the vehicle computer 210 and / or the wiper control system 214 can be installed in the vehicle engine compartment (or elsewhere in the vehicle 202). In addition, the vehicle computer 210 can operate as a functional part of the wiper control system 214. The vehicle computer 210 can be or include an electronic vehicle controller having one or more processors 218 and a memory 220. In addition, the wiper control system 214 can be separate from the vehicle computer 210 (e.g., Figure 2 ), or may be integrated as part of the vehicle computer 210.
[0040] The processor 218 may be configured to communicate with one or more memory devices (eg, memory 220 and / or memory 224) configured to communicate with a corresponding computing system. Figure 2 The processor 218 may utilize the memory 220 to store programs and / or store data in code form to perform various aspects of the present disclosure. The memory 220 may be a non-temporary computer-readable memory that stores wiper control program code. The memory 220 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).
[0041] According to some aspects, the VCU 212 can share a power bus with the vehicle computer 210 and can be configured and / or programmed to communicate between the systems of the vehicle 202, connected servers (e.g., server 206), and other vehicles operating as part of a vehicle fleet (e.g., server 206). Figure 2202 ). The VCU 212 may include or communicate with any combination of ECUs 216, such as, for example, a body control module (BCM) 222, an engine control module (ECM) 224, a transmission control module (TCM) 226, a telematics control unit (TCU) 228, a driver assistance technology (DAT) controller 230, etc. The VCU 212 may also include and / or communicate with a vehicle perception system (VPS) 232, which connects and / or controls one or more vehicle sensing systems 234. The vehicle sensing system 234 may include one or more vehicle sensors, including, but not limited to, radio detection and ranging (RADAR or "radar") sensors configured to detect and locate objects inside and outside the vehicle 202 using radio waves, seating area lock sensors, seating area sensors, light detection and ranging (LiDAR or "laser radar") sensors, door sensors, proximity sensors, temperature sensors, wheel sensors, ambient weather sensors, vehicle interior and exterior cameras, etc. Figure 3 An exemplary snapshot / top view of a vehicle 202 having one or more sensors described herein is shown.
[0042] like Figure 3 As shown, the vehicle 202 may include a front camera 302a, a rear camera 302b, and a front / front dashcam 302c (collectively referred to as vehicle cameras 302). The front camera 302a may be configured to capture images in front of the vehicle 202 and images of the ground / road 104 where the vehicle 202 may be located. The rear camera 302b may be configured to capture images of the rear side of the vehicle and images of the ground / road 104. The front dashcam 302c may be configured to capture images of the front windshield (e.g., the front windshield 106) of the vehicle and images of the ground / road 104. The vehicle cameras 302 may be configured to collectively capture images of areas in front and rear of the vehicle 202, the vehicle windshield, and the ground where the vehicle 202 may be located.
[0043] Vehicle 202 may include additional cameras and sensors, such as Figure 3 Examples of such additional cameras and sensors include, but are not limited to, a built-in microphone 304a, an external microphone 304b, an external rain sensor 304c, a built-in GPS sensor / receiver 304d, an external GPS sensor / receiver 304e, a rearview mirror camera 304f, a rear-mounted driving recorder (not shown), etc. (collectively referred to as additional sensors 304).
[0044] In some aspects, VCU 212 may control aspects of vehicle operation and implement one or more instruction sets received from user device 204 , from one or more instruction sets stored in memory 220 , including instructions to operate as part of wiper control system 214 .
[0045] The TCU 228 may be configured and / or programmed to provide vehicle connectivity to wireless computing systems on and off the vehicle 202 and may include a navigation (NAV) receiver 236 (which may be the same as the GPS sensor / receivers 304d, 304e) for receiving and processing GPS signals, module (BLEM) 238, a Wi-Fi transceiver, a UWB transceiver, and / or may be configured to communicate between the vehicle 202 and other systems (e.g., a vehicle key fob, Figure 2 Not shown), other wireless transceivers for wireless communication between the computer and the module ( Figure 2 216). The TCU 228 may be configured to communicate with the ECU 216 via a bus.
[0046] The ECU 216 may control various aspects of vehicle operation and communication using input from a human driver, input from an autonomous vehicle controller, the wiper control system 214, and / or via wireless signal input received from other connected devices (such as user device 204, server 206, etc.) over a wireless connection.
[0047] BCM 222 generally includes an integration of sensors, vehicle performance indicators, and varactors associated with vehicle systems, and may include processor-based power distribution circuits that may control functions associated with the vehicle body, such as lights, windows, security devices, cameras, audio systems, speakers, wipers, door locks and access controls, and various comfort controls. BCM 222 may also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 (not shown) to interact.
[0048] The DAT controller 230 may provide Level 1 to Level 3 autonomous driving and driver assistance functions, which may include, for example, active park assist, vehicle back-up assist, adaptive cruise control, and / or lane keeping, among other features. The DAT controller 230 may also provide various aspects of user and environmental input that may be used for user authentication.
[0049] In some aspects, the vehicle computer 210 can be connected to an infotainment system 240. The infotainment system 240 can include a touch screen interface portion, and can include a voice recognition feature, a biometric recognition capability that can recognize a user based on facial recognition, voice recognition, fingerprint recognition, or other biometric recognition means. In other aspects, the infotainment system 240 can also be configured to receive user commands via the touch screen interface portion, and / or display notifications, navigation maps, etc. on the touch screen interface portion.
[0050] Vehicle 202 may also include a windshield 242 and wipers 244. Windshield 242 may be the same as front windshield 106 and / or rear windshield, and wipers 244 may be the same as wipers 108. Vehicle computer 210 and / or wiper control system 214 may control wiper operation and movement via BCM 222.
[0051] The computing system architecture of the vehicle computer 210, VCU 212 and / or wiper control system 214 may omit certain computing modules. It should be readily understood that Figure 2 The computing environment depicted in FIG. 1 is an example of possible implementations according to the present disclosure and, therefore, should not be considered limiting or exclusive.
[0052] According to some aspects, the wiper control system 214 can be integrated with and / or executed as part of the ECU 216. The wiper control system 214, whether it is integrated with the vehicle computer 210 or the ECU 216, or whether it operates as a standalone computing system in the vehicle 202, can include a transceiver 246, a processor 248, and a computer readable memory 250.
[0053] The transceiver 246 may be configured to receive information / input from one or more external devices or systems (e.g., user device 204, server 206, etc.) via the network 208. In addition, the transceiver 246 may transmit notifications (e.g., alerts / alarm signals) to the external devices or systems. In addition, the transceiver 246 may be configured to receive information / input from vehicle 202 components (such as the infotainment system 240, the vehicle sensor system 234 (including Figure 3 In addition, the transceiver 246 can transmit notifications (e.g., alarm / warning signals) to vehicle 202 components (such as the infotainment system 240, BCM 222, etc.).
[0054] Processor 248 and memory 250 may be the same or similar to processor 218 and memory 220, respectively. In some aspects, processor 248 may be an AI / ML based processor that may utilize memory 250 to store programs in code form and / or store data to perform aspects according to the present disclosure. Memory 250 may be a non-transitory computer readable memory that stores wiper control code. In some aspects, memory 250 may additionally store information associated with vehicle 202 and data from sensor system 234 (e.g., Figure 3 In an additional aspect, memory 250 may store training data including correlations between one or more humidity levels on windshield 242 and optimal wiper speeds or sampling frequencies for obtaining inputs from vehicle camera 302. Use of the training data is described below.
[0055] In operation, the processor 248 may determine via the VCU 212 that the vehicle operator may have started the vehicle ignition or performed a key-on operation. In response to determining the key-on operation, the processor 248 may initiate an "initialization mode" of the wiper control system 214. In the initialization mode, the processor 248 may obtain input from the vehicle camera 302 at a first sampling frequency. Specifically, in the initialization mode, the processor 248 may begin to obtain images of areas of the front and rear sides of the vehicle 202 and images of the windshield 242 at the first sampling frequency. In addition, the processor 248 may obtain input from the additional sensor 304 at the first sampling frequency.
[0056] In response to obtaining input from vehicle camera 302, processor 248 can determine whether vehicle 202 may be located inside or outside a covered enclosure (e.g., a parking lot area) and whether windshield 242 and / or the ground on which vehicle 202 may be located may be wet or dry. Figure 4 An exemplary snapshot of vehicle 202 is shown residing / located in covered enclosure 402. Covered enclosure 402 may be a home parking lot, an office parking lot, a sun visor under which a vehicle operator may have parked vehicle 202, or the like. Figure 5A and Figure 5B An exemplary snapshot of vehicle 202 positioned outside of a covered protective enclosure (eg, traveling on road 104 ) is shown.
[0057] In some aspects, the processor 248 may determine whether the vehicle 202 is likely to be inside or outside the covered protective enclosure 402 based on input (e.g., images) obtained from the vehicle camera 302. In other aspects, the processor 248 may determine whether the vehicle 202 is likely to be inside or outside the covered protective enclosure 402 based on input obtained from the additional sensors 304. For example, the processor 248 may determine whether the vehicle 202 is likely to be inside or outside the covered protective enclosure 402 based on real-time vehicle location obtained from the GPS sensors / receivers 304d, 304e.
[0058] Similarly, the processor 248 can determine whether the windshield 242 and / or the ground on which the vehicle 202 may be located may be wet or dry based on input (e.g., images) obtained from the vehicle camera 302. In additional aspects, the processor 248 can determine whether the windshield 242 and / or the ground on which the vehicle 202 may be located may be wet or dry based on input obtained from the additional sensors 304 and / or input received from external devices. For example, the processor 248 can determine that the windshield 242 or the ground is wet based on weather condition information obtained from the server 206, sound signals obtained from the microphones 304a, 304b (e.g., when raindrops may fall on the windshield 242), input received from other vehicles that may be part of a fleet of vehicles (e.g., via V2V communication), input received from external sensors that may be installed near the vehicle 202 (e.g., via vehicle-to-infrastructure communication), etc.
[0059] In response to determining the vehicle position state (i.e., whether the vehicle 202 is likely to be inside or outside the covered protective enclosure 402) and the windshield 242 and ground wetness state, the processor 248 may control the wiper movement. In an exemplary aspect, when the processor 248 determines that the vehicle 202 is likely to be inside the covered protective enclosure 402, the processor 248 may not actuate the wiper movement regardless of whether the windshield 242 and / or the ground are likely to be wet. For example, in Figure 4 In the exemplary aspect depicted in , processor 248 may not actuate wiper movement when vehicle 202 is parked inside covered protective enclosure 402 .
[0060] On the other hand, in response to determining that vehicle 202 may be outside of covered protective enclosure 402, processor 248 may determine whether only windshield 242 may be wet and road 104 may be dry (e.g., Figure 5A ), or only the road 104 may be wet while the windshield 242 may be dry (as shown in FIG. Figure 5B When processor 248 may detect Figure 5A or Figure 5BIn other words, when either of the windshield 242 and the road 104 may be dry, the processor 248 may not actuate the wiper movement.
[0061] When the processor 248 determines that both the windshield 242 and the road 104 may be wet, the processor 248 may actuate the wiper movement. Specifically, the processor 248 may actuate the wiper 244 at a first speed in response to determining that both the windshield 242 and the road 104 may be wet. In some aspects, the processor 248 may also determine that the ambient temperature near the vehicle 202 may be above 0 degrees (i.e., the freezing point of water) via input obtained from the sensing system 234 and / or weather condition information obtained from the server 206. The processor 248 may actuate the wiper movement when the ambient temperature may be above 0 degrees (so that rain or snow may be in a liquid state), and may not actuate the wiper movement when the ambient temperature may be equal to or less than 0 degrees.
[0062] The processor 248 can continue to move the wipers 244 at the first speed and obtain input from the vehicle camera 302 (and additional sensors 304) at the first sampling frequency until the processor 248 determines that the vehicle 202 may be moving. The processor 248 can determine that the vehicle 202 may be moving based on the real-time vehicle location obtained from the GPS sensors / receivers 304d, 304e and / or input obtained from the VCU 212.
[0063] In response to determining that the vehicle 202 may be moving, the processor 248 may initiate a "wet detection mode" of the wiper control system 214. In some aspects, the processor 248 may initiate the "wet detection mode" when the vehicle 202 begins to move, regardless of whether the wipers 244 are moving (moving at a first speed) or stationary in the "initialization mode."
[0064] In the "wetness detection mode," the processor 248 may obtain input from the vehicle camera 302 (and additional sensors 304) at a second sampling frequency. In some aspects, the second sampling frequency may be the same as the first sampling frequency. In other aspects, the second sampling frequency may be different from (e.g., greater than or less than) the first sampling frequency. In response to obtaining the input, the processor 248 may again determine whether the vehicle 202 is likely to be inside a covered protective enclosure (e.g., traveling in a tunnel) or outside. In addition, the processor 248 may determine whether either the windshield 242 or the road 104 is likely to be dry, as described above.
[0065] In response to determining that vehicle 202 may be outside of a covered enclosure and both windshield 242 and road 104 may be wet, processor 248 may actuate wipers 244 at a second speed. In some aspects, the second speed may be the same as the first speed. In other aspects, the second speed may be different from the first speed.
[0066] The processor 248 can continue to operate the wiper control system 214 in the "wetness detection mode" and obtain input from the vehicle camera 302 (and additional sensors 304) while the vehicle 202 is traveling or moving on the road 104. The processor 248 can determine the humidity level of the windshield 242 (or the vehicle's surroundings) based on the obtained input, and can adjust the wiper speed and the sampling frequency of the input obtained from the vehicle camera 302 (and additional sensors 304) based on the determined humidity level, as described below.
[0067] The processor 248 can determine the humidity level at multiple timestamps, and can determine whether the humidity level is likely to increase or decrease over time. For example, the processor 248 can determine the first humidity level of the windshield 242 (or the vehicle's surroundings) at the first timestamp "T=T1". In some aspects, the processor 248 can determine the first humidity level based on the windshield image and the ground / road image obtained from the vehicle camera 302. In other aspects, the processor 248 can also determine the first humidity level based on input obtained from the microphones 304a, 304b, the vehicle ambient weather sensor, the piezoelectric sensor (e.g., based on the decibel level of raindrops detected when the vehicle 202 may be traveling through a rainfall geographic area) and / or weather condition information obtained from the server 206 (the server can provide weather condition information to the vehicle 202 based on the vehicle's real-time location).
[0068] In some aspects, the processor 248 may determine the first humidity level based on the size of water droplets on the windshield 242, the shape of the droplets on the windshield 242, the shape and size of the water flow on the windshield 242, the decibel of the raindrops, the moisture content on the ground / road 104, etc. In some aspects, the processor 248 may determine the first humidity level using an AI / ML-based algorithm (which may be stored in the memory 250) and a first training data set that may be stored in the memory 250 (and / or obtained from the server 206). The AI / ML-based algorithm may be an algorithm based on supervised learning. In an exemplary aspect, the first training data set may include a correlation between a defined humidity level (e.g., humidity level "low", "low-medium", "medium", "medium-high", "high", etc.) and a preset water drop size, shape, raindrop decibel level, ground moisture content, etc. The processor 248 may compare the determined water drop size, shape, raindrop decibel level, ground moisture content, etc. with the corresponding preset values stored in the memory 250 to determine the first humidity level (low, medium, high, etc.).
[0069] Similar to determining the first humidity level at the first timestamp “T=T1”, the processor 248 may determine the second humidity level at the second timestamp “T=T2”. In an exemplary aspect, T1 and T2 may correspond to a sampling frequency (e.g., a second sampling frequency) at which the processor 248 may obtain inputs from the vehicle camera 302 and the additional sensor 304. In response to determining the first humidity level and the second humidity level, the processor 248 may compare the first humidity level and the second humidity level to determine whether the humidity level of the windshield 242 is likely to increase, decrease, or remain the same. For example, when the second humidity level is likely to be greater than the first humidity level, the processor 248 may determine that the humidity level is likely to be increasing. Similarly, when the second humidity level is likely to be less than the first humidity level, the processor 248 may determine that the humidity level is likely to be decreasing.
[0070] In response to determining that the second humidity level is likely to be greater than the first humidity level, processor 248 may increase the wiper speed from the second speed to a third (higher) speed. In response to determining that the second humidity level is likely to be greater than the first humidity level, processor 248 may also increase the second sampling frequency to a third (higher) sampling frequency.
[0071] In some aspects, when processor 248 determines that the second humidity level may be equal to the first humidity level, processor 248 may keep the wiper speed and sampling frequency the same (or may increase).
[0072] On the other hand, in response to determining that the second humidity level is likely to be less than the first humidity level, processor 248 can reduce the wiper speed from the second speed to a fourth (lower) speed. In response to determining that the second humidity level is likely to be less than the first humidity level, processor 248 can also reduce the second sampling frequency to a fourth (lower) sampling frequency.
[0073] As will be appreciated by one of ordinary skill in the art, increasing the wiper speed enhances the convenience of the user operating the vehicle 202 when the humidity level (or rainfall intensity) on the windshield 242 is likely to increase. In addition, increasing the sampling frequency ensures that the processor 248 determines further humidity levels more frequently (at subsequent time stamps T3, T4, T5, etc.), and thus provides better and faster wiper speed control when the rainfall intensity is likely to be high. Similarly, reducing the sampling frequency when the humidity level (and therefore rainfall intensity) is likely to decrease ensures that the processor 248 saves computing resources.
[0074] In some aspects, the processor 248 may determine a second speed, a third speed, a fourth speed, etc.; and the second sampling frequency, the third sampling frequency, the fourth sampling frequency, etc. described above based on the AI / ML algorithm (which may be stored in the memory 250) and the second training data set that may be stored in the memory 250 (and / or obtained from the server 206). In an exemplary aspect, the second training data set may include a correlation between defined wiper speeds (e.g., the second speed, the third speed, and the fourth speed) and a preset humidity level. Similarly, the second training data set may include a correlation between defined sampling frequencies (e.g., the second sampling frequency, the third sampling frequency, and the fourth sampling frequency) and a preset humidity level. For example, the second training data set may include a correlation indicating that the wiper 244 may move at a first speed or a second speed when the humidity level may be low or medium (e.g., when the windshield 242 may be wet due to the sprinkler system may have sprayed water on the windshield 242, splashing water from another vehicle traveling near the vehicle 202, snow, etc.). The second training data set may also include correlations indicating that wipers 244 may move at higher speeds when humidity levels may be high (eg, when windshield 242 may be wet due to high intensity rain).
[0075] In some aspects, server 206 may update the first training data set and the second training data set periodically or at a predefined duration, and may provide the updated training data set to vehicle 202 (and other vehicles that may be part of a fleet of vehicles) so that processor 248 can use the updated training data set to determine the optimal wiper speed and sampling frequency.
[0076] In a further aspect, when the wiper control system 214 may be operating in a "wet detection mode," the processor 248 may be configured to determine that the vehicle 202 may have been stopped or stationary for a duration greater than a threshold duration based on the real-time vehicle location obtained from the GPS sensor / receiver 304d, 304e, the input obtained from the VCU 212, and / or the image obtained from the vehicle camera 302. In response to determining that the duration that the vehicle 202 may be stationary is greater than the threshold duration, the processor 248 may reduce the wiper speed to a fifth (lower) wiper speed (if both the windshield 242 and the road 104 may be wet) and / or reduce the sampling frequency to a fifth (lower) sampling frequency. The processor 248 may reduce processor computing resources and vehicle battery power usage by reducing the wiper speed and sampling frequency when the vehicle 202 may be stationary. In other aspects, in this case, the processor 248 can transmit a notification to the vehicle operator via the user device 204 and / or the infotainment system 240 to disable or deactivate the "wet detection mode" or automatic wipe vehicle feature when the vehicle operator desires the processor 248 not to move the wipers 244 and / or not to detect the windshield wetness level. Then, in response to receiving the notification, the vehicle operator can disable the automatic wipe vehicle feature via the user device 204 or the infotainment system 240. If the vehicle operator does not disable the automatic wipe vehicle feature, the processor 248 can continue to obtain input from the vehicle camera 302 and the additional sensor 304 at the fifth sampling frequency and control the wiper speed based on the obtained input.
[0077] Although the above description describes aspects in which the processor 248 determines the humidity level and controls the wiper speed based on inputs obtained from the vehicle camera 302 and the additional sensors 304, in some aspects, the processor 248 may determine the humidity level and control the wiper speed based only on inputs obtained from the vehicle camera 302. In other words, if the processor 248 has access to inputs obtained only from the vehicle camera 302 and may not have access to the additional sensors 304 described above, the processor 248 may equally effectively perform the operations mentioned above.
[0078] Figure 6 A flow chart of an exemplary method 600 for facilitating automatic wiping according to the present disclosure is depicted. Figure 6 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps shown or described herein, and may include the steps in an order different from that described in the example embodiments below.
[0079] The method 600 starts at step 602. At step 604, the method 600 may include obtaining, by the processor 248, a windshield image and a ground / road image from the vehicle camera 302. At step 606, the method 600 may include determining, by the processor 248, that the windshield 242 and the ground / road 104 may be wet based on the windshield image and the ground / road image. At step 608, the method 600 may include actuating, by the processor 248, the wipers 244 at a predefined speed (e.g., a first speed) in response to determining that both the windshield 242 and the ground / road 104 may be wet.
[0080] Method 600 ends at step 610 .
[0081] In the above disclosure, reference has been made to the accompanying drawings that form a part of the above disclosure, which illustrate specific embodiments in which the present disclosure can be practiced. It should be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present disclosure. References in this specification to "one embodiment," "embodiment," "example embodiment," etc. indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include the specific features, structures, or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when features, structures, or characteristics are described in conjunction with an embodiment, whether or not explicitly described, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments.
[0082] In addition, where appropriate, the functions described herein may be performed in one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As will be appreciated by those skilled in the art, components may be referred to by different names. This document is not intended to distinguish between components that have different names but the same function.
[0083] It should also be understood that the word "example" as used herein is intended to be non-exclusive and non-limiting in nature. More specifically, the word "example" used herein indicates one of several examples, and it should be understood that no undue emphasis or preference is placed on the specific example described.
[0084] Computer-readable media (also referred to as processor-readable media) include any non-transitory (e.g., tangible) media that participate in providing data (e.g., instructions) that can be read by a computer (e.g., by a processor of a computer). Such media can take many forms, including but not limited to non-volatile media and volatile media. A computing device may include computer-executable instructions, where the instructions are executable by one or more computing devices (such as those listed above) and stored on a computer-readable medium.
[0085] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced by performing the described steps in an order different from the order described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.
[0086] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Upon reading the above description, many embodiments and applications other than the examples provided will be apparent. The scope should not be determined with reference to the above description, but should be determined with reference to the entire scope of the appended claims and equivalents to which such claims are entitled. It is anticipated and expected that the technology discussed herein will develop in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In short, it should be understood that the present application is capable of modification and change.
[0087] Unless explicitly indicated to the contrary in this article, all terms used in the claims are intended to be given their ordinary meanings as understood by the skilled person described herein. Specifically, unless the claim states an explicit limitation to the contrary, the use of singular articles such as "one", "the", "said" and the like should be interpreted as describing one or more of the indicated elements. Unless otherwise specifically stated or understood in other ways within the context when used, conditional language such as, in particular, "can", "may", "can" or "may" is generally intended to express that certain embodiments may include certain features, elements and / or steps, while other embodiments may not include certain features, elements and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element and / or step in any way.
[0088] In one aspect of the invention, determining that the vehicle is outside the covered protective enclosure includes determining that the vehicle is outside the covered protective enclosure based on real-time vehicle position.
[0089] In one aspect of the present invention, the method includes: determining that the vehicle is moving based on the real-time vehicle position; and in response to determining that the vehicle is moving, determining a first wetness level at a first timestamp and a second wetness level at a second timestamp based on the windshield image and the ground image obtained from the vehicle camera at the first predefined sampling frequency.
[0090] In one aspect of the invention, the method includes: determining that the second wetness level is greater than the first wetness level; and increasing the first speed to a second speed in response to determining that the second wetness level is greater than the first wetness level.
[0091] In one aspect of the invention, the method comprises increasing the first predefined sampling frequency to a second predefined sampling frequency in response to determining that the second wetness level is greater than the first wetness level.
[0092] According to the present invention, a non-transitory computer-readable storage medium includes instructions stored thereon, which, when executed by a processor, cause the processor to: obtain a windshield image and a ground image from a vehicle camera at a first predefined sampling frequency; determine that a windshield and a ground of the vehicle are wet based on the windshield image and the ground image; and actuate a wiper at a first speed based on determining that the windshield and the ground are wet, wherein the wiper is configured to clean the windshield.
Claims
1. A vehicle comprising: windshield; a wiper configured to clean the windshield; a vehicle camera configured to capture a windshield image and a ground image; as well as a processor communicatively coupled to the wiper and the vehicle camera, wherein the processor is configured to: obtaining the windshield image and the ground image from the vehicle camera at a first predefined sampling frequency; determining, based on the windshield image and the ground image, that the windshield and the ground are wet; as well as The wipers are actuated at a first speed based on determining that the windshield and the ground are wet.
2. The vehicle of claim 1, wherein the processor is further configured to determine that the vehicle is outside a protective cover, wherein the processor actuates the wipers when the processor determines that the vehicle is outside the protective cover. 3 . The vehicle of claim 2 , wherein the vehicle camera is further configured to capture a vehicle surrounding image, and wherein the processor determines that the vehicle is located outside the covered protective enclosure based on the vehicle surrounding image.
4. The vehicle of claim 2, further comprising a geolocation module configured to determine a real-time vehicle location, and wherein the processor determines that the vehicle is located outside of the covered protective enclosure based on the real-time vehicle location.
5. The vehicle of claim 4, wherein the processor is further configured to: determining that the vehicle is moving based on the real-time vehicle position; and In response to determining that the vehicle is moving, a first wetness level at a first timestamp and a second wetness level at a second timestamp are determined based on the windshield image and the ground image obtained from the vehicle camera at the first predefined sampling frequency.
6. The vehicle of claim 5, wherein the processor determines the first wetness level and the second wetness level based on at least one of: a droplet size on the windshield, a droplet shape on the windshield, a water stream flow shape and size on the windshield, and a moisture content on the ground.
7. The vehicle of claim 5, wherein the processor is further configured to: determining that the second wetness level is greater than the first wetness level; and The first speed is increased to a second speed in response to determining that the second wetness level is greater than the first wetness level. 8 . The vehicle of claim 7 , wherein the processor is further configured to increase the first predefined sampling frequency to a second predefined sampling frequency in response to determining that the second wetness level is greater than the first wetness level.
9. The vehicle of claim 7, wherein the processor is further configured to: determining that the second wetness level is less than the first wetness level; and The first speed is reduced to a third speed in response to determining that the second wetness level is less than the first wetness level. 10 . The vehicle of claim 9 , wherein the processor is further configured to reduce the first predefined sampling frequency to a third predefined sampling frequency in response to determining that the second wetness level is less than the first wetness level.
11. The vehicle of claim 5, further comprising at least one of: a vehicle microphone and an external vehicle rain sensor.
12. The vehicle of claim 11, wherein the processor is further configured to: obtaining input from said vehicle microphone and said external vehicle rain sensor; and Obtain weather condition information from an external server based on the real-time vehicle position, Wherein the processor determines the first wetness level and the second wetness level based on the inputs obtained from the vehicle microphone and the external vehicle rain sensor and the weather condition information.
13. The vehicle of claim 4, wherein the processor is further configured to: determining, based on the real-time vehicle position, that the vehicle is stationary for a duration greater than a predefined threshold duration; reducing the first speed to a fourth speed; and The first predefined sampling frequency is reduced to a fourth predefined frequency.
14. A method for facilitating automatic wiping, the method comprising: obtaining, by a processor, a windshield image and a ground image from a vehicle camera at a first predefined sampling frequency; determining, by the processor, based on the windshield image and the ground image, that a windshield of the vehicle and the ground are wet; as well as A wiper is actuated, by the processor, at a first speed based on determining that the windshield and the ground are wet, wherein the wiper is configured to clean the windshield. 15 . The method of claim 14 , further comprising determining that the vehicle is outside a protective hood, wherein actuating the wipers comprises actuating the wipers when the vehicle is outside the protective hood.
