SYSTEMS AND METHODS FOR REMOVING CONGESTION FROM A VEHICLE GLASS SURFACES

Abstract

A vehicle is disclosed that includes a windshield, a sensor, a camera, an HVAC unit, and a processor. The sensor is configured to detect a humidity level on the windshield, and the camera is configured to capture an image of a target vehicle glass surface. The processor is configured to determine, based on inputs received from the sensor, that the humidity level is greater than a predefined threshold. The processor further obtains the image from the camera in response to determining that the humidity level is greater than the predefined threshold and detects the presence of condensation on the target vehicle glass surface based on the image.The processor additionally determines a condensation level on the target vehicle glass surface based on the image and controls the operation of the HVAC unit based on the condensation level to remove condensation from the target vehicle glass surface.

Description

AREA

[0001] The present disclosure relates to systems and methods for removing condensation from a vehicle glass surface based on images taken by a vehicle camera and optimal control of a heating, ventilation and air conditioning unit (HVAC unit) of the vehicle. GENERAL STATE OF THE ART

[0002] It is known that condensation occurs on a glass surface when warm, humid air comes into contact with the glass at a cold temperature. If condensation occurs on a vehicle's windshield, the driver can activate the vehicle's de-icing system.

[0003] Many modern vehicles have mechanisms that automatically detect condensation on the windshield and take measures to remove it. While these conventional mechanisms are effective at removing condensation from the windshield, they are not designed to detect condensation on other glass surfaces of the vehicle, such as the side windows, the upper rear window, the rear window, the interior and exterior mirrors, and / or the like. There may be situations where the driver may wish to remove condensation from other glass surfaces of the vehicle in addition to the windshield. SUMMARY

[0004] The present disclosure describes a vehicle that can be configured to detect the presence of condensation on one or more vehicle glass surfaces (which may differ from the vehicle's windshield) and to take corrective action to remove the condensation from the affected vehicle glass surfaces. Examples of such vehicle glass surfaces include, but are not limited to, side windows, a rear window, mirrors, built-in displays, etc. The corrective action may, for example, involve causing a vehicle's heating, ventilation, and air conditioning (HVAC) unit to blow air toward the affected vehicle glass surfaces (and not toward other vehicle glass surfaces that may not be condensed) in order to remove the condensation from the affected surfaces.

[0005] The vehicle may include a humidity sensor configured to detect the humidity level on the windshield. The vehicle may use the input from the humidity sensor to determine whether the humidity level on the windshield is potentially higher than a threshold. In response to determining that the humidity level is potentially higher than the threshold, the vehicle may obtain an image of a target vehicle glass area (“target vehicle glass area image”) from a vehicle camera. In some respects, the target vehicle glass area may be the vehicle glass area where there is a potentially high probability of condensation. For example, the target vehicle glass area may be the vehicle glass area near which a user may be sitting or where a hot drink, wet shoes, fabric, etc., may be present.

[0006] Upon acquiring the target vehicle glass surface image, the vehicle can compare this image to a pre-stored image of the target vehicle glass surface under a non-condensing condition (i.e., when the target vehicle glass surface is potentially clean). Based on this comparison, the vehicle can determine whether or not condensation is present on the target vehicle glass surface.

[0007] In response to the detection of condensation on the target vehicle's glass surface, the vehicle can correlate the target vehicle's glass surface image with training data that includes a large number of pre-stored images of the target vehicle's glass surface at different levels of condensation. Based on this correlation, the vehicle can determine the condensation level on the target vehicle's glass surface (e.g., whether the condensation level is high, medium, low, etc.).

[0008] The vehicle can then cause the HVAC unit to blow air toward the target vehicle window surface to remove condensation based on the specified level of fogging. For example, the vehicle can set the HVAC unit's fan speed to high, medium, low, etc., based on the level of fogging on the target vehicle window surface. The vehicle can also control / set a duration for which the HVAC unit blows air toward the target vehicle window surface, based on the level of fogging. Additionally, the vehicle can control the operation of the HVAC unit (e.g., fan speed and / or duration) based on the location and / or type of the target vehicle window surface.

[0009] The present disclosure reveals a vehicle that efficiently detects condensation on vehicle glass surfaces other than the windshield and takes corrective action to remove the condensation from the affected surfaces. The vehicle utilizes existing cameras, sensors, and units to detect the condensation and take corrective action, thus requiring no external units / components to perform the operations disclosed in this disclosure. Furthermore, the vehicle causes the HVAC unit to blow air only towards the vehicle glass surfaces affected by condensation and not towards other glass surfaces, thereby ensuring optimal use of the vehicle's resources / energy required to operate the HVAC unit.Furthermore, the vehicle controls / adjusts the fan speed of the HVAC unit and / or the duration of operation based on the level of condensation, so that the HVAC unit does not consume unnecessary energy for operation.

[0010] These and other benefits of the present revelation are provided in detail in this document. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical elements. Different embodiments may use different elements and / or components than those illustrated in the drawings, and some elements and / or components may not be present in different embodiments. The elements and / or components in the figures are not necessarily drawn to scale. Throughout this disclosure, singular and plural expressions may be used interchangeably depending on the context. Fig. Figure 1 shows a first interior view of an exemplary vehicle according to the present disclosure. Fig. Figure 2 shows a block diagram of a system for removing condensation from one or more vehicle glass surfaces according to the present disclosure. Fig. Figure 3 shows a second interior view of an exemplary vehicle according to the present disclosure. Fig. Figure 4 shows a table illustrating exemplary mitigation measures that can be carried out to remove condensation from one or more vehicle glass surfaces in accordance with the present disclosure. Fig. Figure 5 shows a flowchart of an exemplary method for removing condensation from one or more vehicle glass surfaces according to the present disclosure. DETAILED DESCRIPTION

[0012] The disclosure is described in more detail below with reference to the accompanying drawings, which show exemplary embodiments of the disclosure, and is not intended to be restrictive.

[0013] Fig. Figure 1 shows a first interior view of an exemplary vehicle 100 according to the present disclosure. The first interior view is a view of a section of the vehicle's interior. The vehicle 100 can take the form of any passenger or commercial vehicle, such as a car, a work vehicle, a crossover vehicle, a truck, a van, a minivan, a taxi, a bus, etc. The vehicle 100 can be a manually driven vehicle or can be configured to operate in a semi- or fully autonomous mode. Furthermore, the vehicle 100 can include any powertrain, such as a gasoline engine, one or more electrically driven motors, a hybrid system, etc.

[0014] The vehicle 100 may include a variety of components, including, but not limited to, a windshield 102, a left side window 104, a right side window 106, a left rearview mirror 108, a right rearview mirror 110, a window in the upper section of the vehicle (not shown), one or more built-in displays (not shown), and / or the like. Furthermore, a driver / user 112 may be seated in a driver's seat area of ​​a vehicle. Although Fig. 1 depicts a single user 112 sitting in the vehicle 100, the present disclosure is not limited to the Fig. The illustration shown in Figure 1 is limited. Several users can sit in the vehicle interior section (e.g., in a passenger seating area and / or rear seating areas) without deviating from the scope of this disclosure.

[0015] It is known that condensation forms on a cold surface when warm, moist air comes into contact with it. For example, condensation can form on the interior surface / section of the vehicle's glass surfaces described above (e.g., the left side window 104, the right side window 106, the left rearview mirror 108, the right rearview mirror 110, and / or the like) when warm, moist air present in the vehicle's interior comes into contact with the glass surfaces and the glass surface temperature is low (e.g., during winter). The air in the vehicle's interior can be warm and moist for various reasons, such as the breath of the occupant 112 (or other occupants present in the vehicle's interior), the presence of warm drinks, wet clothing, shoes, etc., lack of fresh air circulation, and / or the like.The moisture from condensation typically appears on the glass surface as tiny water droplets, causing a blurry haze or "fogging" on the glass. An example view of a fogged area 114 on a left-hand window section / left-hand window surface of the interior (facing the vehicle interior section) is shown in . Fig. 1 shown.

[0016] In some aspects, the vehicle 100 may also include a humidity sensor (which may be part of a vehicle sensor system 232 that is in Fig. 2), which may be part of the windshield 102 or be installed near it. The humidity sensor may be configured to detect a humidity level on the windshield 102. The vehicle 100 may be configured to detect the presence of condensation on the windshield 102 based on inputs obtained from the humidity sensor (and also inputs obtained from one or more vehicle temperature sensors) and to take a corrective action to remove condensation from the windshield 102 (or to remove / reduce the condensation on it). In one exemplary aspect, the corrective action may involve causing a heating, ventilation, and air conditioning (HVAC) unit (in Fig. 2 (shown as HVAC unit 206) blows air towards the interior section / interior surface of the windscreen 102, causing fogging to be removed from the windscreen 102 or condensation to be removed.

[0017] The humidity sensor described above may not be configured to detect humidity levels on other vehicle glass surfaces (e.g., the left side window 104, the right side window 106, the left rearview mirror 108, the right rearview mirror 110, and / or the like). To ensure that the vehicle 100 optimally detects condensation on other vehicle glass surfaces (different from the windshield 102), the vehicle 100 can acquire images of one or more vehicle glass surfaces from one or more vehicle cameras (which may be part of the vehicle sensor system). In response to acquiring the images, the vehicle 100 can analyze the images and detect the presence of condensation on one or more vehicle glass surfaces based on the image analysis. The process of detecting condensation based on image analysis is briefly described below and in conjunction with Fig. 2 described in more detail.

[0018] In the following text, the term "vehicle glass surface" refers to the left side window 104, the right side window 106, the left rearview mirror 108, the right rearview mirror 110, the window in the upper section of the vehicle (not shown), the built-in displays (not shown), and / or the like, which are different from the windscreen 102. In other words, the term "vehicle glass surface" in the following text does not refer to the windscreen 102, but instead to other glass surfaces of the vehicle that are different from the windscreen 102.

[0019] The vehicle 100 can prestore images (or “first images”) of each vehicle glass surface under a “no fogging” condition (e.g., in a vehicle memory located in Fig. (2 is shown as memory 244). In particular, the first images may be the images of the vehicle's glass surfaces, if the glass surfaces are possibly not fogged or clean. In some aspects, the vehicle can prestore the first images for each vehicle glass surface under different ambient conditions / light intensities, e.g., at night, during the day, at different ambient light intensity levels, etc.

[0020] The vehicle 100 can also prestore a multitude of secondary images assigned to each vehicle glass surface at different levels of condensation (or "condensation levels"). The condensation levels can be defined by a vehicle manufacturer or a driver. For example, a condensation level of "0" could represent no condensation on the vehicle glass surface (i.e., the vehicle glass surface is clean), a condensation level of "1" could represent a blurred area, a condensation level of "2" could represent an area with condensation, a condensation level of "3" could represent an area with streaks of droplets, and / or the like.The exemplary coating levels described in this document should not be interpreted as restrictive and the coating levels may be defined in any other way without deviating from the scope of this disclosure.

[0021] In some aspects, to detect the presence of condensation on a vehicle glass surface (e.g., the left side window 104), the vehicle 100 can compare an image of the left side window 104 captured by the vehicle camera(s) (or a captured "image of the left side window") with the associated first image of the left side window 104 (e.g., an image of the left side window 104 without condensation). The vehicle 100 can detect the presence of condensation on the left side window 104 if the captured image of the left side window differs from the first image associated with the left side window 104.

[0022] In response to the detection of condensation on the left side window 104, the vehicle 100 can correlate the captured image of the left side window with the multitude of second images associated with the left side window 104 to determine a condensation level on the left side window 104. Based on the determined condensation level, the vehicle 100 can then perform one or more remedial actions to remove condensation from the left side window 104. For example, the vehicle 100 can cause the vehicle's HVAC unit to blow air toward the left side window 104 to remove condensation from it. The vehicle 100 can also, based on the determined condensation level, adjust the airflow rate toward the left side window 104 (e.g.,(adjust the fan speed of the HVAC unit) and / or set a duration for which the HVAC unit blows air towards the left side window 104.

[0023] Even if the left side window 104 (or any other vehicle glass surface) does not have an associated humidity sensor, the vehicle 100 is still able to effectively detect the presence of condensation on the left side window 104 based on image analysis and optimally remove the condensation from the left side window 104. Furthermore, the vehicle 100 ensures that the HVAC unit blows air only towards the vehicle glass surface that is fogged (i.e., the "affected" vehicle glass surface, e.g., the left side window 104) and not towards other vehicle glass surfaces that may not be affected by condensation, thus ensuring that no unnecessary energy is consumed in operating the HVAC unit. In addition, the vehicle 100 can monitor the condensation level on the affected vehicle glass surface over time and can adjust the operation of the HVAC unit (e.g.,The fan speed and / or the operating time of the HVAC unit are adjusted based on the "real-time" condensation level, further ensuring that the HVAC unit is not used unnecessarily when the condensation level may decrease or the condensation may have disappeared from the vehicle glass surface (e.g., when the condensation level is reduced to 0).

[0024] Further details of vehicle 100 are listed below in conjunction with Fig. 2 described.

[0025] The Vehicle 100 implements and / or carries out operations as described herein in accordance with the user manual and safety guidelines. Additionally, any action taken by the operator / user based on notifications / recommendations provided by the Vehicle 100 should comply with all regulations specific to the location and operation of the Vehicle 100 (e.g., federal, state, county, city, etc.). The notifications / recommendations provided by the Vehicle 100 should be treated as suggestions and followed only in accordance with any regulations specific to the location and operation of the Vehicle 100.

[0026] Fig. Figure 2 shows a block diagram of a system 200 for removing condensation from one or more vehicle glass surfaces according to the present disclosure. In describing Fig. 2 will be applied to the Fig. 3 and Fig. 4 referenced.

[0027] System 200 can include the vehicle 100 and one or more servers 202 (or a single server 202) that are communicatively coupled to each other via one or more networks 204. The server 202 can be part of a cloud-based computing infrastructure and can be associated with and / or include a telematics service delivery network (SDN) that provides the vehicle 100 and other vehicles (in Fig. 2 (not shown), which may be part of a vehicle fleet, provides digital data services.

[0028] In other aspects, server 202 can store the first images and the multitude of second images assigned to a variety of vehicle glass surfaces. As above in conjunction with Fig. As described in section 1, the first image associated with a vehicle glass surface can be an image of the glass surface without any condensation (or condensation at level "0"). The second images can be images of the glass surface at different condensation levels (e.g., condensation levels "1", "2", "3", etc.). Additionally, the server can be configured to store historical information associated with condensation on each vehicle glass surface. This historical information can include, for example, typical locations on each glass surface where condensation begins, historical images of condensation associated with each glass surface, and / or similar data.Server 202 can transmit the first image(s), the second image(s), and the historical information associated with each vehicle glass surface to vehicle 100 at a predefined frequency, or when vehicle 100 sends a request to server 202 to obtain such information.

[0029] The network(s) 204 illustrate(s) an exemplary communications infrastructure in which the connected devices discussed in various embodiments of this disclosure can communicate. The network(s) 204 may be and / or include the Internet, a private network, a public network, or another configuration operating using any one or more known communication protocols, such as Transmission Control Protocol / Internet Protocol (TCP / IP), Bluetooth, or other similar technologies. ®Bluetooth Low Energy (BLE), Wi-Fi based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, Ultra-wideband (UWB) and mobile communication technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High-Speed ​​Packet Access (HSPDA), Long-Term Evolution (LTE), Global System for Mobile Communications (GSM) and Fifth Generation (5G), to name a few examples.

[0030] The vehicle 100 can include a variety of units, including, but not limited to, an HVAC unit 206, a vehicle computer 208, a vehicle control unit (VCU) 210, and a fogging control unit 212 (or unit 212). The VCU 210 can include a variety of electronic control units (ECUs) 214, which communicate with the vehicle computer 208.

[0031] In some aspects, the vehicle computer 208 and / or the unit 212 can be installed at any location in the vehicle 100 according to the disclosure. Furthermore, the vehicle computer 208 can be operated as a functional component of the unit 212. The vehicle computer 208 can be or include an electronic vehicle control unit comprising one or more processor(s) 216 and a memory 218. In addition, the unit 212 can be separate from the vehicle computer 208 (as in Fig. 2 shown) or integrated as part of the vehicle computer 208.

[0032] The processor(s) 216 can communicate with one or more storage devices that communicate with the respective computing systems (e.g., the memory 218 and / or one or more external databases located in Fig. (2 not shown). The processor(s) 216 can / can use the memory 218 to store programs as code and / or to store data for performing aspects according to the disclosure. The memory 218 can be a non-transient, computer-readable medium or a non-transient, computer-readable memory that stores a fogging control program code. The memory 218 can include any or a combination of volatile memory elements (e.g., dynamic random-access memory (DRAM), synchronous dynamic random-access memory (SDRAM), etc.) and can include any or several non-volatile memory elements (e.g.,including erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0033] According to some aspects, the VCU 210 can share a power bus with the vehicle computer 208 and can be configured and / or programmed to transmit data between systems of the vehicle 100, connected servers (e.g., the server(s) 202), and other vehicles (in Fig. 2 (not shown), which are operated as part of a vehicle fleet. The VCU 210 can include or communicate with any combination of the ECUs 214, such as a Body Control Module (BCM) 220, an Engine Control Module (ECM) 222, a Transmission Control Module (TCM) 224, a Telematics Control Unit (TCU) 226, a Driver Assistance Technologies (DAT) 228, etc.

[0034] The VCU 210 may also include and / or communicate with a Vehicle Perception System (VPS) 230, which has connectivity to and / or controls one or more vehicle sensor systems 232. The vehicle sensor system 232 may include one or more vehicle sensors, including, but not limited to, a radio detection and ranging (radar) sensor configured to detect and locate objects inside and outside the vehicle 100 using radio waves, seat belt buckle sensors, seat area sensors, a light detection and ranging (lidar) sensor, door sensors, proximity sensors, temperature sensors, wheel sensors, ambient weather sensors, ambient light sensors, vehicle interior and exterior cameras, one or more rain sensors, a humidity sensor, a tire pressure sensor, ultrasonic sensors, etc.

[0035] In some aspects, the humidity sensor (or a “first sensor”) can be configured to detect a humidity level on the windshield 102. Furthermore, the vehicle cameras, seat belt buckle sensors, seat area sensors, temperature sensors, radar sensor(s), etc. (collectively referred to as a “second sensor”) can be configured to detect the presence of users or objects in the vehicle interior area, which may be configured to cause condensation on the multitude of vehicle glass surfaces. As described above, the vehicle glass surfaces in this disclosure refer to the glass surfaces of the vehicle 100 that are distinct from the windshield 102.It is known that when the vehicle glass surface temperature is low / cold, the breath of occupants sitting near the glass and / or the presence of hot drinks (and / or wet clothing, wet shoes, etc.) near the glass can cause condensation. The second sensor can be configured to detect the presence of occupants and / or such objects near the vehicle glass.

[0036] In some aspects, the VCU 210 can control operational aspects of the vehicle and execute one or more sets of instructions received from a user device assigned to user 112 from one or more sets of instructions stored in memory 218, including instructions that are operational as part of the unit 212.

[0037] The TCU 226 can be configured and / or programmed to provide vehicle connectivity with wireless computing systems inside and outside the vehicle 100, and can include a navigation receiver (NAV receiver) 234 for receiving and processing a GPS signal, a BLE module (BLEM) 236, a Wi-Fi transceiver, a UWB transceiver and / or other wireless transceivers (in Fig. 2 (not shown) include components that can be configured for wireless communication (including cellular communication) between the vehicle 100 and other systems (e.g., the user device, a radio key, an NFC device, etc.), computers, and modules. The NAV receiver 234 can be configured to determine a real-time geolocation of the vehicle. The TCU 226 can communicate with the ECUs 214 via a bus.

[0038] The ECUs 214 can control aspects of vehicle operation and communication using inputs from human drivers, inputs from a controller of an autonomous vehicle, the unit 212 and / or via wireless signal inputs received via the wireless link(s) from other connected devices, such as, among others, the user device, the server(s) 202.

[0039] The BCM 220 generally integrates sensors, vehicle performance indicators, and variable throttles assigned to vehicle systems. It may include processor-based power distribution circuits capable of controlling functions associated with the vehicle body, such as lights, windows, security, camera(s), fans, headlights, audio system(s), speakers, windshield wipers, door locks and access control, mirrors, various comfort controls, body panels, and the like. The BCM 220 can also operate as a gateway for bus and network interfaces to communicate with remote ECUs (in Fig. 2 not shown) to interact.

[0040] The DAT 228 controller can provide Level 1 to Level 3 automated driving and driver assistance functionality, which may include, for example, active parking assistance, reverse parking assistance, and adaptive cruise control, among other features. The DAT 228 controller can also provide aspects of user and environmental input that can be used for user authentication.

[0041] In some aspects, the vehicle computer 208 can connect to an infotainment system 238 (or a human-machine interface (MMS) 238 of the vehicle). The infotainment system 238 can include a touchscreen interface section and can include voice recognition features and biometric identification capabilities that can identify users based on facial recognition, voice recognition, fingerprint identification, or other biological identification methods. In other aspects, the infotainment system 238 can also be configured to receive user instructions via the touchscreen interface section and / or to display notifications / recommendations, navigation maps, etc., on the touchscreen interface section.

[0042] In the computer system architecture of the vehicle computer 208, the VCU 210 and / or the unit 212, certain computing modules may be omitted. It goes without saying that the in Fig. The computing environment shown in Figure 2 is an example of a possible implementation according to the present disclosure and should therefore not be considered restrictive or exclusive.

[0043] According to some aspects, the unit 212 can be integrated into the ECUs 214 and / or run as part of them. Regardless of whether it is integrated into the vehicle computer 208 or the ECUs 214, or operated as an independent computing system in the vehicle 100, the unit 212 can include a transceiver 240, a processor 242, and computer-readable memory 244.

[0044] The transceiver 240 can be configured to receive information / input from one or more external devices or systems, such as the user device assigned to user 112, server(s) 202, and / or the like, via network 204. For example, the transceiver 240 can receive the first image(s), the second images, and the historical information assigned to each vehicle glass surface from server 202 via network 204. Furthermore, the transceiver 240 can transmit notifications (e.g., warning / alarm signals) to the external devices or systems. Additionally, the transceiver 240 can be configured to receive information / input from components of the vehicle 100, such as the infotainment system 238, the vehicle sensor system 232, the TCU 226, and / or the like. Furthermore, the transceiver can receive 240 notifications (e.g.Warning / alarm / command signals) are transmitted to the components of the vehicle 100, such as the infotainment system 238, the BCM 220, the HVAC unit 206, etc.

[0045] The processor 242 and the memory 244 can be the same as or similar to the processor 216 and the memory 218, respectively. In some aspects, the processor 242 can use the memory 244 to store programs in code and / or data for performing aspects according to the disclosure. The memory 244 can be a non-transitory computer-readable medium or a non-transitory computer-readable memory that stores the fogging control program code. In some aspects, the memory 244 can be configured to store the first image(s), the second images, and the historical information associated with each vehicle glass surface that the vehicle 100 obtains from the server 202.

[0046] In operation, the processor 242 can, in one exemplary aspect, receive input from the second sensor described above and determine a probability of condensation forming on each of the many vehicle glass surfaces based on the input received from the second sensor. For example, the processor 242 can determine the probability of condensation forming on each vehicle glass surface based on whether, according to the input received from the second sensor, a user (e.g., user 112 or another occupant) is sitting near the vehicle glass surface or whether any object that can cause condensation is present near the vehicle glass surface. In response to determining the probability for each vehicle glass surface, the processor 242 can compare the probabilities with a first predefined threshold (e.g., 50 or 60%).

[0047] Based on the comparison described above, Processor 242 can identify one or more "target" vehicle glass surfaces to focus on (or to allocate processing resources to in order to detect fogging). In some aspects, the target vehicle glass surface may have an associated probability greater than the first predefined threshold. For example, Processor 242 can, since the user 112, as in Fig. Figure 1, located near the left side window 104, determines that the probability of condensation forming on the left side window 104 may be greater than the first predefined threshold. In this case, processor 242 can identify the left side window 104 as the target vehicle glass surface.

[0048] In response to the identification of the target vehicle glass surface (e.g., the left side window 104), the processor 242 can receive input from the first sensor (e.g., the humidity sensor) and check whether the humidity level on the windshield 102 is greater than a second predefined threshold based on the input received from the first sensor. Upon determining that the humidity level on the windshield 102 is greater than the second predefined threshold, the processor 242 can begin the process of detecting the presence of condensation on the identified target vehicle glass surface.

[0049] Because Processor 242 begins the process of detecting the presence of condensation on the identified target vehicle glass surface, rather than on all vehicle glass surfaces, Processor 242 saves resources that would otherwise be required to identify condensation on all vehicle glass surfaces. An average professional will recognize that significant processor resources can be utilized if Processor 242 attempts to detect condensation on all vehicle glass surfaces. By focusing the detection process on those vehicle glass surfaces that are highly likely to fog up (i.e., the target vehicle glass surface(s)), Processor 242 is able to conserve resources required for processing.Furthermore, by focusing the detection process on the target vehicle glass surface(s), the processor 242 is able to save time required to detect the presence of condensation.

[0050] In alternative aspects, the processor 242 can skip the step described above for identifying the target vehicle glass surface and begin the process of detecting the presence of condensation on all vehicle glass surfaces without deviating from the scope of this disclosure. In other words, the step of identifying the target vehicle glass surface is not necessary for implementing this disclosure. The following description is given in the context of the aspect in which the processor 242 performs the step of identifying the target vehicle glass surface before beginning the process of detecting the presence of condensation; however, such a description should not be interpreted as restrictive.

[0051] In some aspects, the processor 242 can begin the process of detecting the presence of condensation on the target vehicle glass surface by acquiring an image(s) of the target vehicle glass surface and then analyzing the acquired image(s), as described below. If, in other aspects, the processor 242 has already acquired the image(s) of the target vehicle glass surface (even before the moisture level on the windshield 102 exceeds the second predefined threshold), the processor 242 can begin the process of detecting the presence of condensation on the target vehicle glass surface by increasing the rate (or frequency) of acquiring and analyzing the target vehicle glass surface images.

[0052] The process for detecting the presence of condensation on the target vehicle's glass surface is described below.

[0053] In some aspects, the processor 242, in response to identifying the target vehicle glass surface (e.g., the left side window 104) and determining that the moisture level on the windshield 102 is greater than the second predefined threshold, can obtain the image of the left side window from a vehicle camera that may be configured to capture the image of the left side window. In other words, the processor 242 can obtain the image of the left side window from a vehicle camera that may have the left window 104 in its field of view (FOV).

[0054] The processor 242 can then compare the acquired image of the left side window with the first image assigned to the left side window 104 (i.e., the prestored image of the left side window 104 without condensation) to detect the presence of condensation on the left side window 104. In particular, the processor 242 can detect the presence of condensation on the left side window 104 if the acquired image of the left side window differs from the first image assigned to the left side window 104.

[0055] In some aspects, the initial image associated with the left side window 104 may include multiple images taken under different environmental conditions / light intensities (e.g., in low light, in bright light, at night, during the day, etc.). Based on real-time environmental conditions within the vehicle interior (determined from inputs obtained by the vehicle sensor system 232), the processor 242 can select a suitable initial image and compare it with the acquired image of the left side window to detect the presence of condensation on the left side window 104. In this way, the processor 242 can detect the presence of condensation on the left side window 104 under different environmental conditions or light intensities.As one example, if the vehicle cameras include a heat detection capability, the processor 242 can compare the images based on an image heatmap analysis.

[0056] In some aspects, the initial images assigned to different vehicle glass surfaces may differ based on the location of the glass surfaces within the vehicle 100 and / or the type of glass surface (e.g., whether the glass is tinted or not). For example, the initial image assigned to the rear window may differ from the initial image assigned to the left rearview mirror 108 because of the different locations and types of these glass surfaces. The processor 242 can compare the target vehicle glass surface image with its respective initial image to correctly detect the presence of condensation based on the location and / or type of the target vehicle glass surface.

[0057] In further aspects, in order to improve or accelerate the process of detecting the presence of condensation on the target vehicle glass surface (e.g., the left side window 104), the processor 242 can first identify an expected or typical condensation initiation point on the left side window 104 (where condensation on the left side window 104 typically begins) based on historical information / images of condensation associated with the left side window 104 and / or inputs obtained from the second sensor.In response to identifying the expected condensation initiation point, processor 242 can begin analyzing the portion of the left side window image corresponding to the expected condensation initiation point, or comparing it to the corresponding portion in the first image, to quickly detect the presence of condensation on the left side window 104. Since the typical or expected condensation initiation point may be a small section within the left side window 104 where the probability of condensation starting is high, processor 242 is able to quickly detect the presence of condensation on the left side window 104 by using minimal processing resources, focusing on this small section of the glass surface in the left side window image.

[0058] In response to comparing the obtained image of the left side window with the first image and determining that the obtained image of the left side window differs from the first image, the processor 242 can detect the presence of condensation on the left side window 104 (as in Fig. 1 shown). In response to the detection of the presence of condensation on the left side window 104, the processor 242 can determine a condensation level on the left side window 104 based on the obtained image of the left side window.

[0059] In some aspects, the processor 242 can be an artificial intelligence (AI)-based processor that can be configured to use training data (which may include the first and second images associated with each vehicle glass surface) stored in memory 244 to compare and correlate the acquired image of the left side window with the associated second images in order to determine a "match" between the acquired image of the left side window and a second image associated with the left side window 104. Specifically, in response to the detection of condensation on the left side window 104, the processor 242 can correlate the acquired image of the left side window with the second images associated with the left side window 104 to determine a second image that substantially matches the acquired image of the left side window.Since the second images are assigned to different levels of condensation (as above in conjunction with . Fig. (as described in section 1), the processor 242 can determine a condensation level at the left side window 104 based on the correlation described above (i.e., based on the second image that "matches" the obtained image of the left side window). For example, the processor 242 can determine that the condensation level at the left side window 104 can be "1" if the obtained image of the left side window matches the second image associated with condensation level "1", the condensation level at the left side window 104 can be "2" if the obtained image of the left side window matches the second image associated with condensation level "2", and so on.

[0060] In response to the determination of the condensation level on the left side window 104, the processor 242 can control the operation of the HVAC unit based on the condensation level to remove condensation from the left side window 104. Specifically, in this case, the processor 242 can control the ventilation openings of the HVAC unit so that the HVAC unit 206 blows air towards the left side window 104, thereby removing condensation from the left side window 104 (as indicated by an arrow 302 in the figure). Fig. 3 shown).

[0061] In some aspects, the processor 242 can cause the HVAC unit 206 to blow air only towards the vehicle glass surfaces that may be fogged up, and not towards all vehicle glass surfaces, thereby saving energy required to operate the HVAC unit 206. For example, the processor 242 can, as in Fig. As shown in Figure 3, the HVAC unit 206 blows air only in the direction of the left side window 104 (as shown by the arrow 302) and not in the direction of the right side window 106 (as shown by a cross 304), because condensation is only present on the left side window 104 and not on the right side window 106.

[0062] The processor 242 can further be configured to control / set an HVAC airflow rate (e.g., a fan speed) toward the target vehicle glass surface and / or a duration for which the HVAC unit 206 can blow air toward the target vehicle glass surface, based on the specific level of condensation and / or the position of the target vehicle glass surface in the vehicle 100. The HVAC airflow rate and / or the duration can also be set / controlled based on the type of target vehicle glass surface (e.g., whether the glass is tinted or not).

[0063] An exemplary Table 400, illustrating one or more mitigation measures that can be performed by the Processor 242 to remove condensation from one or more vehicle glass surfaces, is provided in Fig. Figure 4 is shown. In Table 400, column 402 represents the vehicle glass surface(s) where the processor 242 may have detected the presence of condensation, column 404 represents a condensation level on the vehicle glass surface(s), and column 406 represents a defrost removal measure (HVAC) carried out by the processor 242 (e.g., controlling a fan speed 406a of the HVAC unit, a runtime 406b of the HVAC unit, and switching on or controlling HVAC vents 406c).

[0064] If, as shown in line 408, the area on which condensation is detected is located in a second row of the vehicle and on the left side (e.g., a left rear side window or "surface_1") and the condensation level is possibly "1" (indicating a blurred area), the processor 242 can set the HVAC fan speed to a first speed or "1", cause the HVAC unit 206 to blow air towards "surface_1" for a first predefined duration (e.g., "period_1 (t1- min)"), and turn on a rear vent of the HVAC unit 206 on the left side.

[0065] If, as shown in line 410, the surface on which condensation is detected is “Surface_1” and the condensation level is possibly “2” (indicating condensation), the processor 242 can similarly set the HVAC fan speed to a second speed or “2”, cause the HVAC unit 206 to blow air towards “Surface_1” for a second predefined period (e.g., “Period_2 (t2- min)”), and turn on the rear HVAC vent on the left side.

[0066] If, furthermore, “Surface_1” has a condensation level of “1” as shown in line 412, and at the same time a window on the right side (e.g. a rear right side window or “Surface_2”) has a condensation level of “2”, the processor 242 can set the HVAC fan speed for “Surface_1” to “1” and the HVAC fan speed for “Surface_2” to “2”, cause the HVAC unit 206 to blow air in the direction of both “Surface_1” and “Surface_2” for the second predefined duration, and turn on the rear HVAC vents on both the right and left sides.

[0067] In additional aspects, the processor 242 can be configured to monitor the rate of change of the condensation level on the target vehicle glass surface / left side window 104 (as used in the example described above) over time, based on a correlation between real-time images of the left side window and the second images associated with the left side window 104. For example, the processor 242 can determine, based on the correlation of these images, whether the condensation level is increasing or decreasing over time. The processor 242 can also adjust the operation of the HVAC unit based on the rate of change of the condensation level.As an example, the processor 242 can reduce the speed of the HVAC fan and / or the operating time of the HVAC unit as the condensation level decreases over time, in order to conserve resources / energy required to operate the HVAC unit 206. The processor 242 can also disable the blowing of air toward the target vehicle glass surface by the HVAC unit 206 if the processor 242 determines that the condensation level on the target vehicle glass surface may have reached level “0”.

[0068] In additional aspects of this disclosure, if the processor 242 determines that several vehicle glass surfaces may be subject to condensation, it can activate the HVAC unit 206 for the entire vehicle interior / cabin to remove the condensation from all affected vehicle glass surfaces at once. In this case, the processor 242 can also issue a notification via the infotainment system 238, prompting the user 112 to open a small vent in the vehicle 100 to allow fresh / ambient air into the vehicle interior / cabin and thus remove the condensation from the affected vehicle glass surfaces.The processor 242 can additionally prompt the user 112 to check if a vehicle occupant is possibly smoking and ask the smoking occupant to stop or temporarily leave the vehicle 100 to facilitate the removal of condensation from the affected vehicle glass surfaces.

[0069] Fig. Figure 5 shows a flowchart of an exemplary method 500 for removing condensation from one or more vehicle glass surfaces according to the present disclosure. Fig.Figure 5 can be described with continued reference to the preceding figures. The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described in this document, and these steps may be performed in a sequence that differs from the sequence described in the following exemplary embodiments.

[0070] Procedure 500 begins at step 502. At step 504, procedure 500 may include determining, by processor 242, that the moisture level on the windshield 102 is greater than a predefined threshold, based on the inputs obtained from the first sensor / humidity sensor. At step 506, procedure 500 may include obtaining a target vehicle glass surface image by processor 242 in response to determining that the moisture level is greater than the predefined threshold.

[0071] In step 508, the procedure 500 may involve the processor 242 detecting the presence of condensation on the target vehicle glass surface based on the image. In step 510, the procedure 500 may involve the processor 242 determining the level of condensation on the target vehicle glass surface based on the image in response to the detection of condensation. In step 512, the procedure 500 may involve the processor 242 controlling the operation of the HVAC unit based on the condensation level to remove condensation from the target vehicle glass surface, as described above.

[0072] At step 514, the procedure can end in step 500.

[0073] The preceding disclosure refers to the accompanying drawings, which form part thereof and illustrate specific implementations in which the present disclosure can be practically implemented. It is understood that other implementations may be used and structural modifications made without deviating from the scope of the present disclosure. References in the description to "an embodiment," "an exemplary embodiment," etc., indicate that the described embodiment may include a specific feature, structure, or property, but not every embodiment necessarily includes that specific feature, structure, or property. Furthermore, such formulations do not necessarily refer to the same embodiment.Furthermore, if a feature, structure or property is described in connection with an embodiment, the person skilled in the art will recognize such a feature, structure or property in connection with other embodiments, whether this is expressly described or not.

[0074] Furthermore, the functions described in this document may be performed in one or more hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to execute one or more of the systems and procedures described in this document. Certain terms used throughout the description and in the claims refer to specific system components. It is obvious to those skilled in the art that the components may be designated by other names. This document does not distinguish between components that differ in name but do not differentiate in function.

[0075] It is also understood that the word "example," as used in this document, is not intended to be exclusive or restrictive. In particular, the word "example" in this context indicates one of several examples, and it is understood that no undue emphasis or preference is placed on the specific example described.

[0076] A computer-readable medium (also called a processor-readable medium) includes any non-transient (e.g., physical) medium involved in providing data (e.g., instructions) that can be read by a computer (e.g., by a computer's processor). Such a medium can take many forms, including, without limitation, non-volatile and volatile media. Computing devices can contain computer-executable instructions, the instructions being executable by one or more computing devices, such as those listed above, and being stored on a computer-readable medium.

[0077] With regard to the processes, systems, procedures, heuristics, etc., described in this document, it is understood that although the steps of such processes, etc., have been described as occurring according to a specific, ordered sequence, such processes could be implemented in practice, with the described steps being carried out in a sequence that differs from the sequence described in this document. Furthermore, it is understood that certain steps could be carried out simultaneously, that other steps could be added, or that certain steps described herein could be omitted. In other words, the descriptions of processes in this document serve the purpose of illustrating various embodiments and should in no way be interpreted as limiting the patent claims.

[0078] Accordingly, it is understood that the foregoing description is intended to be illustrative and not limiting. Many other embodiments and applications beyond the examples provided will become apparent from reading the preceding description. The scope should not be determined by reference to the foregoing description, but instead by reference to the attached claims, together with the full scope of equivalents to which these claims entitle. It is anticipated and intended that there will be future developments in the prior art discussed in this document and that the disclosed systems and methods will be incorporated into such future embodiments. Overall, it is understood that the application may be modified and varied.

[0079] All terms used in the patent claims shall have their general meanings as they are known to a person skilled in the art in the field of the technologies described in this document, unless expressly stated otherwise herein. In particular, the use of singular articles such as "a," "an," "the," "a," "a," etc., shall be understood to mean that one or more of the specified elements are named, unless a patent claim expressly limits this to the contrary. Phrases expressing conditional relationships, such as "may," "could," "can," or "could," are generally intended to convey that certain embodiments may include certain features, elements, and / or steps, whereas other embodiments may not include them, unless specifically stated otherwise or the context makes it clear otherwise.Therefore, such formulations, which express conditional relationships, should generally not imply that features, elements and / or steps are required in any way for one or more embodiments.

[0080] In one aspect of the invention, controlling the operation of the HVAC unit involves causing the HVAC unit to blow air towards the target vehicle glass surface.

[0081] In one aspect of the invention, controlling the operation of the HVAC unit further comprises setting at least one HVAC airflow rate in the direction of the target vehicle glass surface or a duration to blow air in the direction of the target vehicle glass surface, based on the level of condensation.

[0082] In one aspect of the invention, the method involves adjusting at least one of the HVAC airflow rates or the duration based on the position of the target vehicle glass surface.

[0083] In one aspect of the invention, the method comprises the following: comparing the image obtained by the camera with a first image, wherein the first image is associated with the target vehicle glass surface without condensation; detecting the presence of condensation on the target vehicle glass surface when the image obtained by the camera differs from the first image; correlating the image obtained by the camera with a plurality of second images in response to the detection of the presence of condensation on the target vehicle glass surface, wherein the plurality of second images are associated with the target vehicle glass surface with different levels of condensation; and determining the level of condensation on the target vehicle glass surface based on the correlation.

[0084] According to the present invention, a non-transient, computer-readable storage medium is provided on which instructions are stored which, when executed by a processor, cause the processor to: determine, based on inputs obtained from a sensor, that a moisture level on a vehicle windshield is greater than a predefined threshold; obtain an image of a target vehicle glass surface from a camera in response to determining that the moisture level is greater than the predefined threshold; detect the presence of condensation on the target vehicle glass surface based on the image; determine a condensation level on the target vehicle glass surface based on the image in response to detecting the presence of condensation;and controlling the operation of a heating, ventilation and air conditioning unit (HVAC unit) based on the level of condensation to remove condensation from the target vehicle glass surface. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited non-patent literature

[0000] Institute of Electrical and Electronics Engineers (IEEE) Standard 802.11, ultra-wideband (

[0029]

Claims

[1] Vehicle, comprising: a windshield; a first sensor configured to detect a moisture level on the windshield; a camera configured to capture an image of a target vehicle's glass surface; a heating, ventilation and air conditioning unit (HVAC unit); and a processor configured to do the following: Determine, based on inputs obtained from the first sensor, that the humidity level is greater than a first predefined threshold; Obtaining the image from the camera in response to determining that the humidity level is greater than the first predefined threshold; Detecting the presence of condensation on the target vehicle's glass surface based on the image; Determining a level of condensation on the target vehicle glass surface based on the image in response to the detection of the presence of condensation; and Controlling the operation of an HVAC unit based on the level of condensation to remove condensation from the target vehicle glass surface. [2] Vehicle according to claim 1, wherein the target vehicle glass surface differs from the windscreen. [3] Vehicle according to claim 1, further comprising a second sensor configured to detect the presence of users or objects configured to cause condensation on a plurality of vehicle glass surfaces, wherein the processor is further configured to: Receiving input from the second sensor; Determining the probability of condensation forming on multiple vehicle glass surfaces out of a multitude of vehicle glass surfaces based on the inputs obtained from the second sensor; and Identifying the target vehicle glass area from the multiple vehicle glass areas based on probability, where the probability associated with the target vehicle glass area is greater than a second predefined threshold. [4] Vehicle according to claim 3, wherein the processor is further configured as follows: Identifying an expected starting point of condensation on the target vehicle glass surface based on at least one of the inputs obtained from the second sensor and historical condensation images associated with the target vehicle glass surface; and Analyzing the image associated with the expected condensation initiation point on the target vehicle glass surface to detect the presence of condensation on the target vehicle glass surface. [5] Vehicle according to claim 1, further comprising a memory configured to store a first image associated with the target vehicle glass surface without condensation and a plurality of second images associated with the target vehicle glass surface with different levels of condensation, wherein the processor is configured as follows: Comparing the image obtained by the camera with the first image; and Detecting the presence of condensation on the target vehicle's glass surface when the image obtained by the camera differs from the first image. [6] Vehicle according to claim 5, wherein the processor is further configured to: Correlating the image obtained by the camera with the multitude of second images in response to the detection of condensation on the target vehicle's glass surface; and Determining the level of condensation on the target vehicle glass surface based on correlation. [7] Vehicle according to claim 6, wherein the processor is further configured to: Monitoring the rate of change in the condensation level on the target vehicle glass surface over time based on correlation; and Adjusting the operation of the HVAC unit based on the rate of change of the condensation level. [8] Vehicle according to claim 1, wherein the processor is configured to control the operation of the HVAC unit based on the level of condensation on the target vehicle glass surface, causing the HVAC unit to blow air towards the target vehicle glass surface. [9] Vehicle according to claim 8, wherein the processor is further configured to set at least one HVAC airflow rate towards the target vehicle glass surface or a duration to blow air towards the target vehicle glass surface, based on the level of condensation. [10] Vehicle according to claim 9, wherein the processor is further configured to set at least one of the HVAC airflow rate or time duration based on a position of the target vehicle glass surface. [11] Vehicle according to claim 1, wherein the processor is further configured to detect the presence of condensation on the target vehicle glass surface based on at least one of the following: a position of the target vehicle glass surface, a type of target vehicle glass surface or an ambient light level. [12] Procedures, including: Determine, by a processor, based on inputs obtained from a first sensor, that a moisture level on a vehicle's windshield is greater than a predefined first threshold; Erlangen, by the processor, of an image of a target vehicle glass surface from a camera in response to determining that the humidity level is greater than the first predefined threshold; The processor detects the presence of condensation on the target vehicle's glass surface based on the image; Determine, by the processor, a level of condensation on the target vehicle glass surface based on the image in response to the detection of the presence of condensation; and Control, by the processor, of the operation of a heating, ventilation and air conditioning unit (HVAC unit) based on the level of condensation, in order to remove condensation from the target vehicle glass surface. [13] Method according to claim 12, wherein the target vehicle glass surface differs from the windscreen. [14] The method of claim 12, further comprising: Receiving input from a second sensor configured to detect the presence of users or objects configured to cause condensation on a variety of vehicle glass surfaces; Determining the probability of condensation forming on each vehicle glass surface from the multitude of vehicle glass surfaces based on the inputs obtained from the second sensor; and Identifying the target vehicle glass surface from the multitude of vehicle glass surfaces based on probability, where the probability associated with the target vehicle glass surface is greater than a second predefined threshold. [15] The method of claim 14, further comprising: Identifying an expected starting point of condensation on the target vehicle glass surface based on at least one of the inputs obtained from the second sensor and historical condensation images associated with the target vehicle glass surface; and Analyzing the image associated with the expected condensation initiation point on the target vehicle glass surface to detect the presence of condensation on the target vehicle glass surface.

Images