System and method for defogging vehicle glass surface

Abstract

The invention provides a system and a method for demisting a vehicle glass surface. A vehicle includes a front windshield, a sensor, a camera, an HVAC unit, and a processor. A sensor is configured to detect a humidity level at the front windshield, and a camera is configured to capture an image of a target vehicle glass surface. The processor is configured to determine that the humidity level is greater than a predefined threshold based on an input obtained from the sensor. The processor also obtains an image from the camera in response to determining that the humidity level is greater than a predefined threshold, and detects the presence of fogging on the target vehicle glass surface based on the image. The processor additionally determines a level of fogging on the target vehicle glass surface based on the image, and controls the HVAC unit to operate to defog the target vehicle glass surface based on the level of fogging.

Description

Technical Field

[0001] This disclosure relates to systems and methods for defogging vehicle glass surfaces based on images captured by vehicle cameras and optimal control of the vehicle's heating, ventilation, and air conditioning (HVAC) unit. Background Technology

[0002] As is well known, fogging occurs on glass surfaces when warm, humid air comes into contact with them at low temperatures. When fog forms on a vehicle's windshield, the vehicle operator or driver can activate the vehicle's defrosting system.

[0003] Many modern vehicles have a mechanism that automatically detects fogging on the windshield and takes mitigation actions to defog it. While this conventional mechanism is effective at defogging the windshield, it is not typically equipped to detect fogging on other glass surfaces of the vehicle, such as side windows, roof windows, rear windshield, interior and exterior mirrors, etc. It is possible that the vehicle operator may want to defog other glass surfaces besides the windshield. Summary of the Invention

[0004] This disclosure describes a vehicle that can be configured to detect the presence of fogging on one or more vehicle glass surfaces (which may be different from the vehicle's windshield) and perform remedial actions to defog the affected vehicle glass surfaces. Examples of such vehicle glass surfaces include, but are not limited to, side windows, rear windshields, side mirrors, built-in displays, etc. Remedial measures may include, for example, causing the vehicle's heating, ventilation, and air conditioning (HVAC) unit to blow air toward the affected vehicle glass surface (rather than toward other vehicle glass surfaces that may not be fogged) to defog the affected surface.

[0005] The vehicle may include a humidity sensor configured to detect the humidity level at the windshield. The vehicle can use input from the humidity sensor to determine whether the humidity level at the windshield is likely to exceed a threshold. In response to determining that the humidity level is likely to exceed the threshold, the vehicle can acquire an image of a target vehicle glass surface (“target vehicle glass surface image”) from a vehicle camera. In some aspects, the target vehicle glass surface may be a vehicle glass surface where the probability of fogging is likely to be high. For example, the target vehicle glass surface may be a vehicle glass surface where a user may be sitting nearby or where there may be hot drinks / wet shoes / cloths, etc., nearby.

[0006] In response to obtaining an image of the target vehicle's glass surface, the vehicle can compare the image with a pre-stored image of the target vehicle's glass surface under fog-free conditions (i.e., when the target vehicle's glass surface is likely clean). Based on this comparison, the vehicle can determine whether fogging exists on the target vehicle's glass surface.

[0007] In response to determining that fogging exists on the surface of a target vehicle's windshield, the vehicle can associate an image of the target vehicle's windshield with training data, which includes multiple pre-stored images of the target vehicle's windshield at different fogging levels. Based on this association, the vehicle can determine the level of fogging at the target vehicle's windshield (e.g., whether the fogging level is high, medium, or low).

[0008] The vehicle can then cause the HVAC unit to blow air toward the target vehicle's glass surface to defog it, based on the determined fogging level. For example, the vehicle can set the HVAC unit fan speed to high, medium, or low based on the fogging level at the target vehicle's glass surface. The vehicle can also control / adjust the duration for which the HVAC unit can blow air toward the target vehicle's glass surface based on the fogging level. The vehicle can further control the HVAC unit operation (e.g., fan speed and / or duration) based on the location and / or type of the target vehicle's glass surface.

[0009] This disclosure discloses a vehicle that efficiently detects fogging on vehicle glass surfaces other than the windshield and performs remedial actions to defog the affected surfaces. The vehicle utilizes existing cameras, sensors, and units to detect fogging and perform remedial actions, and therefore requires no external units / components to perform the operations disclosed in this disclosure. Furthermore, the vehicle causes the HVAC unit to blow air only toward those vehicle glass surfaces affected by fogging, rather than toward other glass surfaces, thereby ensuring optimal utilization of the vehicle resources / energy required to operate the HVAC unit. Additionally, the vehicle controls / adjusts the HVAC unit fan speed and / or operating duration based on the fogging level, so that the HVAC unit does not unnecessarily consume energy for operation.

[0010] These and other advantages of this disclosure are provided in detail herein. Attached Figure Description

[0011] Specific embodiments are illustrated with reference to the accompanying drawings. The same reference numerals may be used to indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the drawings, and some elements and / or components may not be present in various embodiments. Elements and / or components in the drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms can be used interchangeably depending on the context.

[0012] Figure 1 A first interior view of an example vehicle according to this disclosure is depicted.

[0013] Figure 2 A block diagram of a system for defogging one or more vehicle glass surfaces according to the present disclosure is depicted.

[0014] Figure 3 A second interior view of an example vehicle according to this disclosure is depicted.

[0015] Figure 4 A table is depicting example mitigation actions that can be performed to defog one or more vehicle glass surfaces according to this disclosure.

[0016] Figure 5 A flowchart depicts an example method for defogging one or more vehicle glass surfaces according to this disclosure. Detailed Implementation

[0017] The present disclosure will be described more fully below with reference to the accompanying drawings, which illustrate exemplary embodiments of the present disclosure and are not intended to be limiting.

[0018] Figure 1 A first interior view of an example vehicle 100 according to this disclosure is depicted. The first interior view is a view of the interior portion of the vehicle. Vehicle 100 can take the form of any passenger car or commercial vehicle, such as an automobile, work vehicle, crossover, truck, van, minivan, taxi, bus, etc. Vehicle 100 can be a manually driven vehicle or can be configured to operate in a partially / fully autonomous mode. Furthermore, vehicle 100 can include any powertrain system, such as a gasoline engine, one or more electric actuators, a hybrid system, etc.

[0019] Vehicle 100 may include multiple components, including but not limited to a windshield 102, a left-side window 104, a right-side window 106, a left rearview mirror 108, a right rearview mirror 110, a roof window (not shown), one or more built-in displays (not shown), etc. Additionally, the driver / user 112 may be seated in the driver's seating area of ​​the vehicle. Although Figure 1 The illustration depicts a single user 112 sitting in vehicle 100, but this disclosure is not limited to... Figure 1 The illustration shows that, without departing from the scope of this disclosure, multiple users may be seated in parts of the vehicle interior (e.g., in the passenger seating area and / or the rear seating area).

[0020] As is well known, condensation forms on cold surfaces when warm, humid air comes into contact with them. For example, when warm, humid air present in the interior of a vehicle comes into contact with the aforementioned glass surfaces of the vehicle (e.g., left-side window 104, right-side window 106, left rearview mirror 108, right rearview mirror 110, etc.) and the glass surface temperature is low (e.g., during winter), condensation may form on the inner surfaces / parts of said glass surfaces. The air in the interior of the vehicle may be warm and humid for various reasons, such as the presence of the user 112 (or other users present in the interior of the vehicle) breathing, hot drinks, wet clothes, shoes, etc., lack of fresh air circulation, etc. Moisture caused by condensation typically appears as tiny water droplets on the glass surface, resulting in a hazy fog or causing "fogging" on the glass surface. Figure 1 The image shows an example view of a fogging area 114 on the interior left-side window portion / surface (facing the interior of the vehicle).

[0021] In some aspects, vehicle 100 may also include a humidity sensor (which may be...) Figure 2 As part of the vehicle sensing system 232 shown, the humidity sensor may be part of or mounted near the windshield 102. The humidity sensor may be configured to detect the humidity level on the windshield 102. The vehicle 100 may be configured to detect the presence of fogging on the windshield 102 based on input from the humidity sensor (and also input from one or more vehicle temperature sensors), and perform remedial actions to defog (or remove / reduce fogging) the windshield 102. In an exemplary aspect, the remedial action may include causing the vehicle's heating, ventilation, and air conditioning (HVAC) unit (in... Figure 2 The HVAC unit (shown as HVAC unit 206) blows air into the interior portion / surface of the windshield 102, thereby defogging the windshield 102 or removing condensation.

[0022] The aforementioned humidity sensor may not be configured to detect humidity levels on other vehicle glass surfaces (e.g., left side window 104, right side window 106, left rearview mirror 108, right rearview mirror 110, etc.). To ensure that vehicle 100 optimally detects fogging on other vehicle glass surfaces (different from the windshield 102), vehicle 100 can acquire images of one or more vehicle glass surfaces from one or more vehicle cameras (which may be part of a vehicle sensing system). In response to acquiring the images, vehicle 100 can analyze the images and detect the presence of fogging on one or more vehicle glass surfaces based on the image analysis. The process of detecting fogging based on image analysis is briefly described below, and combined with... Figure 2 Describe the process in detail.

[0023] In the following text, the term "vehicle glass surface" refers to the left-side window 104, right-side window 106, left-side mirror 108, right-side mirror 110, roof window (not shown), built-in display, etc., which are different from the windshield 102. In other words, in the following text, the term "vehicle glass surface" does not refer to the windshield 102, but to other vehicle glass surfaces that are different from the windshield 102.

[0024] Vehicle 100 can pre-store (e.g., in vehicle memory, vehicle memory in Figure 2 The image shown is an image (or "first image") of each vehicle glass surface in a "fog-free" state (represented as memory 244). Specifically, the first image may be those images of the vehicle's glass surfaces when the glass surfaces may not be fogged or may be clean. In some aspects, vehicle 100 may pre-store the first image of each vehicle glass surface under different environmental conditions / light intensities (e.g., at night, during the day, at different ambient light intensity levels, etc.).

[0025] Vehicle 100 may also pre-store multiple second images associated with each vehicle glass surface at different fogging levels. Fogging levels may be defined by the vehicle manufacturer or vehicle operator. In an exemplary aspect, fogging level "0" may represent no fogging at the vehicle glass surface (i.e., indicating the vehicle glass surface is clean), fogging level "1" may represent a blurred surface, fogging level "2" may represent a surface with condensation, fogging level "3" may represent a surface with droplet streaks, and so on. The example fogging levels described herein should not be construed as limiting, and fogging levels may be defined in any other way without departing from the scope of this disclosure.

[0026] In some aspects, to detect the presence of fogging on a vehicle glass surface (e.g., the left-side window 104), the vehicle 100 can compare an image of the left-side window 104 captured by a vehicle camera (or a captured "left-side window image") with a first image associated with the left-side window 104 (i.e., an image of the left-side window 104 without fogging). The vehicle 100 can detect the presence of fogging on the left-side window 104 when the captured left-side window image differs from the first image associated with the left-side window 104.

[0027] In response to the detection of fogging on the left-side window 104, the vehicle 100 can correlate a captured image of the left-side window with multiple second images associated with the left-side window 104 to determine the level of fogging on the left-side window 104. Based on the determined level of fogging, the vehicle 100 can then perform one or more remedial actions to defog the left-side window 104. For example, the vehicle 100 can cause the vehicle's HVAC unit to blow air toward the left-side window 104 to defog it. The vehicle 100 can also adjust the airflow rate toward the left-side window 104 (e.g., adjust the fan speed of the HVAC unit) and / or the duration for which the HVAC unit blows air toward the left-side window 104 based on the determined level of fogging.

[0028] In this way, even if the left-side window 104 (or any other vehicle glass surface) does not have an associated humidity sensor, the vehicle 100 can still effectively detect the presence of fogging on the left-side window 104 based on image analysis and optimally defog the left-side window 104. Furthermore, the vehicle 100 ensures that the HVAC unit blows air only toward the fogged vehicle glass surface (i.e., the "affected" vehicle glass surface, such as the left-side window 104) and not toward other vehicle glass surfaces that may not be affected by fogging, thereby ensuring that no unnecessary energy is consumed when operating the HVAC unit. In addition, the vehicle 100 can monitor the fogging level over time on the affected vehicle glass surface and can adjust the HVAC unit operation (e.g., fan speed and / or the duration of HVAC unit operation) based on the "real-time" fogging level, further ensuring that the HVAC unit is not unnecessarily utilized when the fogging level may be decreasing or the fog may have disappeared from the vehicle glass surface (e.g., when the fogging level drops to 0).

[0029] The following text combines Figure 2 Describe 100 details of another vehicle.

[0030] Vehicle 100 shall implement and / or perform the operations described herein in accordance with the owner's manual and safety guidelines. Additionally, any actions taken by the vehicle operator / user based on notifications / recommendations provided by Vehicle 100 shall comply with all rules specific to the location and operation of Vehicle 100 (e.g., federal, state, national, city, etc.). Notifications / recommendations provided by Vehicle 100 shall be considered recommendations and shall be followed only in accordance with any rules specific to the location and operation of Vehicle 100.

[0031] Figure 2 A block diagram of a system 200 for defogging one or more vehicle glass surfaces according to this disclosure is depicted. In the description... Figure 2 At that time, will refer to Figure 3 and Figure 4 .

[0032] System 200 may include vehicles 100 and one or more servers 202 (or servers 202) communicatively coupled to each other via one or more networks 204. Servers 202 may be part of a cloud-based computing infrastructure and may be associated with and / or include a Telematics Service Delivery Network (SDN), which delivers services to vehicles 100 and other vehicles that may be part of a vehicle fleet. Figure 2 (Not shown in the image) provides digital data services.

[0033] In another aspect, server 202 can store a first image and multiple second images associated with multiple vehicle glass surfaces. (As stated above...) Figure 1 The first image associated with a vehicle glass surface, as described, may be an image of a vehicle glass surface without fogging (or fogged at level "0"). The second image may be an image of the vehicle glass surface at different fogging levels (e.g., at fogging levels "1", "2", "3", etc.). Additionally, server 202 may be configured to store historical information associated with fogging at each vehicle glass surface. This historical information may include, for example, typical locations where fogging begins on each vehicle glass surface, historical fogging images associated with each vehicle glass surface, etc. Server 202 may transmit the first image, the second image, and the historical information associated with each vehicle glass surface to vehicle 100 at a predefined frequency or when vehicle 100 transmits a request to server 202 for such information.

[0034] Network 204 illustrates example communication infrastructure in which connected devices discussed in various embodiments of this disclosure may communicate. Network 204 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols such as Transmission Control Protocol / Internet Protocol (TCP / IP). Bluetooth Low Energy (BLE), Wi-Fi based on the IEEE standard 802.11, Ultra Wideband (UWB), and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed ​​Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and 5G are just a few examples.

[0035] Vehicle 100 may include multiple units, including but not limited to HVAC unit 206, vehicle computer 208, vehicle control unit (VCU) 210, and fogging control unit 212 (or unit 212). VCU 210 may include multiple electronic control units (ECUs) 214 that communicate with vehicle computer 208.

[0036] In some respects, according to this disclosure, the vehicle computer 208 and / or unit 212 can be installed anywhere within the vehicle 100. Furthermore, the vehicle computer 208 can operate as a functional part of unit 212. The vehicle computer 208 can be or include an electronic vehicle controller having one or more processors 216 and memory 218. Additionally, unit 212 can be separate from the vehicle computer 208 (e.g., Figure 2 (as shown), or it can be integrated as part of the automotive computer 208.

[0037] Processor 216 can communicate with one or more memory devices (e.g., memory 218 and / or memory) of a corresponding computing system. Figure 2 The processor 216 may communicate with one or more external databases (not shown). The processor 216 may utilize the memory 218 to store programs and / or data in the form of code to execute aspects of this disclosure. The memory 218 may be a non-transitory computer-readable medium or memory storing fogging control program code. The memory 218 may include any or a combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.) and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0038] In some respects, the VCU 210 may share a power bus with the vehicle computer 208 and may be configured and / or programmed to coordinate the systems of vehicle 100, connected servers (e.g., server 202), and other vehicles operating as part of a vehicle fleet. Figure 2 Data between (not shown in the image). VCU 210 may include or communicate with any combination of ECU 214, such as Body Control Module (BCM) 220, Engine Control Module (ECM) 222, Transmission Control Module (TCM) 224, Telematics Control Unit (TCU) 226, Driver Assistance Technology (DAT) Controller 228, etc.

[0039] VCU 210 may also include and / or communicate with a vehicle perception system (VPS) 230, which has connectivity with and / or controls one or more vehicle sensing systems 232. The vehicle sensing system 232 may include one or more vehicle sensors, including but not limited to radio detection and ranging (radar) sensors, seating area latch sensors, seating area sensors, light detection and ranging (LiDAR) sensors, door sensors, proximity sensors, temperature sensors, wheel sensors, ambient weather sensors, ambient light sensors, vehicle interior and exterior cameras, one or more rain sensors, humidity sensors, tire pressure sensors, ultrasonic sensors, etc., configured to detect and locate objects inside and outside the vehicle 100 using radio waves.

[0040] In some aspects, a humidity sensor (or "first sensor") may be configured to detect the humidity level at the windshield 102. Furthermore, a vehicle camera, a seating area latch sensor, a seating area sensor, a temperature sensor, a radar sensor, etc. (collectively, "second sensor") may be configured to detect the presence of a user or object within the vehicle interior that may be configured to cause fogging at multiple vehicle glass surfaces. As described above, in this disclosure, vehicle glass surfaces refer to those glass surfaces of the vehicle 100 that are different from the windshield 102. It is well known that when the vehicle glass surface temperature is low / cold, the breathing of a user sitting near the vehicle glass surface and / or the presence of hot beverages (and / or wet clothes, shoes, etc.) near the vehicle glass surface may cause fogging at the vehicle glass surface. The second sensor may be configured to detect the presence of a user and / or such object near the vehicle glass surface.

[0041] In some respects, VCU 210 can control vehicle operation aspects and implement one or more sets of instructions received from user equipment associated with user 112, one or more sets of instructions stored in memory 218, including instructions that operate as part of unit 212.

[0042] TCU 226 can be configured and / or programmed to provide vehicle connectivity to wireless computing systems on and outside the vehicle 100, and may include a navigation (NAV) receiver 234 for receiving and processing GPS signals, a BLE module (BLEM) 236, a Wi-Fi transceiver, a UWB transceiver, and / or other wireless transceivers that can be configured for wireless communication (including cellular communication) between the vehicle 100 and other systems (e.g., user devices, key fobs, NFC devices, etc.), computers, and modules. Figure 2 (Not shown in the image). NAV receiver 234 can be configured to determine the real-time geographical location of the vehicle. TCU 226 can communicate with ECU 214 via bus.

[0043] ECU 214 can use inputs from the human driver, inputs from the autonomous vehicle controller, unit 212, and / or wireless signal inputs received from other connected devices (such as user devices, server 202, etc.) via a wireless connection to control various aspects of vehicle operation and communication.

[0044] The BCM 220 typically integrates sensors, vehicle performance indicators, and variable reactors associated with vehicle systems. It may also include processor-based power distribution circuitry that controls functions associated with the vehicle body, such as lights, windows, safety devices, cameras, fans, headlights, audio systems, speakers, wipers, door locks and entry controls, mirrors, various comfort controls, and housings. The BCM 220 can also function as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 Interact with (not shown in the image).

[0045] The DAT controller 228 provides Level 1 to Level 3 automated driving and driver assistance functionality, which may include features such as active parking assist, vehicle reversing assist, and adaptive cruise control. The DAT controller 228 also provides various aspects of user and environmental inputs that can be used for user authentication.

[0046] In some aspects, the vehicle computer 208 may be connected to the infotainment system 238 (or the vehicle human-machine interface (HMI) 238). The infotainment system 238 may include a touchscreen interface portion and may include voice recognition features, and the ability to identify a user's biometric features based on facial recognition, voice recognition, fingerprint recognition, or other biometric methods. In other aspects, the infotainment system 238 may also be configured to receive user commands / inputs via the touchscreen interface portion, and / or display notifications / recommendations, navigation maps, etc., on the touchscreen interface portion.

[0047] The computing system architecture of the automotive computer 208, VCU 210, and / or unit 212 may omit certain computing modules. This should be easily understood. Figure 2 The computing environment depicted herein is an example of possible implementations of this disclosure and should therefore not be considered limiting or exclusive.

[0048] Depending on some aspects, unit 212 may be integrated with and / or performed as part of ECU 214. Whether integrated with vehicle computer 208 or ECU 214, or operating as a stand-alone computing system in vehicle 100, unit 212 may include transceiver 240, processor 242, and computer-readable storage 244.

[0049] Transceiver 240 can be configured to receive information / input from one or more external devices or systems (e.g., user devices associated with user 112, server 202, etc.) via network 204. For example, transceiver 240 can receive first images, second images, and historical information associated with each vehicle glass surface from server 202 via network 204. Furthermore, transceiver 240 can transmit notifications (e.g., alarm / alarm signals) to external devices or systems. Additionally, transceiver 240 can be configured to receive information / input from vehicle 100 components (such as infotainment system 238, vehicle sensing system 232, TCU 226, etc.). Furthermore, transceiver 240 can transmit notifications (e.g., alarm / alarm / command signals) to vehicle 100 components (such as infotainment system 238, BCM 220, HVAC unit 206, etc.).

[0050] Processor 242 and memory 244 may be the same as or similar to processor 216 and memory 218, respectively. In some aspects, processor 242 may utilize memory 244 to store programs in code form and / or store data for execution of aspects according to this disclosure. Memory 244 may be a non-transitory computer-readable medium or memory storing fogging control program code. In some aspects, memory 244 may be configured to store first images, second images, and historical information associated with each vehicle glass surface obtained by vehicle 100 from server 202.

[0051] In operation, in one exemplary aspect, processor 242 may obtain input from the aforementioned second sensor and determine the probability of fogging at each of a plurality of vehicle glass surfaces based on the input obtained from the second sensor. As an example, based on the input obtained from the second sensor, processor 242 may determine the probability of fogging at each vehicle glass surface based on whether a user (e.g., user 112 or any other occupant) is sitting near the vehicle glass surface or whether there are any objects near the vehicle glass surface that could cause fogging. In response to determining the probability at each vehicle glass surface, processor 242 may compare the probability with a first predefined threshold (e.g., 50% or 60%).

[0052] Processor 242 can identify one or more "target" vehicle glass surfaces to focus on (or expend processing resources to detect fogging) based on the above comparisons. In some aspects, the target vehicle glass surfaces may have an associated probability greater than a first predefined threshold. As an example, such as Figure 1 As shown, since user 112 is sitting near the left-side window 104, processor 242 can determine that the probability of fogging at the left-side window 104 may be greater than a first predefined threshold. In this case, processor 242 can identify the left-side window 104 as the target vehicle's glass surface.

[0053] In response to identifying a target vehicle glass surface (e.g., the left-side window 104), the processor 242 may obtain input from a first sensor (e.g., a humidity sensor) and check whether the humidity level at the windshield 102 is greater than a second predefined threshold based on the input obtained from the first sensor. In response to determining that the humidity level at the windshield 102 is greater than the second predefined threshold, the processor 242 may begin the process of detecting the presence of fogging at the identified target vehicle glass surface.

[0054] Because processor 242 begins the process of detecting the presence of fogging on the identified target vehicle glass surface rather than on all vehicle glass surfaces, processor 242 saves the resources required to detect the presence of fogging on all vehicle glass surfaces. Those skilled in the art will understand that if processor 242 attempted to detect the presence of fogging on all vehicle glass surfaces, it could consume considerable processor resources. By focusing the detection process on those vehicle glass surfaces with a high probability of fogging (i.e., the target vehicle glass surface), processor 242 is able to save the processing resources required. Furthermore, by focusing the detection process on the target vehicle glass surface, processor 242 is able to save the time required to detect the presence of fog.

[0055] Alternatively, without departing from the scope of this disclosure, processor 242 may skip the step of identifying the target vehicle glass surface and may begin the process of detecting the presence of fogging on all vehicle glass surfaces. In other words, the step of identifying the target vehicle glass surface is not essential for embodiments of this disclosure. The following description is given in the context of processor 242 performing the step of identifying the target vehicle glass surface before beginning the process of detecting the presence of fog; however, such a description should not be construed as limiting.

[0056] In some aspects, processor 242 can begin the process of detecting the presence of fogging on the target vehicle's glass surface by acquiring an image of the target vehicle's glass surface and then analyzing the acquired image, as described below. In other aspects, if processor 242 is already acquiring an image of the target vehicle's glass surface (even before the time when the humidity level at the windshield 102 becomes greater than a second predefined threshold), processor 242 can begin the process of detecting the presence of fogging on the target vehicle's glass surface by increasing the rate (or frequency) of acquiring and analyzing the target vehicle's glass surface images.

[0057] The following describes the process of detecting the presence of fogging on the glass surface of a target vehicle.

[0058] In some respects, in response to identifying a target vehicle glass surface (e.g., the left-side window 104) and determining that the humidity level at the windshield 102 is greater than a second predefined threshold, processor 242 can obtain a left-side window image from a vehicle camera that can be configured to capture a left-side window image. In other words, processor 242 can obtain a left-side window image from a vehicle camera that has the left-side window 104 in its field of view (FOV).

[0059] Then, the processor 242 can compare the obtained left-side window image with a first image associated with the left-side window 104 (i.e., a pre-stored image of the left-side window 104 without fogging) to detect whether fogging exists at the left-side window 104. Specifically, the processor 242 can detect the presence of fogging at the left-side window 104 when the obtained left-side window image may be different from the first image associated with the left-side window 104.

[0060] In some aspects, the first image associated with the left-side window 104 may include multiple images under different environmental conditions / light intensities (e.g., in low light, in bright light, at night, during the day, etc.). Based on the real-time environmental conditions inside the vehicle (determined based on input obtained from the vehicle sensing system 232), the processor 242 may select an appropriate first image and compare it with the acquired left-side window image to detect fogging at the left-side window 104. In this way, the processor 242 may be able to detect the presence of fogging at the left-side window 104 under different environmental conditions or light intensities. In an exemplary aspect, if the vehicle camera includes thermal detection capabilities, the processor 242 may compare images based on image thermal analysis.

[0061] In some respects, the first image associated with different vehicle glass surfaces may also differ based on the location and / or type of the vehicle glass surfaces in vehicle 100 (e.g., whether the glass is tinted or untinted). For example, the first image associated with the rear windshield may differ from the first image associated with the left rearview mirror 108 because the locations and types of these glass surfaces are different. The processor 242 may compare the target vehicle glass surface image with its corresponding first image based on the target vehicle glass surface location and / or type to accurately detect the presence of fogging.

[0062] In another aspect, to enhance or accelerate the process of detecting the presence of fogging on the surface of a target vehicle's glass (e.g., the left-side window 104), the processor 242 may first identify the expected or typical fogging start location at the left-side window 104 based on historical information / fogging images associated with the left-side window 104 and / or input obtained from a second sensor (fogging typically begins at said start location on the left-side window 104). In response to identifying the expected fogging start location, the processor 242 may begin analyzing the portion of the left-side window image corresponding to the expected fogging start location or comparing it with the corresponding portion in the first image to quickly detect the presence of fogging at the left-side window 104. Since the typical or expected fogging start location may be a small portion within the left-side window 104 where the probability of fogging initiation is likely high, the processor 242 is able to quickly detect the presence of fogging at the left-side window 104 using minimal processing resources by focusing on this "small portion" of the glass surface in the left-side window image.

[0063] In response to comparing the obtained left-side window image with the first image and determining that the obtained left-side window image is different from the first image, the processor 242 can determine the presence of fogging on the left-side window 104 (e.g., Figure 1 (As shown). In response to the detection of fogging on the left window 104, the processor 242 can determine the level of fogging at the left window 104 based on the acquired left window image.

[0064] In some aspects, processor 242 may be an artificial intelligence (AI) based processor, which may be configured to use training data stored in memory 244 (which may include a first image and a second image associated with each vehicle glass surface) to compare and correlate the acquired left-side window image with the associated second image to determine a “match” between the acquired left-side window image and a second image associated with left-side window 104. Specifically, in response to detecting the presence of fogging on left-side window 104, processor 242 may correlate the acquired left-side window image with the second image associated with left-side window 104 to determine a second image that substantially matches the acquired left-side window image. Since the second image is associated with different levels of fogging (as described above), Figure 1 Therefore, processor 242 can determine the fogging level at left window 104 based on the aforementioned association (i.e., based on the second image "matched" with the obtained left window image). For example, when the obtained left window image matches the second image associated with fogging level "1", processor 242 can determine that the fogging level at left window 104 may be "1", when the obtained left window image matches the second image associated with fogging level "2", the fogging level at left window 104 may be "2", and so on.

[0065] In response to determining the fogging level at the left-side window 104, the processor 242 can control the HVAC unit operation based on the fogging level to defog the left-side window 104. Specifically, in this case, the processor 242 can control the HVAC unit vents so that the HVAC unit 206 blows air toward the left-side window 104, which can defog the left-side window 104 (e.g., ...). Figure 3 (As indicated by arrow 302 in the image).

[0066] In some respects, the processor 242 can cause the HVAC unit 206 to blow air only toward those vehicle glass surfaces that may fog up, rather than toward all vehicle glass surfaces, thereby saving the energy required to operate the HVAC unit 206. For example, as Figure 3 As shown, since fogging only exists on the left window 104 and not on the right window 106, the processor 242 can cause the HVAC unit 206 to blow air only toward the left window 104 (as indicated by arrow 302) and not toward the right window 106 (as indicated by cross mark 304).

[0067] The processor 242 can also be configured to control / adjust the HVAC airflow rate (e.g., fan speed) toward the target vehicle glass surface and / or the duration for which the HVAC unit 206 can blow air toward the target vehicle glass surface based on a determined fogging level and / or the location of the target vehicle glass surface in vehicle 100. The HVAC airflow rate and / or duration can also be adjusted / controlled based on the type of the target vehicle glass surface (e.g., whether the glass is tinted or untinted).

[0068] Figure 4 Example Table 400 is shown, illustrating one or more mitigation actions that can be executed by processor 242 to defog one or more vehicle glass surfaces. In Table 400, column 402 depicts vehicle glass surfaces where processor 242 may have detected the presence of fogging, column 404 depicts the level of fogging at the vehicle glass surface, and column 406 depicts anti-fogging actions (HVAC) performed by processor 242 (e.g., controlling HVAC unit fan speed 406a, HVAC unit runtime 406b, and activating or controlling HVAC vents 406c).

[0069] As shown in line 408, when a fogging surface is detected in the second row of the vehicle and on the left side (e.g., the left rear window or “Surface_1”) and the fogging level can be “1” (indicating a fogged surface), the processor 242 can set the HVAC fan speed to a first speed or “1”, causing the HVAC unit 206 to blow air toward “Surface_1” for a first predefined duration (e.g., “Time Period_1 (t1-min)”) and activate the left rear vent of the HVAC unit 206.

[0070] Similarly, as shown in line 410, when the fogging surface is detected as “Surface_1” and the fogging level can be “2” (indicating condensation), the processor 242 can set the HVAC fan speed to a second speed or “2”, causing the HVAC unit 206 to blow air toward “Surface_1” for a second predefined duration (e.g., “Time Period_2 (t2-min)”) and activate the left rear HVAC vent.

[0071] Furthermore, as shown in line 412, when the fogging level of “Surface_1” is “1” and the fogging level of the right-side window (e.g., the right rear window or “Surface_2”) is “2”, the processor 242 can set the HVAC fan speed to “1” for “Surface_1” and set the HVAC fan speed to “2” for “Surface_2”, causing the HVAC unit 206 to blow air toward both “Surface_1” and “Surface_2” for a second predefined duration, and activating both the right rear and left rear HVAC vents.

[0072] In an additional aspect, processor 242 can be configured to monitor the rate of change of fogging level over time on the target vehicle glass surface / left window 104 (as used in the example above) based on the correlation between a real-time image of the left window and a second image associated with the left window 104. For example, based on the correlation of these images, processor 242 can determine whether the fogging level is increasing or decreasing over time. Processor 242 can also adjust HVAC unit operation based on the rate of change of fogging level. As an example, if the fogging level is decreasing over time, processor 242 can reduce the HVAC fan speed and / or the duration of HVAC unit operation to save resources / energy required to operate HVAC unit 206. When processor 242 determines that the fogging level at the target vehicle glass surface may have become equal to level "0", processor 242 can also disable HVAC unit 206 from blowing air toward the target vehicle glass surface.

[0073] In an additional aspect of this disclosure, if the processor 242 determines that multiple vehicle glass surfaces may be experiencing fogging, the processor 242 may activate the HVAC unit 206 for the entire vehicle interior / cabin to defog all affected vehicle glass surfaces at once. In this case, the processor 242 may additionally output a notification via the infotainment system 238 requesting the user 112 to open small vents in the vehicle 100 to allow fresh / ambient air into the vehicle interior / cabin, and thus defog the affected vehicle glass surfaces. The processor 242 may additionally request the user 112 to check if any vehicle occupant may be smoking and request the smoking occupant to stop or temporarily remove themselves from the vehicle 100 to facilitate defogging of the affected vehicle glass surfaces.

[0074] Figure 5 A flowchart depicts an example method 500 for defogging one or more vehicle glass surfaces according to this disclosure. Further description can be made with reference to the preceding figures. Figure 5 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include these steps in a different order than that described in the following example embodiments.

[0075] Method 500 begins at step 502. At step 504, method 500 may include processor 242 determining, based on input obtained from the first sensor / humidity sensor, that the humidity level at the windshield 102 is greater than a predefined threshold. At step 506, method 500 may include processor 242 obtaining an image of the target vehicle glass surface in response to determining that the humidity level is greater than the predefined threshold.

[0076] At step 508, method 500 may include the processor 242 detecting the presence of fogging on the target vehicle glass surface based on an image. At step 510, method 500 may include the processor 242 determining the fogging level on the target vehicle glass surface based on an image in response to detecting the presence of fogging. At step 512, method 500 may include the processor 242 controlling HVAC unit operation to defog the target vehicle glass surface based on the fogging level, as described above.

[0077] At step 514, method 500 can end.

[0078] In the foregoing disclosure, reference has been made to the accompanying drawings, which form a part of the foregoing disclosure, illustrating specific implementations in which the present disclosure may be practiced. It should be understood that other embodiments and structural changes may be utilized without departing from the scope of the present disclosure. References to “an embodiment,” “embodiment,” “example embodiment,” etc., in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include said specific features, structures, or characteristics. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when features, structures, or characteristics are described in connection with embodiments, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments, whether explicitly described or not.

[0079] Furthermore, where appropriate, the functions described herein may be performed by one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application-specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As those skilled in the art will appreciate, components may be referred to by different names. This document is not intended to distinguish between components with different names but identical functions.

[0080] It should also be understood that the term "example" as used herein is intended to be non-exclusive and non-restrictive in nature. More specifically, the term "example" as used herein refers to one of several examples, and it should be understood that there is no undue emphasis or preference on the particular example described.

[0081] Computer-readable media (also known as processor-readable media) include any non-transitory (e.g., tangible) medium that contributes to providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. Computing devices may include computer-executable instructions, which can be executed by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0082] Regarding the processes, systems, methods, heuristics, etc., described herein, it should be understood that although the steps of such processes, etc., are described as occurring in a certain ordered order, such processes can be practiced by performing the described steps in a different order than that described herein. It should also be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of processes herein is provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0083] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Many embodiments and applications beyond the examples provided will become apparent upon reading the above description. The scope should not be determined by reference to the above description, but rather by reference to the appended claims and the full scope of their equivalents. It is anticipated and expected that the techniques discussed herein will evolve in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In conclusion, it should be understood that modifications and changes are possible with this application.

[0084] Unless explicitly indicated otherwise herein, all terms used in the claims are intended to be given their ordinary meaning as understood by one skilled in the art as described herein. Specifically, unless the claims explicitly limit the recitation to the contrary, the use of singular articles such as “a,” “the,” or “the” should be interpreted as one or more of the elements indicated by the recitation. Unless otherwise specifically stated or otherwise understood in the context of use, conditional language such as, in particular, “can,” “may,” “may,” or “may” is generally intended to express that some embodiments may include certain features, elements, and / or steps, while other embodiments may not include certain features, elements, and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element, and / or step in any way.

[0085] In one aspect of the invention, controlling the operation of the HVAC unit includes causing the HVAC unit to blow air toward the glass surface of a target vehicle.

[0086] In one aspect of the invention, controlling the operation of the HVAC unit further includes adjusting at least one of the HVAC airflow rate toward the target vehicle glass surface or the duration of blowing air toward the target vehicle glass surface based on the fogging level.

[0087] In one aspect of the invention, the method includes adjusting at least one of the HVAC airflow rate or the duration based on the position of the target vehicle glass surface.

[0088] In one aspect of the invention, the method includes: comparing an image obtained from a camera with a first image, wherein the first image is associated with a target vehicle glass surface that is not fogged; detecting the presence of fog on the target vehicle glass surface when the image obtained from the camera differs from the first image; in response to detecting the presence of fog on the target vehicle glass surface, associating the image obtained from the camera with a plurality of second images, wherein the plurality of second images are associated with target vehicle glass surfaces having different levels of fogging; and determining a level of fogging on the target vehicle glass surface based on the association.

[0089] According to the present invention, a non-transitory computer-readable storage medium is provided, wherein instructions are stored on the non-transitory computer-readable storage medium, which, when executed by a processor, cause the processor to: determine, based on input obtained from a sensor, that the humidity level at the windshield of a vehicle is greater than a predefined threshold; in response to determining that the humidity level is greater than the predefined threshold, acquire an image of the target vehicle glass surface from a camera; detect the presence of fogging on the target vehicle glass surface based on the image; determine the fogging level on the target vehicle glass surface based on the image in response to detecting the presence of fogging; and control the operation of a heating, ventilation, and air conditioning (HVAC) unit to defog the target vehicle glass surface based on the fogging level.

Claims

1. A vehicle comprising: Windshield; A first sensor, configured to detect the humidity level at the windshield; A camera configured to capture images of the glass surface of a target vehicle; Heating, ventilation and air conditioning (HVAC) unit; as well as Processor, the processor being configured to: The humidity level is determined to be greater than a first predefined threshold based on the input obtained from the first sensor. The image is acquired from the camera in response to determining that the humidity level is greater than the first predefined threshold; The presence of fogging on the glass surface of the target vehicle is detected based on the image. In response to the detection of the presence of fogging, the level of fogging on the glass surface of the target vehicle is determined based on the image; and The operation of the HVAC unit is controlled based on the fogging level to defog the glass surface of the target vehicle.

2. The vehicle as claimed in claim 1, wherein the target vehicle glass surface is different from the windshield.

3. The vehicle of claim 1, further comprising a second sensor configured to detect the presence of a user or object configured to cause fogging at a plurality of vehicle glass surfaces, wherein the processor is further configured to: Input is obtained from the second sensor; The probability of fogging at multiple vehicle glass surfaces among the plurality of vehicle glass surfaces is determined based on the input obtained from the second sensor; and The target vehicle glass surface is identified from the plurality of vehicle glass surfaces based on the probability, wherein the probability associated with the target vehicle glass surface is greater than a second predefined threshold.

4. The vehicle of claim 3, wherein the processor is further configured to: The expected fogging start location at the target vehicle's glass surface is identified based on at least one of the input obtained from the second sensor and historical fogging images associated with the target vehicle's glass surface; and The image associated with the expected fogging start location on the target vehicle's glass surface is analyzed to detect the presence of fogging on the target vehicle's glass surface.

5. The vehicle of claim 1, further comprising a memory configured to store a first image associated with a target vehicle glass surface that is not fogged and a plurality of second images associated with target vehicle glass surfaces having different levels of fogging, wherein the processor is configured to: The image obtained from the camera is compared with the first image; and When the image obtained from the camera is different from the first image, the presence of fogging on the glass surface of the target vehicle is detected.

6. The vehicle of claim 5, wherein the processor is further configured to: In response to the detection of fogging on the target vehicle's glass surface, the image obtained from the camera is associated with the plurality of second images; and The level of fogging on the glass surface of the target vehicle is determined based on the correlation.

7. The vehicle of claim 6, wherein the processor is further configured to: The rate of change of the fogging level on the target vehicle's glass surface over time is determined based on the correlation; and The operation of the HVAC unit is adjusted based on the rate of change of the fogging level.

8. The vehicle of claim 1, wherein, in order to control the operation of the HVAC unit based on the level of fogging at the target vehicle glass surface, the processor is configured to cause the HVAC unit to blow air toward the target vehicle glass surface.

9. The vehicle of claim 8, wherein the processor is further configured to adjust at least one of the HVAC airflow rate toward the target vehicle glass surface or the duration of airflow toward the target vehicle glass surface based on the fogging level.

10. The vehicle of claim 9, wherein the processor is further configured to adjust at least one of the HVAC airflow rate or the duration based on the position of the target vehicle glass surface.

11. The vehicle of claim 1, wherein the processor is further configured to detect the presence of fogging on the target vehicle glass surface based on at least one of the following: the location of the target vehicle glass surface, the type of the target vehicle glass surface, or the ambient light level.

12. A method, the method comprising: The processor determines, based on input obtained from the first sensor, that the humidity level at the vehicle's windshield is greater than a first predefined threshold. The processor acquires an image of the target vehicle's glass surface from the camera in response to determining that the humidity level is greater than the first predefined threshold. The processor detects the presence of fogging on the glass surface of the target vehicle based on the image; The processor determines the level of fogging on the target vehicle's glass surface based on the image in response to the detection of the presence of fogging; as well as The processor controls the operation of the heating, ventilation, and air conditioning (HVAC) unit to defog the glass surface of the target vehicle based on the fogging level.

13. The method of claim 12, wherein the target vehicle glass surface is different from the windshield.

14. The method of claim 12, further comprising: Input is obtained from a second sensor configured to detect the presence of a user or object configured to cause fogging on multiple vehicle glass surfaces; The probability of fogging at each of the plurality of vehicle glass surfaces is determined based on the input obtained from the second sensor. as well as The target vehicle glass surface is identified from the plurality of vehicle glass surfaces based on the probability, wherein the probability associated with the target vehicle glass surface is greater than a second predefined threshold.

15. The method of claim 14, further comprising: The expected fogging start location at the target vehicle glass surface is identified based on at least one of the input obtained from the second sensor and a historical fogging image associated with the target vehicle glass surface. as well as The image associated with the expected fogging start location on the target vehicle's glass surface is analyzed to detect the presence of fogging on the target vehicle's glass surface.

Images