Anti-fog system and control methods

By acquiring information about the conversations of vehicle occupants and weather conditions, the operating conditions of the defogging device are adjusted, solving the problem of high-precision control of the defogging device in autonomous driving and driver assistance systems, and improving the system's performance and fuel efficiency.

CN117698643BActive Publication Date: 2026-11-17TOYOTA JIDOSHA KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310996597.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-09-13
Filing Date
2023-08-09
Publication Date
2026-11-17
Estimated Expiration
2043-08-09

AI Technical Summary

Technical Problem

In existing autonomous driving and driver assistance systems, the operation of anti-fog devices is difficult to control with high precision, resulting in unnecessary power consumption and performance degradation. Furthermore, the lack of humidity measurement equipment increases costs and design complexity.

Method used

By acquiring information related to the conversation status of vehicle occupants, the operating conditions of the defogging device are adjusted. The conversation status is detected using an in-vehicle monitoring camera and sound sensors, and combined with weather information, the operation of the defogging device is precisely controlled.

Benefits of technology

It enables high-precision sensing of rising humidity inside the vehicle without a hygrometer, and appropriate control of the anti-fog device, thereby improving the performance and fuel efficiency of autonomous driving and driver assistance systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117698643B_ABST
    Figure CN117698643B_ABST
Patent Text Reader

Abstract

This disclosure relates to an anti-fog system and a control method. The anti-fog system of this disclosure includes: an anti-fog device to prevent fogging of vehicle windows; and a control device to control the anti-fog device. The control device is configured to perform the following processes: activating the anti-fog device when predetermined conditions are met; acquiring information related to the occupants of the vehicle, including at least whether a conversation is in progress; and modifying the predetermined conditions based on the information related to the conversation status.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the control of an anti-fog device for preventing fogging of vehicle windows. Background Technology

[0002] Japanese Patent Application Publication No. 2017-061245 discloses a method for activating a compressor when the elapsed time from the ignition switch being turned on is determined to be more than a predetermined time, thereby enabling the defrost unit to function.

[0003] Fog on the windshields and rear windows of a vehicle reduces the driver's visibility in front of and behind. On the other hand, in autonomous driving and driver assistance systems, the information detected by cameras inside the vehicle through the windshields and rear windows is crucial for understanding the vehicle's surroundings. Therefore, to fully ensure the performance of autonomous driving and driver assistance systems, it is ideal to keep the vehicle's windows fog-free.

[0004] However, anti-fog devices typically consist of heaters and air conditioning units, resulting in high power consumption. Therefore, from a fuel efficiency and environmental performance perspective, it is not ideal to keep the anti-fog device constantly activated. Consequently, in autonomous driving and driver assistance systems, it is required that the anti-fog device activate primarily in situations where fog is likely to form.

[0005] Furthermore, the humidity inside a car greatly affects the formation of fog. Therefore, it can be assumed that fog is more likely to form when the humidity inside the car is high. However, humidity measurement is hardly considered necessary for autonomous driving and driver assistance functions, and from a cost and design perspective, it is not ideal to fully equip the car with high-precision humidity meters based on its interior structure.

[0006] Japanese Patent Application Publication No. 2017-061245 discloses a method for sensing the increase in humidity inside a vehicle by observing the elapsed time from when the ignition switch is turned on. However, depending on the situation of the vehicle's occupants, even if a predetermined time has elapsed since the ignition switch was turned on, the situation may not be conducive to fogging. Consequently, the anti-fog device may activate unnecessarily. Summary of the Invention

[0007] In view of the above problems, one object of this disclosure is to provide a technology that enables an anti-fog device to operate appropriately in situations where fogging is prone to occur, without the presence of a hygrometer.

[0008] The first point of this disclosure relates to an anti-fog system.

[0009] The first-view anti-fog system includes: an anti-fog device to prevent fogging of the vehicle's windows; and a control device to control the anti-fog device, the control device performing the following processes: activating the anti-fog device when specified conditions are met; acquiring information related to the conversation status of the vehicle's occupants, including at least whether a conversation is in progress; and changing the specified conditions based on the information related to the conversation status.

[0010] The second aspect of this disclosure relates to a control method for controlling an anti-fog device that prevents fogging of vehicle windows via a computer.

[0011] The control methods of the second viewpoint include the following: activating the anti-fog device when specified conditions are met; obtaining information related to the conversation status of the vehicle's occupants, including at least whether a conversation is in progress; and changing the specified conditions based on the information related to the conversation status.

[0012] According to this disclosure, the conditions for activating the defogging device are modified based on information related to the session status, including at least whether a session is in progress. Therefore, the defogging device can be made to operate easily or difficultly depending on the session status. Furthermore, it is possible to accurately sense increases in humidity inside the vehicle and to appropriately activate the defogging device in situations prone to fogging. Attached Figure Description

[0013] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, wherein the same reference numerals denote the same elements, wherein:

[0014] Figure 1 This is a block diagram showing the configuration of the anti-fog system in this embodiment.

[0015] Figure 2 This is a block diagram illustrating an example of the configuration of a vehicle to which the anti-fog system of this embodiment is applied.

[0016] Figure 3 This is a block diagram illustrating the configuration of the control device in this embodiment.

[0017] Figure 4 This is a flowchart illustrating the processes performed by the control device in this embodiment.

[0018] Figure 5 This is a diagram illustrating an embodiment of the anti-fog system according to this implementation. Detailed Implementation

[0019] Hereinafter, this embodiment will be described with reference to the accompanying drawings.

[0020] 1. Composition

[0021] Figure 1 This is a block diagram illustrating the configuration of the anti-fog system 10 according to this embodiment. The anti-fog system 10 senses conditions where fog is easily generated on the vehicle's windows and provides an anti-fog function that activates the anti-fog device 400. The anti-fog system 10 includes a control device 100, a sensor group 200, a communication device 300, and the anti-fog device 400. Here, the control device 100 is connected to the sensor group 200, the communication device 300, and the anti-fog device 400 in a manner that allows them to exchange information. For example, the control device 100 is connected to these devices via an in-vehicle network consisting of a CAN (Control Area Network) or similar network.

[0022] Sensor group 200 is equipped in the vehicle to detect the vehicle's driving status and the environment inside and outside the vehicle. Sensor group 200 includes an in-vehicle monitoring camera 210, a sound sensor 220, and a perimeter monitoring camera 230. (See reference...) Figure 2 The in-vehicle surveillance camera 210, the sound sensor 220, and the surrounding surveillance camera 230 are described.

[0023] Figure 2 This is a conceptual diagram illustrating an example of the configuration of a vehicle 1 with an anti-fog system 10 that includes an in-vehicle surveillance camera 210, a sound sensor 220, and a perimeter surveillance camera 230.

[0024] The in-vehicle monitoring camera 210 is a camera that captures images of the interior of vehicle 1. Specifically, the in-vehicle monitoring camera 210 is configured to capture images of the occupant 2 (who may be a single person) of vehicle 1. The detection information output by the in-vehicle monitoring camera 210 can be either the captured image data or information obtained through image recognition of the captured image data. In the latter case, the in-vehicle monitoring camera 210 is configured to output information related to the conversation status of the occupant 2 of vehicle 1. This conversation-related information includes at least information about whether the occupant 2 of vehicle 1 is engaged in a conversation. For example, the in-vehicle monitoring camera 210 uses image recognition to obtain changes in the occupant 2's facial expressions, mouth movements, and mouth opening amount reflected in the captured image data, thereby detecting whether the occupant 2 of vehicle 1 is engaged in a conversation. In addition, examples of conversation-related information output by the in-vehicle monitoring camera 210 include the number of occupants 2 engaged in a conversation and the location of the occupants 2 engaged in a conversation. Figure 2 Example 211 of image data captured by in-vehicle surveillance camera 210 is shown. In this case, in-vehicle surveillance camera 210 outputs, for example, information that two passengers 2 are having a conversation.

[0025] The in-vehicle monitoring camera 210 can be a driver monitor or a dashcam used for recording images inside the vehicle, which are installed for functions such as autonomous driving and driver assistance. However, it can also be a camera installed to form the anti-fog system 10.

[0026] The sound sensor 220 is a sensor that detects sound inside the vehicle 1. The detection information output by the sound sensor 220 is typically the encoded sound data of the detected sound.

[0027] The sound sensor 220 can be a speaker with a microphone or a hands-free system with voice recognition. However, it can also be a microphone provided to form the anti-fog system 10.

[0028] The perimeter surveillance camera 230 is a camera that captures images of the area surrounding the vehicle 1. Typically, the perimeter surveillance camera 230 captures images of the area surrounding the vehicle 1 through the windshield and rear window. Figure 2 The image shows a camera 230 that captures images of the area in front of the vehicle 1 through the windshield 3. The detection information output by the peripheral surveillance camera 230 can be either the captured image data or information obtained through image recognition of the captured image data.

[0029] The surrounding surveillance camera 230 can be a camera originally installed for autonomous driving or driver assistance functions. However, it can also be a camera installed to form the anti-fog system 10.

[0030] Thus, the anti-fog system 10 includes a sensor group 200. The detection information output by the sensor group 200 is transmitted to the control device 100.

[0031] Refer again Figure 1 The communication device 300 is a device that communicates with and sends and receives information from external devices of the vehicle 1. For example, the communication device 300 is connected to the Internet via a mobile communication network and communicates with a server on the Internet. Examples of information received by the communication device 300 include weather information, meteorological information, map information, and road traffic information in the vicinity of the vehicle 1. The information received by the communication device 300 is transmitted to the control device 100.

[0032] The control device 100 performs anti-fog function processing based on the acquired information. In particular, the control device 100 is configured to perform action judgment processing P101 and control processing P102 as anti-fog function processing.

[0033] Action determination processing P101 is the process of determining whether to activate the anti-fog device 400. Specifically, in action determination processing P101, the control device 100 determines to activate the anti-fog device 400 when a predetermined condition is met. Here, the predetermined condition is typically that a specific state value relating to vehicle 1 exceeds a predetermined threshold. The specific state value is generally a value related to the state of fog generated on the glass of vehicle 1. For example, a specific state value is a value obtained by quantifying the degree of fog on the windshield 3 (e.g., 0%–100%). In this case, for example, in action determination processing P101, when the degree of fog on the windshield 3 exceeds 20%, the control device 100 determines that the predetermined condition is met. It should be noted that the degree of fog on the windshield 3 can be obtained, for example, through image recognition of image data acquired from the peripheral monitoring camera 230.

[0034] Other specific state values ​​relating to vehicle 1 include the temperature difference between the inside and outside of vehicle 1, and the elapsed time since the defogging device 400 was stopped. In particular, these specific state values ​​can be values ​​used in conventional defogging systems that perform threshold control on the defogging device, which are the objects of threshold determination. It should be noted that the specified conditions can be given as a combination of multiple state values. For example, the specified conditions could be: the degree of fogging on the windshield 3 exceeds 20% and / or the temperature difference between the inside and outside of vehicle 1 exceeds 5 degrees Celsius. Furthermore, the threshold can also have a hysteresis range.

[0035] Thus, typically, a specific state value for vehicle 1 exceeding a predetermined threshold can be set as a predetermined condition. In the following description, the specific state value for vehicle 1 will be referred to as the "fog state value".

[0036] The control device 100 is also configured to: in the action judgment process P101, acquire information related to the conversation status of the passenger 2 of the vehicle 1, and change the prescribed conditions based on the information related to the conversation status.

[0037] Here, the information related to the conversation status includes at least information about whether the occupant 2 of vehicle 1 is having a conversation. In addition, examples of conversation-related information include the number of occupants 2 having a conversation, the duration of the conversation, and the volume of the conversation. The control device 100 acquires this conversation-related information, for example, through image recognition of video data acquired from the in-vehicle monitoring camera 210 and analysis of audio data acquired from the sound sensor 220. Alternatively, the control device 100 may be configured to acquire conversation-related information as detection information for the sensor group 200. Furthermore, changes to the prescribed conditions typically involve changes to the threshold value of the fogging state. Changing the prescribed conditions may make the anti-fog device 400 easier or harder to operate.

[0038] The inventors of this disclosure have discovered that the increase in humidity inside vehicle 1 is highly dependent on the conversation status of the occupants 2 of vehicle 1. In particular, the humidity inside the vehicle differs significantly when the occupants 2 are engaged in conversation versus when they are not. According to this embodiment, by modifying prescribed conditions based on information related to the conversation status, including at least whether a conversation is in progress, the anti-fog device 400 can be made to operate easily or not easily depending on the conversation status. As a result, the increase in humidity inside the vehicle can be sensed with high precision, and the anti-fog device 400 can be made to operate appropriately for situations where fogging is likely to occur.

[0039] As a preferred example, in the action judgment process P101, the control device 100 changes the prescribed conditions based on information related to the session status, as follows.

[0040] First, the control device 100 estimates the exhalation volume of the passenger 2 in vehicle 1 based on information related to the conversation status. For example, the control device 100 can correct a value obtained by numerically integrating the volume of the conversation with the duration of the conversation using the number of passengers 2 currently having the conversation, and estimate the exhalation volume per unit time (e.g., one minute) based on the value obtained after this correction. In this case, estimating the exhalation volume can also be described as calculating the conversation volume.

[0041] Then, the control device 100 changes the prescribed conditions in such a way that the greater the estimated exhalation volume, the easier it is for the anti-fog device 400 to operate. For example, the greater the estimated exhalation volume, the more the control device 100 reduces the threshold value of the fog state.

[0042] The amount of exhaled air by the passenger 2 in vehicle 1 directly affects the humidity inside the vehicle. Therefore, the greater the amount of exhaled air estimated based on information related to the conversation, the easier it is for the anti-fog device 400 to operate, thereby enabling more accurate sensing of the increase in humidity inside the vehicle and the operation of the anti-fog device 400 at appropriate timing.

[0043] The control device 100 can also be configured to: acquire weather information surrounding the vehicle 1 in the action judgment processing P101, and change the prescribed conditions based on the weather information. For example, when the weather surrounding the vehicle 1 is raining, the control device 100 further reduces the threshold value of the fog state value.

[0044] The control device 100 can obtain weather information about the vicinity of the vehicle 1, for example, through image recognition of image data acquired from the surrounding surveillance camera 230. Alternatively, the control device 100 can also be configured to obtain weather information from the communication device 300.

[0045] The weather conditions surrounding vehicle 1 serve as an indicator of the humidity inside the vehicle when passenger 2 is not engaged in conversation. For example, it is known that the humidity inside the vehicle is higher when it is raining or snowing around vehicle 1 compared to sunny days. Therefore, it is assumed that even if passenger 2 is engaged in conversation, the humidity inside the vehicle will vary slightly depending on the weather conditions around vehicle 1. Thus, by changing the prescribed conditions based on weather information, it is possible to achieve more accurate sensing of the increase in humidity inside the vehicle and to activate the anti-fog device 400 at appropriate timing.

[0046] Control processing P102 generates a control signal for the anti-fog device 400 based on the processing result of action determination processing P101. If action determination processing P101 determines that the anti-fog device 400 should not operate, control device 100 generates a control signal to stop the anti-fog device 400 in control processing P102. Conversely, if action determination processing P101 determines that the anti-fog device 400 should operate, control device 100 generates a control signal to operate the anti-fog device 400 in control processing P102. For example, if the anti-fog device 400 is a heater that heats a heating element such as an electric heating wire, control device 100 generates a control signal indicating the heat output of the heating element in control processing P102. Furthermore, if the anti-fog device 400 is an air conditioning unit, control device 100 generates a control signal in control processing P102 to control the internal / external air of the air conditioning unit.

[0047] Here, the control device 100 can also be configured to generate a control signal in the control process P102 based on the detection information obtained from the sensor group 200 and the processing result of the action judgment process P101. For example, the greater the exhalation volume estimated in the action judgment process P101, the more the control device 100 generates a control signal indicating a greater calorific value.

[0048] The anti-fog device 400 operates according to the control signal output by the control device 100. The anti-fog device 400 can also be called a defroster or defogger. Typically, the anti-fog device 400 targets the front and rear windows of the vehicle 1 and consists of a heater and air conditioning equipment. However, depending on the environment in which the anti-fog system 10 is used, the anti-fog device 400 can adopt a suitable design. The anti-fog device 400 operates according to the control signal, thereby realizing the anti-fog function of the anti-fog system 10.

[0049] As described above, the anti-fog system 10 constitutes this embodiment.

[0050] Next, refer to Figure 3 The configuration of the control device 100 in this embodiment will be described. Figure 3This is a block diagram illustrating a preferred example of the control device 100.

[0051] The control device 100 is a computer equipped with a storage device 110 and a processor 120. The storage device 110 may be composed of recording media such as ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), or SSD (Solid State Disk). The processor 120 may be composed of a CPU (Central Processing Unit), which includes arithmetic units, registers, etc. The control device 100 may be composed of, for example, one or more ECUs (Electronic Control Units).

[0052] The storage device 110 is coupled to the processor 120 and stores multiple instructions 112 that can be executed by the processor 120 and various data 113 required for the execution of the process.

[0053] Multiple instructions 112 are given by computer program 111. Furthermore, the multiple instructions 112 are configured to cause processor 120 to perform anti-fog function processing. That is, processor 120 performs actions according to the multiple instructions 112, thereby realizing the execution of action judgment processing P101 and control processing P102. Data 113 includes information acquired by control device 100, parameter information of computer program 111, etc.

[0054] As described above, the control device 100 of this embodiment can be constituted.

[0055] 2. Processing

[0056] The following describes the processing of the anti-fog function performed by the control device 100.

[0057] Figure 4 This is a flowchart illustrating an example of the processing performed by the control device 100, and more specifically, the processing performed by the processor 120. Figure 4 The process shown in the flowchart begins, for example, when the ignition switch of vehicle 1 is turned on, and is repeated in each predetermined cycle.

[0058] In S100, the control device 100 acquires information related to the conversation status of the passenger 2 in the vehicle 1 and weather information.

[0059] Next, in S200, the control device 100 estimates the exhalation volume of the passenger 2 in the vehicle 1 based on information related to the conversation situation.

[0060] Next, in S300, the control device 100 changes the threshold value of the fog state of the vehicle 1 based on the weather information obtained in S100 or the estimated exhalation volume in S200. In particular, the control device 100 reduces the threshold in such a way that the higher the estimated exhalation volume, the easier it is for the anti-fog device 400 to operate.

[0061] Next, in S400, the control device 100 calculates the fog state value based on the acquired information.

[0062] Next, in S500, the control device 100 determines whether the fog state value calculated in S400 exceeds the threshold.

[0063] If the fog state value exceeds the threshold (S500: Yes), the control device 100 determines that the anti-fog device 400 should be activated and controls the anti-fog device 400 (S600). If the fog state value does not exceed the threshold (S500: No), the control device 100 stops the anti-fog device 400 (S700).

[0064] As explained above, the control device 100 performs the anti-fog function processing. Furthermore, by performing this processing through the control device 100, a control method is implemented to control the anti-fog device 400 via a computer.

[0065] 3. Example

[0066] The following is for reference Figure 5 An embodiment of the anti-fog system 10 of this implementation will be described.

[0067] As an example, Figure 5 The graphs show the time-varying changes of the estimated exhalation volume and the time-varying changes of the fog state value. Specifically, the graphs showing the time-varying changes of the fog state value illustrate the application of the anti-fog system 10 of this embodiment (with threshold change, solid line) and the non-application of the anti-fog system 10 of this embodiment (without threshold change, dashed line). Here, in both graphs, the horizontal axis representing the passage of time is the same. Figure 5 This refers to the situation where the control device 100 causes the threshold value of the fog state to change between a first threshold value and a second threshold value based on the estimated exhalation volume.

[0068] Without the application of the anti-fog system 10 of this embodiment, the anti-fog device 400 does not operate until the fog state value exceeds the first threshold. Therefore, as Figure 5As shown, the defogging device 400's operation lags behind the increase in humidity inside the vehicle, potentially causing an excessive increase in the fogging state value. Consequently, it may be unable to adequately ensure the performance of autonomous driving and driver assistance systems. Furthermore, if the fogging state value threshold is set to a second threshold, the defogging device 400 may unnecessarily activate even when the increase in humidity inside the vehicle is not anticipated, potentially reducing fuel efficiency and environmental performance.

[0069] On the other hand, when the anti-fog system 10 of this embodiment is applied, at time t1, the estimated exhalation volume increases, so the control device 100 lowers the threshold of the fog state value from the first threshold to the second threshold. As a result, the fog state value exceeds the threshold, and the control device 100 starts controlling the anti-fog device 400. Thus, even if the exhalation volume further increases after time t1 and an increase in humidity inside the vehicle is anticipated, the anti-fog device 400 can operate appropriately without increasing the fog state value.

[0070] Then, at time t3, the estimated exhalation volume decreases, so the control device 100 raises the threshold value of the fog state value from the second threshold to the first threshold. As a result, since the fog state value is lower than the threshold, the control device 100 stops the defogging device 400. Thus, after time t3, when the exhalation volume decreases and there is no concern about the increase in vehicle humidity, unnecessary operation of the defogging device 400 can be suppressed.

[0071] Thus, according to this embodiment, the anti-fog device 400 can be appropriately activated in situations prone to fogging, even without a hygrometer. Furthermore, the anti-fog system 10 of this embodiment can also be applied using the configuration of conventional autonomous driving systems and driver assistance systems. It should be noted that in the above embodiment, a case is shown where the threshold value for the fogging state value changes between a first threshold and a second threshold, but other methods can be used to change the threshold. For example, the control device 100 can be configured to change the threshold in more stages based on the exhalation volume, or it can be configured to change the threshold according to a mapping diagram that provides a threshold based on the exhalation volume.

Claims

1. An anti-fog system, comprising: Anti-fog devices, including heaters, prevent fogging of vehicle windows; as well as The control device controls the anti-fog device. The control device is configured to perform the following processes: The anti-fog device is activated when the specified conditions are met. By performing image recognition on the occupants of the vehicle, information related to the conversation status of the occupants, including at least whether a conversation is in progress, is obtained; and The specified conditions are modified based on information related to the session status. The processing of changes to the specified conditions includes: The passenger's expiratory volume is estimated based on information related to the conversation; and The specified conditions are changed in such a way that the greater the exhalation volume, the easier it is for the anti-fog device to operate. The control device is configured such that, when the anti-fog device is activated, the greater the exhalation volume, the more heat generated by the heater.

2. The anti-fog system according to claim 1, wherein, The specified condition is that one or more specific state values ​​of the vehicle exceed a specified threshold. Information related to the session status also includes the number of passengers in a session, the duration of the session, and the volume of the session. The condition for changing the specified condition is to change the threshold.

3. The anti-fog system according to claim 1 or 2, wherein, The control device is also configured to perform the following processes: Obtain weather information about the vicinity of the vehicle; and The specified conditions may be changed based on the weather information.

4. A control method for controlling an anti-fogging device on vehicle windows via a computer, the control method comprising: The anti-fog device is activated when the specified conditions are met. By performing image recognition on the occupants of the vehicle, information related to the conversation status of the occupants of the vehicle, including at least whether a conversation is in progress, is obtained; as well as The specified conditions are modified based on information related to the session status. The processing of changes to the specified conditions includes: The passenger's expiratory volume is estimated based on information related to the conversation; and The specified conditions are changed in such a way that the greater the exhalation volume, the easier it is for the anti-fog device to operate. The control method further includes: when the anti-fog device is activated, the greater the exhalation volume, the greater the heat output of the heater is generated, which is a control signal.

Citation Information

Patent Citations

  • Vehicle air conditioner

    JP2017061245A

  • Auto air conditioner control device for vehicle

    JP2002137630A