Vehicle window defog method and device, electronic device and storage medium

Abstract

The present disclosure relates to a vehicle window defogger method and device, electronic device and storage medium, the method comprising: obtaining a vehicle interior temperature value near the vehicle window position and a vehicle interior humidity value far from the vehicle window position; determining a first saturated humidity value corresponding to the vehicle interior temperature value; determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body taken through the vehicle window when the vehicle interior humidity value is less than the first saturated humidity value and greater than a fogging suspicion threshold, the fogging suspicion threshold being the difference between the first saturated humidity value and a preset fogging suspicion offset; sending a start command to a vehicle interior defogger when it is determined that the vehicle window is fogged. The embodiment of the present disclosure can send a start command to a vehicle interior defogger when it is determined that the vehicle window is fogged, so as to timely perform vehicle window defoggering and improve driving safety.

Description

Background Art

[0002] Vehicles are one of the most important means of transportation in modern human life, and they have brought great convenience to people's daily life and work. Generally speaking, there is a certain temperature difference between the inside and outside of a vehicle. For example, in order to improve the comfort of passengers, modern vehicles are often equipped with air conditioning systems, which will cause a temperature difference between the inside and outside of the vehicle. When there is a temperature difference between the inside and outside of the vehicle, especially when the temperature and humidity inside the vehicle are high, water vapor will condense and fog up on the surface of the car window.

[0003] The fogging of car windows will hinder the driver's vision, easily leading to visual blind spots and causing car accidents, resulting in casualties and property losses. Especially in the rainy season and winter, car accidents are more frequent, and a large part of them are caused by fogging of car windows. Therefore, timely and effective defogging of car windows is the key to improving driving safety.

[0004] In the related art, when defogging the windows of a car, the driver usually does it manually. Although there are some automatic defogging technical solutions, the current automatic defogging technical solutions have low accuracy, and there is a situation where the windows are already fogged but not defogged in time. Summary of the invention

[0005] The present disclosure proposes a vehicle window defogger technology solution.

[0006] According to one aspect of the present disclosure, a vehicle window defog method is provided, comprising:

[0007] Get the temperature value of the car near the window and the humidity value of the car far from the window;

[0008] Determine a first saturated humidity value corresponding to the vehicle interior temperature value;

[0009] When the humidity value in the vehicle is less than a first saturated humidity value and greater than a fogging suspicion threshold, determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window, wherein the fogging suspicion threshold is a difference between the first saturated humidity value and a preset fogging suspicion offset;

[0010] When it is determined that the vehicle windows are fogged, a start command is sent to the defogger device in the vehicle.

[0011] In a possible implementation, determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window includes:

[0012] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0013] Determining a similarity between the current image and a standard image, wherein the standard image is an image of the reference object taken through a non-fogged vehicle window;

[0014] When the similarity is less than the similarity threshold, it is determined that the vehicle window is fogged.

[0015] In a possible implementation, the reference object includes an external reference object fixed on an external body of the vehicle, and acquiring a current image of the reference object fixed on the vehicle body photographed through a vehicle window includes:

[0016] Acquire a current image of a reference object outside the vehicle captured by an image acquisition device inside the vehicle;

[0017] The determining the similarity between the current image and the standard image comprises:

[0018] Determine the similarity between the target area in the current image and the target area in the standard image, wherein the target area is the area where the external reference object is located.

[0019] In a possible implementation manner, after determining the similarity between the current image and the standard image, the method 5 further includes:

[0020] In the case where the similarity is less than a similarity threshold, instructing a windshield wiper of the vehicle to perform a sweeping action on the vehicle window;

[0021] Within a predetermined time period after performing the sweeping action, obtaining a latest image of a reference object fixed to the vehicle body photographed through the vehicle window;

[0022] Determining the similarity between the latest image and the standard image;

[0023] 0 When the similarity between the latest image and the standard image is less than a similarity threshold, it is determined that the vehicle window is fogged.

[0024] In a possible implementation, determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window includes:

[0025] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0026] Identifying the reference object in the current image by a target recognition algorithm;

[0027] 5 In case of recognition failure, it is determined that the vehicle windows are fogged.

[0028] In a possible implementation manner, after determining the first saturated humidity value corresponding to the in-vehicle temperature value, the method further includes:

[0029] When the humidity value in the vehicle is greater than or equal to the first saturated humidity value, a start instruction is sent to the defogger device in the vehicle.

[0030] In a possible implementation, the method further includes:

[0031] When the defogger is turned on, obtain the outside temperature value of the vehicle;

[0032] Determine a second saturated humidity value corresponding to the vehicle exterior temperature value;

[0033] When the second saturated humidity value is greater than the fogging suspicion threshold, the defogger is kept running; when the second saturated temperature value is not greater than the fogging suspicion threshold, a closing command is sent to the defogger in the vehicle.

[0034] According to one aspect of the present disclosure, a vehicle window defogger device is provided, comprising:

[0035] A first acquisition unit is used to acquire a temperature value in the vehicle near the vehicle window and a humidity value in the vehicle far from the vehicle window; a first determination unit is used to determine a first saturated humidity value corresponding to the temperature value in the vehicle;

[0036] a fogging determination unit, configured to determine whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window when the humidity value in the vehicle is less than a first saturated humidity value and greater than a fogging suspicion threshold value 0;

[0037] The fogging suspicion threshold is the difference between the first saturated humidity value and a preset fogging suspicion offset;

[0038] The first instruction sending unit is used to send a start instruction to the defogger device in the vehicle when it is determined that the vehicle window is fogged.

[0039] In a possible implementation manner, the fogging determination unit is used to:

[0040] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0041] 5. Determine the similarity between the current image and a standard image, wherein the standard image is an image of the reference object taken through a non-fogged vehicle window;

[0042] When the similarity is less than the similarity threshold, it is determined that the vehicle window is fogged.

[0043] In a possible implementation, the reference object includes an external reference object fixed on the external body of the vehicle.

[0044] The fogging determination unit is used to obtain a current image of a reference object outside the vehicle taken by an image acquisition device inside the vehicle;

[0045] The fogging determination unit is used to determine the similarity between the target area in the current image and the target area in the standard image, and the target area is the area where the external reference object is located.

[0046] In a possible implementation manner, after determining the similarity between the current image and the standard image, the apparatus further includes:

[0047] The sweeping indication unit is used to indicate that the vehicle wiper sweeps the vehicle when the similarity is less than the similarity threshold.

[0048] The window performs a sweeping action;

[0049] 0 latest image acquisition unit, used to acquire the fixed image photographed through the vehicle window within a predetermined time after performing the sweeping action.

[0050] The latest images of the reference objects set on the vehicle body;

[0051] a similarity determination unit, configured to determine the similarity between the latest image and a standard image;

[0052] The vehicle window fogging determination unit is used to determine that the vehicle window is fogged when the similarity between the latest image and the standard image is less than a similarity threshold.

[0053] In a possible implementation, the fogging determination unit is used to:

[0054] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0055] Identifying the reference object in the current image by a target recognition algorithm;

[0056] In case of a recognition failure, it is determined that the vehicle windows are fogged.

[0057] In a possible implementation, the device further includes: a second instruction sending unit configured to send a command to the vehicle when the humidity value in the vehicle is greater than or equal to the first saturated humidity value.

[0058] The interior defogger sends a start command.

[0059] In a possible implementation, the method further includes:

[0060] A second acquisition unit is used to acquire the vehicle outside temperature value when the defogger is turned on;

[0061] A second determining unit, configured to determine a second saturated humidity value corresponding to the vehicle exterior temperature value;

[0062] 5. A maintaining unit, configured to maintain the defogging when the second saturated humidity value is greater than the fogging suspicion threshold value.

[0063] The device continues to operate;

[0064] The third instruction sending unit is used to send a closing instruction to the in-vehicle defogger device when the second saturation temperature value is not greater than the fogging suspicion threshold.

[0065] According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above

[0066] method.

[0067] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor.

[0068] In the embodiment of the present disclosure, the vehicle interior temperature value near the vehicle window position and the vehicle interior humidity value far from the vehicle window position are obtained; then the first saturated humidity value corresponding to the vehicle interior temperature value is determined; when the vehicle interior humidity value is less than the first saturated humidity value, the vehicle interior humidity value is determined.

[0069] When the temperature and humidity are greater than the fogging suspicion threshold, it indicates that it is impossible to determine whether the window is fogged based on the temperature and humidity. At this time, it is possible to determine whether the window is fogged based on the current image of the reference object fixed on the vehicle body taken through the window, which can determine whether the window is fogged more timely and accurately. Then, if it is determined that the window is fogged, a start command is sent to the defogger device in the vehicle so that the window can be defogged in time to improve driving safety.

[0070] The fogging suspicion threshold is the difference between the first saturated humidity value and the preset fogging suspicion offset, so that the fogging suspicion thresholds at different temperatures are different, which improves the accuracy of determining whether there is a fogging suspicion situation, and can accurately and timely start the subsequent process of determining whether the window is fogged based on the image, so as to timely detect the fogging of the window and defog the window in time. In addition, this implementation does not need to store a fogging suspicion threshold for each temperature, but only stores a fogging suspicion offset, and obtains the fogging suspicion threshold by calculation, saving storage space.

[0071] It should be understood that the above general description and the following detailed description are exemplary and explanatory only and do not limit the present disclosure. Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0073] Figure 1 A flow chart showing a vehicle window defog method according to an embodiment of the present disclosure.

[0074] Figure 2 A hardware framework diagram of a vehicle window defogger device provided in an embodiment of the present disclosure is shown.

[0075] Figure 3 A flow chart showing yet another vehicle window defog method according to an embodiment of the present disclosure.

[0076] Figure 4 A schematic diagram showing the location of a target area according to an embodiment of the present disclosure.

[0077] Figure 5 A block diagram of a vehicle window defogger device according to an embodiment of the present disclosure is shown.

[0078] Figure 6 A block diagram of an electronic device according to an embodiment of the present disclosure is shown.

[0079] Figure 7 A block diagram of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0080] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0081] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0082] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0083] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0084] As described in the background art, in the related art, automobile glass defogger is mostly manual defogger, and the driver defogs the glass passively and after observing the glass fogging. Moreover, some current automatic defogger technical solutions are also mostly post-defogging, which cannot accurately and timely defog the car windows.

[0085] In the disclosed embodiment, the vehicle interior temperature value near the vehicle window position and the vehicle interior humidity value far from the vehicle window position are obtained; then the first saturated humidity value corresponding to the vehicle interior temperature value is determined; when the vehicle interior humidity value is less than the first saturated humidity value and greater than the fogging suspicion threshold, it indicates that it is impossible to determine whether the vehicle window is fogged by temperature and humidity. At this time, it is possible to determine whether the vehicle window is fogged based on the current image of the reference object fixed on the vehicle body taken through the vehicle window, so as to determine whether the vehicle window is fogged more timely and accurately. Then, when it is determined that the vehicle window is fogged, a start command is sent to the vehicle interior defogger so as to defog the vehicle window in time and improve driving safety.

[0086] The fogging suspicion threshold is the difference between the first saturated humidity value and the preset fogging suspicion offset, so that the fogging suspicion thresholds at different temperatures are different, which improves the accuracy of determining whether there is a fogging suspicion situation, and can accurately and timely start the subsequent process of determining whether the window is fogged based on the image, so as to timely detect the fogging of the window and defog the window in time. In addition, this implementation does not need to store a fogging suspicion threshold for each temperature, but only stores a fogging suspicion offset, and obtains the fogging suspicion threshold by calculation, saving storage space.

[0087] In addition, when the humidity value inside the vehicle is greater than or equal to the first saturated humidity value, it can be considered that the conditions for fogging of the vehicle windows exist. Even if the vehicle windows are not fogged at this time, a start command is sent to the defogger device inside the vehicle to prevent fogging in time before the vehicle windows fog up.

[0088] The execution subject of the method may be a window defogger automatic control device installed on a vehicle. In one possible implementation, the method may be executed by a terminal device or a server or other processing device. Among them, the terminal device may be a vehicle-mounted device, a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device or a wearable device, etc. Among them, the vehicle-mounted device may be a vehicle computer or a domain controller in the cabin, or may be a device host for executing the window defogger method in an ADAS (Advanced Driving Assistance System), an OMS (Occupant Monitoring System) or a DMS (Driver Monitoring System). In some possible implementations, the window defogger method may be implemented by a processor calling a computer-readable instruction stored in a memory.

[0089] The vehicle window defogger technology solution provided by the present invention is described in detail below through specific embodiments.

[0090] Figure 1 A flow chart of a vehicle window defog method according to an embodiment of the present disclosure is shown as follows: Figure 1 As shown, the vehicle window defog method comprises:

[0091] In step S11, the temperature value inside the vehicle near the vehicle window and the humidity value inside the vehicle far from the vehicle window are obtained.

[0092] Since the higher the temperature, the greater the saturated humidity, when the temperature of the window glass is lower than the temperature inside the vehicle, the saturated humidity near the window is lower, so the water vapor inside the vehicle far from the window may condense on the window to form fog. Then, the temperature value inside the vehicle near the window and the humidity value inside the vehicle far from the window can be detected to facilitate subsequent judgment of window fogging.

[0093] The position close to the vehicle window may be a position whose distance from the vehicle window is less than a first distance, and the first distance may be, for example, 0-5 cm; the position far from the vehicle window may be a position whose distance from the vehicle window is greater than or equal to a second distance, and the second distance may be a value greater than or equal to 5 cm. The specific values ​​of the first distance and the second distance are only given as examples here, and may be determined according to actual application scenarios, and the present disclosure does not make specific limitations on this.

[0094] The temperature inside the vehicle near the window can be obtained by using a temperature sensor located near the window; the humidity inside the vehicle far from the window can be obtained by using a humidity sensor located far from the window.

[0095] In step S12, a first saturated humidity value corresponding to the vehicle interior temperature value is determined.

[0096] Saturated humidity is the maximum humidity at a certain temperature. When the air humidity exceeds the saturated humidity at a certain temperature, water vapor will condense into water droplets, which will cause fogging.

[0097] In one example, the correspondence between the atmospheric temperature and the saturated humidity may be pre-stored, and after obtaining the in-vehicle temperature value, the saturated humidity value having a corresponding relationship with the in-vehicle temperature value may be searched as the first saturated humidity value. In another example, the saturated humidity value having a corresponding relationship with the in-vehicle temperature value may also be searched from a cloud database via a network. The present disclosure does not specifically limit the method for determining the first saturated humidity value.

[0098] When the humidity value in the vehicle is greater than or equal to the first saturated humidity value, it indicates that the water vapor in the vehicle will condense on the vehicle window, and a start instruction can be sent to the vehicle defogger. In other words, when the humidity value in the vehicle is greater than or equal to the first saturated humidity value, it is considered that there is a condition for fogging of the vehicle window, and regardless of whether the vehicle window is fogged at this time, a start instruction is sent to the vehicle defogger to prevent fogging before the vehicle window fogs up.

[0099] In step S13, when the humidity value inside the vehicle is less than the first saturated humidity value and greater than a fogging suspicion threshold, it is determined whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body taken through the vehicle window, and the fogging suspicion threshold is the difference between the first saturated humidity value and a preset fogging suspicion offset.

[0100] It is generally believed that when the humidity value in the car is less than the first saturated humidity value, the car windows will not fog up. However, in practice, it is found that even when the humidity value in the car is less than the first saturated humidity value, the car windows still fog up. That is, there is a situation where it is uncertain whether the car windows are fogged up, which is referred to as fogging doubt. The fogging doubt situation exists in a fogging doubt humidity range. When the humidity is greater than the fogging doubt threshold and less than the first saturated humidity value, it is a fogging doubt situation.

[0101] At different temperatures, the corresponding fogging suspicion threshold is also different. Through practical experience, it is found that the fogging suspicion threshold is lower than the saturation humidity value by a predetermined difference m, which is referred to here as the preset fogging suspicion offset m. The offset can be an empirical value and can be obtained through specific practice. The specific determination method is not specifically limited in this disclosure.

[0102] Then, the fogging suspicion threshold may be the difference between the first saturated humidity value and the preset fogging suspicion offset n, so that the fogging suspicion thresholds at different temperatures are different, thereby improving the accuracy of determining whether there is a fogging suspicion situation.

[0103] When it is determined that there is a doubtful fogging situation, it is possible to determine whether the window is fogged based on the current image of the reference object fixed on the vehicle body taken through the window, so as to timely determine whether the window is fogged. Since the reference object on the vehicle body cannot be clearly photographed through the window when the window is fogged, it is possible to determine whether the window is fogged based on the image. For the specific method of determining whether the window is fogged based on the image, please refer to the possible implementation method provided by the present disclosure, which will not be described in detail here.

[0104] In addition, the reference object in the present disclosure is fixed on the vehicle body, that is, the reference object will not move relative to the vehicle as the vehicle moves. This avoids inaccurate window fogging detection caused by the movement and change of the reference object, and improves the accuracy of determining whether the window is fogged.

[0105] In one example, the reference object fixed on the vehicle body may be, for example, a vehicle logo, a vehicle engine hood, a vehicle trunk lid, a vehicle rearview mirror frame, and the like.

[0106] In step S14, when it is determined that the vehicle window is fogged, a start command is sent to the in-vehicle defogger device.

[0107] When it is determined that the vehicle windows are fogged, a start command can be sent to the vehicle interior defogger device. After receiving the start command, the vehicle interior defogger device starts working and performs the defog operation.

[0108] There are many ways to defog the vehicle interior defogger. In one example, the vehicle window can be heated by warm air to evaporate the fog on the window. In another example, the vehicle window can be automatically wiped to remove the fog on the vehicle window. In another example, the external circulation ventilation can be turned on to allow the outside air to enter the cab to reduce the humidity and temperature under the vehicle. The present disclosure does not specifically limit the specific defogger method of the vehicle interior defogger.

[0109] In the disclosed embodiment, the vehicle interior temperature value near the vehicle window position and the vehicle interior humidity value far from the vehicle window position are obtained; then the first saturated humidity value corresponding to the vehicle interior temperature value is determined; when the vehicle interior humidity value is less than the first saturated humidity value and greater than the fogging suspicion threshold, it indicates that it is impossible to determine whether the vehicle window is fogged by temperature and humidity. At this time, it is possible to determine whether the vehicle window is fogged based on the current image of the reference object fixed on the vehicle body taken through the vehicle window, so as to determine whether the vehicle window is fogged more timely and accurately. Then, when it is determined that the vehicle window is fogged, a start command is sent to the vehicle interior defogger so as to defog the vehicle window in time and improve driving safety.

[0110] The fogging suspicion threshold is the difference between the first saturated humidity value and the preset fogging suspicion offset, so that the fogging suspicion thresholds at different temperatures are different, which improves the accuracy of determining whether there is a fogging suspicion situation, and can accurately and timely start the subsequent process of determining whether the window is fogged based on the image, so as to timely detect the fogging of the window and defog the window in time. In addition, this implementation does not need to store a fogging suspicion threshold for each temperature, but only stores a fogging suspicion offset, and obtains the fogging suspicion threshold by calculation, saving storage space.

[0111] In one possible implementation, the determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window includes: acquiring a current image of the reference object fixed to the vehicle body photographed through the vehicle window; determining a similarity between the current image and a standard image, wherein the standard image is an image of the reference object photographed through a non-fogged vehicle window; and determining that the vehicle window is fogged if the similarity is less than a similarity threshold.

[0112] In a possible implementation, after determining the similarity between the current image and the standard image, the method further includes: if the similarity is not less than the similarity threshold, determining that the vehicle window is not fogged.

[0113] When the car window is fogged, the reference object photographed through the car window often becomes blurred, and even when the car window is seriously fogged, the reference object may not be photographed; while when the car window is not fogged, the reference object photographed through the car window is often clear. Therefore, the visual effects of the two images obtained by photographing the reference object when the car window is fogged and when it is not fogged are different. In order to measure the difference in visual effects, the present disclosure quantifies the difference in visual effects of the two images obtained by photographing the reference object when the car window is fogged and when it is not fogged by calculating the similarity of the two images.

[0114] For the convenience of description, the image obtained by shooting the reference object through the non-fogged car window can be called the standard image, and the image obtained by shooting the reference object through the car window at the current moment can be called the current image. Then, the similarity between the current image and the standard image can represent the difference in the visual effects of the two images. When the similarity is less than the similarity threshold, it is considered that the car window is fogged. The similarity threshold here can be determined based on actual experience.

[0115] In one example, the similarity between a photo taken when fogging initially occurs and a standard image may be pre-calculated, and the similarity may be determined as a similarity threshold; in another example, the similarities between multiple photos taken when fogging occurs and the standard image may be calculated separately, and the minimum value of the multiple similarities obtained may be used as the similarity threshold.

[0116] In the disclosed embodiment, a current image of a reference object fixed on a vehicle body is obtained and photographed through a vehicle window; the similarity between the current image and a standard image is determined, and when the similarity is less than a similarity threshold, it is determined that the vehicle window is fogged. Thus, based on the similarity between the current image and the standard image photographed when not fogged, the difference in visual effects between the image of the reference object photographed when the vehicle window is fogged and when not fogged is quantified, and it is possible to accurately determine whether the current vehicle window is fogged.

[0117] In one possible implementation, the reference object includes an external reference object fixed on the vehicle body, and obtaining a current image of the reference object fixed on the vehicle body taken through a vehicle window includes: obtaining a current image of the external reference object taken by an image acquisition device inside the vehicle; determining the similarity between the current image and a standard image includes: determining the similarity between a target area in the current image and a target area in the standard image, the target area being the area where the external reference object is located.

[0118] In this implementation, the reference object is fixed on the vehicle body, so if you want to shoot the reference object through the vehicle window, the image acquisition device for shooting the reference object is located inside the vehicle. In this way, when the image acquisition device shoots the reference object outside the vehicle window, it shoots through the vehicle window.

[0119] When the position and shooting angle of the image acquisition device are fixed, the area where the reference object is located can be manually marked in the standard image after shooting the standard image. In one example, the area can be manually framed by a quadrilateral, and the coordinates of the area can be represented by the coordinates of the four vertices of the quadrilateral; in another example, the area can be manually framed by a polygon, and the coordinates of the area can be represented by the coordinates of the vertices of the polygon.

[0120] Alternatively, after the shooting position and angle of the image acquisition device change, the user may be prompted to re-acquire the standard image. After receiving the instruction to re-acquire the standard image from the user, the standard image may be re-acquired, and after the new standard image is acquired, the target external reference object may be identified in the standard image to obtain the target area of ​​the external reference object in the standard image.

[0121] In the case where the target area is known, after the current image is acquired, only the similarity between the target area in the current image and the target area in the standard image can be determined. In one example, the image of the target area in the standard image can be cropped in advance according to the coordinates of the target area, and then after the current image is acquired, the image of the target area in the current image can be cropped according to the coordinates of the target area, and then the similarity of the two cropped images can be calculated. In another example, the image can be cropped without cropping, but the similarity between the target area in the current image and the target area in the standard image can be calculated according to the coordinates of the target area.

[0122] Correspondingly, the similarity threshold used to determine whether the car window is fogged is also predetermined based on the similarity between the target area in the image taken when the car window is fogged and the target area in the standard image. Then, based on the similarity between the target area in the current image and the target area in the standard image and the similarity threshold, it can be determined whether the car window is fogged.

[0123] In the embodiment of the present disclosure, when the reference object includes an external reference object fixed on the vehicle body, the current image of the external reference object captured by the image acquisition device in the vehicle is obtained, and then the similarity between the target area in the current image and the target area in the standard image is determined. Since the target area is the area where the external reference object is located, by only comparing the similarity of the target area where the reference object is located, the influence of the change of the external movable object outside the target area on the similarity between the current image and the standard image can be reduced, thereby improving the accuracy of judging whether the vehicle window is fogged.

[0124] In one possible implementation, the determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window includes: acquiring a current image of the reference object fixed to the vehicle body photographed through the vehicle window; identifying the reference object in the current image by a target recognition algorithm; and in case of recognition failure, determining that the vehicle window is fogged.

[0125] The target recognition algorithm here can recognize the specified target in the image. The algorithm can be, for example, a target recognition algorithm based on a neural network. The target recognition algorithm takes the current image as input, and then performs operations such as feature extraction and feature classification on the current image. Its output is the probability that the target object (reference object on the vehicle body) exists in the current image. If the probability is greater than the probability threshold, it is considered that the reference object has been recognized. If the probability is not greater than the probability threshold, it is considered that the recognition has failed.

[0126] In the case of recognition failure, it indicates that there is no target reference object in the current image, or the captured target reference object is not clear enough, and it can be considered that the vehicle window is fogged. Therefore, it can be accurately determined whether the current vehicle window is fogged.

[0127] In one possible implementation, after determining the similarity between the current image and the standard image, the method further includes: when the similarity is less than a similarity threshold, instructing a vehicle wiper to perform a sweeping action on the vehicle window; within a predetermined time period after performing the sweeping action, obtaining a latest image of a reference object fixed on the vehicle body taken through the vehicle window; determining the similarity between the latest image and the standard image; and when the similarity between the latest image and the standard image is less than a similarity threshold, determining that the vehicle window is fogged.

[0128] When the similarity is less than the similarity threshold, it is considered that the objects outside the window are not clear enough, that is, the visibility is low. However, the low visibility may not be entirely caused by the fogging of the window, but may also be caused by the rain and snow covering the outer layer of the window due to rain and snow. Therefore, in this case, the vehicle wiper can be instructed to perform a sweeping action on the window, and an image is captured through the window again after the sweeping to determine whether the window is fogged.

[0129] It should be noted that the time to capture an image through the car window again should be within a predetermined time after the sweeping action is performed, so as to avoid a large amount of rain and snow adhering to the car window again after a long time after the sweeping action is performed, resulting in the similarity re-determined based on the latest image still being less than the similarity threshold. The predetermined time here can be, for example, 1 second, and the specific value of the predetermined time can be obtained based on experience, and the present disclosure does not make any specific limitation on this.

[0130] Then, within a predetermined time after performing the sweeping action, after obtaining the latest image, the similarity between the latest image and the standard image can be determined. When the similarity between the latest image and the standard image is less than the similarity threshold, it is determined that the vehicle window is fogged; when the similarity between the latest image and the standard image is not less than the similarity threshold, it is determined that the vehicle window is not fogged.

[0131] In the disclosed embodiment, when the similarity is less than the similarity threshold, the vehicle windshield wiper is instructed to perform a sweeping action on the vehicle window; within a predetermined time after the sweeping action is performed, the latest image of the reference object fixed on the vehicle body taken through the vehicle window is obtained; then the similarity between the latest image and the standard image is determined; when the similarity between the latest image and the standard image is less than the similarity threshold, it is determined that the vehicle window is fogged. Therefore, when the similarity is small, by starting the windshield wiper to perform the sweeping action on the vehicle window, the possibility of small similarity caused by rainy and snowy weather is eliminated, and the situation of mistakenly starting the defogger device is reduced.

[0132] In a possible implementation, the method further includes: obtaining an outside temperature value when the defogger is turned on; determining a second saturated humidity value corresponding to the outside temperature value; maintaining the defogger in operation when the second saturated humidity value is greater than the fogging suspicion threshold; and sending a shutdown command to the defogger inside the vehicle when the second saturated temperature value is not greater than the fogging suspicion threshold.

[0133] The outside temperature value can be obtained through a temperature sensor outside the vehicle, or obtained approximately through a network, and then the second saturated humidity value corresponding to the outside temperature value is determined. Specifically, it can be determined based on the correspondence between the temperature value and the saturated humidity value. The specific process can be referred to the process of determining the first saturated humidity value based on the inside temperature value of the vehicle, which will not be elaborated here.

[0134] When the second saturated humidity value is greater than the suspected fog threshold, the defogger can be kept running; and when the second saturated temperature value is not greater than the suspected fog threshold, a shutdown command can be sent to the defogger in the vehicle. Thus, by determining whether to shut down the defogger based on the second temperature value collected by the temperature sensor outside the vehicle, the defogger is shut down only when the saturated humidity value outside the vehicle is less than the suspected fog threshold, which can more accurately determine the timing of shutting down the defogger, and shut down the defogger in time when there is no defog demand, thereby avoiding waste of resources.

[0135] The following is an exemplary description of the vehicle window defogger technology provided by the present disclosure through a specific embodiment. Figure 2 The hardware framework diagram of the vehicle window defogger device provided according to the embodiment of the present disclosure is shown as follows: Figure 2 Said device comprises:

[0136] The in-car temperature sensor is used to collect the in-car temperature near the window;

[0137] The outside temperature sensor is used to collect the temperature outside the vehicle;

[0138] In-vehicle image acquisition equipment, used to acquire images of reference objects outside the vehicle through the vehicle window;

[0139] In-car humidity sensor, used to collect the humidity in the car away from the window;

[0140] An in-vehicle processor (CPU) is used to execute the vehicle window defog method provided by the present disclosure.

[0141] Based on the above device, an application scenario of the embodiment of the present disclosure is described below. Figure 3 , which is a flow chart of a vehicle defog method provided by the present invention.

[0142] 1) Reference object setting: When there is no fog, the image acquisition device inside the vehicle takes images of reference objects outside the vehicle through the vehicle window and pre-stores them in the vehicle memory as standard images, which serve as the basis for subsequent judgment on whether there is fog.

[0143] 2) After the vehicle is started, without turning on the defogger, the CPU reads the values ​​of the interior temperature sensor, exterior temperature sensor, and interior humidity sensor at regular intervals. Assume that the current value of the interior humidity sensor is K, and the current value of the interior temperature sensor near the window is t1. Find the saturated humidity value S1 corresponding to t1 in the table pre-stored in the vehicle memory.

[0144] If K>S1-m, the in-vehicle defogger is directly started, where m is the error tolerance. That is, due to the measurement accuracy of the in-vehicle humidity sensor, the measured s1 has errors. Therefore, the error tolerance is used to reduce the impact of the error on the measurement result.

[0145] If K < S1-m and K>S1-mn, the image comparison algorithm is started at this time, and the current image of the reference object captured is compared with the pre-stored standard image to determine whether the window is fogged. If it is fogged, the defogger in the car is automatically started. If it is determined that there is no fog, the defogger in the car is not started.

[0146] If K≤S1-mn, it is determined that the environment does not meet the conditions for fogging and the vehicle defogger will not be turned on.

[0147] 3) When the defogger is turned on, the current temperature value of the temperature sensor outside the vehicle is t2, and the saturated humidity value S2 corresponding to t2 is found in the table pre-stored in the vehicle memory. The current value of the temperature sensor near the window inside the vehicle is t3, and the saturated humidity value S3 corresponding to t3 is found in the table pre-stored in the vehicle memory.

[0148] If S1>S2+L and K>S1-mn, the in-vehicle defogger will continue to operate. L is the error tolerance, that is, due to the measurement accuracy of the in-vehicle humidity sensor, the measured S1 has errors. Therefore, the error tolerance is used to reduce the impact of the error on the measurement result.

[0149] If the above conditions are not met, turn off the interior defogger.

[0150] The specific process of the image comparison algorithm in this application scenario is described in more detail below.

[0151] 1. When the window is not fogged, the window defogger collects and pre-stores the standard image IMG1 through the in-vehicle image acquisition device. When the viewing angle and position of the in-vehicle image acquisition device do not change, the image can be pre-stored once, or different standard images can be pre-stored at several commonly used positions and viewing angles.

[0152] 2. Annotate the target area AERA1 on the pre-stored standard image. The image captured by the image acquisition device should contain a reference object that is stationary relative to the image acquisition device during the vehicle's motion, such as the front part of the vehicle, the vehicle logo, or a fixed pattern on the vehicle body. Figure 4 , which is a schematic diagram of the location of a target area provided in an embodiment of the present disclosure.

[0153] 3. During vehicle driving, when the image acquisition device needs to be started for detection, the image acquisition device will capture the current image IMG2 of the reference object, and then the CPU will compare the similarity of the AERA1 area in the two images of IMG1 and IMG2, and give similarity data. When the similarity is higher than the similarity threshold, it is considered that there is no fogging, and the in-vehicle defogger will not be started. When the similarity is lower than the similarity threshold, it is considered that there is fogging or there is a tendency to fogging, and the in-vehicle defogger will be started. Alternatively, the target recognition algorithm can be used to identify the reference object calibrated in the current image. If the recognition fails, it is considered that there is fogging.

[0154] In the disclosed embodiment, when judging whether it is necessary to perform window defogger, temperature, humidity and image information are integrated, which has a higher accuracy rate. At the same time, whether to turn on the defogger function is determined based on temperature and humidity, so that the turning on of the defogger function is changed from passive to active prevention, which can effectively prevent the windows from fogging up before fogging up, rather than waiting until fogging occurs before defoggering. In addition, when it is determined that defogger is not necessary, the defogger function will be actively turned off to save energy.

[0155] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. Due to space limitations, the present disclosure will not repeat them. It can be understood by those skilled in the art that in the above-mentioned method of the specific implementation method, the specific execution order of each step should be determined according to its function and possible internal logic.

[0156] In addition, the present disclosure also provides a vehicle window defogger device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any vehicle window defogger method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method part and will not be repeated here.

[0157] Figure 5 A block diagram of a vehicle window defogger according to an embodiment of the present disclosure is shown, Figure 5 As shown, the device 20 comprises:

[0158] A first acquisition unit 21 is used to acquire a temperature value in the vehicle near the vehicle window and a humidity value in the vehicle far from the vehicle window;

[0159] A first determining unit 22, configured to determine a first saturated humidity value corresponding to the vehicle interior temperature value;

[0160] a fogging determination unit 23, configured to determine whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window when the humidity value in the vehicle is less than a first saturated humidity value and greater than a fogging suspicion threshold, wherein the fogging suspicion threshold is a difference between the first saturated humidity value and a preset fogging suspicion offset;

[0161] The first instruction sending unit 24 is used to send a start instruction to the defogger device in the vehicle when it is determined that the vehicle window is fogged.

[0162] In a possible implementation manner, the fogging determination unit is used to:

[0163] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0164] Determining a similarity between the current image and a standard image, wherein the standard image is an image of the reference object taken through a non-fogged vehicle window;

[0165] When the similarity is less than the similarity threshold, it is determined that the vehicle window is fogged.

[0166] In a possible implementation, the reference object includes an external reference object fixed on the external body of the vehicle, and the fogging determination unit is used to obtain a current image of the external reference object taken by an image acquisition device in the vehicle;

[0167] The fogging determination unit is used to determine the similarity between the target area in the current image and the target area in the standard image, and the target area is the area where the external reference object is located.

[0168] In a possible implementation manner, after determining the similarity between the current image and the standard image, the apparatus further includes:

[0169] a sweeping instruction unit, used for instructing the vehicle wiper to perform a sweeping action on the vehicle window when the similarity is less than a similarity threshold;

[0170] A latest image acquisition unit, used to acquire the latest image of the reference object fixed on the vehicle body photographed through the vehicle window within a predetermined time period after the sweeping action is performed;

[0171] a similarity determination unit, configured to determine the similarity between the latest image and a standard image;

[0172] The vehicle window fogging determination unit is used to determine that the vehicle window is fogged when the similarity between the latest image and the standard image is less than a similarity threshold.

[0173] In a possible implementation manner, the fogging determination unit is used to:

[0174] Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window;

[0175] Identifying the reference object in the current image by a target recognition algorithm;

[0176] In case of a recognition failure, it is determined that the vehicle windows are fogged.

[0177] In a possible implementation manner, the device further includes:

[0178] The second instruction sending unit is used to send a start instruction to the in-vehicle defogger device when the in-vehicle humidity value is greater than or equal to the first saturated humidity value.

[0179] In a possible implementation, the method further includes:

[0180] A second acquisition unit is used to acquire the vehicle outside temperature value when the defogger is turned on;

[0181] A second determining unit, configured to determine a second saturated humidity value corresponding to the vehicle exterior temperature value;

[0182] a maintaining unit, configured to maintain the demisting device in continuous operation when the second saturated humidity value is greater than the fogging suspicion threshold;

[0183] The third instruction sending unit is used to send a closing instruction to the in-vehicle defogger device when the second saturation temperature value is not greater than the fogging suspicion threshold.

[0184] This method has a specific technical connection with the internal structure of the computer system, and can solve the technical problem of how to improve the hardware computing efficiency or execution effect (including reducing the amount of data storage, reducing the amount of data transmission, increasing the hardware processing speed, etc.), thereby obtaining the technical effect of improving the internal performance of the computer system in accordance with the laws of nature.

[0185] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0186] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0187] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0188] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0189] The electronic device may be provided as a terminal, a server, or a device in other forms.

[0190] Figure 6 A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown. For example, the electronic device 800 may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, or other terminal device.

[0191] Reference Figure 6 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0192] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0193] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0194] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0195] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0196] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0197] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0198] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0199] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as a wireless network (Wi-Fi), a second generation mobile communication technology (2G), a third generation mobile communication technology (3G), a fourth generation mobile communication technology (4G), a long-term evolution (LTE) of a universal mobile communication technology, a fifth generation mobile communication technology (5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0200] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0201] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above method.

[0202] The present disclosure relates to the field of augmented reality. By acquiring the image information of the target object in the real environment, the relevant features, states and attributes of the target object are detected or identified by various visual related algorithms, so as to obtain an AR effect that combines virtuality and reality and matches the specific application. Exemplarily, the target object may involve the face, limbs, gestures, actions, etc. related to the human body, or markers, markers related to objects, or sand tables, display areas or display items related to venues or places. Visual related algorithms may involve visual positioning, SLAM, three-dimensional reconstruction, image registration, background segmentation, key point extraction and tracking of objects, and position or depth detection of objects. Specific applications may not only involve interactive scenes such as guided tours, navigation, explanations, reconstruction, virtual effect superposition and display related to real scenes or objects, but also special effects processing related to people, such as makeup beautification, limb beautification, special effects display, virtual model display and other interactive scenes. The relevant features, states and attributes of the target object can be detected or identified by a convolutional neural network. The above-mentioned convolutional neural network is a network model obtained by model training based on a deep learning framework.

[0203] Figure 7 1 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, the electronic device 1900 may be provided as a server or a terminal device. Figure 7 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0204] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as a Microsoft Server operating system (Windows Server 2003). TM ), a graphical user interface operating system launched by Apple (Mac OSX TM ), a multi-user, multi-process computer operating system (Unix TM ), a free and open source Unix-like operating system (Linux TM ), an open source Unix-like operating system (FreeBSD TM ) or similar.

[0205] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.

[0206] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0207] Computer readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. Computer readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. The computer readable storage medium used here is not interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated by a waveguide or other transmission medium (for example, a light pulse by an optical fiber cable), or an electrical signal transmitted by a wire.

[0208] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0209] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0210] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0211] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0212] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0213] The flowcharts and block diagrams in the accompanying drawings show systems, methods and computer programs according to various embodiments of the present disclosure.

[0214] The possible architecture, functions and operations of the product. In this regard, each box in the flowchart or block diagram may represent a module, a program segment or a portion of instructions, which includes one or more

[0215] A plurality of executable instructions for implementing specified logical functions. In some alternative implementations, the functions marked in the blocks may also occur in a different order than that marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the opposite order, depending on the functions involved. Also note that

[0216] It is noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by dedicated hardware and computer instructions.

[0217] It can be achieved by a combination of commands.

[0218] The computer program product may be implemented in hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a computer storage medium.

[0219] The machine program product is specifically embodied as a software product, such as a software development kit (SDK), etc. 5 The above description of the various embodiments tends to emphasize the differences between the various embodiments, and the same or similar

[0220] For the sake of brevity, this article will not go into details.

[0221] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0222] 0 If the technical solution of this application involves personal information, the product using the technical solution of this application shall, before processing personal information,

[0223] The rules for processing personal information have been clearly informed and the individual’s voluntary consent has been obtained. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual’s separate consent before processing sensitive personal information, and

[0224] At the same time, the requirement of "explicit consent" should be met. For example, in cameras and other personal information collection devices, clear and obvious

[0225] The user shall be informed that the user has entered the personal information collection scope and that personal information will be collected. If the user voluntarily enters the collection scope, it shall be deemed that the user agrees to the collection of his / her personal information; or, on the device that processes personal information, the user shall be informed that the user has entered the personal information collection scope and that personal information will be collected.

[0226] In the case of the personal information processing rules being notified through identification / information, the personal authorization is obtained through pop-up information or by asking the individual to upload their personal information; the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0227] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments.

[0228] Many modifications and variations are obvious to those skilled in the art. The selection of terms used herein is intended to best explain the principles of each embodiment, practical applications or improvements to the technology in the market, or to enable other persons skilled in the art to understand the embodiments disclosed herein.

Claims

1. A vehicle window defog method, characterized in that: include: Get the temperature value of the car near the window and the humidity value of the car far from the window; Determine a first saturated humidity value corresponding to the vehicle interior temperature value; When the humidity value in the vehicle is less than a first saturated humidity value and greater than a fogging suspicion threshold, determining whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window, wherein the fogging suspicion threshold is a difference between the first saturated humidity value and a preset fogging suspicion offset; When it is determined that the vehicle windows are fogged, a start command is sent to the defogger device in the vehicle.

2. The method according to claim 1, characterized in that The determining whether the vehicle window is fogged based on a current image of a reference object fixed on the vehicle body photographed through the vehicle window comprises: Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window; Determining a similarity between the current image and a standard image, wherein the standard image is an image of the reference object taken through a non-fogged vehicle window; When the similarity is less than the similarity threshold, it is determined that the vehicle window is fogged.

3. The method according to claim 2, characterized in that The reference object includes an external reference object fixed on the vehicle body, and the obtaining of a current image of the reference object fixed on the vehicle body photographed through a vehicle window includes: Acquire a current image of a reference object outside the vehicle captured by an image acquisition device inside the vehicle; The determining the similarity between the current image and the standard image comprises: Determine the similarity between the target area in the current image and the target area in the standard image, wherein the target area is the area where the external reference object is located.

4. The method according to claim 2, characterized in that: After determining the similarity between the current image and the standard image, the method further includes: In the case where the similarity is less than a similarity threshold, instructing a windshield wiper of the vehicle to perform a sweeping action on the vehicle window; Within a predetermined time period after performing the sweeping action, obtaining a latest image of a reference object fixed to the vehicle body photographed through the vehicle window; Determining the similarity between the latest image and the standard image; When the similarity between the latest image and the standard image is less than a similarity threshold, it is determined that the vehicle window is fogged.

5. The method according to claim 1, characterized in that The determining whether the vehicle window is fogged based on a current image of a reference object fixed on the vehicle body photographed through the vehicle window comprises: Obtaining a current image of a reference object fixed to a vehicle body photographed through a vehicle window; Identifying the reference object in the current image by a target recognition algorithm; In case of a recognition failure, it is determined that the vehicle windows are fogged.

6. The method according to claim 1, characterized in that After determining the first saturated humidity value corresponding to the in-vehicle temperature value, the method further includes: When the humidity value in the vehicle is greater than or equal to the first saturated humidity value, a start instruction is sent to the defogger device in the vehicle.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: When the defogger is turned on, obtain the outside temperature value of the vehicle; Determine a second saturated humidity value corresponding to the vehicle exterior temperature value; When the second saturated humidity value is greater than the fogging suspicion threshold, keeping the defogger device running; When the second saturation temperature value is not greater than the fogging suspicion threshold, a closing instruction is sent to the in-vehicle defogger device.

8. A vehicle window defogger, characterized in that: include: A first acquisition unit is used to acquire a temperature value inside the vehicle near the vehicle window and a humidity value inside the vehicle far from the vehicle window; A first determining unit, configured to determine a first saturated humidity value corresponding to the vehicle interior temperature value; a fogging determination unit, configured to determine whether the vehicle window is fogged based on a current image of a reference object fixed to the vehicle body photographed through the vehicle window when the humidity value in the vehicle is less than a first saturated humidity value and greater than a fogging suspicion threshold, wherein the fogging suspicion threshold is a difference between the first saturated humidity value and a preset fogging suspicion offset; The command sending unit is used to send a start command to the defogger device in the vehicle when it is determined that the vehicle window is fogged.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to call the instructions stored in the memory to execute the method described in any one of claims 1 to 7.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images