Vehicle window glass purification method and device and storage medium
By automatically identifying and processing abnormal areas on the car window glass, using grayscale images and on-board camera technology, the automatic purification of the car window glass is achieved, solving the driving safety hazards caused by manual operation in the existing technology, and improving driving convenience Sex and safety.
Patent Information
- Application Number
- CN202310530757.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, when the window glass is fogging or foreign objects are blocked, the driver needs to manually operate the defogging button or wiper, which leads to distracting attention, affecting driving safety, and failing to identify and deal with abnormal areas in time, resulting in blind spots and accidents in sight. Risk increases.
By obtaining the grayscale image of the car window glass, abnormal areas are automatically identified, such as falling objects and fog, and using on-board cameras and image processing technology to determine the location and size of the abnormal areas, and automatically start the glass water nozzle and wiper for purification.
It improves driving convenience and safety, reduces the probability of accidents, reduces the operating burden and distraction of drivers through automated purification processes, and improves the cleaning efficiency of window glass.
Smart Images

Figure CN118928295A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicle control technology, and in particular to a vehicle window glass purification method, a vehicle window glass purification device, and a computer-readable storage medium. Background Art
[0002] When driving a vehicle, the windows often fog up, foreign objects fly in and block the view, which affects the driver's normal observation of the traffic conditions outside the vehicle. For this reason, existing vehicles usually require the driver to actively look down to find and click the defog button, or actively operate the sprayer and wiper control lever to manually clean the window glass.
[0003] However, in actual driving, due to subjective and objective reasons such as lack of experience or poor driving habits, many drivers are unable to timely and correctly assess the impact of fogging and foreign objects on road conditions, and therefore fail to purify the window glass in time, resulting in many additional blind spots and posing a hidden danger to driving safety. On the other hand, fogging of windows generally occurs in rainy or night scenes with low visibility, and the above-mentioned manual operation requirements will further distract the driver's attention, thus seriously affecting the driver's normal driving and easily causing traffic accidents.
[0004] In order to overcome the above-mentioned defects of the prior art, the art is in urgent need of a vehicle window glass purification technology for automatically identifying abnormal areas on the vehicle window glass and selecting a corresponding method to purify the vehicle window glass, thereby improving driving convenience and safety and reducing the occurrence of accidents. Summary of the invention
[0005] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or decisive elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.
[0006] In order to overcome the above-mentioned defects of the prior art, the present invention provides a method for purifying vehicle window glass, a device for purifying vehicle window glass, and a computer-readable storage medium, which can automatically identify abnormal areas on the vehicle window glass and select a corresponding method to purify the vehicle window glass, thereby improving the convenience and safety of driving and reducing the occurrence of accidents.
[0007] Specifically, the vehicle window glass purification method provided according to the first aspect of the present invention comprises the following steps: obtaining a grayscale image of the vehicle window glass; analyzing the grayscale image to determine an abnormal area in the vehicle window glass; and purifying the vehicle window glass according to the size and / or position of the abnormal area.
[0008] Furthermore, in some embodiments of the present invention, the step of parsing the grayscale image to determine the abnormal area in the vehicle window glass includes: performing a first filtering on the grayscale image to filter out bright areas whose grayscale values are greater than a preset first grayscale threshold and whose areas are greater than a preset first area threshold to determine at least one dark area, wherein the bright area is composed of a plurality of adjacently arranged pixels whose grayscale values are greater than the first grayscale threshold; focusing the dark areas that meet the above conditions via a vehicle-mounted camera; and determining the dark areas whose focusing result is equal to the distance from the vehicle-mounted camera to the vehicle window glass as abnormal falling object areas.
[0009] Furthermore, in some embodiments of the present invention, before performing a first filtering on the grayscale image, the purification method also includes the following steps: parsing the grayscale image to determine a first average grayscale value of a plurality of pixels therein; and determining the first grayscale threshold based on the first average grayscale value.
[0010] Furthermore, in some embodiments of the present invention, before focusing the dark area that meets the above conditions via the vehicle-mounted camera, the purification method also includes the following steps: placing a calibration object at at least one calibration position on the vehicle window glass; pre-focusing the calibration object via the vehicle-mounted camera; and determining the distance from the vehicle-mounted camera to each of the calibration positions based on the result of the pre-focusing.
[0011] Furthermore, in some embodiments of the present invention, the step of focusing on a dark area that meets the above conditions via a vehicle-mounted camera includes: performing a second filtering on the dark area that meets the above conditions, filtering out noisy dark areas whose areas are smaller than a preset second area threshold, to determine a target dark area that affects observation; and focusing on the target dark area via the vehicle-mounted camera.
[0012] Furthermore, in some embodiments of the present invention, the step of focusing the target dark area via the vehicle-mounted camera includes: determining the center position coordinates of the target dark area based on the coordinates of multiple pixel points contained in the target dark area; and focusing the center position coordinates of the target dark area via the vehicle-mounted camera.
[0013] Furthermore, in some embodiments of the present invention, the step of purifying the vehicle window glass according to the size and / or position of the abnormal area includes: in response to the size of the abnormal area of fallen objects being greater than or equal to a preset second area threshold, starting a glass water nozzle and / or a wiper to purify the vehicle window glass.
[0014] Furthermore, in some embodiments of the present invention, a plurality of identification areas are pre-defined on the vehicle window glass, and the step of parsing the grayscale image to determine the abnormal area in the vehicle window glass includes: performing a third filtering on the identification area to determine the proportion of pixels whose grayscale values are greater than a preset second grayscale threshold; determining the variance of brightness values of a plurality of pixels in the identification area; and determining the identification area whose brightness value variance is less than a preset brightness variance threshold and whose pixel proportion is greater than a preset proportion threshold as a fogging abnormal area.
[0015] Furthermore, in some embodiments of the present invention, before performing a third filtering on the identification area, the purification method also includes the following steps: parsing the grayscale image in the identification area to determine a second average grayscale value of multiple pixels therein; and determining the second grayscale threshold based on the second average grayscale value.
[0016] Furthermore, in some embodiments of the present invention, the step of determining the variance of brightness values of multiple pixel points in the identification area includes: acquiring a window glass image in the identification area; converting the window glass image into image data in NV21 YUV format; and determining the brightness values of multiple pixel points in the identification area according to the Y component in the image data in NV21 YUV format to calculate the brightness value variance.
[0017] Furthermore, in some embodiments of the present invention, a first identification area and a second identification area are defined at the lower left corner and the lower right corner of the vehicle window glass, respectively, and the step of purifying the vehicle window glass according to the size and / or position of the abnormal area includes: in response to the first identification area and the second identification area being determined as fogging abnormal areas, turning on the defog function.
[0018] Furthermore, in some embodiments of the present invention, a third identification area and a fourth identification area are respectively defined at the upper left corner and the upper right corner of the vehicle window glass, and the step of purifying the vehicle window glass according to the size and / or position of the abnormal area also includes: in response to the first identification area, the second identification area, the third identification area and the fourth identification area being determined as fogging abnormal areas, increasing the air volume of the defogger function.
[0019] Furthermore, in some embodiments of the present invention, a fifth identification area is defined at the center of the vehicle window glass, and the step of purifying the vehicle window glass according to the size and / or position of the abnormal area also includes: in response to the first identification area, the second identification area, the third identification area, the fourth identification area and the fifth identification area being determined as fogging abnormal areas, lowering the set temperature of the vehicle air-conditioning system.
[0020] In addition, the window glass purification device provided according to the second aspect of the present invention comprises a memory and a processor. The memory stores computer instructions. The processor is connected to the memory and configured to execute the computer instructions stored in the memory to implement the window glass purification method as described in any one of the first aspects of the present invention.
[0021] In addition, the computer-readable storage medium provided according to the third aspect of the present invention stores computer instructions, which, when executed by a processor, implement the vehicle window glass purification method as described in any one of the first aspects of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.
[0023] Figure 1 A schematic flow chart of a method for purifying vehicle window glass provided according to some embodiments of the present invention is shown.
[0024] Figure 2 A schematic diagram of a vehicle window glass provided according to some embodiments of the present invention is shown.
[0025] Figure 3 A schematic diagram of an identification area provided according to some embodiments of the present invention is shown.
[0026] Figure 4 A schematic diagram of an NV21 format picture provided according to some embodiments of the present invention is shown.
[0027] Figure 5 A schematic diagram of an image of a vehicle window glass in a non-fogged state provided according to some embodiments of the present invention is shown.
[0028] Figure 6 A schematic diagram showing the brightness value of each pixel compared with the average brightness value in a non-fogging state according to some embodiments of the present invention is shown.
[0029] Figure 7A schematic diagram of an image of a vehicle window glass in a fogged condition provided according to some embodiments of the present invention is shown.
[0030] Figure 8 A schematic diagram showing the brightness value of each pixel compared with the average brightness under fogging conditions provided by some embodiments of the present invention is shown. DETAILED DESCRIPTION
[0031] The following specific embodiments illustrate the implementation of the present invention, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to this implementation. On the contrary, the purpose of introducing the invention in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, the following description will include many specific details. The present invention can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present invention, some specific details will be omitted in the description.
[0032] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0033] In addition, the terms "upper", "lower", "left", "right", "top", "bottom", "horizontal" and "vertical" used in the following description should be understood as the directions shown in the paragraph and the related drawings. Such relative terms are only used for the convenience of description and do not mean that the device described therein must be manufactured or operated in a specific direction, and therefore should not be understood as limiting the present invention.
[0034] It is understood that although the terms "first", "second", "third", etc. may be used herein to describe various components, regions, layers and / or parts, these components, regions, layers and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers and / or parts. Therefore, the first component, region, layer and / or part discussed below may be referred to as a second component, region, layer and / or part without departing from some embodiments of the present invention.
[0035] As mentioned above, during the driving process, the windows often fog up, foreign objects fly in and block the view, which affects the driver's normal observation of the traffic conditions outside the car. For this reason, existing vehicles usually require the driver to actively look down to find and click the defogger button, or actively operate the sprayer and wiper control lever to manually purify the window glass. However, in the actual driving process, due to subjective and objective reasons such as lack of experience or poor driving habits, many drivers are unable to timely and correctly assess the impact of fogging and foreign objects blocking the road conditions, and therefore fail to purify the window glass in time, resulting in many additional blind spots and posing a hidden danger to driving safety. On the other hand, fogging of windows generally occurs in rainy or night scenes with low visibility, and the above-mentioned manual operation requirements will further distract the driver's attention, thereby seriously affecting the driver's normal driving and easily causing accidents.
[0036] In order to overcome the above-mentioned defects of the prior art, the present invention provides a method for purifying vehicle window glass, a device for purifying vehicle window glass, and a computer-readable storage medium, which can automatically identify abnormal areas on the vehicle window glass and select a corresponding method to purify the vehicle window glass, thereby improving the convenience and safety of driving and reducing the occurrence of accidents.
[0037] In some non-limiting embodiments, the above-mentioned vehicle window glass purification method provided in the first aspect of the present invention can be implemented via the above-mentioned vehicle window glass purification device provided in the second aspect of the present invention. Specifically, the vehicle window glass purification device provided in the second aspect of the present invention can be configured with a memory and a processor. The memory includes but is not limited to the computer-readable storage medium provided in the third aspect of the present invention, on which computer instructions are stored. The processor is connected to the memory and is configured to execute the computer instructions stored on the memory to implement the above-mentioned vehicle window glass purification method provided in the first aspect of the present invention.
[0038] Please refer to Figure 1 and Figure 2 . Figure 1 A schematic flow chart of a method for purifying vehicle window glass provided according to some embodiments of the present invention is shown. Figure 2 A schematic diagram of a vehicle window glass provided according to some embodiments of the present invention is shown.
[0039] like Figure 1 As shown, during the driving process of the vehicle, the window glass purification device can first obtain a grayscale image of the window glass. Here, the window glass includes but is not limited to the front windshield, rear windshield, and glass arranged on the left and right doors of the vehicle.
[0040] Taking the front windshield as an example, the purification device can be connected to the vehicle's driving recorder, and the driving recorder can be used to capture or monitor the original color image of the front windshield of the vehicle in real time, and then convert it into a grayscale image through image processing. Here, the smaller the grayscale value, the darker the corresponding pixel point. The process of converting the color image into a grayscale image does not involve the technical improvement of the present invention and will not be described in detail here.
[0041] After obtaining the grayscale image of the vehicle window glass, the purification device can analyze it to determine whether it contains an abnormal area. Here, the types of abnormal areas include but are not limited to falling object abnormal areas and fogging abnormal areas.
[0042] First, taking the abnormal area of falling objects as an example, after obtaining the grayscale image of the car window glass, the purification device can first perform a first filter on the grayscale image according to the preset first grayscale threshold and the first area threshold to filter out the bright area whose grayscale value is greater than the first grayscale threshold and whose area is greater than the first area threshold. Here, the first area threshold can be manually set by the technician according to the data processing capacity of the purification device and / or the vehicle computer. The first grayscale threshold can be manually set by the technician according to the results of the foreign body calibration experiment, or it can be dynamically determined by the purification device according to the grayscale average value of the collected grayscale image.
[0043] Specifically, the first grayscale threshold X is dynamically determined. th1 In the process, the purification device can first analyze the grayscale image of the vehicle window glass to determine the grayscale value of each pixel therein, and calculate its first grayscale average value X avg1 Afterwards, the purification device can be based on a preset conversion factor (for example: ), dynamically determine the corresponding first grayscale threshold X th1 ,Right now
[0044]
[0045] Further, according to the first gray threshold X th1 After grayscale filtering is performed on the grayscale image to screen out bright pixels with higher grayscale values, the purification device can also filter the grayscale image according to the first area threshold A. th1 The bright area composed of adjacent bright pixels is filtered to remove the scattered bright areas that have no practical observation effect, so as to obtain Figure 2 At least one dark area is shown.
[0046] Afterwards, the purification device can send the original image obtained by the vehicle camera such as the driving recorder to the image signal processor (ISP), and the ISP performs a focus analysis on the contour, texture and other information of the objects in the dark area i that meet the above conditions one by one to determine the corresponding focus result f=k i In response to the focus result k of any dark area i i Equal to the distance d from the vehicle camera to the window glass (i.e. k i =d), the purification device can determine that there is a foreign object floating in the dark area i of the window glass, and thus determine the dark area i as an abnormal area of falling objects. It should be noted that the specific method of focusing analysis based on the contour, texture and other information of the object by ISP does not involve the technical improvement of the present invention and will not be described in detail here.
[0047] Furthermore, in some embodiments of the present invention, the distance d between the vehicle camera and the window glass can also be pre-calibrated by ISP focusing. Specifically, in the case where the distances between the vehicle camera and multiple positions of the window glass are different, the technician can first place a calibration object j at multiple calibration positions of the window glass. Afterwards, the purification device can capture images of each calibration object through the vehicle camera, and perform focusing analysis on the contour, texture and other information of each calibration object j one by one through ISP to respectively determine the distance d from the vehicle camera to each calibration position. j , and use this to characterize the distance between the vehicle camera and each position of the window glass, so as to avoid misjudgment or missed judgment of foreign objects due to the different distances between the vehicle camera and multiple positions of the window glass.
[0048] Furthermore, before performing a focus analysis on each dark area i, the purification device may preferably first perform a second filtering on the dark area i to filter out those dark areas whose area is smaller than a preset second area threshold A. th2 In some embodiments, the second area threshold A th2 According to the window glass area A window Preset ratio To determine,
[0049]
[0050] Among them, n can be set to 32. After that, the purification device only needs to focus on the target dark area obtained by screening to effectively determine whether there is an abnormal area of fallen objects on the window glass, thereby further reducing the data processing load and improving the efficiency and real-time performance of abnormal area identification.
[0051] Furthermore, the focus analysis of the target dark area can be implemented based on the coordinates of its center position. Specifically, in response to determining that the area is greater than or equal to the second area threshold A th2 The purification device can also preferably determine the center position coordinates of the target dark area according to the coordinates of multiple pixel points included in the target dark area. Afterwards, the purification device only needs to focus on the center position coordinates of the target dark area through the vehicle-mounted camera to accurately characterize the distance from the camera to the target dark area.
[0052] Optionally, in some other embodiments, the second filtering can also be performed after the focus analysis. Specifically, after determining the abnormal area of fallen objects in the window glass, the purification device can preferably perform a second filtering on the abnormal area of fallen objects to filter out the areas whose area is smaller than a preset second area threshold A. th2 Noise dark area.
[0053] Please continue to refer to Figure 1 In response to the size of the abnormal falling object area being greater than or equal to a preset second area threshold, the purification device can correspondingly operate the falling object purification function and automatically start the glass water nozzle and / or the wiper to purify the vehicle window glass.
[0054] Taking the fogging abnormal area as an example, the car window glass can be Figure 3 As shown, multiple identification areas A to E are defined. Here, identification area A is located at the upper left corner of the window glass, identification area B is located at the upper right corner of the window glass, identification area C is located at the lower left corner of the window glass, identification area D is located at the lower right corner of the window glass, and identification area E is located at the center of the window glass, and each has a corresponding arc radius R. Since the center and radius are known, the purification device can easily determine the coordinate position (x, y) of each pixel point in each identification area A to E, and further determine the brightness value of each pixel point based on the coordinate position (x, y). In this way, in the process of determining the fogging abnormal area in the window glass, the purification device can first calculate the brightness value variance SA to SE and the fogging pixel point proportion WA to WE of each identification area A to E, and then judge whether each identification area A to E has fogging abnormality based on the brightness value variance SA to SE and the fogging pixel point proportion WA to WE.
[0055] Please refer to Figure 4 , Figure 4 A schematic diagram of an NV21 format picture provided according to some embodiments of the present invention is shown.
[0056] like Figure 4As shown, in the process of calculating the brightness value variance SA~SE of each identification area A~E, the purification device can first convert the original image of the car window glass into image data in NV21 YUV format. Here, the NV21 format belongs to the YUV 420Semi-Planar type, in which the Y component is stored separately, while the U component and the V component are stored alternately, and the four Y components share a set of UV components. In the example where the total number of pixels N=32 obtained by the image width*height, Y1~Y32 represent the brightness (Luminance) of each of the 32 pixels, that is, the grayscale value. The value range of Y is (0~255). U and V are chromaticity and concentration (Chrominance), which are used to describe the color and saturation of the image and are used to specify the color of the pixel. The same color block represents a set of pixels that share a set of U values and V values. As shown Figure 3 {Y1,Y2,Y9,Y10} share the same group {U1,V1}.
[0057] Afterwards, the purification device can determine the brightness values of multiple pixels in each identification area A to E according to the Y component in the image data in NV21 YUV format, and calculate the brightness value variance of each identification area A to E accordingly, that is,
[0058]
[0059] Among them, S 2 represents the brightness value variance, n represents the number of pixels in the corresponding area, and y i Indicates the Y value of the i-th pixel, y avg Represents the average brightness of all pixels in the corresponding area.
[0060] Please refer to Figures 5 to 8 , Figure 5 A schematic diagram of an image of a vehicle window glass in a non-fogged state provided according to some embodiments of the present invention is shown. Figure 6 A schematic diagram showing the brightness value of each pixel compared with the average brightness value in a non-fogging state according to some embodiments of the present invention is shown. Figure 7 A schematic diagram of an image of a vehicle window glass in a fogged condition provided according to some embodiments of the present invention is shown. Figure 8 A schematic diagram showing the brightness value of each pixel compared with the average brightness under fogging conditions provided by some embodiments of the present invention is shown.
[0061] like Figure 5 and Figure 6 As shown in Figure 1, under normal circumstances without fogging, each pixel in the window glass image can accurately and objectively reflect the brightness of the corresponding object (e.g., sky, leaves, vehicles, pedestrians), so the brightness value y of each pixel i is i Compared to the average brightness y avgThe difference is large, so the brightness value variance S 2 will also increase accordingly. Figure 7 and Figure 8 As shown in the figure, in the abnormal case of fogging, the brightness value y of each pixel i in the window glass image is i will be affected by the brightness values of adjacent pixels, and the brightness value variance S calculated from this 2 Therefore, the present invention selects the brightness value variance S 2 As a basis for judging abnormal fogging in the identification area.
[0062] In addition, considering that fogging abnormality will cause the window glass image to appear as a whole whitened effect, the purification device can also preferably perform a third filtering on each identification area A to E to determine the grayscale value of the area that is greater than the preset second grayscale threshold value X th2 The pixel ratio is used to represent the fog pixel ratio WA~WE of each recognition area A~E.
[0063] Taking the process of determining the fog pixel ratio WA in the identification area A as an example, the purification device can first analyze the grayscale image in the identification area A to determine the second average grayscale value X of multiple pixels therein. avg2 Afterwards, the purification device can be based on a preset conversion factor (for example: ), dynamically determine the corresponding second grayscale threshold X th2 ,Right now
[0064]
[0065] Afterwards, the purification device can identify the gray value X of each pixel in the area A. i One by one with the second gray threshold X th2 Compare to obtain the gray value in the identification area A greater than the second gray value threshold X th2 The number of fogged pixels RA is combined with the total number of pixels NA in the recognition area A to determine the proportion of fogged pixels WA in the recognition area A, that is,
[0066]
[0067] Similarly, the purification device can also calculate the proportion of fogged pixels WB~WE in the remaining identification areas B~E as described above, and then combine the two criteria of brightness value variance SA~SE and fogged pixel proportion WA~WE to accurately and reliably determine whether there is abnormal fogging in each identification area A~E.
[0068] Specifically, the purification device may only treat the brightness value variance S less than the preset brightness variance threshold S thAnd the proportion of fogged pixels W is greater than the preset proportion threshold W th The identified area is determined as a fogging abnormal area, and the vehicle window glass is purified according to the size and / or position of the fogging abnormal area.
[0069] For example, in response to the identification area C and the identification area D being determined as fogging abnormal areas (i.e., SC <SC th And SD <SD th And WC>WC th And WD>WD th ) judgment result, the purification device can determine that there is an abnormality of slight fogging on the vehicle window glass, and thus activate the low-level defogger function.
[0070] For another example, in response to the identification of areas A, B, C, and D being determined as fogging abnormal areas (ie, SA <SA th And SB <SB th And SC <SC th And SD <SD th And WA>WA th And WB>WB th And WC>WC th And WD>WD th ), the purification device can determine that there is a moderate fogging abnormality on the vehicle window glass, thereby turning on the mid-range defogger function and increasing the air volume of the defogger function on the basis of the above-mentioned low-range defogger.
[0071] For another example, in response to the identification of areas A, B, C, and D being determined as fogging abnormal areas (ie, SA <SA th And SB <SB th And SC <SC th And SD <SD th And SE <SE th And WA>WA th And WB>WB th And WC>WC th And WD>WD th And WE>WE th ), the purification device can determine that the vehicle window glass is severely fogged, thereby turning on the high-end defogger function, and further reducing the set temperature of the vehicle air-conditioning system on the basis of the above-mentioned mid-range defogger.
[0072] In this way, the present invention can adapt to the fogging pattern that the vehicle window glass first starts to fog from the lower corners C and D, then expands the fogging range from the upper corners A and B, until finally extending to the central area E, and quantitatively defogs and purifies the vehicle window glass to take into account both the defog effect and the energy loss caused by defog.
[0073] Those skilled in the art will appreciate that the above-mentioned operation of purifying the vehicle window glass is only a non-limiting implementation mode provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide a specific solution that is convenient for the public to implement, rather than to limit the scope of protection of the present invention.
[0074] Optionally, in other embodiments, those skilled in the art may also adopt other control rules to purify the vehicle window glass according to actual needs.
[0075] In summary, by executing the above steps, the present invention can automatically identify abnormal areas on the vehicle window glass and select a corresponding method to purify the vehicle window glass, thereby improving the convenience and safety of driving and reducing the occurrence of accidents.
[0076] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.
[0077] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for purifying vehicle window glass, characterized in that: The following steps are involved: Acquire a grayscale image of the vehicle window glass; Analyzing the grayscale image to determine abnormal areas in the vehicle window glass; as well as The vehicle window glass is cleaned according to the size and / or location of the abnormal area.
2. The purification method according to claim 1, characterized in that: The step of analyzing the grayscale image to determine the abnormal area in the vehicle window glass comprises: Performing a first filtering on the grayscale image to filter out bright areas whose grayscale values are greater than a preset first grayscale threshold and whose areas are greater than a preset first area threshold, so as to determine at least one dark area, wherein the bright area is composed of a plurality of adjacently arranged pixel points whose grayscale values are greater than the first grayscale threshold; Focusing the at least one dark area via a vehicle-mounted camera; and The dark area where the focus result is equal to the distance from the vehicle-mounted camera to the vehicle window glass is determined as the abnormal falling object area.
3. The purification method according to claim 2, characterized in that: Before performing the first filtering on the grayscale image, the purification method further comprises the following steps: Analyzing the grayscale image to determine a first average grayscale value of a plurality of pixels therein; and The first grayscale threshold is determined according to the first average grayscale value.
4. The purification method according to claim 2, characterized in that: Before focusing the at least one dark area via the vehicle-mounted camera, the purification method further comprises the following steps: Placing a calibration object at at least one calibration position on the vehicle window glass; Pre-focusing the calibration object via the vehicle-mounted camera; and According to the result of the pre-focusing, the distance between the vehicle-mounted camera and each of the calibration positions is determined.
5. The purification method according to claim 2, characterized in that: The step of focusing the at least one dark area via the vehicle-mounted camera comprises: Performing a second filtering on the at least one dark area to filter out the noise dark area whose area is smaller than a preset second area threshold, so as to determine a target dark area that affects observation; and The target dark area is focused via the vehicle-mounted camera.
6. The purification method according to claim 5, characterized in that: The step of focusing the target dark area via the vehicle-mounted camera comprises: Determining the coordinates of the center position of the target dark area according to the coordinates of a plurality of pixel points included in the target dark area; and The center position coordinates of the target dark area are focused via the vehicle-mounted camera.
7. The purification method according to claim 2, characterized in that: The step of purifying the vehicle window glass according to the size and / or position of the abnormal area comprises: In response to the size of the abnormal falling object area being greater than or equal to a preset second area threshold, a windshield washer nozzle and / or a windshield wiper are started to clean the vehicle window glass.
8. The purification method according to claim 1, characterized in that: A plurality of identification areas are predefined on the vehicle window glass, and the step of analyzing the grayscale image to determine the abnormal area in the vehicle window glass includes: Performing a third filtering on the identified area to determine a proportion of pixels having a grayscale value greater than a preset second grayscale threshold; Determining the variance of brightness values of a plurality of pixels in the identification area; and The identification area where the brightness value variance is less than the preset brightness variance threshold and the pixel point ratio is greater than the preset ratio threshold is determined as the fogging abnormal area.
9. The purification method according to claim 8, characterized in that: Before performing the third filtering on the identified area, the purification method further comprises the following steps: Analyzing the grayscale image in the identification area to determine a second average grayscale value of a plurality of pixels therein; and The second grayscale threshold is determined according to the second average grayscale value.
10. The purification method according to claim 8, characterized in that: The step of determining the brightness value variance of a plurality of pixel points in the identification area comprises: Acquire a vehicle window glass image in the identification area; Converting the window glass image into image data in NV21 YUV format; and According to the Y component in the image data in the NV21 YUV format, the brightness values of multiple pixels in the identification area are determined to calculate the brightness value variance.
11. The purification method according to claim 8, characterized in that: The lower left corner and the lower right corner of the vehicle window glass are respectively defined as a first identification area and a second identification area. The step of purifying the vehicle window glass according to the size and / or position of the abnormal area comprises: In response to the first recognition area and the second recognition area being determined as abnormal fogging areas, a defog function is activated.
12. The purification method according to claim 11, characterized in that: The upper left corner and the upper right corner of the vehicle window glass are further defined with a third identification area and a fourth identification area, respectively. The step of purifying the vehicle window glass according to the size and / or position of the abnormal area further includes: In response to the first recognition area, the second recognition area, the third recognition area and the fourth recognition area being determined as abnormal fogging areas, the air volume of the defogger function is increased.
13. The purification method according to claim 12, characterized in that: The center of the vehicle window glass is further defined with a fifth identification area, and the step of purifying the vehicle window glass according to the size and / or position of the abnormal area further comprises: In response to the first recognition area, the second recognition area, the third recognition area, the fourth recognition area, and the fifth recognition area being determined as abnormal fogging areas, a set temperature of the vehicle air conditioning system is reduced.
14. A vehicle window glass purification device, characterized in that: include: a memory having computer instructions stored thereon; as well as A processor is connected to the memory and is configured to execute computer instructions stored in the memory to implement the vehicle window glass purification method according to any one of claims 1 to 13.
15. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed by a processor, the vehicle window glass cleaning method according to any one of claims 1 to 13 is implemented.
