Raindrop fitting method, windshield wiper control method, device, equipment, medium and vehicle

Abstract

The invention relates to a raindrop fitting method, a windshield wiper control method and device, equipment, a medium and a vehicle. The raindrop fitting method comprises the following steps: acquiring a to-be-fitted image; performing raindrop region identification on the to-be-fitted image to obtain a plurality of raindrop regions, and determining the total number of the plurality of raindrop regions; for each raindrop region, determining the region area of the raindrop region; raindrop fitting is carried out based on the plurality of area areas of the plurality of raindrop areas and the total number of the plurality of raindrop areas, raindrop parameters of the to-be-fitted image are obtained, and the raindrop parameters comprise the raindrop number and the raindrop diameter. According to the embodiment of the invention, raindrop fitting can be carried out on the to-be-fitted image from the software level to obtain the raindrop number and the raindrop diameter, so that a rainfall sensor can be omitted, the hardware cost can be reduced, and the accuracy of the raindrop number and the raindrop diameter can be improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of vehicles, and in particular, to a raindrop fitting method, a windshield wiper control method, a device, a device medium, and a vehicle. Background Art

[0002] With the development of vehicle technology, for the control of windshield wipers on the front windshield of a vehicle, users are no longer satisfied with manually controlling the windshield wipers, but rather hope to be able to automatically control the windshield wipers to free up the user's hands. In view of this, more and more vehicles have begun to detect the amount of rainfall through a rain sensor. When there are raindrops on the outer surface of the front windshield, part of the light incident on the front windshield is scattered, and the light received by the receiving tube after reflection becomes less. The greater the amount of rainfall, the less light is reflected back. Then, based on the perception of the amount of rainfall by the rain sensor, the windshield wipers are automatically controlled to wipe.

[0003] However, sensing the amount of rainfall through a rain sensor will increase the hardware cost. And the ambient light during rain is usually quite different from the ambient light when the front windshield is dry. Therefore, the measurement result is greatly affected by the ambient light, resulting in a low measurement accuracy. Summary of the Invention

[0004] To solve the above technical problems, the present disclosure provides a raindrop fitting method, a windshield wiper control method, a device, a device, a medium, and a vehicle.

[0005] In a first aspect, the present disclosure provides a raindrop fitting method, including:

[0006] Obtain an image to be fitted;

[0007] Identify raindrop regions in the image to be fitted, obtain a plurality of raindrop regions, and determine the total number of the plurality of raindrop regions;

[0008] For each raindrop region, determine the region area of the raindrop region;

[0009] Perform raindrop fitting based on the plurality of region areas of the plurality of raindrop regions and the total number of the plurality of raindrop regions to obtain raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0010] In a second aspect, the present disclosure provides a windshield wiper control method, including:

[0011] Obtain a first current image, where the first current image is an image obtained by an image acquisition device currently performing image acquisition on a target region on the windshield;

[0012] Adopt the raindrop fitting method described in the first aspect to perform raindrop fitting on the first current image to obtain raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter;

[0013] Look up the target rainy-day image that matches the first current image in the database based on the raindrop parameters of the first current image, where multiple wiper gears and the rainy-day images associated with each wiper gear are recorded in the database;

[0014] If the target rainy-day image is found, look up the first target wiper gear associated with the target rainy-day image in the database;

[0015] Control the wiper to perform the wiping operation at the first target wiper gear.

[0016] In a third aspect, the present disclosure provides a raindrop fitting device, including:

[0017] A first acquisition module for acquiring an image to be fitted;

[0018] A first recognition module for recognizing raindrop regions in the image to be fitted, obtaining multiple raindrop regions, and determining the total number of the multiple raindrop regions;

[0019] A first determination module for determining the area of each raindrop region for each raindrop region;

[0020] A first fitting module for performing raindrop fitting based on the multiple area sizes of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain the raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0021] In a fourth aspect, the present disclosure provides a wiper control device, including:

[0022] A second acquisition module for acquiring a first current image, where the first current image is an image obtained by an image acquisition device currently performing image acquisition on a target area on the windshield;

[0023] A second fitting module for performing raindrop fitting on the first current image by using the raindrop fitting method described in the first aspect to obtain the raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter;

[0024] A first search module for looking up the target rainy-day image that matches the first current image in the database based on the raindrop parameters of the first current image, where multiple wiper gears and the rainy-day images associated with each wiper gear are recorded in the database;

[0025] A second search module for, if the target rainy-day image is found, looking up the first target wiper gear associated with the target rainy-day image in the database;

[0026] A first control module for controlling the wiper to perform the wiping operation at the first target wiper gear.

[0027] Fifth aspect, the present disclosure provides an electronic device, including:

[0028] a processor;

[0029] a memory for storing executable instructions;

[0030] wherein, the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the wiper control method described in the first aspect.

[0031] Sixth aspect, the present disclosure provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the wiper control method described in the first aspect.

[0032] The technical solutions provided by the embodiments of the present disclosure have the following advantages compared with the prior art:

[0033] The raindrop fitting method, wiper control method, device, equipment, medium and vehicle of the embodiments of the present disclosure can obtain an image to be fitted; identify raindrop regions in the image to be fitted to obtain a plurality of raindrop regions and determine the total number of the plurality of raindrop regions; for each raindrop region, determine the area of the raindrop region; perform raindrop fitting based on the areas of the plurality of raindrop regions and the total number of the plurality of raindrop regions to obtain raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter. It can be seen that by adopting the above technical solutions, raindrop fitting can be performed on the image to be fitted from the software level to obtain the number of raindrops and the raindrop diameter. In this way, a rain sensor can be omitted, reducing the hardware cost. And, by adopting the above technical solutions, raindrop fitting can be performed based on the areas of the plurality of raindrop regions and the total number identified from the image to be fitted to obtain the number of raindrops and the raindrop diameter, without the image in the dry condition being involved in raindrop fitting. Therefore, even if there is a difference in the ambient light when collecting the image to be fitted and the ambient light in the dry condition, it will not affect the accuracy of raindrop fitting. Therefore, the accuracy of the number of raindrops and the raindrop diameter can be improved. In this way, when the wiper is controlled based on the relatively high-accuracy number of raindrops and raindrop diameter subsequently, the working gear of the wiper can have a high matching degree with the rain condition, which is beneficial to improving the user experience. Description of the Drawings

[0034] In combination with the drawings and with reference to the following specific embodiments, the above and other features, advantages and aspects of the embodiments of the present disclosure will become more obvious. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and the original elements and elements are not necessarily drawn to scale.

[0035] Figure 1Shows a schematic flowchart of a raindrop fitting method provided by an embodiment of the present disclosure;

[0036] Figure 2 Shows a schematic flowchart of a windshield wiper control method provided by an embodiment of the present disclosure;

[0037] Figure 3 Shows a schematic flowchart of another windshield wiper control method provided by an embodiment of the present disclosure;

[0038] Figure 4 Shows a schematic structural diagram of a raindrop fitting device provided by an embodiment of the present disclosure;

[0039] Figure 5 Shows a schematic structural diagram of a windshield wiper control device provided by an embodiment of the present disclosure;

[0040] Figure 6 Shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Detailed Embodiments

[0041] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0042] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0043] The term "including" and its variations used herein are open-ended, that is, "including but not limited to". The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0044] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions executed by these devices, modules or units or their interdependent relationships.

[0045] It should be noted that the modifications of "one" and "multiple" mentioned in this disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0046] The names of the messages or information exchanged between multiple devices in the embodiments of this disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0047] The applicant has found through research that in the prior art, a rain sensor is usually used to detect rainfall to obtain the raindrop diameter and the number of raindrops. However, obtaining the raindrop diameter and the number of raindrops through a rain sensor will increase the hardware cost. And the ambient light during rain is usually quite different from the ambient light when the front windshield is dry. Therefore, the measurement result is greatly affected by the ambient light, resulting in low measurement accuracy. Moreover, the maximum rainfall detection area of the rain sensor is only about 200mm 2 or so. Generally, heavy rain conditions are relatively easy to identify. However, in the case of non - heavy rain conditions, especially for light rain conditions, since the size and density distribution of raindrops falling on the windshield are uneven, the degree of coincidence between the rainfall detected by the rain sensor and the actual rainfall within the driver's field of vision is often very low. As a result, there are often large errors between the expected wiper situation and the actual wiper situation under light rain conditions, and the expected satisfaction is low.

[0048] In addition, drivers have different tolerances and personal preferences for the amount of rain on the windshield. Some with stronger safety awareness hope to immediately wipe off the rain as soon as it starts and prefer to maintain a clear field of vision. Others are more vehicle - loving and think that a small amount of rain does not affect driving and hope to wipe when there is more rain, which is more friendly to the life of the wiper blade. And as the vehicle is used, the degree of dirt on the windshield surface and the aging state of the wiper blade are also constantly changing. The mapping relationship between the amount of rain and the wiper frequency formulated for a new car may no longer be applicable to the current vehicle situation. These reasons in multiple aspects make it difficult for related wiper automatic control methods to adapt to all user preference requirements, resulting in some people complaining about it being too slow and some complaining about it being too fast, or complaining about it wiping too early or too late, bringing troubles to users.

[0049] To solve at least some of the above problems, the embodiments of this disclosure provide a raindrop fitting method, a wiper control method, a device, a device, a medium, and a vehicle. Next, the wiper control method provided by the embodiments of this disclosure will be described first.

[0050] Figure 1 The flowchart of a raindrop fitting method provided by the embodiments of this disclosure is shown.

[0051] In some embodiments of this disclosure, Figure 1The described raindrop fitting method is applicable to scenarios for measuring rainfall, and can be executed by a raindrop fitting device. The raindrop fitting device can be implemented by hardware and / or software, and can be applied to vehicles, etc., without specific limitation in this regard.

[0052] As Figure 1 shown, the raindrop fitting method may include the following steps.

[0053] S110. Obtain the image to be fitted.

[0054] In some embodiments, the raindrop fitting device may be connected to an image acquisition device. Among them, the image acquisition device may include a camera, a webcam, etc., but is not limited thereto. In this way, the image acquisition device can perform image acquisition on the target area on the windshield and send the acquired image (i.e., the image to be fitted) to the raindrop fitting control device.

[0055] Of course, in some other embodiments, the image to be fitted can be read from a storage device (such as a USB flash drive, etc.).

[0056] S120. Identify raindrop regions in the image to be fitted, obtain multiple raindrop regions, and determine the total number of the multiple raindrop regions.

[0057] S130. For each raindrop region, determine the area of the raindrop region.

[0058] Specifically, the applicant has observed that raindrops usually distribute in patches when landing on the windshield. Therefore, each region where raindrops are located in the image to be fitted can be separately identified to obtain multiple raindrop regions, and the area occupied by each raindrop region (i.e., the area of the region) can be determined, and the total number of the multiple raindrop regions can be counted.

[0059] S140. Perform raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain the raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0060] In some embodiments, S140 may include:

[0061] S1411. For each raindrop region, divide the area of the region by the preset standard raindrop area and take the integer to obtain the standard raindrop fitting number, where the standard raindrop area is the area of a standard raindrop with a preset diameter and in a circular shape.

[0062] It should be noted that the specific value of the preset diameter can be set by those skilled in the art according to the actual situation, and is not limited here. For example, the preset diameter can be less than or equal to 1 mm, etc., but is not limited thereto.

[0063] Specifically, divide the area of the region by the pre-set standard raindrop area and then round up. It can be rounding up to the next integer. For example, if the result of dividing the area of the region by the pre-set standard raindrop area is 0.9, it can be rounded up to 1; it can also be rounding down to the nearest integer. For example, if the result of dividing the area of the region by the pre-set standard raindrop area is 2.2, it can be rounded down to 2; it can also be rounding to the nearest integer, and there is no limitation on this.

[0064] Specifically, divide the area of the region by the pre-set standard raindrop area and then round up to obtain the standard raindrop fitting quantity. The raindrop region can be equivalent to the standard raindrop fitting quantity of standard raindrops. In this way, the independent and irregular raindrop regions in the image can all be characterized by standard raindrops that are circular and have a unified diameter.

[0065] S1412. In the pre-set raindrop parameter table, search for the raindrop parameters associated with the total quantity and the standard raindrop fitting quantity of multiple raindrop regions, and use them as the raindrop parameters of the image to be fitted.

[0066] Specifically, the database also records a pre-set raindrop parameter table, which records the association relationship among the total quantity of multiple raindrop regions, the standard raindrop fitting quantity of multiple raindrop regions, and the raindrop parameters. Therefore, the raindrop parameters of the image to be fitted can be obtained by querying this raindrop parameter table.

[0067] It should be noted that the acquisition method of the pre-set raindrop parameter table can be set by those skilled in the art according to the actual situation, and there is no limitation here. For example, a large number of rainy-day images can be obtained in advance as samples, and for each rainy-day image in this large number of rainy-day images, obtain the total quantity of its corresponding multiple raindrop regions and the standard raindrop fitting quantity of multiple raindrop regions, and obtain its corresponding raindrop parameters through iterative optimization experiments, so as to obtain the pre-set raindrop parameter table, but it is not limited to this.

[0068] Optionally, after SS1411, it can also include: for each raindrop region, if the standard raindrop fitting quantity of the raindrop region is greater than the pre-set quantity threshold, multiply the standard raindrop fitting quantity by a pre-set proportionality coefficient to obtain an updated standard raindrop fitting quantity, where the proportionality coefficient is less than 1. Correspondingly, S1412 can include: in the pre-set raindrop parameter table, query the raindrop parameters associated with the total quantity and the updated standard raindrop fitting quantity of multiple raindrop regions, and use them as the raindrop parameters of the image to be fitted.

[0069] It should be noted that the specific value of the preset proportionality coefficient can be set by those skilled in the art according to the actual situation, and is not limited herein. For example, multiple values can be evenly selected from 0 to 1 as candidate proportionality coefficients, and experiments can be carried out for these multiple candidate proportionality coefficients. The candidate proportionality coefficient with the best correction effect on the number of standard raindrop fittings is used as the preset proportionality coefficient, but it is not limited thereto.

[0070] It can be understood that the applicant considers that raindrops that are gathered without gaps, have overlapping raindrop areas, or are gathered together and flowing down as rainwater have less impact on the field of view than raindrops adjacent with small gaps. In other words, when multiple raindrops are gathered, the impact on the field of view is smaller. For this situation, the corresponding number of standard raindrop fittings obtained equivalently can be appropriately reduced. In the embodiments of the present disclosure, by setting that if the number of standard raindrop fittings in the raindrop region is greater than the preset number threshold, the number of standard raindrop fittings is multiplied by the preset proportionality coefficient, the number of standard raindrop fittings can be optimized by reduction, so that the impact degree of the raindrop region on the field of view and the equivalently obtained number of standard raindrop fittings are more matched, which is beneficial to making the raindrop parameters of the to-be-fitted image obtained by fitting more accurate.

[0071] Certainly, in some other embodiments, the total number and the number of standard raindrop fittings in multiple raindrop regions can also be input into a pre-trained query model to obtain the raindrop parameters of the to-be-fitted image output by the query model.

[0072] It can be understood that for each raindrop region, the area of the raindrop region is determined, and after dividing the area of the raindrop region by the preset standard raindrop area and taking the integer, the number of standard raindrop fittings is obtained; then, in the preset raindrop parameter table, the raindrop parameters associated with the total number of multiple raindrop regions in the to-be-fitted image and the number of standard raindrop fittings in multiple raindrop regions are searched for and used as the raindrop parameters of the to-be-fitted image. In this way, the method of raindrop fitting for the to-be-fitted image can be simple, convenient, more in line with the actual raindrop shape and distribution, and is beneficial to reducing the implementation difficulty of raindrop fitting.

[0073] In some other embodiments, S140 may include:

[0074] S1421. Taking the average of the areas of multiple raindrop regions to obtain the average area.

[0075] S1422. Summing up the areas of multiple raindrop regions to obtain the total area.

[0076] S1423. Determining the fitting raindrop diameter corresponding to the fitting raindrop with an area equal to the average area and in a circular shape, and using it as the raindrop diameter of the to-be-fitted image.

[0077] Specifically, the fitting raindrop diameter can be calculated based on the following formula:

[0078]

[0079] Among them, d1 is the fitted raindrop diameter corresponding to the average area, and S1 is the average area.

[0080] S1424. Divide the total area by the average area and round up to obtain the number of raindrops in the image to be fitted.

[0081] Specifically, dividing the total area by the average area and rounding up can be rounding up to the next integer. For example, if the result of dividing the total area by the average area is 15.8, it can be rounded up to 16; it can also be rounding down to the nearest integer. For example, if the result of dividing the total area by the average area is 24.2, it can be rounded down to 24; it can also be rounding to the nearest integer, and there is no limitation on this.

[0082] It can be understood that by averaging and summing the areas of multiple raindrop regions respectively, the average area and the total area are obtained, and the fitted raindrop diameter corresponding to the fitted raindrop with an area equal to the average area and in a circular shape (i.e., the raindrop diameter of the image to be fitted) is determined. Moreover, dividing the total area by the average area and rounding up to obtain the number of raindrops in the image to be fitted. In this way, the morphology of most raindrops in the image to be fitted can be better reflected, and the aggregated raindrops are disassembled, which is beneficial to improving the accuracy of raindrop fitting.

[0083] In some other embodiments, S140 may include:

[0084] S1431. Take the total number as the number of raindrops in the image to be fitted.

[0085] In this way, it can be considered that one raindrop region represents one raindrop.

[0086] S1432. Sum the areas of multiple raindrop regions to obtain the total area.

[0087] S1433. Divide the total area by the total number to obtain the fitted raindrop area of the image to be fitted.

[0088] S1434. Determine the fitted raindrop diameter corresponding to the fitted raindrop with an area equal to the fitted raindrop area and in a circular shape, and use it as the raindrop diameter of the image to be fitted.

[0089] Specifically, the fitted raindrop diameter can be calculated based on the following formula:

[0090]

[0091] Among them, D2 is the fitted raindrop diameter corresponding to the fitted raindrop area, and S2 is the fitted raindrop area.

[0092] It can be understood that by considering a raindrop region as representing a raindrop and taking the total number of multiple raindrop regions in the image to be fitted as the raindrop number, the raindrop number in the image to be fitted can better reflect the distribution of raindrops in the image to be fitted. And by dividing the total area of multiple raindrop regions by the total number, the fitted raindrop area of the image to be fitted is obtained, and based on the fitted raindrop area, the raindrop diameter of the image to be fitted is fitted. In this way, the raindrops in the image to be fitted can better reflect the shape of raindrops in the image to be fitted, which is beneficial to improving the accuracy of raindrop fitting.

[0093] In the embodiments of the present disclosure, raindrop fitting can be performed on the image to be fitted from the software level to obtain the raindrop number and the raindrop diameter. In this way, the rain gauge sensor can be omitted, reducing the hardware cost. Moreover, by adopting the above technical solution, raindrop fitting can be performed based on the multiple regional areas and the total number of multiple raindrop regions identified from the image to be fitted to obtain the raindrop number and the raindrop diameter, without the image in the dry condition being involved in raindrop fitting. Therefore, even if there are differences between the ambient light when the image to be fitted is collected and the ambient light in the dry condition, it will not affect the accuracy of raindrop fitting. Therefore, the accuracy of the raindrop number and the raindrop diameter can be improved. In this way, when the wiper is controlled based on the relatively high-accuracy raindrop number and raindrop diameter subsequently, the working gear of the wiper can have a high matching degree with the rain condition, which is beneficial to improving the user experience.

[0094] Figure 2 The flowchart of a wiper control method provided by the embodiments of the present disclosure is shown.

[0095] In some embodiments of the present disclosure, Figure 2 the shown wiper control method is applicable to the scenario of automatically controlling the wiper to wipe, and can be executed by a wiper control device. The wiper control device can be implemented by hardware and / or software, and can be applied to vehicles, etc., without specific limitation.

[0096] Such as Figure 2 shown, the wiper control method may include the following steps.

[0097] S210. Obtain a first current image, where the first current image is an image obtained by an image acquisition device currently performing image acquisition on a target area on the windshield.

[0098] In the embodiments of the present disclosure, the wiper control device can be connected to the image acquisition device. Among them, the image acquisition device can include a camera, a camera head, etc., but is not limited thereto. In this way, the image acquisition device can perform image acquisition on the target area on the windshield and send the acquired image to the wiper control device.

[0099] Specifically, the applicant considered that when the windshield wiper is working, the raindrops on the windshield are in a cycle of being wiped off and gradually increasing, and then being wiped off again and gradually increasing. Among them, the amount of rain that increases or accumulates between the last time it is wiped off and the next time it is wiped off varies due to the change of rain conditions. To make the image collected by the image acquisition device more reference-worthy, the target area should avoid the interference of the windshield wiper as much as possible. Therefore, the target area should be avoided in the overlapping area of the main and auxiliary windshield wipers. In other words, the target area should be selected in the non-overlapping area of the main and auxiliary windshield wipers, that is, the area in the wiping area of the main windshield wiper that does not overlap with the wiping area of the auxiliary windshield wiper, or the area in the wiping area of the auxiliary windshield wiper that does not overlap with the wiping area of the main windshield wiper. Further, the applicant considered that the larger the area of the target area, the shorter the time for rain accumulation without being interfered by the windshield wiper, and the greater the disturbance factor. Therefore, the size of the target area should not be too large. The target area can be set as a rectangular area within the non-overlapping area, where the length of the target area is greater than or equal to 260 mm and less than or equal to 300 mm, and the width of the target area is greater than or equal to 230 mm and less than or equal to 270 mm. Further, the applicant considered that compared with other areas on the windshield (such as the area directly in front of the co-pilot's field of vision), the rain accumulation in the area directly in front of the driver's field of vision has a greater impact on the driver's observation of the road conditions. Therefore, the target area can be set as a rectangular area with a preset size directly in front of the driver's field of vision in Area A on the windshield. The preset size can be, for example, 280 mm * 250 mm, but is not limited thereto.

[0100] Optionally, obtaining the first current image includes: when the wiper blade is scraping upward and is still a preset angle away from entering the scraping area, controlling the image acquisition device to perform image acquisition on the target area to obtain the first current image.

[0101] It should be noted that the specific value of the preset angle can be set by those skilled in the art according to the actual situation and is not limited here. For example, the preset angle is 5 degrees, but is not limited thereto.

[0102] Specifically, the scraping angle can be measured in real time by a Hall angle sensor built in the output shaft of the electronic windshield wiper motor gearbox and sent to the windshield wiper control device in real time. In this way, when the windshield wiper control device determines that the wiper blade is scraping upward and is still a preset angle away from entering the scraping area based on the scraping angle, it can send an acquisition instruction to the image acquisition device to control the image acquisition device to perform image acquisition on the target area on the windshield, but is not limited thereto.

[0103] It can be understood that the applicant considers that in order to avoid the possibility that the collected images may not reflect the periodic rainfall changes (i.e., the rainfall increase from the last time it was wiped off to the next time it was wiped off), or that some areas in the collected images are wiped off by the wiper blades and the rainfall accumulation cannot be reflected. In each image acquisition cycle, the time point for the image acquisition device to acquire images should be limited. In the embodiments of the present disclosure, image acquisition is performed at the time point when the wiper blade is swiping upward and at a preset angle swiping position before entering the swiping area, so that the images can accurately reflect the periodic rainfall changes and avoid the situation where some areas in the images are wiped off by the wiper blades.

[0104] S220. Use a preset raindrop fitting method to fit the raindrops in the first current image to obtain the raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0105] In some embodiments, the preset raindrop fitting method can be any raindrop fitting method shown in the previous embodiments of the present disclosure.

[0106] Of course, in some other embodiments, S220 may include: inputting the first current image into a trained raindrop fitting model for raindrop fitting to obtain the raindrop diameter and the number of raindrops output by the raindrop fitting model.

[0107] S230. Based on the raindrop parameters of the first current image, search in the database for the target rainy-day image that matches the first current image, where the database records multiple wiper gears and the rainy-day images associated with each wiper gear.

[0108] Specifically, different wiper gears correspond to different swiping parameters, where the swiping parameters include the swiping frequency, etc., but are not limited thereto.

[0109] It should be noted that the swiping parameters corresponding to each wiper gear can be set by those skilled in the art according to the actual situation, and no limitation is made thereto.

[0110] Exemplarily, the database may include the following eight wiper gears: Gear 1: 5s intermittent, Gear 2: 3.5s intermittent, Gear 3: 2.5s intermittent, Gear 4: 1s intermittent, Gear 5: low speed 42rad / s, Gear 6: low speed 45rad / s, Gear 7: high speed 55rad / s, Gear 8: high speed 60rad / s.

[0111] Specifically, the rainy-day image is an image obtained by acquiring an image of a target area on the windshield in the case of rain.

[0112] Specifically, the association between a certain wiper gear and a certain rainy-day image indicates that in the rain condition corresponding to the rainy-day image, the wiper should be controlled to perform the swiping operation at that wiper gear.

[0113] Optionally, each wiper gear is associated with multiple rainy-day images, and the multiple rainy-day images correspond to different raindrop diameters and / or raindrop parameters. In this way, a large number of rainy-day images corresponding to different rain conditions can be recorded in the database, and the wiper gears corresponding to these rainy-day images are also recorded. Since the rainy-day images in the database are relatively rich, it is beneficial to find a target rainy-day image with a high similarity to the first current image, and further make the first target wiper gear determined based on the target rainy-day image better match the current rain condition.

[0114] It should be noted that the rainy-day images associated with each wiper gear can be set by those skilled in the art according to actual situations, and there is no limitation in this regard. Exemplarily, as shown in Table 1 below, gear 1 is associated with images 11, 12, 13, 14, and 15. Among them, these 5 rainy-day images correspond to different raindrop diameters and / or raindrop numbers. For other gears, the understanding can refer to gear 1, and details will not be elaborated here.

[0115] Table 1

[0116]

[0117] In some embodiments, optionally, the database also records multiple rainfall categories, the rainfall categories associated with each wiper gear, and the rainy-day images associated with each rainfall category. The multiple rainfall categories include multiple rainfall categories belonging to the light rain condition. Further optionally, the multiple rainfall categories may further include at least one rainfall category belonging to the moderate rain condition and / or at least one rainfall category belonging to the heavy rain condition.

[0118] Specifically, different rainfall categories may correspond to different raindrop diameter ranges, may also correspond to different raindrop number ranges, or may further correspond to different raindrop diameter ranges and raindrop number ranges. Among them, the raindrop diameter range is obtained by dividing the possible raindrop diameters in the target area, and the raindrop number range is obtained by dividing the possible raindrop numbers in the target area.

[0119] Among them, the multiple rainfall categories belonging to the light rain condition mentioned here mean that although these rainfall categories all correspond to the light rain condition, they correspond to different raindrop diameter ranges and / or raindrop number ranges. Similarly, when the database records multiple rainfall categories belonging to the moderate rain condition and multiple rainfall categories belonging to the heavy rain condition, the understanding of "multiple rainfall categories belonging to the moderate rain condition" and "multiple rainfall categories belonging to the heavy rain condition" can refer to "multiple rainfall categories belonging to the light rain condition", and details will not be elaborated here.

[0120] It should be noted that the ranges of raindrop diameters and the ranges of raindrop numbers corresponding to each rainfall category can be set by those skilled in the art according to actual situations, and no limitations are imposed thereon. Exemplarily, as shown in Table 2 below, the raindrop diameters can be divided into the following four ranges: a1, a2, c1, and c2, and the raindrop numbers can be divided into the following four ranges: b1, b2, d1, and d2. Then, the following 16 rainfall categories can be divided: a1b1, a1b2, a1d1, a1d2, a2b1, a2b2, a2d1, a2d2, c1b1, c1b2, c1d1, c1d2, c2b1, c2b2, c2d1, c2d2.

[0121] Table 2

[0122] Serial number Raindrop diameter range (mm) Raindrop quantity range (pcs) 1 a1：≤2 b1：≤25 2 a2: 2 - 3 (including 3) b2: 25 - 40 (including 25mm) 3 c1: 3 - 4 (excluding 4) d1: 40 - 60 (excluding 60mm) 4 c2：≥4 d2：≥60

[0123] Specifically, in the initial database (i.e., the database before being updated according to user preferences), each windshield wiper gear is associated with at least one rainfall category, each rainfall category is associated with at least one rainy-day image, and if a certain rainy-day image is associated with a certain rainfall category, and this rainfall category is associated with a certain windshield wiper gear, then the raindrop diameter of this rainy-day image falls within the range of raindrop diameters corresponding to this rainfall category, the raindrop number of this rainy-day image falls within the range of raindrop numbers corresponding to this rainfall category, and this rainy-day image is associated with this windshield wiper gear, where the raindrop diameter and the number of raindrops in the rainy-day image are obtained by fitting raindrops in the rainy-day image.

[0124] In some examples, optionally, at least one rainfall category is associated with multiple rainy-day images corresponding to different raindrop diameters and / or raindrop numbers.

[0125] It can be understood that one rainfall category corresponds to one range of raindrop diameters and one range of raindrop numbers, and different raindrop diameters and / or different specific values of raindrop numbers correspond to different rain conditions. For example, for the rainfall category a1b1, the rain conditions corresponding to a raindrop diameter of 1.5 and a raindrop number of 20 are different from those corresponding to a raindrop diameter of 2 and a raindrop number of 20. Therefore, setting a rainfall category to be associated with multiple rainy-day images corresponding to different raindrop diameters and / or raindrop numbers can cover as many rain conditions as possible under this rainfall category. In this way, the rainy-day images in the database can cover more rain conditions, which is beneficial to making the rain condition corresponding to the target rainy-day image found subsequently closer to the rain condition corresponding to the first current image, and further making the first target windshield wiper gear determined subsequently more matched with the rain condition corresponding to the first current image.

[0126] Further optionally, for each rainfall category belonging to the light rain working condition, it is associated with multiple rainy-day images corresponding to different raindrop diameters and / or raindrop numbers.

[0127] It can be understood that users are more sensitive to different rainfall categories under light rain conditions. For example, users can perceive the difference between a1b1 and a1b2, and users may also be able to perceive different rainfall conditions within the same rainfall category. For example, users can perceive the difference between the following two rainfall conditions: the rainfall condition corresponding to a raindrop diameter of 1.5 and a raindrop number of 20, and the rainfall condition corresponding to a raindrop diameter of 2 and a raindrop number of 20. Therefore, in the embodiments of the present disclosure, by setting that each rainfall category belonging to the light rain condition is associated with a plurality of rainy day images corresponding to different raindrop diameters and / or raindrop numbers, a large number of rainy day images belonging to the light rain condition can be included in the database, which is beneficial to making the rainfall condition corresponding to the target rainy day image found subsequently closer to the rainfall condition corresponding to the first current image, and further making the first target wiper gear determined subsequently more matched with the rainfall condition corresponding to the first current image.

[0128] It should be noted that those skilled in the art can set the rainfall categories and rainy day images associated with each wiper gear, as well as the rainy day images associated with each rainfall category, according to the actual situation, and this is not limited herein. Exemplarily, as shown in Table 3 below, gear 1 is associated with a1b1, a1b1 is associated with images 11, 12, 13, 14, 15, and gear 1 is associated with images 11, 12, 13, 14, 15. Among them, the 5 rainy day images associated with a1b1 correspond to different raindrop diameters and / or raindrop numbers. For other gears, it can be understood with reference to gear 1, and details are not described herein again. It should also be noted that considering that no rain is also a common working condition, therefore, a rainy day image corresponding to no rain should be included in the rainy day images associated with gear 1.

[0129] Table 3

[0130]

[0131]

[0132] It can be understood that considering that users are more sensitive to different rainfall categories under light rain conditions than under heavy rain conditions. For example, although both are light rain conditions, users can distinguish between a light rain condition with slightly larger but sparser raindrops and a light rain condition with slightly smaller but denser raindrops. Therefore, the database records multiple rainfall categories with different raindrop diameter ranges and / or raindrop number ranges for light rain conditions. In this way, it is beneficial to make the rainfall condition corresponding to the target rainy day image found closer to the rainfall condition corresponding to the first current image, and further make the first target wiper gear determined based on the target rainy day image more in line with the current rainfall condition, further improving the matching between the actual wiping situation of the wiper and the current rainfall condition.

[0133] Of course, in some other examples, optionally, at least one rainfall category is associated with a plurality of rainy day images corresponding to different ambient light conditions.

[0134] Further optionally, for each rainfall category belonging to the light rain condition, multiple images are associated therewith, and the multiple images include rainy day images with the same raindrop diameter and raindrop number but corresponding to different ambient lights.

[0135] Specifically, different ambient lights may include: gloomy weather, various street lights at different distances, oncoming vehicles at night, no street lights at night, white rainy weather, sun shower weather, etc., but are not limited thereto.

[0136] Exemplarily, for the rainfall category a1b1, the associated rainy day images include 6 rainy day images with a raindrop diameter of 1.5 and a raindrop number of 20, and the 6 rainy day images respectively correspond to gloomy weather, various street lights at different distances, oncoming vehicles at night, no street lights at night, white rainy weather, sun shower weather.

[0137] Specifically, the target rainy day image is a rainy day image whose image similarity with the first current image is greater than a preset similarity threshold. It should be noted that the specific value of the preset similarity threshold can be set by those skilled in the art according to the actual situation and is not limited herein.

[0138] In some embodiments, S230 may include: determining the image similarity between the first current image and the rainy day images in the database based on the raindrop parameters of the first current image and the rainy day images in the database, and determining the rainy day images with an image similarity greater than the preset similarity threshold as the target rainy day images.

[0139] It should be noted that the specific value of the preset similarity threshold can be set by those skilled in the art according to the actual situation and is not limited herein.

[0140] Specifically, the raindrop parameters of the rainy day images in the database may be pre-recorded in the database or calculated in real time when calculating the image similarity, and this is not limited.

[0141] In an example, the process of calculating the image similarity between the first current image and the rainy day image may include: determining the diameter difference based on the raindrop diameter of the first current image and the raindrop diameter of the rainy day image, and determining the quantity difference based on the raindrop number of the first current image and the raindrop number of the rainy day image; calculating the image similarity based on the diameter difference and the quantity difference, where both the diameter difference and the quantity difference are inversely proportional to the image similarity, or, in a pre-established similarity table, looking up the image similarity associated with the diameter difference and the quantity difference, where the pre-established similarity table records the association relationship among the diameter difference, the quantity difference, and the image similarity.

[0142] It can be understood that determining the rainy day images with an image similarity greater than the preset similarity threshold as the target rainy day images can quickly find the target rainy day images.

[0143] In some other embodiments, S230 may include: determining an image similarity between the first current image and the rainy-day images in the database based on the raindrop parameters of the first current image and the rainy-day images in the database, and determining the rainy-day image with the maximum image similarity and with the image similarity greater than a preset similarity threshold as the target rainy-day image.

[0144] It can be understood that by determining the rainy-day image with the maximum image similarity and with the image similarity greater than a preset similarity threshold as the target rainy-day image, the rain condition corresponding to the target rainy-day image can be closer to the rain condition corresponding to the first current image, and further, the first target windshield wiper gear determined subsequently can be more matched with the rain condition corresponding to the first current image.

[0145] It can also be understood that calculating the image similarity between the first current image and the rainy-day image based on the raindrop diameter and raindrop number of the first current image and the raindrop diameter and raindrop number of the rainy-day image can make the calculation of the image similarity between the two more focused on the similarity between the two in terms of raindrops. Thus, it is beneficial to find a target rainy-day image that is more matched with the raindrop shape and distribution in the first current image.

[0146] In some other embodiments, S230 may include: obtaining a second current image, where the image acquisition device periodically acquires images of a target area on the windshield, and the second current image is an image obtained by the image acquisition device acquiring images of the target area on the windshield in the next acquisition cycle after acquiring the first current image; determining an image similarity between the first current image and the rainy-day images in the database based on the raindrop parameters of the first current image and the rainy-day images in the database, and determining the rainy-day images with the image similarity greater than a preset similarity threshold as the first candidate rainy-day images; performing raindrop fitting on the first current image to obtain the raindrop parameters of the second current image, and determining an image similarity between the second current image and the rainy-day images in the database based on the raindrop parameters of the second current image and the rainy-day images in the database, and determining the rainy-day images with the image similarity greater than a preset similarity threshold as the second candidate rainy-day images; if the first candidate rainy-day image and the second candidate rainy-day image are associated with the same windshield wiper gear, then taking the first candidate rainy-day image as the target rainy-day image, otherwise, determining that no target rainy-day image is found. Of course, for the first current image, the rainy-day image with the maximum image similarity and greater than a preset similarity threshold can also be determined as the first candidate rainy-day image. Similarly, for the second current image, the rainy-day image with the maximum image similarity and greater than a preset similarity threshold can also be determined as the second candidate rainy-day image.

[0147] Specifically, regarding how to calculate the "image similarity between the second current image and the rainy day images in the database", please refer to the previous description on how to calculate the "image similarity between the first current image and the rainy day images in the database", which will not be repeated here.

[0148] It is understandable that the applicant has considered that in real life scenarios, there are "fake rain" conditions, such as encountering a short period of heavy rain, or a vehicle passing under a dripping building or tree. At this time, one wiper cycle can solve the problem, and there is no need to change the wiper gear. At the same time, since the candidate rainy day image is searched for the first current image and the second current image respectively, the processing time is about 1s-1.5s, which is within the acceptable time for most users. In the embodiment of the present disclosure, when the first candidate rainy day image and the second candidate rainy day image are associated with the same wiper gear, the first candidate rainy day image is used as the target rainy day image, and the rainfall is considered to have changed and is adopted. In this way, the "fake rain" can be wiped off, and the problem of switching the wiper gear back and forth in a short period of time can be avoided. It can also avoid the problem that the user is annoyed because the wiper gear cannot be quickly switched back to the original wiper gear after switching the wiper gear due to "fake rain".

[0149] S240: If the target rainy day image is found, searching a database for a first target wiper gear position associated with the target rainy day image.

[0150] Specifically, the first target wiper gear is a wiper gear associated with the target rainy day image.

[0151] In some embodiments, S240 may include: searching for a first target wiper gear position associated with the target rainy day image based on the rainy day image associated with each wiper gear position recorded in the database.

[0152] In other embodiments, as described above, the database also records a plurality of rainfall categories, as well as the rainfall category associated with each wiper position, and the rainy day image associated with each rainfall category, and different rainfall categories correspond to different raindrop diameter ranges and / or raindrop quantity ranges. In the initial database (i.e., the database before the database is updated according to user preferences), the first target wiper position is the wiper position associated with the rainfall category associated with the target rainy day image. At this time, S240 may include: based on the rainy day image associated with each rainfall category recorded in the database, searching for the rainfall category associated with the target rainy day image, and then based on the rainfall category associated with each wiper position recorded in the database, searching for the first target wiper position associated with the target rainy day image, so that the first target wiper position can be quickly found.

[0153] S250: Control the windshield wiper to perform wiping operation at a first target wiper gear position.

[0154] Optionally, if the target rainy-day image is not found, the current wiper gear of the wiper remains unchanged.

[0155] In the embodiment of the present disclosure, a target rainy-day image matching the first current image can be searched in the database based on the raindrop parameters of the first current image. Since the first current image and the target rainy-day image match, the raindrop parameters of the first current image and the target rainy-day image are similar, and the rain conditions corresponding to the first current image and the target rainy-day image are similar. Therefore, the wiper gear associated with the target rainy-day image is used as the first target wiper gear, and the wiper is controlled to perform the wiping operation at the first target wiper gear, which can make the current working gear of the wiper highly matched with the current rain condition, thus being beneficial to improving the user experience.

[0156] Figure 3 The flowchart of another wiper control method provided by the embodiment of the present disclosure is shown. The embodiment of the present disclosure is optimized on the basis of the above embodiment, and the embodiment of the present disclosure can be combined with each optional solution in one or more of the above embodiments.

[0157] As Figure 3 shown, the wiper control method may include the following steps.

[0158] S310. Obtain a first current image, where the first current image is an image obtained by an image acquisition device currently performing image acquisition on a target area on the windshield.

[0159] Specifically, S310 is similar to S110 and will not be described in detail here.

[0160] S320. Use a preset raindrop fitting method to perform raindrop fitting on the first current image to obtain the raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0161] Specifically, S320 is similar to S120 and will not be described in detail here.

[0162] S330. Search in the database for a target rainy-day image that matches the first current image based on the raindrop parameters of the first current image, where the database records multiple wiper gears and the rainy-day images associated with each wiper gear.

[0163] Specifically, S530 is similar to S130 and will not be described in detail here.

[0164] S340. If the target rainy-day image is found, search in the database for the first target wiper gear associated with the target rainy-day image.

[0165] Specifically, S540 is similar to S140 and will not be described in detail here.

[0166] S350. Control the wiper to perform a wiping operation at the first target wiper gear.

[0167] Specifically, S550 is similar to S150, and will not be described in detail here.

[0168] S360. When the adjustment is effective, in response to receiving a user's adjustment operation on the working gear of the wiper, determine the second target wiper gear, and control the wiper to perform a wiping operation at the second target wiper gear.

[0169] In some embodiments, the adjustment is effective immediately after S550, that is, no limit is set on the effectiveness of the adjustment.

[0170] In other embodiments, the method further includes: real-time detecting a first continuous wiping duration during which the wiper continuously wipes at the first target wiper gear; when the first continuous wiping duration reaches a first preset duration threshold, determining that the adjustment is effective, and when the first continuous wiping duration is less than the first preset duration threshold, determining that the adjustment is ineffective.

[0171] Specifically, the first continuous wiping duration refers to the duration elapsed from the moment when S550 changes the wiper gear to the first target wiper gear to the current moment.

[0172] It should be noted that the specific value of the first preset duration threshold can be set by those skilled in the art according to actual situations, and is not limited thereto. For example, the first preset duration threshold can be 1 minute, but is not limited to this.

[0173] It can be understood that based on the applicant's experience in solving after-sales problems and contact with users, users will only manually adjust the wiper gear when the first target wiper gear does not meet their highest tolerance limit, and will not manually adjust the wiper gear when the wiper just starts to operate at the first target wiper gear. In addition, users may accidentally adjust the wiper gear. Based on the above considerations, the embodiments of the present disclosure set a first preset duration threshold to filter out some misoperations and gear update intentions that are not actually expected by users.

[0174] In some embodiments, in response to receiving a user's adjustment operation on the working gear of the wiper, determining the second target wiper gear includes: starting from when the adjustment is effective, each time the user makes at least one adjustment to the working gear of the wiper, the corresponding wiper gear for each adjustment can be used as the second target wiper gear.

[0175] In some other embodiments, in response to receiving a user's operation of adjusting the working gear of the windshield wiper, determining a second target windshield wiper gear includes: starting from when the adjustment becomes effective, if the user adjusts the working gear of the windshield wiper at least once within a preset duration, taking the windshield wiper gear corresponding to the last adjustment as the second target windshield wiper gear. Of course, in still some other embodiments, the windshield wiper gear corresponding to the last adjustment can also be taken as a candidate windshield wiper gear, and the second continuous wiping duration during which the windshield wiper continuously wipes at the candidate windshield wiper gear is detected in real time; when the second continuous wiping duration reaches a second preset duration threshold, taking the candidate windshield wiper gear as the second target windshield wiper gear.

[0176] It should be noted that those skilled in the art can set the specific values of the preset duration and the second preset duration threshold according to the actual situation, and no limitation is imposed thereon. For example, the preset duration can be 20 seconds, and the second preset duration threshold is 1 minute, but it is not limited thereto.

[0177] It can be understood that the applicant considers that the windshield wiper gear adjusted by the user for the first time may not be the one he thinks he most wants, and he may continue to make a second adjustment. In addition, there may also be a situation of accidental triggering of the gear adjustment. In order to filter out the above situations, in the embodiments of the present disclosure, by setting the windshield wiper gear corresponding to the user's last adjustment within the preset duration as the second target windshield wiper gear, the second target windshield wiper gear can be the windshield wiper gear that the user most wants to use for the current rain condition.

[0178] It can also be understood that when the user adjusts to a windshield wiper gear and does not continue to adjust for a period of time, it is considered that the user is satisfied with the windshield wiper gear, so it is considered that the windshield wiper gear is a reasonable gear that he thinks in the current rain condition. Therefore, in the embodiments of the present disclosure, first taking the windshield wiper gear corresponding to the last adjustment as a candidate windshield wiper gear, and then when the second continuous wiping duration during which the subsequent windshield wiper continuously wipes at the candidate windshield wiper gear reaches the second preset duration threshold, taking the candidate windshield wiper gear as the second target windshield wiper gear. In this way, the windshield wiper gear that the user prefers in the current rain condition can be accurately determined.

[0179] S370. Obtain an updated image, where the updated image is obtained by an image acquisition device performing image acquisition on a target area during the process of the user adjusting the working gear of the windshield wiper.

[0180] Specifically, since the image acquisition device continuously and periodically performs image acquisition on the target area on the windshield, during the process of the user adjusting the working gear of the windshield wiper, the image acquisition device is still acquiring images.

[0181] Specifically, the added image is an image acquired by the image device and subsequently added to the database.

[0182] Specifically, all images collected during the process of the user adjusting the working gear of the windshield wiper can be used as additional images; or a randomly selected image from them can be used as an additional image; or an image with the acquisition moment closest to the determination moment of the second target windshield wiper gear can be selected from them as an additional image, but it is not limited thereto.

[0183] S380. Delete the target rainy-day image from the database, save the updated image to the database, and associate the updated image with the second target windshield wiper gear to update the database.

[0184] Specifically, when the user manually adjusts the first target windshield wiper gear to the second target windshield wiper gear, it indicates that the user believes that the first target windshield wiper gear is not reasonable under the current rain condition, but the second target windshield wiper gear is more reasonable. Therefore, the target rainy-day image can be deleted from the database, thereby disconnecting the association relationship between the target rainy-day image and the first target windshield wiper gear, as well as disconnecting the association relationship between the target rainy-day image and its original corresponding rainfall category, so as to prevent the windshield wiper from still being controlled to scrape at the first target windshield wiper gear that the user does not like when the current rain condition appears again.

[0185] Specifically, add the additional image to the database and establish an association relationship between the additional image and the second target windshield wiper gear, so that when the current rain condition appears again, the windshield wiper can be controlled to scrape at the second target windshield wiper gear that the user likes.

[0186] Exemplarily, if the target rainy-day image is Image 15 in Table 3, the first target windshield wiper gear is Gear 1: 5s intermittent, and after the user manually adjusts the gear and determines that the second target windshield wiper gear is Gear 2: 3.5s intermittent, and the additional image is Additional Image 1, the updated database is shown in Table 4 below.

[0187] Table 4

[0188]

[0189]

[0190] It can be understood that for the updated database, when "finding the first target wiper gear associated with the target rainy-day image from the database", the first target wiper gear associated with the target rainy-day image can be found based on the rainy-day images associated with each wiper gear recorded in the updated database. Of course, if the target rainy-day image is not an added image but a rainy-day image included in the initial database, and the database also records multiple rainfall categories, as well as the rainfall categories associated with each wiper gear and the rainy-day images associated with each rainfall category, then the rainfall category associated with the target rainy-day image can also be found based on the rainy-day images associated with each rainfall category recorded in the database, and then the first target wiper gear associated with the target rainy-day image can be found based on the rainfall categories associated with each wiper gear recorded in the database. In this way, the first target wiper gear can be quickly found.

[0191] In the embodiments of the present disclosure, the applicant considers that the wiper gear selected according to the initial database may not meet the preferences of all users. Therefore, when the adjustment is effective, in response to receiving an adjustment operation of the working gear of the wiper by the user, the second target wiper gear is determined, and the wiper is controlled to perform the wiping operation at the second target wiper gear; the added image is obtained, and then the target rainy-day image is deleted from the database, and the added image is saved to the database, and the added image is associated with the second target wiper gear to update the database. In this way, the association relationship between the wiper gear and the rainy-day image recorded in the updated database can better meet the user's preferences, and a database matching the user's usage habits can be formed for different users. Finally, the actual performance of the wiper gear automatically determined based on the database is more in line with the user's usage habits and expected effects, the user experience is better, which is conducive to reducing customer complaints and lowering the cost of after-sales response.

[0192] On the basis of the above technical solution, optionally, as described above, the database also records multiple rainfall categories, as well as the rainfall categories associated with each wiper gear and the rainy-day images associated with each rainfall category. Different rainfall categories correspond to different raindrop diameter ranges and / or raindrop quantity ranges. At this time, the preset diameter of the standard raindrop is less than the target boundary value, where the target boundary value is the boundary value of the raindrop diameter range corresponding to the rainfall category representing the minimum rainfall.

[0193] Exemplarily, as shown in Table 2 above, among the multiple rainfall categories recorded in the database, a1b1 is the rainfall category representing the minimum rainfall, and the boundary value of the raindrop diameter range corresponding to a1b1 is 2 mm. At this time, the preset diameter can be less than 2 mm.

[0194] It can be understood that due to different rain conditions, the area of the region is usually of different sizes. For example, for the rain condition belonging to the light rain working condition, the area of the region is usually small, while for the rain condition belonging to the heavy rain working condition, the area of the region is usually large. Therefore, in order to make each raindrop region approximately equivalent (or fitting) to at least one standard raindrop, the preset diameter of the standard raindrop can be set smaller. And setting the preset diameter of the standard raindrop smaller can also make the total area of the standard raindrops fitting the number of standard raindrops closer to the area of the raindrop region, thereby making the fitting more accurate.

[0195] Figure 4 FIG. shows a schematic structural diagram of a raindrop fitting device provided by an embodiment of the present disclosure. The raindrop fitting device can be understood as the above-mentioned electronic device or a partial functional module in the above-mentioned electronic device. As Figure 4 shown, the raindrop fitting device 400 includes:

[0196] A first acquisition module 410, configured to acquire an image to be fitted;

[0197] A first recognition module 420, configured to recognize raindrop regions in the image to be fitted, obtain a plurality of raindrop regions, and determine the total number of the plurality of raindrop regions;

[0198] A first determination module 430, configured to determine the regional area of each raindrop region;

[0199] A first fitting module 440, configured to perform raindrop fitting based on the plurality of regional areas of the plurality of raindrop regions and the total number of the plurality of raindrop regions, and obtain raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

[0200] In another implementation manner of the present disclosure, the first fitting module 440 may include:

[0201] A first determination sub-module, configured to, for each raindrop region, divide the regional area by a preset standard raindrop area and take the integer to obtain the number of standard raindrops fitted, where the standard raindrop area is the area of a standard raindrop with a preset diameter and in a circular shape;

[0202] A first search sub-module, configured to search for raindrop parameters associated with the total number and the number of standard raindrops fitted of the plurality of raindrop regions in a preset raindrop parameter table, and use them as the raindrop parameters of the image to be fitted.

[0203] In yet another implementation manner of the present disclosure, the device further includes:

[0204] A first update module, configured to, for each of the raindrop regions, if the number of standard raindrop fittings in the raindrop region is greater than a preset number threshold, multiply the number of standard raindrop fittings by a preset proportionality coefficient to obtain an updated number of standard raindrop fittings, where the proportionality coefficient is less than 1;

[0205] Wherein, the first search sub-module is specifically configured to query, in a preset raindrop parameter table, raindrop parameters associated with the total number and the updated number of standard raindrop fittings of the multiple raindrop regions, and use them as the raindrop parameters of the image to be fitted.

[0206] In another implementation manner of the present disclosure, the first fitting module 440 is specifically configured to take an average of the regional areas of the multiple raindrop regions to obtain an average regional area;

[0207] Sum the regional areas of the multiple raindrop regions to obtain a total regional area;

[0208] Determine the fitting raindrop diameter corresponding to a fitting raindrop with an area equal to the average regional area and in a circular shape, and use it as the raindrop diameter of the image to be fitted;

[0209] Divide the total regional area by the average regional area and take the integer to obtain the number of raindrops in the image to be fitted.

[0210] In another implementation manner of the present disclosure, the first fitting module 440 is specifically configured to use the total number as the number of raindrops in the image to be fitted;

[0211] Sum the regional areas of the multiple raindrop regions to obtain a total regional area;

[0212] Divide the total regional area by the total number to obtain the fitting raindrop area of the image to be fitted;

[0213] Determine the fitting raindrop diameter corresponding to a fitting raindrop with an area equal to the fitting raindrop area and in a circular shape, and use it as the raindrop diameter of the image to be fitted.

[0214] Figure 5 The structural schematic diagram of a windshield wiper control device provided by an embodiment of the present disclosure is shown. The windshield wiper control device can be understood as the above-mentioned electronic device or a partial functional module in the above-mentioned electronic device. As Figure 5 shown, the windshield wiper control device 500 includes:

[0215] A second acquisition module 510, configured to acquire a first current image, where the first current image is an image obtained by an image acquisition device currently performing image acquisition on a target region on a windshield;

[0216] A second fitting module 520, configured to perform raindrop fitting on the first current image by using a preset raindrop fitting method, so as to obtain raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter;

[0217] A first searching module 530, configured to search in a database for a target rainy-day image that matches the first current image based on the raindrop parameters of the first current image, where the database records multiple wiper gears and rainy-day images associated with each wiper gear;

[0218] A second searching module 540, configured to, if the target rainy-day image is found, search in the database for a first target wiper gear associated with the target rainy-day image;

[0219] A first control module 550, configured to control the wiper to perform a wiping operation at the first target wiper gear.

[0220] In another embodiment of the present disclosure, the preset raindrop fitting method is the raindrop fitting method described in any embodiment of the present disclosure.

[0221] In still another embodiment of the present disclosure, the second searching module 540 is specifically configured to determine an image similarity between the first current image and a rainy-day image in the database based on the raindrop parameters of the first current image and the rainy-day image in the database, and determine the rainy-day image with the largest image similarity and greater than a preset similarity threshold as the target rainy-day image.

[0222] In yet another embodiment of the present disclosure, the apparatus further includes:

[0223] A second determination module, configured to, after the working gear of the wiper is the first target wiper gear and in case of an effective adjustment, in response to receiving an adjustment operation of the user on the working gear of the wiper, determine a second target wiper gear, and control the wiper to perform a wiping operation at the second target wiper gear;

[0224] A third acquisition module, configured to acquire an updated image, where the updated image is obtained by an image acquisition device performing image acquisition on the target area during the process of the user adjusting the working gear of the wiper;

[0225] A first update module, configured to delete the target rainy-day image from the database, save the updated image to the database, and associate the updated image with the second target wiper gear to update the database.

[0226] In yet another embodiment of the present disclosure, the database records multiple wiper gears, multiple rainfall categories, and multiple rainy-day images, and records the rainfall category associated with each wiper gear and the rainy-day image associated with each rainfall category. Different rainfall categories correspond to different ranges of raindrop diameters and / or different ranges of raindrop numbers;

[0227] The preset diameter of the standard raindrop is smaller than the target boundary value, where the target boundary value is the boundary value of the raindrop diameter range corresponding to the rainfall category representing the minimum rainfall.

[0228] Figure 6 FIG. shows a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.

[0229] As Figure 6 shown, the electronic device may include a controller 601 and a memory 602 storing computer program instructions.

[0230] Specifically, the controller 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0231] The memory 602 may include a mass storage for information or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disc, a magneto-optical disc, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. In a suitable case, the memory 602 may include a removable or non-removable (or fixed) medium. In a suitable case, the memory 602 may be internal or external to the integrated gateway device. In a specific embodiment, the memory 602 is a non-volatile solid state memory. In a specific embodiment, the memory 602 includes a read-only memory (ROM). In a suitable case, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically alterable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0232] The controller 601 reads and executes the computer program instructions stored in the memory 602 to perform the steps of the wiper control method provided by the embodiments of the present disclosure.

[0233] In one example, the electronic device may further include a transceiver 603 and a bus 604. Among them, as Figure 6 shown, the controller 601, the memory 602, and the transceiver 603 are connected through the bus 604 and complete communication with each other.

[0234] The bus 604 includes hardware, software, or both. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side BUS (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses or a combination of two or more of these. In a suitable case, the bus 604 may include one or more buses. Although the embodiments of the present application describe and illustrate specific buses, the present application contemplates any suitable bus or interconnect.

[0235] The embodiments of the present disclosure also provide a computer-readable storage medium, which may store a computer program. When the computer program is executed by a processor, the processor implements the raindrop fitting method or the wiper control method provided by the embodiments of the present disclosure.

[0236] The above storage medium may include, for example, a memory 602 storing computer program instructions, and the above instructions may be executed by a controller 601 of an electronic device to implement the wiper control method provided by the embodiments of the present disclosure. Optionally, the storage medium may be a non-transitory computer-readable storage medium. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0237] The embodiments of the present disclosure further provide a vehicle, including at least one of the following:

[0238] The raindrop fitting device provided by the embodiments of the present disclosure;

[0239] The wiper control device provided by the embodiments of the present disclosure;

[0240] The electronic device provided by the embodiments of the present disclosure;

[0241] The computer-readable storage medium provided by the embodiments of the present disclosure.

[0242] It should be noted that in this document, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising" is intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or elements inherent to such process, method, article, or device.

[0243] The above are only specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but rather to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A raindrop fitting method, characterized in that, Including: Obtain an image to be fitted; Perform raindrop region recognition on the image to be fitted to obtain multiple raindrop regions, and determine the total number of the multiple raindrop regions; For each raindrop region, determine the area of the raindrop region; Perform raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

2. The method according to claim 1, wherein The performing raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain raindrop parameters of the image to be fitted includes: For each raindrop region, divide the area of the region by a preset standard raindrop area and round up to obtain the standard raindrop fitting number, where the standard raindrop area is the area of a standard raindrop with a preset diameter and in a circular shape; In a preset raindrop parameter table, search for raindrop parameters associated with the total number and the standard raindrop fitting numbers of the multiple raindrop regions, and use them as the raindrop parameters of the image to be fitted.

3. The method according to claim 2, wherein Also included is: For each of the raindrop regions, if the standard raindrop fitting number of the raindrop region is greater than a preset number threshold, multiply the standard raindrop fitting number by a preset proportionality coefficient to obtain an updated standard raindrop fitting number, where the proportionality coefficient is less than 1; Wherein, the searching in the preset raindrop parameter table for raindrop parameters associated with the total number and the standard raindrop fitting numbers of the multiple raindrop regions and using them as the raindrop parameters of the image to be fitted includes: In the preset raindrop parameter table, search for raindrop parameters associated with the total number and the updated standard raindrop fitting numbers of the multiple raindrop regions, and use them as the raindrop parameters of the image to be fitted.

4. The method according to claim 1, wherein The performing raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain raindrop parameters of the image to be fitted includes: Take the average of the areas of the multiple raindrop regions to obtain an average area; Sum up the areas of the multiple raindrop regions to obtain a total area; Determine the fitting raindrop diameter corresponding to a fitting raindrop with an area equal to the average area and in a circular shape, and use it as the raindrop diameter of the image to be fitted; Divide the total area by the average area and round up to obtain the number of raindrops of the image to be fitted.

5. The method according to claim 1, wherein The performing raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain raindrop parameters of the image to be fitted includes: Take the total number as the number of raindrops of the image to be fitted; Sum up the areas of the multiple raindrop regions to obtain a total area; Divide the total area by the total number to obtain the fitting raindrop area of the image to be fitted; Determine the fitting raindrop diameter corresponding to a fitting raindrop with an area equal to the fitting raindrop area and in a circular shape, and use it as the raindrop diameter of the image to be fitted.

6. A windshield wiper control method, characterized in that, Including: Obtain a first current image, where the first current image is an image obtained by an image acquisition device currently acquiring an image of a target area on a windshield; Adopt the raindrop fitting method described in any one of claims 1-5 to perform raindrop fitting on the first current image to obtain raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter; Based on the raindrop parameters of the first current image, search in a database for a target rainy-day image that matches the first current image, where the database records multiple wiper gears and the rainy-day images associated with each wiper gear; If the target rainy-day image is found, search in the database for a first target wiper gear associated with the target rainy-day image; Control the wiper to perform a wiping operation at the first target wiper gear.

7. The method according to claim 6, wherein The searching in the database for a target rainy-day image that matches the first current image based on the raindrop parameters of the first current image includes: Based on the raindrop parameters of the first current image and the raindrop parameters of the rainy-day images in the database, determine the image similarity between the first current image and the rainy-day images in the database, and determine the rainy-day image with the maximum image similarity and greater than a preset similarity threshold as the target rainy-day image.

8. The method according to claim 6, wherein After the working gear of the wiper is controlled to be the first target wiper gear, it further includes: In the case of an effective adjustment, in response to receiving a user's adjustment operation on the working gear of the wiper, determine a second target wiper gear, and control the wiper to perform a wiping operation at the second target wiper gear; Obtain an updated image, where the updated image is obtained by an image acquisition device acquiring an image of the target area during the process of the user adjusting the working gear of the wiper; Delete the target rainy-day image from the database, save the updated image to the database, and associate the updated image with the second target wiper gear to update the database.

9. The method according to claim 6, characterized in that, The database records multiple wiper gears, multiple rainfall categories, and multiple rainy-day images, and records the rainfall category associated with each wiper gear and the rainy-day images associated with each rainfall category. Different rainfall categories correspond to different raindrop diameter ranges and / or raindrop number ranges; The preset diameter of a standard raindrop is less than a target boundary value, where the target boundary value is the boundary value of the raindrop diameter range corresponding to the rainfall category representing the minimum rainfall.

10. A raindrop fitting device, characterized in that, It includes: A first acquisition module for acquiring an image to be fitted; A first recognition module for identifying raindrop regions in the image to be fitted to obtain multiple raindrop regions and determine the total number of the multiple raindrop regions; A first determination module for determining the area of each raindrop region for each raindrop region; A first fitting module for performing raindrop fitting based on the multiple areas of the multiple raindrop regions and the total number of the multiple raindrop regions to obtain raindrop parameters of the image to be fitted, where the raindrop parameters include the number of raindrops and the raindrop diameter.

11. A windshield wiper control device, characterized in that, It includes: A second acquisition module, configured to acquire a first current image, where the first current image is an image obtained by an image acquisition device currently acquiring an image of a target area on a windshield; A second fitting module, configured to perform raindrop fitting on the first current image by using the raindrop fitting method according to any one of claims 1-5, to obtain raindrop parameters of the first current image, where the raindrop parameters include the number of raindrops and the raindrop diameter; A first search module, configured to search for a target rainy-day image matching the first current image in a database based on the raindrop parameters of the first current image, where the database records multiple wiper gears and rainy-day images associated with each of the wiper gears; A second search module, configured to, if the target rainy-day image is found, search for a first target wiper gear associated with the target rainy-day image in the database; A first control module, configured to control the wiper to perform a wiping operation at the first target wiper gear.

12. An electronic device, characterized in that, Comprising: A processor; A memory, configured to store executable instructions; Wherein, the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the raindrop fitting method according to any one of claims 1-5 or the wiper control method according to any one of claims 6-9.

13. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, causes the processor to implement the raindrop fitting method according to any one of claims 1-5 or the wiper control method according to any one of claims 6-9.

14. A vehicle, characterized in that, Including at least one of the following: The raindrop fitting device according to claim 10; The wiper control device according to claim 11; The electronic device according to claim 12; The computer-readable storage medium according to claim 13.

Images