Windshield wiper control methods, devices, electronic equipment, and computer-readable storage media

Abstract

This application discloses a windshield wiper control method, device, electronic device, and computer-readable storage medium, relating to the field of vehicle electronics technology. The method includes: receiving images of the windshield within the driver's field of vision continuously acquired and transmitted by a paired wearable image acquisition terminal; identifying raindrops in the images and calculating the real-time density of the raindrops; obtaining a matching table of density and speed, and determining the real-time speed corresponding to the real-time density based on the matching table; and sending the real-time speed to a windshield wiper control unit to control the windshield wipers to operate according to the real-time speed.

Description

Technical Field

[0001] This application relates to the field of vehicle electronics technology, specifically to a windshield wiper control method, device, electronic device, and computer-readable storage medium. Background Technology

[0002] Traditional rain sensors have limited accuracy in light rain: in light rain, only droplets or a thin film of water form on the windshield, resulting in low changes in light reflection, making it difficult for the sensor to accurately collect rainfall information; oil film and dust adhering to the glass can easily cause distortion of reflection parameters, which in turn causes the vehicle controller to fail to activate the wipers or the wipers to wipe at a lower frequency, reducing windshield visibility and affecting vehicle driving safety. Summary of the Invention

[0003] This application provides a windshield wiper control method, device, electronic device, and computer-readable storage medium, which can accurately control the windshield wipers under different rainfall conditions.

[0004] In a first aspect, embodiments of this application provide a windshield wiper control method, applied to a vehicle infotainment system, comprising: Receives and transmits images of the windshield within the driver's field of vision continuously acquired by a paired wearable image acquisition terminal; Identify raindrops in the image and calculate the real-time density of the raindrops; Obtain a matching table of density and gear level, and determine the real-time gear level corresponding to the real-time density based on the matching table; The real-time gear setting is sent to the wiper control unit to control the wipers to operate according to the real-time gear setting.

[0005] Secondly, embodiments of this application provide a windshield wiper control method, applied to a wearable image acquisition terminal, comprising: Continuously acquire images of the windshield within the driver's field of vision; The image is transmitted to the paired vehicle system, which then identifies the raindrops in the image, calculates the real-time density of the raindrops, obtains a matching table of density and speed, determines the real-time speed corresponding to the real-time density based on the matching table, and sends the real-time speed to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed.

[0006] Thirdly, embodiments of this application provide a windshield wiper control device applied to an in-vehicle system, comprising: The receiving module is used to receive images of the windshield within the driver's field of vision continuously acquired and transmitted by the paired wearable image acquisition terminal; A statistics module is used to identify raindrops in the image and to calculate the real-time density of the raindrops; The determination module is used to obtain a matching table of density and gear level, and determine the real-time gear level corresponding to the real-time density based on the matching table; The sending module is used to send the real-time gear position to the wiper control unit to control the wipers to operate according to the real-time gear position.

[0007] Fourthly, embodiments of this application provide a windshield wiper control device, applied to a wearable image acquisition terminal, comprising: The acquisition module is used to continuously acquire images of the windshield within the driver's field of vision; The transmission module is used to transmit the image to the paired vehicle system, so that the vehicle system can identify raindrops in the image, count the real-time density of the raindrops, obtain a matching table of density and speed, determine the real-time speed corresponding to the real-time density based on the matching table, and send the real-time speed to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed.

[0008] Fifthly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the aforementioned windshield wiper control method.

[0009] Sixthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the aforementioned windshield wiper control method. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic diagram of the steps of a windshield wiper control method provided in an embodiment of this application; Figure 2 This is a schematic diagram of another step in the windshield wiper control method provided in an embodiment of this application; Figure 3 This is a schematic flowchart of a windshield wiper control method provided in an embodiment of this application; Figure 4 This is a schematic diagram of the structure of a windshield wiper control device provided in an embodiment of this application; Figure 5 This is another structural schematic diagram of a wiper control device provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0012] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0013] In one embodiment, such as Figure 1 As shown, a windshield wiper control method is provided. Although the logical sequence is illustrated in the step diagram, in some cases, the steps shown or described can be performed in a different order than that shown in the diagram. Specifically, this windshield wiper control method can be applied to an in-vehicle infotainment system, which is an in-vehicle control terminal with data transmission, data processing, and bus forwarding capabilities. This in-vehicle infotainment system may include, but is not limited to, one or more of an in-vehicle central control unit, a cockpit domain controller, and a body domain controller. These will be described in detail below. It should be noted that the order of description of the following embodiments is not intended to limit the priority of the embodiments.

[0014] according to Figure 1 The windshield wiper control method shown includes at least steps S110 to S140, which are described in detail below: In step S110, the driver receives and transmits images of the windshield within his field of vision continuously acquired by the paired wearable image acquisition terminal.

[0015] In step S120, raindrops in the image are identified, and the real-time density of the raindrops is calculated.

[0016] In step S130, a matching table of density and gear is obtained, and the real-time gear corresponding to the real-time density is determined based on the matching table.

[0017] In step S140, the real-time gear setting is sent to the wiper control unit to control the wipers to operate according to the real-time gear setting.

[0018] A wearable image acquisition terminal is an image acquisition device that can be worn on the human head and has image acquisition and data transmission functions. This wearable image acquisition terminal may include, but is not limited to, one or more of smart glasses, AR glasses, VR headsets, and head-mounted camera devices.

[0019] When the driver wears this wearable image acquisition terminal, the field of view (FOV) of the camera matches the driver's field of vision, accurately capturing the windshield image corresponding to the driver's actual visible area. The captured image closely matches the real driving field of vision, thus ensuring that subsequent raindrop calculations match the actual driving scenario. The windshield is a transparent protective glass component mounted directly in front of the vehicle's driver's compartment, used to separate the interior and exterior spaces and ensure the driver's forward visibility.

[0020] In this embodiment, the vehicle-mounted infotainment system and the wearable image acquisition terminal are pre-paired and a data transmission channel is established. The pairing connection between the vehicle-mounted infotainment system and the wearable image acquisition terminal can be based on Bluetooth, WiFi, or other wireless communication protocols. After pairing, a stable data transmission channel is established, enabling bidirectional data interaction between the two, providing a communication foundation for subsequent image and signal transmission.

[0021] The wearable image acquisition terminal can continuously acquire images of the windshield within the driver's field of vision and transmit the acquired images to the vehicle's infotainment system in real time via a data transmission channel. The wearable image acquisition terminal can continuously acquire and transmit these images at a relatively high frequency (e.g., every 2 seconds), and this frequency can be set according to actual needs.

[0022] When the vehicle's infotainment system receives images transmitted in real time from the wearable image acquisition terminal, it can preprocess the images to improve the accuracy of subsequent raindrop density determination. Optionally, image preprocessing may include, but is not limited to, one or more of the following: noise reduction, white balance correction, image grayscale conversion, adaptive brightness and contrast correction, and cropping of invalid edge regions. This preprocessing can eliminate image interference caused by driving light and shadow, glass smudges, and ambient light, optimize effective image features, facilitate accurate subsequent segmentation and recognition of raindrop contours, and reduce statistical errors in raindrop density.

[0023] The vehicle's infotainment system can utilize built-in image recognition algorithms to process pre-processed images and identify raindrops within them. Specifically, this image recognition algorithm can include, but is not limited to, one or more of edge feature extraction algorithms, threshold segmentation algorithms, and small target contour filtering algorithms. Based on these algorithms, individual raindrop contour information can be extracted, invalid interference features such as dust and light spots can be removed, and all real raindrop targets can be accurately identified. After identifying the raindrops, the vehicle's infotainment system can calculate the real-time density of raindrops in each image based on the effective sampling area of ​​the image.

[0024] The vehicle's infotainment system can retrieve a pre-stored density and wiper speed matching table. This table includes the correspondence between different real-time raindrop density ranges determined in advance based on experiments or big data analysis and different wiper speeds. The system can then query this matching table based on the current real-time raindrop density to determine the corresponding real-time speed.

[0025] The vehicle's infotainment system can convert the matched real-time gear code into a control command that can be recognized by the vehicle's bus. This command is then forwarded to the wiper control unit (ECU) via the vehicle bus. After parsing the control command, the wiper control unit outputs a drive signal to control the wipers to work according to the wiping frequency and operating speed corresponding to the real-time gear.

[0026] The technical solution adopted in this application embodiment, based on the image of the windshield captured by the wearable image acquisition terminal, can cover the driver's actual field of vision and accurately reflect the driver's obstructed vision. Addressing the inaccuracy of traditional rain sensors relying on photoelectric detection technology for rain measurement, this application embodiment uses image processing technology to identify raindrops in the image and calculate their real-time density. This allows for accurate capture of sparse, dotted raindrops in light rain conditions, avoiding interference from windshield film and dust on optical sampling, thereby effectively improving the accuracy of rain measurement in light rain. Matching the corresponding real-time speed based on the real-time raindrop density can avoid the need for windshield wipers. This technology addresses the issues of poor windshield visibility caused by delayed start-up and low-frequency wiping, thereby optimizing driving visibility in rainy weather and improving vehicle safety. Furthermore, by using a wearable image acquisition terminal to capture images, there is no need to install additional sensors on the windshield, reducing vehicle hardware costs and assembly complexity. A single wearable image acquisition terminal can be adapted to multiple vehicles for cross-vehicle reuse; raindrop image acquisition can be performed on any paired vehicle to assist in wiper control, thus significantly reducing hardware costs across multiple vehicles. Calculation and control based on the vehicle's infotainment system saves power consumption of the wearable image acquisition terminal, extending its battery life.

[0027] Based on the above technical solution, in intelligent adjustment mode, the wearable image acquisition terminal will acquire images to determine the real-time wiper setting and transmit these images to the vehicle's infotainment system. Intelligent adjustment mode refers to the mode that determines the real-time wiper setting based on images acquired by the wearable image acquisition terminal.

[0028] As an example, the conditions that trigger the wearable image acquisition terminal to start acquiring images may include one or more of rain sensor triggering and manual triggering.

[0029] Rain sensor triggering includes: when the vehicle's infotainment system receives a rain signal from the onboard rain sensor, it sends a start signal to the wearable image acquisition terminal. The start signal is used to enable the wearable image acquisition terminal to start acquiring images.

[0030] The vehicle's original rain sensor monitors the water level on the windshield in real time. When the rain sensor detects rainfall, it generates a rain signal and transmits it to the vehicle's infotainment system via the LIN / CAN bus. Upon receiving the rain signal, the infotainment system sends a start signal to the wearable image acquisition terminal via a pre-paired wireless transmission channel. Upon receiving the start signal, the wearable image acquisition terminal immediately activates its camera to capture images of the windshield within the driver's field of vision, initiating the real-time image acquisition and transmission process. This avoids wasted power caused by ineffective image capture and continuous data transmission in rainless conditions.

[0031] Manual triggering includes: the wearable image acquisition terminal receiving a signal from the user to manually trigger the wearable image acquisition terminal to perform the wiper adjustment function.

[0032] Drivers can actively activate the wiper adjustment function through physical buttons, touch buttons, or voice control modules on the wearable image acquisition terminal. This causes the wearable image acquisition terminal to generate a signal to execute the wiper adjustment function. Based on this signal, the wearable image acquisition terminal can activate the camera to capture images of the windshield within the driver's field of vision, thus entering the real-time image acquisition and transmission process. This avoids the power consumption waste caused by the device's ineffective shooting and continuous data transmission in rainless environments.

[0033] Based on the above technical solution, the intelligent adjustment mode can be exited if no raindrops are detected within a preset duration. Specifically, if it is detected that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops within a preset duration, a stop signal is sent to the wearable image acquisition terminal; the stop signal is used to cause the wearable image acquisition terminal to stop acquiring images; exit the intelligent adjustment mode of the wipers and return to standby mode.

[0034] During the continuous operation of the windshield wiper intelligent adjustment mode, the vehicle's infotainment system continuously receives and transmits images of the windshield from the wearable image acquisition terminal, and uses the built-in image recognition algorithm to detect and identify raindrop features in the image content frame by frame.

[0035] If the vehicle's infotainment system fails to detect raindrops in multiple frames of images transmitted from the wearable image acquisition terminal within a preset time period (e.g., 30 seconds), it can determine that rainfall has stopped. At this point, the vehicle's infotainment system can send a stop signal to the wearable image acquisition terminal via a pre-established wireless data transmission channel. This stop signal is used to cause the wearable image acquisition terminal to cease image acquisition.

[0036] Upon receiving the stop signal, the wearable image acquisition terminal can stop acquiring images of the windshield used to determine the real-time gear position and stop transmitting those images.

[0037] After generating a stop signal, the vehicle's infotainment system can also proactively exit the intelligent wiper adjustment mode, ceasing operations such as raindrop density statistics, wiper gear matching, and control command issuance. It then reverts to the traditional adjustment mode that controls the wipers based on data collected by the rain sensor, automatically switching to a low-power standby state to await the next rainfall trigger signal or a user-triggered signal. This completes the closed-loop start-stop logic of the entire intelligent rain control system, effectively reducing the energy consumption of in-vehicle equipment and wearable terminals, and improving system stability and lifespan.

[0038] In one embodiment, when the wearable image acquisition terminal receives a signal from the user that the wearable image acquisition terminal has manually triggered the windshield wiper adjustment function to turn off, it may stop the corresponding image acquisition and transmission based on the signal and send the signal to the vehicle's infotainment system so that the vehicle's infotainment system exits the smart adjustment mode of the windshield wipers and returns to the standby state.

[0039] In one embodiment, if the raindrop density is detected to be greater than a preset density for a continuously preset duration, indicating particularly heavy rainfall, the wiper's intelligent adjustment mode is exited, and the system reverts to the traditional adjustment mode that controls the wipers based on data collected by a rain sensor. This is because, in cases of particularly heavy rainfall, the data collected by the rain sensor is sufficient to achieve accurate control of the wipers.

[0040] Based on the above technical solution, as an embodiment, step S120 may include: identifying raindrops in the image based on an image recognition algorithm; dividing the image into multiple image regions and calculating the raindrop density of each image region; obtaining the weight coefficient of each image region; and performing a weighted summation of the raindrop density of each image region based on the weight coefficient of each image region to obtain the real-time density of raindrops.

[0041] The degree to which raindrop density affects the driver's field of vision varies in different image regions. Because the image is a view of the windshield within the driver's field of vision, the center of the image usually coincides with the center of the driver's field of vision. Therefore, the raindrop density in the central area of ​​the image usually has a greater impact on the driver's field of vision than the raindrop density in the edge areas of the image.

[0042] Therefore, to improve the fit and accuracy of raindrop density detection, the vehicle-mounted system can divide the acquired image into several uniformly sized, independent image regions, covering the driver's entire effective field of vision. The system then counts the number of raindrops and calculates the area of ​​each independent image region, determining the raindrop density for each region.

[0043] The system can preset weight coefficients for different image regions based on the degree of impact of raindrop density on the driver's field of vision. These weight coefficients are proportional to the degree of impact on the corresponding field of vision. The vehicle's infotainment system can retrieve the weight coefficients for each image region, match and multiply the raindrop density of each region with its corresponding weight coefficient, and then sum them up to obtain the real-time raindrop density for the entire image.

[0044] By adopting the technical solution of this application embodiment, the error of single-area detection is corrected by multi-area weighted fusion, which can avoid the detection deviation caused by local image interference and uneven raindrop distribution. Finally, the global raindrop real-time density is calculated in a way that fits the actual rainfall conditions and is accurate and reliable, providing accurate data basis for subsequent precise matching of wiper speed.

[0045] In one embodiment, such as Figure 2 As shown, a windshield wiper control method is provided. Although the logical order is illustrated in the step diagram, in some cases, the steps shown or described can be performed in a different order than that shown in the figures. Specifically, this windshield wiper control method can be applied to a wearable image acquisition terminal, which is an image acquisition device that can be worn on the human head and has image acquisition and data transmission functions. The wearable image acquisition terminal can include, but is not limited to, one or more of smart glasses, AR glasses, VR headsets, and head-mounted camera devices. These will be described in detail below. It should be noted that the order of description of the following embodiments is not intended to limit the priority of the embodiments.

[0046] according to Figure 2 The windshield wiper control method shown includes at least steps S210 to S220, which are described in detail below: In step S210, images of the windshield within the driver's field of vision are continuously acquired.

[0047] In step S220, the image is transmitted to the paired vehicle system. This allows the vehicle system to identify raindrops in the image, calculate the real-time density of the raindrops, obtain a matching table between density and speed setting, determine the real-time speed setting corresponding to the real-time density based on the matching table, and send the real-time speed setting to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed setting.

[0048] The various embodiments of this application can be referenced interchangeably. The vehicle-mounted unit is an in-vehicle control terminal with data transmission, data processing, and bus forwarding capabilities. This in-vehicle unit may include, but is not limited to, one or more of an in-vehicle central control unit, a cockpit domain controller, and a body domain controller.

[0049] The vehicle-mounted infotainment system and the wearable image acquisition terminal are pre-paired and connected, establishing a data transmission channel. The pairing between the vehicle-mounted system and the wearable image acquisition terminal can be based on Bluetooth, WiFi, or other wireless communication protocols. Once paired, a stable data transmission channel is established, enabling bidirectional data interaction between the two devices, providing a communication foundation for subsequent image and signal transmission.

[0050] When the driver wears this wearable image acquisition terminal, the field of view of the camera on the wearable image acquisition terminal matches the driver's field of vision, and can accurately capture the windshield image corresponding to the driver's actual visible area. The captured image closely matches the actual driving field of vision, so the subsequent raindrop measurement results match the actual driving scenario. The windshield is a transparent protective glass component installed at the front of the vehicle's cab, used to separate the interior and exterior spaces of the vehicle and ensure the driver's forward driving vision.

[0051] The wearable image acquisition terminal can continuously acquire images of the windshield within the driver's field of vision and transmit the acquired images to the vehicle's infotainment system in real time via a data transmission channel. The wearable image acquisition terminal can continuously acquire and transmit these images at a relatively high frequency (e.g., every 2 seconds), and this frequency can be set according to actual needs.

[0052] When the vehicle's infotainment system receives images transmitted in real time from the wearable image acquisition terminal, it can preprocess the images to improve the accuracy of subsequent raindrop density determination. Optionally, image preprocessing may include, but is not limited to, one or more of the following: noise reduction, white balance correction, image grayscale conversion, adaptive brightness and contrast correction, and cropping of invalid edge regions. This preprocessing can eliminate image interference caused by driving light and shadow, glass smudges, and ambient light, optimize effective image features, facilitate accurate subsequent segmentation and recognition of raindrop contours, and reduce statistical errors in raindrop density.

[0053] The vehicle's infotainment system can utilize built-in image recognition algorithms to process pre-processed images and identify raindrops within them. Specifically, this image recognition algorithm can include, but is not limited to, one or more of edge feature extraction algorithms, threshold segmentation algorithms, and small target contour filtering algorithms. Based on these algorithms, individual raindrop contour information can be extracted, invalid interference features such as dust and light spots can be removed, and all real raindrop targets can be accurately identified. After identifying the raindrops, the vehicle's infotainment system can calculate the real-time density of raindrops in each image based on the effective sampling area of ​​the image.

[0054] The vehicle's infotainment system can retrieve a pre-stored density and wiper speed matching table. This table includes the correspondence between different real-time raindrop density ranges determined in advance based on experiments or big data analysis and different wiper speeds. The system can then query this matching table based on the current real-time raindrop density to determine the corresponding real-time speed.

[0055] The vehicle's infotainment system can convert the matched real-time gear code into a control command that can be recognized by the vehicle's bus. This command is then forwarded to the wiper control unit via the vehicle bus. After parsing the control command, the wiper control unit outputs a drive signal to control the wipers to operate according to the wiping frequency and speed corresponding to the real-time gear.

[0056] The technical solution adopted in this application embodiment, based on the image of the windshield captured by the wearable image acquisition terminal, can cover the driver's actual field of vision and accurately reflect the driver's obstructed vision. Addressing the inaccuracy of traditional rain sensors relying on photoelectric detection technology for rain measurement, this application embodiment uses image processing technology to identify raindrops in the image and calculate their real-time density. This allows for accurate capture of sparse, dotted raindrops in light rain conditions, avoiding interference from windshield film and dust on optical sampling, thereby effectively improving the accuracy of rain measurement in light rain. Matching the corresponding real-time speed based on the real-time raindrop density can avoid the need for windshield wipers. This technology addresses the issues of poor windshield visibility caused by delayed start-up and low-frequency wiping, thereby optimizing driving visibility in rainy weather and improving vehicle safety. Furthermore, by using a wearable image acquisition terminal to capture images, there is no need to install additional sensors on the windshield, reducing vehicle hardware costs and assembly complexity. A single wearable image acquisition terminal can be adapted to multiple vehicles for cross-vehicle reuse; raindrop image acquisition can be performed on any paired vehicle to assist in wiper control, thus significantly reducing hardware costs across multiple vehicles. Calculation and control based on the vehicle's infotainment system saves power consumption of the wearable image acquisition terminal, extending its battery life.

[0057] Based on the above technical solution, as an embodiment, step S210 may include: responding to the start signal transmitted by the vehicle-mounted unit, continuously acquiring images of the windshield within the driver's field of vision; wherein, the start signal is sent by the vehicle-mounted unit to the wearable image acquisition terminal when it receives a rain signal output by the vehicle's rain sensor; or, upon receiving a signal from the wearable image acquisition terminal manually triggered by the user to perform a wiper adjustment function, continuously acquiring images of the windshield within the driver's field of vision.

[0058] The conditions that trigger the wearable image acquisition terminal to start acquiring images can include one or more of the following: rain sensor triggering and manual triggering.

[0059] Rain sensor triggering includes: when the vehicle's infotainment system receives a rain signal from the onboard rain sensor, it sends a start signal to the wearable image acquisition terminal. The start signal is used to enable the wearable image acquisition terminal to start acquiring images.

[0060] The vehicle's original rain sensor monitors the water level on the windshield in real time. When the rain sensor detects rainfall, it generates a rain signal and transmits it to the vehicle's infotainment system via the LIN / CAN bus. Upon receiving the rain signal, the infotainment system sends a start signal to the wearable image acquisition terminal via a pre-paired wireless transmission channel. Upon receiving the start signal, the wearable image acquisition terminal immediately activates its camera to capture images of the windshield within the driver's field of vision, initiating the real-time image acquisition and transmission process. This avoids wasted power caused by ineffective image capture and continuous data transmission in rainless conditions.

[0061] Manual triggering includes: the wearable image acquisition terminal receiving a signal from the user to manually trigger the wearable image acquisition terminal to perform the wiper adjustment function.

[0062] Drivers can actively activate the wiper adjustment function through physical buttons, touch buttons, or voice control modules on the wearable image acquisition terminal. This causes the wearable image acquisition terminal to generate a signal to execute the wiper adjustment function. Based on this signal, the wearable image acquisition terminal can activate the camera to capture images of the windshield within the driver's field of vision, thus entering the real-time image acquisition and transmission process. This avoids the power consumption waste caused by the device's ineffective shooting and continuous data transmission in rainless environments.

[0063] Based on the above technical solution, the image acquisition is stopped when a stop signal is received from the vehicle-mounted unit; wherein, the stop signal is sent by the vehicle-mounted unit to the wearable image acquisition terminal when it recognizes that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops within a preset duration.

[0064] During the continuous operation of the windshield wiper intelligent adjustment mode, the vehicle's infotainment system continuously receives and transmits images of the windshield from the wearable image acquisition terminal, and uses the built-in image recognition algorithm to detect and identify raindrop features in the image content frame by frame.

[0065] If the vehicle's infotainment system fails to detect raindrops in multiple frames of images transmitted from the wearable image acquisition terminal within a preset time period (e.g., 30 seconds), it can determine that rainfall has stopped. At this point, the vehicle's infotainment system can send a stop signal to the wearable image acquisition terminal via a pre-established wireless data transmission channel. This stop signal is used to cause the wearable image acquisition terminal to cease image acquisition.

[0066] Upon receiving the stop signal, the wearable image acquisition terminal can stop acquiring images of the windshield used to determine the real-time gear position and stop transmitting those images.

[0067] After generating a stop signal, the vehicle's infotainment system can also proactively exit the intelligent wiper adjustment mode, ceasing operations such as raindrop density statistics, wiper gear matching, and control command issuance. It then reverts to the traditional adjustment mode that controls the wipers based on data collected by the rain sensor, automatically switching to a low-power standby state to await the next rainfall trigger signal or a user-triggered signal. This completes the closed-loop start-stop logic of the entire intelligent rain control system, effectively reducing the energy consumption of in-vehicle equipment and wearable terminals, and improving system stability and lifespan.

[0068] In one embodiment, when the wearable image acquisition terminal receives a signal from the user that the wearable image acquisition terminal has manually triggered the windshield wiper adjustment function to turn off, it may stop the corresponding image acquisition and transmission based on the signal and send the signal to the vehicle's infotainment system so that the vehicle's infotainment system exits the smart adjustment mode of the windshield wipers and returns to the standby state.

[0069] In one embodiment, if the raindrop density is detected to be greater than a preset density for a continuously preset duration, indicating particularly heavy rainfall, the wiper's intelligent adjustment mode is exited, and the system reverts to the traditional adjustment mode that controls the wipers based on data collected by a rain sensor. This is because, in cases of particularly heavy rainfall, the data collected by the rain sensor is sufficient to achieve accurate control of the wipers.

[0070] Figure 3 This is a schematic flowchart of a windshield wiper control method provided in an embodiment of this application; Figure 3 The wearable image acquisition terminal in the system can be smart glasses. The driver wears the smart glasses, which serve as the wearable image acquisition terminal. The smart glasses and the vehicle's infotainment system can pair and handshake through wireless communication protocols such as Bluetooth and Wi-Fi to establish a stable two-way data transmission channel.

[0071] The system can monitor in real time whether the smart glasses are triggered to capture images used to determine the real-time gear position. Triggering conditions can be divided into two categories: rain sensor-triggered and manual trigger. When no acquisition trigger signal is received, the entire system maintains a low-power standby state and continuously polls for trigger signals. If an acquisition trigger signal is detected, it jumps to the image acquisition process. After the trigger takes effect, the smart glasses' built-in camera can continuously capture images of the windshield within the driver's field of vision and send the images to the vehicle's infotainment system in real time via the data transmission channel.

[0072] The vehicle's infotainment system performs multi-level image processing on the received images: first, image preprocessing is performed; then, the built-in image recognition algorithm is used to identify raindrops; finally, the real-time density of raindrops is calculated. The system retrieves a locally pre-calibrated match table between raindrop density and wiper speed, looks up the real-time wiper speed based on the real-time raindrop density, generates a speed command, and sends the command to the wiper ECU. The wiper ECU then drives the wipers to operate according to the wiping speed and interval corresponding to the real-time speed.

[0073] The system enters a closed-loop control system. The smart glasses continuously collect and transmit images, while the vehicle's infotainment system periodically refreshes the raindrop density and dynamically adjusts the wiper speed to achieve adaptive wiper speed control during rainfall. If no raindrop features are detected within 30 consecutive seconds of multiple frames, or if the driver manually issues a shutdown command, the system is deemed to have met the shutdown conditions. The vehicle's infotainment system then sends a stop-collection signal to the smart glasses, which shut down their cameras, and the vehicle's infotainment system exits the intelligent wiper adjustment mode. If the shutdown conditions are not met, the system returns to the continuous collection step to continue the loop.

[0074] The technical solution adopted in this application embodiment allows the smart glasses to synchronously capture images based on the driver's head posture and line of sight, enabling the acquired images to accurately match the driver's real-time core field of vision. Even in light rain, raindrops adhering to the core field of vision can be instantly captured and detected, overcoming the shortcomings of traditional fixed rain sensors where the sampling area is limited and visibility is reduced due to localized rainfall without timely speed adjustment. Simultaneously, this solution replaces the light reflection detection principle of traditional photoelectric rain sensors with visual image recognition. Dust and stubborn stains adhering to the windshield will not interfere with the rain detection results. Combined with the multi-level image preprocessing and target recognition algorithms on the vehicle's infotainment system, invalid interference features such as light spots and impurities can be filtered out, further improving the accuracy of rain recognition and wiper mode determination. Furthermore, this solution requires no modification to the vehicle hardware; it can be implemented simply through software pairing, making it compatible with the vast majority of intelligent connected vehicles.

[0075] To facilitate better implementation of the wiper control method of this application, this application also provides a wiper control device based on the above-described wiper control method. The meanings of the terms used are the same as in the wiper control method described above, and specific implementation details can be found in the descriptions of the method embodiments.

[0076] Please see Figure 4 , Figure 4 This is a schematic diagram of the structure of a windshield wiper control device provided in an embodiment of this application, wherein the windshield wiper control device is applied to a vehicle infotainment system and includes: The receiving module 401 is used to receive images of the windshield within the driver's field of vision continuously acquired and transmitted by the paired wearable image acquisition terminal. The statistics module 402 is used to identify raindrops in the image and to count the real-time density of the raindrops; The determination module 403 is used to obtain a matching table of density and gear, and determine the real-time gear corresponding to the real-time density based on the matching table; The sending module 404 is used to send the real-time gear position to the wiper control unit to control the wipers to operate according to the real-time gear position.

[0077] In one embodiment, the conditions that trigger the wearable image acquisition terminal to start acquiring the image include: When the vehicle's infotainment system receives a rain signal from the vehicle's rain sensor, it sends a start signal to the wearable image acquisition terminal. The start signal is used to enable the wearable image acquisition terminal to begin acquiring the image. Alternatively, the wearable image acquisition terminal receives a signal from the user that the wearable image acquisition terminal is manually triggered to perform the wiper adjustment function.

[0078] In one embodiment, the device further includes: A stop signal sending module is used to send a stop signal to the wearable image acquisition terminal when it is detected that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops within a preset duration; the stop signal is used to cause the wearable image acquisition terminal to stop acquiring the images; The mode exit module is used to exit the smart adjustment mode of the windshield wipers and return to standby mode.

[0079] In one embodiment, the statistics module 402 includes: A raindrop recognition unit is used to identify raindrops in the image based on an image recognition algorithm; An image segmentation unit is used to divide the image into multiple image regions and count the raindrop density in each image region. A coefficient acquisition unit is used to acquire the weight coefficients of each of the image regions; The weighted summation unit is used to perform a weighted summation of the raindrop density of each of the image regions based on the weight coefficients of each of the image regions, so as to obtain the real-time density of the raindrops.

[0080] In one embodiment, the vehicle-mounted system and the wearable image acquisition terminal were pre-paired and connected, and a data transmission channel was established.

[0081] The technical solution adopted in this application embodiment, based on the image of the windshield captured by the wearable image acquisition terminal, can cover the driver's actual field of vision and accurately reflect the driver's obstructed vision. Addressing the inaccuracy of traditional rain sensors relying on photoelectric detection technology for rain measurement, this application embodiment uses image processing technology to identify raindrops in the image and calculate their real-time density. This allows for accurate capture of sparse, dotted raindrops in light rain conditions, avoiding interference from windshield film and dust on optical sampling, thereby effectively improving the accuracy of rain measurement in light rain. Matching the corresponding real-time speed based on the real-time raindrop density can avoid the need for windshield wipers. This technology addresses the issues of poor windshield visibility caused by delayed start-up and low-frequency wiping, thereby optimizing driving visibility in rainy weather and improving vehicle safety. Furthermore, by using a wearable image acquisition terminal to capture images, there is no need to install additional sensors on the windshield, reducing vehicle hardware costs and assembly complexity. A single wearable image acquisition terminal can be adapted to multiple vehicles for cross-vehicle reuse; raindrop image acquisition can be performed on any paired vehicle to assist in wiper control, thus significantly reducing hardware costs across multiple vehicles. Calculation and control based on the vehicle's infotainment system saves power consumption of the wearable image acquisition terminal, extending its battery life.

[0082] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a windshield wiper control device provided in an embodiment of this application, wherein the windshield wiper control device is applied to a wearable image acquisition terminal and includes: The acquisition module 501 is used to continuously acquire images of the windshield within the driver's field of vision; The transmission module 502 is used to transmit the image to the paired vehicle system so that the vehicle system can identify raindrops in the image, count the real-time density of the raindrops, obtain a matching table of density and speed, determine the real-time speed corresponding to the real-time density based on the matching table, and send the real-time speed to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed.

[0083] In one embodiment, the acquisition module 501 includes: The first starting unit is configured to continuously acquire images of the windshield within the driver's field of vision in response to a start signal transmitted by the vehicle-mounted unit; wherein the start signal is sent by the vehicle-mounted unit to the wearable image acquisition terminal when it receives a rain signal output by the vehicle's rain sensor. The second starting unit is used to, or, upon receiving a signal from the wearable image acquisition terminal manually triggered by the user to perform a wiper adjustment function, to continuously acquire images of the windshield within the driver's field of vision.

[0084] In one embodiment, the device further includes: The stop acquisition module is used to stop acquiring the image when it receives a stop signal sent by the vehicle's infotainment system. The stop signal is sent by the vehicle system to the wearable image acquisition terminal when it detects that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops within a preset duration.

[0085] The technical solution adopted in this application embodiment, based on the image of the windshield captured by the wearable image acquisition terminal, can cover the driver's actual field of vision and accurately reflect the driver's obstructed vision. Addressing the inaccuracy of traditional rain sensors relying on photoelectric detection technology for rain measurement, this application embodiment uses image processing technology to identify raindrops in the image and calculate their real-time density. This allows for accurate capture of sparse, dotted raindrops in light rain conditions, avoiding interference from windshield film and dust on optical sampling, thereby effectively improving the accuracy of rain measurement in light rain. Matching the corresponding real-time speed based on the real-time raindrop density can avoid the need for windshield wipers. This technology addresses the issues of poor windshield visibility caused by delayed start-up and low-frequency wiping, thereby optimizing driving visibility in rainy weather and improving vehicle safety. Furthermore, by using a wearable image acquisition terminal to capture images, there is no need to install additional sensors on the windshield, reducing vehicle hardware costs and assembly complexity. A single wearable image acquisition terminal can be adapted to multiple vehicles for cross-vehicle reuse; raindrop image acquisition can be performed on any paired vehicle to assist in wiper control, thus significantly reducing hardware costs across multiple vehicles. Calculation and control based on the vehicle's infotainment system saves power consumption of the wearable image acquisition terminal, extending its battery life.

[0086] For specific limitations regarding the wiper control device, please refer to the limitations on the wiper control method above, which will not be repeated here. Each module in the aforementioned wiper control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0087] In addition, this application also provides an electronic device, such as Figure 6 As shown, it illustrates the structural diagram of the electronic device involved in this application, specifically: The electronic device may include components such as a processor 601 with one or more processing cores and a memory 602 with one or more computer-readable storage media. Those skilled in the art will understand that... Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 601 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, thereby providing overall monitoring of the electronic device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0088] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0089] In one embodiment, the electronic device further includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0090] In one embodiment, the electronic device may further include an input unit 604, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0091] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device loads the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 runs the application programs stored in the memory 602, thereby implementing the steps in any of the wiper control methods provided in the embodiments of this application.

[0092] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0093] In one embodiment, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the methods described in any embodiment of this application.

[0094] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method described in any embodiment of this application.

[0095] In some embodiments, a computer program product is also provided, including a computer program or instructions that, when executed by a processor, implement the methods described in any embodiment of this application.

[0096] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0097] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0098] Therefore, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the windshield wiper control methods provided in this application.

[0099] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0100] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0101] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the wiper control methods provided in this application, the beneficial effects that any of the wiper control methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0102] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0103] The foregoing provides a detailed description of a windshield wiper control method, device, electronic device, and computer-readable storage medium. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A windshield wiper control method, characterized in that, Applications in in-vehicle infotainment systems include: Receives and transmits images of the windshield within the driver's field of vision continuously acquired by a paired wearable image acquisition terminal; Identify raindrops in the image and calculate the real-time density of the raindrops; Obtain a matching table of density and gear level, and determine the real-time gear level corresponding to the real-time density based on the matching table; The real-time gear setting is sent to the wiper control unit to control the wipers to operate according to the real-time gear setting.

2. The wiper control method according to claim 1, characterized in that, The conditions that trigger the wearable image acquisition terminal to start acquiring the image include: When the vehicle's infotainment system receives a rain signal from the vehicle's rain sensor, it sends a start signal to the wearable image acquisition terminal. The start signal is used to enable the wearable image acquisition terminal to begin acquiring the image. Alternatively, the wearable image acquisition terminal receives a signal from the user that the wearable image acquisition terminal is manually triggered to perform the wiper adjustment function.

3. The wiper control method according to claim 1, characterized in that, The wiper control method further includes: If, within a preset time period, it is detected that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops, a stop signal is sent to the wearable image acquisition terminal; the stop signal is used to cause the wearable image acquisition terminal to stop acquiring the images. Exit the smart adjustment mode of the windshield wipers and return to standby mode.

4. The wiper control method according to claim 1, characterized in that, The process of identifying raindrops in the image and calculating the real-time density of the raindrops includes: Based on image recognition algorithms, raindrops in the image were identified; The image is divided into multiple image regions, and the raindrop density in each image region is counted. Obtain the weight coefficients for each of the image regions; The real-time density of raindrops is obtained by weighting and summing the raindrop densities of each image region based on the weight coefficients of each image region.

5. The wiper control method according to claim 1, characterized in that, The vehicle-mounted system and the wearable image acquisition terminal were pre-paired and connected, and a data transmission channel was established.

6. A windshield wiper control method, characterized in that, Applications in wearable image acquisition terminals include: Continuously acquire images of the windshield within the driver's field of vision; The image is transmitted to the paired vehicle system, which then identifies the raindrops in the image, calculates the real-time density of the raindrops, obtains a matching table of density and speed, determines the real-time speed corresponding to the real-time density based on the matching table, and sends the real-time speed to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed.

7. The wiper control method according to claim 6, characterized in that, The continuous acquisition of images of the windshield within the driver's field of vision includes: In response to the start signal transmitted by the vehicle-mounted system, it begins to continuously acquire images of the windshield within the driver's field of vision; wherein, the start signal is sent by the vehicle-mounted system to the wearable image acquisition terminal when it receives a rain signal output by the vehicle's rain sensor; Alternatively, upon receiving a signal from the wearable image acquisition terminal that the user has manually triggered to perform a wiper adjustment function, the device will begin to continuously acquire images of the windshield within the driver's field of vision.

8. The wiper control method according to claim 6, characterized in that, The wiper control method further includes: Upon receiving a stop signal from the vehicle's infotainment system, the image acquisition process is halted. The stop signal is sent by the vehicle system to the wearable image acquisition terminal when it detects that none of the multiple images transmitted by the wearable image acquisition terminal contain raindrops within a preset duration.

9. A windshield wiper control device, characterized in that, Applications in in-vehicle infotainment systems include: The receiving module is used to receive images of the windshield within the driver's field of vision continuously acquired and transmitted by the paired wearable image acquisition terminal; A statistics module is used to identify raindrops in the image and to calculate the real-time density of the raindrops; The determination module is used to obtain a matching table of density and gear level, and determine the real-time gear level corresponding to the real-time density based on the matching table; The sending module is used to send the real-time gear position to the wiper control unit to control the wipers to operate according to the real-time gear position.

10. A windshield wiper control device, characterized in that, Applications in wearable image acquisition terminals include: The acquisition module is used to continuously acquire images of the windshield within the driver's field of vision; The transmission module is used to transmit the image to the paired vehicle system, so that the vehicle system can identify raindrops in the image, count the real-time density of the raindrops, obtain a matching table of density and speed, determine the real-time speed corresponding to the real-time density based on the matching table, and send the real-time speed to the wiper control unit, thereby controlling the wipers to operate according to the real-time speed.

11. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the wiper control method as described in any one of claims 1 to 8.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the wiper control method as described in any one of claims 1 to 8.

Images