A rainy day road condition video processing method, system, device and storage medium
By judging the clarity and rainfall intensity of image frames under rainy conditions and using appropriate algorithms to remove rain fog and raindrops, the problem of blurred images in rainy weather is solved, and the vehicle's obstacle recognition ability and safety in rainy weather are improved.
Patent Information
- Application Number
- CN202410917594.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-10
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-07-10
AI Technical Summary
In rainy conditions, raindrops blur vehicle video images, affecting obstacle recognition. Existing methods have failed to effectively remove raindrops, resulting in insufficient safety.
By judging the image frame sharpness and rainfall intensity, a dark channel dehazing algorithm and median filtering method are used to remove rain fog and raindrops, and long raindrop areas are processed according to the object's motion trajectory.
It improves image clarity in rainy conditions, reduces the impact on vehicle recognition systems, and enhances driving safety.
Smart Images

Figure CN118506010B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to a method, system, device and storage medium for processing rainy road condition videos. Background Art
[0002] In rainy weather, raindrops will cause the vehicle's video image to be blurred and the information to be covered, which will cause a certain degree of occlusion on the road conditions, thus affecting the subsequent video image processing process. If obstacles (people, cars and other obstacles) in front of the vehicle are not identified in time, it is easy to cause safety accidents.
[0003] In order to solve the above problems, the prior art proposes a color correction algorithm based on channel restoration and a brightness channel enhancement method to process images in rainy environments. Although this method can improve the clarity of the image to a certain extent, the clarity of the processed image may not meet the recognition requirements, and the method fails to remove raindrops in the image, and the optimization effect is limited. In the subsequent obstacle detection process, the detection effect is not ideal, which affects the safety of vehicle driving. Summary of the invention
[0004] The present application provides a method, system, device and storage medium for processing rainy road condition videos, which are used to improve the clarity of rainy road condition images, so as to reduce the impact of rainy days on vehicle identification systems, and thereby improve the driving safety of vehicles in rainy environments.
[0005] In view of this, the first aspect of the present application provides a method for processing rainy road condition videos, comprising:
[0006] Determine whether the image frame of the road condition video collected in the rainy environment meets the clarity requirement. If not, determine the rain intensity of the image frame;
[0007] When the rain in the image frame is judged to be light rain, the dark channel defogging algorithm is used to remove the rain fog in the image frame;
[0008] When it is determined that the rain in the image frame is heavy rain, the median filtering method is used to remove the raindrops in the image frame, and the motion trajectory of the object in the image frame after the raindrops are removed is obtained. According to the motion trajectory of the object, it is determined whether there is a long raindrop area in the image frame after the raindrops are removed. If so, the long raindrop area is processed according to the motion trajectory around the long raindrop area.
[0009] Optionally, the determining whether the image frames of the road condition video collected in the rainy environment meet the definition requirement includes:
[0010] Performing a second-order derivative operation on the image frames of the road condition video collected in a rainy environment, and calculating the variance of the image frames according to the second-order derivatives of the image frames;
[0011] If the variance of the image frame is greater than or equal to the clarity threshold, it is determined that the image frame meets the clarity requirement;
[0012] If the variance of the image frame is less than the clarity threshold, it is determined that the image frame does not meet the clarity requirement.
[0013] Optionally, the process of obtaining the clarity threshold includes:
[0014] Perform image recognition on sample images with different variances and obtain the recognition rate;
[0015] The minimum value of the variance of the sample images whose recognition rate is higher than the preset recognition rate threshold is taken as the clarity threshold.
[0016] Optionally, determining the rain intensity of the image frame includes:
[0017] The variance of the image frame is compared with the rain intensity variance threshold to determine the rain intensity of the image frame.
[0018] Optionally, after removing raindrops from the image frame by using the median filtering method and before obtaining the motion trajectory of the object in the image frame after the raindrops are removed, the method further includes:
[0019] The image super-resolution method is used to process the image frames after removing the raindrops, and the processed image frames are sharpened.
[0020] Optionally, obtaining the motion trajectory of the object in the image frame after the raindrops are removed includes:
[0021] The object detection method is used to detect the object in the image frame after the raindrops are removed;
[0022] The optical flow method is used to track the objects in the image frame after the raindrops are removed to obtain the motion trajectory of the objects.
[0023] Optionally, judging whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object includes:
[0024] Calculate the similarity between the motion trajectories of objects;
[0025] It is determined whether there are two or more objects whose motion trajectories have a similarity higher than a similarity threshold. If so, it is determined that there is a long raindrop area in the image frame after the raindrops are removed, and the long raindrop area is a region between the two or more objects whose motion trajectories have a similarity higher than the similarity threshold.
[0026] Optionally, processing the long raindrop area according to the motion trajectory around the long raindrop area includes:
[0027] The identification area where two or more objects having similarity of motion trajectories around the long raindrop area higher than a similarity threshold are located is connected with the long raindrop area to form one identification area, and the objects in the identification area are marked as the same object.
[0028] The second aspect of the present application provides a rainy day road condition video processing system, comprising:
[0029] A judgment unit, used to judge whether the image frame of the road condition video collected in the rainy environment meets the definition requirement, and if not, to judge the rain intensity of the image frame;
[0030] A light rain processing unit, for removing rain fog in the image frame by using a dark channel defogging algorithm when the rain in the image frame is determined to be light rain;
[0031] The heavy rain processing unit is used to remove raindrops in the image frame by using a median filtering method when it is determined that the rain in the image frame is heavy rain, obtain the motion trajectory of the object in the image frame after the raindrops are removed, and determine whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object, and if so, process the long raindrop area according to the motion trajectory around the long raindrop area.
[0032] A third aspect of the present application provides an electronic device, the device comprising a processor and a memory;
[0033] The memory is used to store program code and transmit the program code to the processor;
[0034] The processor is used to execute the rainy road condition video processing method described in any one of the first aspects according to the instructions in the program code.
[0035] A fourth aspect of the present application provides a computer-readable storage medium, which is used to store program code. When the program code is executed by a processor, it implements the rainy road condition video processing method described in any one of the first aspects.
[0036] It can be seen from the above technical solutions that this application has the following advantages:
[0037] The rainy day road condition video processing method provided by the present application judges the clarity of the image frame of the road condition video in the rainy day environment, and removes raindrops when the clarity of the image frame does not meet the recognition requirements, thereby improving the clarity of the road condition video, reducing the impact of rain on the vehicle recognition system, and thus improving the driving safety of the vehicle in the rainy day environment;
[0038] Furthermore, the present application determines the rain intensity of the image frame and adopts different processing methods for different rain intensities to obtain a better raindrop removal effect;
[0039] In addition, the present application aims at the situation where long raindrops that may be formed under heavy rain cannot be removed by the median filtering method. By acquiring the motion trajectory of the object in the image frame, it is determined whether there are long raindrops, and the existing long raindrops are removed, thereby achieving raindrop removal under heavy rain and improving the raindrop removal effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0041] Figure 1 A flowchart of a method for processing rainy road condition video provided in an embodiment of the present application;
[0042] Figure 2 A structural schematic diagram of a rainy day road condition video processing system provided in an embodiment of the present application. DETAILED DESCRIPTION
[0043] The present application provides a method, system, device and storage medium for processing rainy road condition videos, which are used to improve the clarity of rainy road condition images, so as to reduce the impact of rainy days on vehicle identification systems, and thereby improve the driving safety of vehicles in rainy environments.
[0044] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0045] For easier understanding, please refer to Figure 1 , the embodiment of the present application provides a method for processing rainy road condition video, comprising:
[0046] Step 110: determine whether the image frame of the road condition video collected in the rainy environment meets the definition requirement. If not, determine the rain intensity of the image frame.
[0047] Considering that raindrops in rainy days will block the vehicle camera, resulting in a decrease in the clarity of the collected road condition video, which in turn affects the subsequent image processing process. Therefore, after collecting the road condition video in a rainy day environment, the clarity of the image frame of the road condition video is judged to determine whether the image frame of the road condition video in a rainy day environment meets the clarity requirements. If the clarity of the image frame does not meet the clarity requirements, it will lead to the subsequent inability to normally identify obstacles in the image frame, and it is necessary to further remove the raindrops in the image frame. If the clarity of the image frame meets the clarity requirements, obstacle detection can be directly performed on it.
[0048] Furthermore, the clarity judgment process of the image frame of the traffic video in the present application may be:
[0049] Performing a second-order derivative operation on the image frames of the road condition video collected in a rainy environment, and calculating the variance of the image frames according to the second-order derivatives of the image frames;
[0050] If the variance of the image frame is greater than or equal to the clarity threshold, it is determined that the image frame meets the clarity requirement;
[0051] If the variance of the image frame is less than the clarity threshold, it is determined that the image frame does not meet the clarity requirement.
[0052] After calculating the variance of the image frame, the clarity of the image frame can be determined based on the variance of the image frame. The larger the variance value, the clearer the image frame, and the smaller the variance value, the less clear the image frame. In the present application, image recognition is performed on sample images with different variances to obtain a recognition rate; the minimum value of the variance of the sample images with a recognition rate higher than a preset recognition rate threshold is used as a clarity threshold. Image frames with a variance greater than or equal to the clarity threshold are determined to be recognizable images, that is, they meet the clarity requirement, and image frames with a variance less than the clarity threshold are determined to not meet the clarity requirement.
[0053] When the variance of a certain image frame in the traffic video is identified to be less than the clarity threshold, the rain intensity of the image frame is further determined. In order to reduce resource waste, the rain intensity of the image frame can be determined by extracting frames.
[0054] Among them, a number of road condition images in heavy rain environment and light rain environment are obtained, and the variance set of the road condition images is calculated, and a variance (generally a variance critical value between light rain and heavy rain) is determined in the variance set as a rain variance threshold. The variance of the image frame is compared with the rain variance threshold to determine the size of the rain in the image frame, and the rain in the image frame whose variance is less than the rain variance threshold is determined to be light rain, and the rain in the image frame whose variance is greater than or equal to the rain variance threshold is determined to be heavy rain.
[0055] Step 120: When it is determined that the rain in the image frame is light rain, a dark channel defogging algorithm is used to remove rain fog in the image frame.
[0056] When it is determined that the rain in the image frame is light rain, considering that dense light rain appears as rain fog effect in the image, the present application adopts a dark channel defogging algorithm to remove the light rain similar to fog in the image frame.
[0057] Step 130: When it is determined that the rain in the image frame is heavy rain, a median filtering method is used to remove raindrops in the image frame, and a motion trajectory of the object in the image frame after the raindrops are removed is obtained. Based on the motion trajectory of the object, it is determined whether there is a long raindrop area in the image frame after the raindrops are removed. If so, the long raindrop area is processed based on the motion trajectory around the long raindrop area.
[0058] When it is determined that the rain in the image frame is heavy rain, the dense heavy rain is similar to noise points. Therefore, the present application adopts a median filtering method to remove raindrops in the image frame.
[0059] This application takes into account the special situation that in a heavy rain environment, rain will be stuck on the camera and the rain will slide down, forming long raindrops in front of the lens. When the camera moves, the photographed objects will produce motion trajectories, but the rain stuck on the camera will not; at the same time, long raindrops may split the photographed objects. When the median filtering method is used to remove raindrops in the image frame, small raindrops (relative to long raindrops) are removed. If the median filtering method is used to remove long raindrops in the image frame, a larger range needs to be set (due to the large range of long raindrops), which will cause the processed image frame to be more blurred. Therefore, after the median filtering method is used to remove small raindrops in the image frame, it is further determined whether there are long raindrops in the image frame where the small raindrops are removed. If there are, it is necessary to further process it. Specifically, the present application further obtains the motion trajectory of the object in the image frame after the raindrops are removed. The target detection method (such as using the YOLO model to detect the object in the image frame after the raindrops are removed) can be used to detect the object in the image frame after the raindrops are removed; the optical flow method is used to track the object in the image frame after the raindrops are removed to obtain the motion trajectory of the object. Due to the existence of long raindrops, some objects will be identified as two or more different individuals. Therefore, after obtaining the motion trajectory, the similarity between the motion trajectories can be calculated. Specifically, the similarity between the motion trajectories can be obtained by calculating the Flamenche distance between the motion trajectories. The similarity between the motion trajectories is compared with the similarity threshold to determine whether there are two or more objects whose motion trajectories have a similarity higher than the similarity threshold. If so, it is determined that there is a long raindrop area in the image frame after the raindrops are removed, and the long raindrop area is the area between two or more objects whose motion trajectory similarity is higher than the similarity threshold. The identification area where two or more objects whose motion trajectory similarity around the long raindrop area is higher than the similarity threshold are connected to the long raindrop area as one identification area, and the objects in the identification area are marked as the same object until the long raindrop area cannot be detected, thereby removing the long raindrops in the image frame.
[0060] Furthermore, after removing the raindrops from the image frame and before obtaining the motion trajectory of the object in the image frame after the raindrops are removed, the image frame after the raindrops are removed can be processed using an image super-resolution method to clarify the blurred image. At the same time, the image frame can also be sharpened to enhance the object features in the image frame and improve the object detection accuracy of the image frame.
[0061] The rainy day road condition video processing method provided by the present application judges the clarity of the image frame of the road condition video in the rainy day environment, and removes raindrops when the clarity of the image frame does not meet the recognition requirements, thereby improving the clarity of the road condition video, reducing the impact of rain on the vehicle recognition system, and thus improving the driving safety of the vehicle in the rainy day environment;
[0062] Furthermore, the present application determines the rain intensity of the image frame and adopts different processing methods for different rain intensities to obtain a better raindrop removal effect;
[0063] In addition, the present application aims at the situation where long raindrops that may be formed under heavy rain cannot be removed by the median filtering method. By acquiring the motion trajectory of the object in the image frame, it is determined whether there are long raindrops, and the existing long raindrops are removed, thereby achieving raindrop removal under heavy rain and improving the raindrop removal effect.
[0064] Please refer to Figure 2 The embodiment of the present application provides a rainy day road condition video processing system, comprising:
[0065] A judgment unit, used to judge whether the image frame of the road condition video collected in the rainy environment meets the definition requirement, and if not, to judge the rain intensity of the image frame;
[0066] A light rain processing unit, for removing rain fog in the image frame by using a dark channel defogging algorithm when the rain in the image frame is determined to be light rain;
[0067] The heavy rain processing unit is used to remove raindrops in the image frame by using a median filtering method when it is determined that the rain in the image frame is heavy rain, obtain the motion trajectory of the object in the image frame after the raindrops are removed, and determine whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object. If so, the long raindrop area is processed according to the motion trajectory around the long raindrop area.
[0068] As a further improvement, the judging unit specifically includes:
[0069] The clarity judgment subunit is used to perform a second-order derivative operation on the image frame of the road condition video collected in a rainy environment, and calculate the variance of the image frame according to the second-order derivative of the image frame;
[0070] If the variance of the image frame is greater than or equal to the clarity threshold, it is determined that the image frame meets the clarity requirement;
[0071] If the variance of the image frame is less than the clarity threshold, it is determined that the image frame does not meet the clarity requirement, and the rain intensity judgment subunit is triggered;
[0072] The rain intensity judgment subunit is used to:
[0073] The variance of the image frame is compared with the rain intensity variance threshold to determine the rain intensity of the image frame.
[0074] As a further improvement, the heavy rain processing unit is specifically used to:
[0075] When it is determined that the rain in the image frame is heavy rain, the median filtering method is used to remove the raindrops in the image frame;
[0076] The object in the image frame after the raindrops are removed is detected by using a target detection method, and the object in the image frame after the raindrops are removed is tracked by using an optical flow method to obtain the motion trajectory of the object;
[0077] Calculate the similarity between the motion trajectories of objects;
[0078] Determine whether there are two or more objects whose motion trajectories have a similarity higher than a similarity threshold, and if so, determine that there is a long raindrop region in the image frame after the raindrops are removed, and the long raindrop region is a region between the two or more objects whose motion trajectories have a similarity higher than the similarity threshold;
[0079] The identification area where two or more objects having similarity of motion trajectories around the long raindrop area higher than a similarity threshold are located is connected with the long raindrop area to form one identification area, and the objects in the identification area are marked as the same object.
[0080] The rainy day road condition video processing system provided by the present application judges the clarity of the image frames of the road condition video in the rainy day environment, and removes raindrops when the clarity of the image frame does not meet the recognition requirements, thereby improving the clarity of the road condition video, reducing the impact of rain on the vehicle recognition system, and thus improving the driving safety of the vehicle in the rainy day environment;
[0081] Furthermore, the present application determines the rain intensity of the image frame and adopts different processing methods for different rain intensities to obtain a better raindrop removal effect;
[0082] In addition, the present application aims at the situation where long raindrops that may be formed under heavy rain cannot be removed by the median filtering method. By acquiring the motion trajectory of the object in the image frame, it is determined whether there are long raindrops, and the existing long raindrops are removed, thereby achieving raindrop removal under heavy rain and improving the raindrop removal effect.
[0083] The embodiment of the present application also provides an electronic device, the device comprising a processor and a memory;
[0084] The memory is used to store the program code and transmit the program code to the processor;
[0085] The processor is used to execute the rainy road condition video processing method in the aforementioned method embodiment according to the instructions in the program code.
[0086] An embodiment of the present application also provides a computer-readable storage medium, characterized in that the computer-readable storage medium is used to store program code, and when the program code is executed by a processor, the rainy road condition video processing method in the aforementioned method embodiment is implemented.
[0087] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.
[0088] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0089] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0090] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0091] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0092] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0093] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions for executing all or part of the steps of the method described in each embodiment of the present application through a computer device (which can be a personal computer, server, or network device, etc.). The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (full name in English: Read-Only Memory, English abbreviation: ROM), random access memory (full name in English: Random Access Memory, English abbreviation: RAM), disk or optical disk and other media that can store program codes.
[0094] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for processing rainy day road condition video, characterized in that: include: Determine whether the image frame of the road condition video collected in the rainy environment meets the clarity requirement. If not, determine the rain intensity of the image frame; When the rain in the image frame is judged to be light rain, the dark channel defogging algorithm is used to remove the rain fog in the image frame; When it is determined that the rain in the image frame is heavy rain, a median filtering method is used to remove raindrops in the image frame, a motion trajectory of an object in the image frame after the raindrops are removed is obtained, and it is determined whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object, and if there is, the long raindrop area is processed according to the motion trajectory around the long raindrop area; The processing of the long raindrop area according to the motion track around the long raindrop area includes: The identification area where two or more objects having similarity of motion trajectories around the long raindrop area higher than a similarity threshold are located is connected with the long raindrop area to form one identification area, and the objects in the identification area are marked as the same object.
2. The method for processing rainy road condition video according to claim 1, characterized in that: The step of judging whether the image frames of the road condition video collected in the rainy environment meet the definition requirements includes: Performing a second-order derivative operation on the image frames of the road condition video collected in a rainy environment, and calculating the variance of the image frames according to the second-order derivatives of the image frames; If the variance of the image frame is greater than or equal to the clarity threshold, it is determined that the image frame meets the clarity requirement; If the variance of the image frame is less than the clarity threshold, it is determined that the image frame does not meet the clarity requirement.
3. The rainy day road condition video processing method according to claim 2, characterized in that: The process of obtaining the clarity threshold includes: Perform image recognition on sample images with different variances and obtain the recognition rate; The minimum value of the variance of the sample images whose recognition rate is higher than the preset recognition rate threshold is taken as the clarity threshold.
4. The method for processing rainy road condition video according to claim 2, characterized in that: The step of determining the rain intensity of the image frame comprises: The variance of the image frame is compared with the rain intensity variance threshold to determine the rain intensity of the image frame.
5. The method for processing rainy road condition video according to claim 1, characterized in that: After removing raindrops from the image frame by using the median filtering method and before obtaining the motion trajectory of the object in the image frame after removing the raindrops, the method further includes: The image super-resolution method is used to process the image frames after removing the raindrops, and the processed image frames are sharpened.
6. The method for processing rainy road condition video according to claim 1, characterized in that: The step of obtaining the motion trajectory of the object in the image frame after removing the raindrops comprises: The object detection method is used to detect the object in the image frame after the raindrops are removed; The optical flow method is used to track the objects in the image frame after the raindrops are removed to obtain the motion trajectory of the objects.
7. The method for processing rainy road condition video according to claim 1, characterized in that: The step of judging whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object comprises: Calculate the similarity between the motion trajectories of objects; It is determined whether there are two or more objects whose motion trajectories have a similarity higher than a similarity threshold. If so, it is determined that there is a long raindrop area in the image frame after the raindrops are removed, and the long raindrop area is a region between the two or more objects whose motion trajectories have a similarity higher than the similarity threshold.
8. A rainy day road condition video processing system, characterized in that: include: A judgment unit, used to judge whether the image frame of the road condition video collected in the rainy environment meets the definition requirement, and if not, to judge the rain intensity of the image frame; A light rain processing unit, for removing rain fog in the image frame by using a dark channel defogging algorithm when the rain in the image frame is determined to be light rain; A heavy rain processing unit is used to, when determining that the rain in the image frame is heavy rain, remove raindrops in the image frame by using a median filtering method, obtain a motion trajectory of an object in the image frame after the raindrops are removed, and determine whether there is a long raindrop area in the image frame after the raindrops are removed according to the motion trajectory of the object, and if so, process the long raindrop area according to the motion trajectory around the long raindrop area; The processing of the long raindrop area according to the motion track around the long raindrop area includes: The identification area where two or more objects having similarity of motion trajectories around the long raindrop area higher than a similarity threshold are located is connected with the long raindrop area to form one identification area, and the objects in the identification area are marked as the same object.
9. An electronic device, characterized in that: The device comprises a processor and a memory; The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the rainy road condition video processing method described in any one of claims 1-7 according to the instructions in the program code.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program codes, and when the program codes are executed by a processor, the method for processing rainy road condition videos according to any one of claims 1 to 7 is implemented.
