Method for transmitting key monitoring data of wind and rain on the basis of 5g camera

By adopting a key data transmission method based on 5G cameras, and utilizing image and video processing frameworks and AI pre-analysis modules, the problems of inflexible data processing and unstable transmission in monitoring systems under windy and rainy weather conditions were solved, achieving efficient and reliable data transmission and processing under adverse weather conditions.

WO2024230075A1PCT designated stage expired Publication Date: 2024-11-14GUANGDONG POWER TELECOMMUNICATION TECHNOLOGY CO LTD

Patent Information

Application Number
PCT/CN2023/126847
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-09
Filing Date
2023-10-26
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Existing surveillance technologies suffer from image and video quality issues in windy and rainy weather, unstable network signals leading to unstable data transmission and slow processing, resulting in a lack of flexibility and efficiency.

Method used

A key data transmission method based on 5G cameras is adopted. Video data is acquired through the main control CPU, and modular processing is performed using image and video processing frameworks to generate key data streams. In addition, an AI pre-analysis module is used to optimize data transmission under adverse weather conditions and dynamically adjust the processing flow to adapt to changes in network signal.

Benefits of technology

It improves the processing efficiency and reliability of the monitoring system under severe weather conditions, ensures the accurate transmission and real-time response of critical data, and reduces the impact of network signal fluctuations on the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023126847_14112024_PF_FP_ABST
    Figure CN2023126847_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed in the present invention is a method for transmitting key monitoring data of wind and rain on the basis of a 5G camera. The method comprises: a main control CPU connecting to a camera by means of a CSI, so as to acquire video data; a data processing module generating core data of an image or a video; and an AI pre-analysis module generating a key data stream according to information of a processed image and video, and uploading the key data stream to a cloud. In the method for transmitting key monitoring data of wind and rain on the basis of a 5G camera provided in the present invention, an image processing framework and a video processing framework are integrated into a unified processing flow, such that modular registration and dynamic loading are realized, and the processing efficiency is improved. The AI pre-analysis module performs analysis in advance and generates the key data stream, and the cloud may obtain clear data by merely using a small amount of video data. The present invention achieves better effects in the aspects of processing speed, resistance to severe weather, data pertinence, etc.
Need to check novelty before this filing date? Find Prior Art

Description

A method for transmitting key data of windy and rainy weather monitoring based on 5G cameras Technical Field

[0001] The present invention relates to the field of camera recognition technology, and specifically to a method for transmitting key monitoring data in windy and rainy weather based on a 5G camera. Background Art

[0002] With the development of science and technology, 5G technology provides faster and more stable network connections for fields such as the Internet of Things, smart cities, and remote monitoring. However, in practical applications, cameras may be obstructed when capturing images and videos due to adverse weather conditions such as wind and rain, resulting in reduced image quality and affecting the accuracy of target detection and tracking. In addition, fluctuations in network signal strength can cause data transmission delays or interruptions, further reducing the reliability of monitoring systems.

[0003] Existing monitoring technologies face multiple challenges in windy and rainy weather conditions: image and video quality is affected by natural factors such as rain and wind speed. Network signals are poor in windy and rainy weather, and sensor data is affected by fluctuations in network signal strength, which may lead to unstable data transmission, transmission of erroneous data, excessive and untargeted data transmission, and slow processing. The current image processing framework and video processing framework are relatively independent and mainly distributed in the cloud. The camera lacks a built-in preprocessing module, resulting in an inflexible and inefficient data processing process.

[0004] To address these challenges, a method for transmitting critical monitoring data in rainy and windy weather, based on 5G cameras, is urgently needed. By optimizing the processing and transmission of image and video data in these conditions, the performance and reliability of the monitoring system can be improved in adverse weather conditions. A modular design enables flexible configuration and efficient operation of the image and video processing frameworks, providing a new solution for the future development of monitoring technology.

[0005] Summary of the Invention

[0006] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract and title of this application to avoid obscuring the purpose of this section, the abstract and the title of the invention, and such simplifications or omissions should not be used to limit the scope of the present invention.

[0007] In view of the above-mentioned problems, the present invention is proposed.

[0008] Therefore, the technical problems solved by the present invention are: the existing monitoring technology is seriously affected by weather, sends all monitoring data, lacks specificity, and is slow to process, as well as how to optimize the distribution of data processing processes between cameras and the cloud.

[0009] To solve the above technical problems, the present invention provides the following technical solutions: a method for transmitting key data of windy and rainy weather monitoring based on a 5G camera, comprising:

[0010] The main control CPU connects to the camera through the CSI interface to obtain video data;

[0011] The data processing module generates the core data of the image or video;

[0012] The AI ​​pre-analysis module generates key data streams based on the processed image and video information and uploads them to the cloud.

[0013] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, the main control CPU connects to the camera through the CSI interface to obtain video data, including connecting the main control CPU to multiple digital cameras or MIPI cameras through the CSI interface, and the cameras transmit images and videos to the image processing framework and the video processing framework.

[0014] As a preferred solution of the method for transmitting key data of monitoring windy and rainy weather based on 5G cameras according to the present invention, the image processing framework and the video processing framework include: after receiving the image, the image processing framework generates an image processing module with image filtering, morphological operation, feature segmentation, feature extraction, edge detection and image enhancement based on the decoded image data; after the processing is completed, the image is encoded into jpeg and png formats and sent to the AI ​​pre-analysis module;

[0015] After receiving the video, the video processing framework converts the video into a video data block based on the H.265 encoding, and generates a video processing module with the video data block as the core, which includes stream conversion, video compression, video enhancement, video preloading, RTSP protocol push and RTP protocol push.

[0016] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, the image processing framework and the video processing framework also include: the video processing module and the image processing module are registered to the framework in a modular manner, dynamically loading and preloading the mounting function, and controlling the enabling or stopping of the mounting function through an open interface API.

[0017] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras according to the present invention, the AI ​​pre-analysis module includes: after completing the processing of images and videos, the serial data receives external wind speed and rainfall data, the sensor program pushes the received data to the cloud, the cloud sends a control command to the control logic unit, and the logic unit determines the wind speed and rainfall to perform operations;

[0018] When the wind speed is less than 6m / s and the rainfall is less than 8mm / h, the camera is judged to be in the presence of rain, which does not affect the camera's acquisition of images and videos. If the network signal strength is greater than -70dBm, the video and image data are directly uploaded to the cloud. If -70dBm is less than the network signal strength and less than -75dBm, the image and video resolution is reduced and the compression ratio is increased to reduce transmission pressure, and the data is uploaded to the cloud. If the network signal strength is less than -75dBm, it is considered a device failure or network information blocking, and the data is saved in the data cache and encrypted.

[0019] When the wind speed is 6m / s≤≤14m / s, and the rainfall is 8mm / h≤≤18mm / h, the camera is judged to be blocked by rain, and the captured images and videos are partially obscured. The images and videos are transferred to the AI ​​pre-analysis module, where noise is reduced through median filtering, objects are identified using the SSD target detection algorithm, human body detection is performed using the OpenPose algorithm, and target tracking is performed using the TLD target tracking algorithm. After identifying the preset dangerous event, the pre-analysis result is sent to the cloud in the form of an alarm. If the network signal strength is less than -75dBm, serial data is received in the same area to determine the network signal strength of 5G cameras in the same area. If both are less than -75dBm, the signal is considered to be affected by the weather. Otherwise, it is judged as a device failure or network information blocking.

[0020] When the wind speed is greater than 14m / s and the rainfall is greater than 18mm / h, it is judged that there is rain on the camera, and the camera is blocked by rain. All the acquired images and videos are blocked. The images and videos are transferred to the AI ​​pre-analysis module. The deep learning deraining network is used for processing and the image and video are fused for multi-frame image fusion analysis. After the analysis is completed, target detection, human detection and target tracking are performed. The tracking results are optimized and corrected based on historical tracking data and target motion characteristics. After the correction is completed, the identified preset dangerous events are forwarded to the cloud in the form of alarms. If the signal is less than -80dBm, the video stream or serial data is temporarily saved in the data cache. When the network is restored, the data is retransmitted.

[0021] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, the AI ​​pre-analysis module also includes that when the wind speed is greater than 16m / s, the camera shakes, and the acquired images and videos are blurred, the images and videos are transferred to the AI ​​pre-analysis module, low-filtering and noise reduction are performed on the images, non-motion frames of the videos are extracted, motion information is calculated based on the pixel changes between the two frames of images, and motion compensation is performed on the images based on the calculated motion information, and dangerous events are identified on the processed images and videos.

[0022] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, the key data stream includes processed image and video data, wind speed and rainfall data, AI pre-analysis of dangerous event types, and request for camera steering instructions.

[0023] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, the request for camera steering instruction includes sending a target tracking request to the cloud after the AI ​​pre-analysis module identifies the preset dangerous time, converting the target tracking recorded in the video into the target tracking of the camera, and recording the dangerous time status in real time.

[0024] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, a computer device includes a memory and a processor, the memory stores a computer program, and is characterized in that when the processor executes the computer program, a method for transmitting key data for monitoring windy and rainy weather based on 5G cameras is implemented.

[0025] As a preferred solution of the method for transmitting key data for monitoring windy and rainy weather based on 5G cameras described in the present invention, it includes: a computer-readable storage medium on which a computer program is stored, characterized in that when the computer program is executed by a processor, a method for transmitting key data for monitoring windy and rainy weather based on 5G cameras is implemented.

[0026] The beneficial effects of the present invention are as follows: The image processing framework and video processing framework of the 5G camera-based method for transmitting key data for monitoring windy and rainy weather are integrated into a unified processing flow, enabling modular registration and dynamic loading, thereby improving processing efficiency. The AI ​​pre-analysis module performs advance analysis and generates key data streams, allowing the cloud to obtain clear data with only a small amount of video data. This method achieves superior results in terms of processing speed, resistance to adverse weather conditions, and data targeting. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive effort. Among them:

[0028] FIG1 is an overall flow chart of a method for transmitting key data for monitoring windy and rainy weather based on a 5G camera provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0029] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the following detailed description of the specific embodiments of the present invention is given in conjunction with the accompanying drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in this field without creative work should fall within the scope of protection of the present invention.

[0030] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0031] Secondly, the term "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in various places throughout this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive of other embodiments.

[0032] The present invention is described in detail with reference to schematic diagrams. For ease of illustration, cross-sectional views of device structures may be partially enlarged and not to scale when describing embodiments of the present invention. Furthermore, the schematic diagrams are merely illustrative and should not limit the scope of the present invention. Furthermore, in actual production, the three-dimensional dimensions of length, width, and depth should be included.

[0033] In the description of the present invention, it should be noted that the terms "upper, lower, inner, and outer" and other references to orientations or positional relationships are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate and simplify the description of the present invention. They are not intended to indicate or imply that the devices or components referred to must have, be constructed, or operate in a specific orientation, and therefore should not be construed as limitations on the present invention. Furthermore, the terms "first, second, or third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0034] In this disclosure, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be interpreted broadly. For example, they may refer to fixed, removable, or integral connections. They may also refer to mechanical, electrical, or direct connections, indirect connections through an intermediary, or internal communication between two components. Those skilled in the art will understand the specific meanings of these terms in this disclosure.

[0035] Example 1

[0036] 1 , an embodiment of the present invention provides a method for transmitting key data of windy and rainy weather monitoring based on a 5G camera, including:

[0037] S1: The main control CPU connects to the camera through the CSI interface to obtain video data.

[0038] Furthermore, the main control CPU is connected to multiple digital cameras or MIPI cameras through the CSI interface, and the cameras transmit images and videos to the image processing framework and video processing framework.

[0039] It should be noted that by connecting multiple digital cameras or MIPI cameras through the CSI interface, images or video streams captured by multiple cameras can be obtained simultaneously, enabling a single CPU to obtain multiple data and send the data to the image processing framework and video processing framework in a unified manner to ensure the processing efficiency of the device.

[0040] S2: The data processing module generates the core data of the image or video.

[0041] Furthermore, the image processing framework: after receiving the image, the image processing framework uses the decoded image data as the core to generate an image processing module that includes image filtering, morphological operations, feature segmentation, feature extraction, edge detection, and image enhancement. After processing, the image is encoded into jpeg and png formats and sent to the AI ​​pre-analysis module.

[0042] The video processing framework includes: after receiving the video, the video processing framework converts the video into a video data block based on the H.265 encoding, and generates a video processing module with the video data block as the core, including stream conversion, video compression, video enhancement, video preloading, RTSP protocol push and RTP protocol push.

[0043] It should be noted that the video processing module and the image processing module are registered to the framework in a modular manner, dynamically loading and preloading the hooking function, and controlling the activation or disabling of the hooking function through an open interface API.

[0044] It should also be noted that hooked functions can be dynamically loaded and preloaded based on actual needs, thereby reducing unnecessary computing resource consumption. For example, in scenarios where edge detection is not required, no loading is performed, saving computing resources. This functional design makes it easy to add new features or upgrade existing features to the image and video processing frameworks, helping to improve the system's maintainability and upgradeability, adapting to future technological developments.

[0045] Furthermore, H.265's high compression ratio is well-suited for our invention's data transmission needs in cross-network environments. This high compression ratio reduces data transmission pressure and allows for more local video storage even when network signals are insufficient for transmission. H.265 also offers low encoding and decoding latency, making it suitable for video applications requiring real-time camera processing and transmission. Compared to H.264, H.265 can halve the bitrate while maintaining the same image quality, reducing resource usage.

[0046] S3: The AI ​​pre-analysis module generates key data streams based on the processed image and video information and uploads them to the cloud.

[0047] Furthermore, the AI ​​pre-analysis module includes: after completing the processing of images and videos, the serial data receives external wind speed and rainfall data, the sensor program pushes the received data to the cloud, the cloud sends control commands to the control logic unit, and the logic unit determines the wind speed and rainfall to perform operations.

[0048] When the wind speed is less than 6m / s and the rainfall is less than 8mm / h, it is judged that there is rain on the camera, which does not affect the camera's acquisition of images and videos. If the network signal strength is greater than -70dBm, the video and image data are directly uploaded to the cloud. If -70dBm is less than the network signal strength and less than -75dBm, the resolution of the image and video is reduced and the compression ratio is increased to reduce transmission pressure, and the data is uploaded to the cloud. If the network signal strength is less than -75dBm, it is considered that the device is faulty or blocked by network information, and the data is saved in the data cache and encrypted.

[0049] When wind speed is 6m / s ≤ ≤ 14m / s and rainfall is 8mm / h ≤ ≤ 18mm / h, the camera is judged to be blocked by rain, and the captured images and videos are partially obscured. The images and videos are transferred to the AI ​​pre-analysis module, where noise is reduced through median filtering, objects are identified using the SSD target detection algorithm, people are detected using the OpenPose algorithm, and targets are tracked using the TLD target tracking algorithm. After identifying a preset dangerous event, the pre-analysis result is sent to the cloud in the form of an alarm. If the network signal strength is less than -75dBm, serial data is received in the same area to determine the network signal strength of 5G cameras in the same area. If both are less than -75dBm, the signal is considered to be affected by weather. Otherwise, it is judged to be a device failure or network information blocking.

[0050] When the wind speed is greater than 14m / s and the rainfall is greater than 18mm / h, it is judged that there is rain on the camera, and the camera is blocked by rain. All the acquired images and videos are blocked. The images and videos are transferred to the AI ​​pre-analysis module. The deep learning deraining network is used for processing and the image and video are fused for multi-frame image fusion analysis. After the analysis is completed, target detection, human detection and target tracking are performed. The tracking results are optimized and corrected based on historical tracking data and target motion characteristics. After the correction is completed, the identified preset dangerous events are forwarded to the cloud in the form of alarms. If the signal is less than -80dBm, the video stream or serial data is temporarily saved in the data cache. When the network is restored, the data is retransmitted.

[0051] It should be noted that when the wind speed is greater than 16m / s, the camera shakes, and the acquired images and videos are blurred. The images and videos are transferred to the AI ​​pre-analysis module, low-filtering and noise reduction are performed on the images, non-motion frames are extracted from the videos, and motion information is calculated based on the pixel changes between the two frames. The images are motion compensated based on the calculated motion information, and dangerous events are identified on the processed images and videos.

[0052] It should also be noted that the selected thresholds are experimental results, dividing the wind speed thresholds into three levels: 6m / s, 14m / s, and 16m / s. This setting fully considers the ability of different wind speeds to deflect raindrops, simulating the amount of raindrops that would be blown onto the camera screen in a real-world environment. 16m / s is the jitter threshold measured in an open environment after the camera is installed. The network signal strength is set to -70dBm as the extreme value for stable transmission. When the network signal of ordinary cameras falls below this threshold, transmission will be interrupted. However, our invention is set to -80dBm because our invention converts images and videos into key data streams, and the video is encoded in H.265, which has a high compression ratio, requiring only a short period of network connectivity for data stream transmission.

[0053] It should be noted that the key data streams include: processed image and video data, wind speed and rainfall data, AI pre-analysis of dangerous event types, and requests for camera steering instructions.

[0054] It should also be noted that when the AI ​​pre-analysis module identifies the preset dangerous time, it sends a target tracking request to the cloud, converts the target tracking recorded in the video into the target tracking of the camera, and records the dangerous time status in real time.

[0055] Example 2

[0056] One embodiment of the present invention provides a method for transmitting key data for monitoring windy and rainy weather based on 5G cameras. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through economic benefit calculation and simulation experiments.

[0057] Set different wind and rain weather environments.

[0058] The same monitoring area uses cameras invented by us and traditional technical solutions.

[0059] Images, videos, and sensor data from the two monitoring systems were collected in various wind and rain environments, while the network signal strength was recorded.

[0060] The collected data are uniformly processed and analyzed, and the image, video quality and sensor data transmission effects of the two monitoring systems in different wind and rain environments are compared.

[0061] Analyze the data processing speed and efficiency of the two monitoring systems under different wind and rain environments, and evaluate the system's real-time response capabilities to preset dangerous events.

[0062] As shown in Table 1, a comparison of risk response capabilities, our invention requires fewer signals than traditional solutions in any adverse situation. This is because, in the face of sudden dangerous events, our invention converts video and image data into a key data stream, reducing the need for network signals. Therefore, when network signals are close, our invention is more likely to avoid network interruptions. Because our invention processes images before generating the key data stream, image quality degradation due to transmission issues is avoided, resulting in significantly improved image quality. Converting dangerous event information into a key data stream and sending it to the cloud effectively avoids alarm delays caused by data redundancy, significantly improving the ability to respond to emergencies.

[0063] Table 1 Comparison of risk response capabilities

[0064] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0065] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program code.

[0066] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0067] More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0068] It should be understood that various parts of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

Claims

1. A method for transmitting key data of windy and rainy weather monitoring based on 5G cameras, characterized in that: include: The main control CPU connects to the camera through the CSI interface to obtain video data; The data processing module generates the core data of the image or video; The AI ​​pre-analysis module generates key data streams based on the processed image and video information and uploads them to the cloud.

2. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 1, characterized in that: The main control CPU connects to the camera through the CSI interface to obtain video data, including: the main control CPU connects to multiple digital cameras or MIPI cameras through the CSI interface, and the camera transmits images and videos to the image processing framework and the video processing framework.

3. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 1 or 2, characterized in that: The image processing framework and the video processing framework include: after receiving the image, the image processing framework generates an image processing module for image filtering, morphological operation, feature segmentation, feature extraction, edge detection and image enhancement based on the decoded image data, and after the processing is completed, encodes the image into jpeg and png formats and sends it to the AI ​​pre-analysis module; After receiving the video, the video processing framework converts the video into a video data block based on the H.265 encoding, and generates a video processing module with the video data block as the core, including stream conversion, video compression, video enhancement, video preloading, RTSP protocol push and RTP protocol push.

4. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 3, characterized in that: The image processing framework and the video processing framework also include that the video processing module and the image processing module are registered to the framework in a modular manner, dynamically load and preload the mounting function, and control the activation or stopping of the mounting function through an open interface API.

5. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 4, characterized in that: The AI ​​pre-analysis module includes, after completing the processing of images and videos, the serial data receives external wind speed and rainfall data, the sensor program pushes the received data to the cloud, the cloud sends a control command to the control logic unit, and the logic unit determines the wind speed and rainfall to operate; When the wind speed is less than 6m / s and the rainfall is less than 8mm / h, it is judged that there is rain on the camera, which does not affect the camera's acquisition of images and videos. If the network signal strength is greater than -70dBm, the video and image data are directly uploaded to the cloud. If -70dBm is less than the network signal strength and less than -75dBm, the resolution of the image and video is reduced and the compression ratio is increased to reduce the transmission pressure, and the image and video are uploaded to the cloud. If the network signal strength is less than -75dBm, it is considered that the device is faulty or blocked by network information, and the data is saved in the data cache and encrypted. When 6m / s≤wind speed≤14m / s, 8mm / h≤rainfall≤18mm / h, it is judged that there is rain on the camera, the camera is blocked by rain, and the acquired images and videos are partially blocked. The images and videos are transferred to the AI ​​pre-analysis module to reduce noise through median filtering, identify objects using the SSD target detection algorithm, detect humans using the OpenPose algorithm, and track targets using the TLD target tracking algorithm. After identifying the preset dangerous events, the pre-analysis results are sent to the cloud in the form of an alarm. If the network signal strength is less than -75dBm, serial data in the same area is received to determine the network signal strength of the 5G cameras in the same area. If both are less than -75dBm, it is considered that the signal is affected by the weather. Otherwise, it is judged as a device failure or network information shielding. When the wind speed is greater than 14m / s and the rainfall is greater than 18mm / h, it is judged that there is rain on the camera, the camera is blocked by rain, and all the acquired images and videos are blocked. The images and videos are transferred to the AI ​​pre-analysis module, processed by the deep learning rain removal network and the images and videos are fused for multi-frame image fusion analysis. After the analysis is completed, target detection, human detection and target tracking are performed. The tracking results are optimized and corrected in combination with historical tracking data and target motion characteristics. After the correction is completed, the identified preset dangerous events are forwarded to the cloud in the form of alarms. If the signal is less than -80dBm, the video stream or serial data is temporarily saved in the data cache. When the network is restored, the data is retransmitted.

6. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 5, characterized in that: The AI ​​pre-analysis module also includes: when the wind speed is greater than 16m / s, the camera shakes, and the acquired images and videos are blurred, the images and videos are transferred to the AI ​​pre-analysis module, low-filtering and noise reduction are performed on the images, non-motion frames are extracted from the videos, motion information is calculated based on the pixel changes between the two frames of images, and motion compensation is performed on the images based on the calculated motion information, and dangerous events are identified on the processed images and videos.

7. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 6, characterized in that: The key data streams include processed image and video data, wind speed and rainfall data, AI pre-analysis of dangerous event types, and requests for camera steering instructions.

8. The method for transmitting key data of windy and rainy weather monitoring based on a 5G camera as claimed in claim 7, characterized in that: The camera steering request instruction includes sending a target tracking request to the cloud after the AI ​​pre-analysis module identifies the preset dangerous time, converting the target tracking recorded in the video to the target tracking of the camera, and recording the dangerous time status in real time.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for transmitting key data for monitoring windy and rainy weather based on a 5G camera as described in any one of claims 1 to 8 is implemented.

Citation Information

Patent Citations

  • Video signal pre-processing method for clearly detecting traffic accidents under severe weather condition

    CN103400135A

  • Highway traffic condition detection system and method based on artificial intelligence

    CN110796862A

  • Image processing method and device

    CN114140346A

  • Weather and rainy weather monitoring key data transmission method based on 5G camera

    CN116709037A

  • Handheld comprehensive maintenance terminal with 5G communication function

    CN216775046U

Cited By

  • Video monitoring system based on image feature analysis

    CN120147978A

  • Multi-modal large model-based severe weather vehicle detection method and related equipment

    CN121392773A

  • Power grid dispatching mobile intelligent page adaptive generation method based on polymorphic data

    CN122248135A