Patrol recorder communication connection method and terminal equipment

Abstract

The present invention relates to the field of mobile communication technology, and in particular to a patrol recorder communication connection method and terminal equipment. The method comprises the following steps: by acquiring patrol recorder data and inspection point data, calculating the distance and generating coordinate data. According to a preset trigger distance threshold, the data is screened and scene video retrieval and three-dimensional scene reconstruction are performed to generate a scene model. When the model is consistent, the inspection point data is encoded to generate a LoRa signal, which is forwarded by a gateway to realize the reporting of patrol records without abnormalities. When the model is inconsistent, the difference segmentation obtains the difference area data, and the abnormal patrol record is reported through optical frequency band transmission. Therefore, the present invention improves the convenience and flexibility of data transmission, accurately measures the distance, improves the data processing efficiency, enhances the authenticity and comprehensiveness of the scene information, and realizes high-speed, low-interference and secure data transmission by optical frequency band transmission.

Description

Technical Field

[0001] The present invention relates to the field of mobile communication technology, and in particular to a patrol recorder communication connection method and terminal equipment. Background Art

[0002] Early patrol recorders mainly used wired methods for communication connections, such as using a serial port (RS-232) or parallel port to connect to a computer or server. This connection method is simple and reliable, but it has limitations, such as limited transmission distance and susceptibility to cable failure. The development of wireless communication technology has brought wireless connection capabilities to patrol recorders, such as Bluetooth and Wi-Fi. Wireless connections eliminate the limitations of wired connections and provide greater flexibility and convenience. However, the defects of this stage include limited communication distance, interference, and security issues. With the advancement of mobile communication technology, patrol recorders have begun to support mobile network connections, such as 2G, 3G, 4G, and now 5G. Mobile communications enable patrol recorders to have remote communication and positioning capabilities, and can transmit data and obtain location information in real time. However, the existing technology has problems such as single technical means, low transmission efficiency, limited transmission capacity, poor reliability, and lack of abnormal situation handling mechanism. Summary of the invention

[0003] Based on this, it is necessary to provide a patrol recorder communication connection method and terminal device to solve at least one of the above technical problems.

[0004] To achieve the above purpose, the patrol recorder communication connection method includes the following steps:

[0005] Step S1: obtaining patrol recorder data; obtaining patrol point data; calculating the positioning distance of the patrol recorder data and the patrol point data to generate coordinate distance data;

[0006] Step S2: based on a preset triggerable distance threshold, the coordinate distance data is subjected to trigger distance discrimination to obtain triggerable distance data; based on the triggerable distance data, the patrol recorder data and the inspection point data are subjected to overlapping scene video retrieval to obtain overlapping scene videos; the overlapping scene videos are subjected to three-dimensional scene reconstruction to generate a scene three-dimensional model;

[0007] Step S3: When the scene 3D model is consistent with the preset security inspection point scene model, the inspection point data is encoded as non-video data based on the scene 3D model to obtain the inspection LoRa signal; the inspection LoRa signal is forwarded in the gateway to perform normal patrol record reporting

[0008] Step S4: When the scene three-dimensional model and the preset safety patrol point scene model are inconsistent, the scene three-dimensional model and the preset safety patrol point scene model are segmented to obtain difference area data; the difference area data and the patrol point data are transmitted in the optical frequency band to perform abnormal patrol record reporting.

[0009] The present invention realizes the transmission of patrol recorder data and inspection point data through wireless communication technology. Wireless transmission eliminates the limitations of traditional wired connections, provides greater flexibility and convenience for the acquisition and processing of patrol data, and uses wireless communication technology to calculate the positioning distance, and can accurately measure the distance between the patrol recorder and the patrol point. This wireless positioning technology can accurately locate in a complex environment, provide accurate spatial information for subsequent data processing and analysis, and distinguish the coordinate distance data based on the preset triggerable distance threshold, and determine which patrol records meet the set trigger distance conditions. This discrimination method uses wireless communication data for screening, which improves the efficiency and accuracy of data processing. Through wireless communication data, overlapping scene video retrieval can be performed to quickly find the overlapping scene video corresponding to the patrol point position. The application of this wireless communication technology can save time and resources and improve the acquisition efficiency of overlapping scene videos. Using wireless communication data to reconstruct a three-dimensional scene, a three-dimensional model of the scene can be generated. Such wireless communication technology applications can provide more real and comprehensive scene information, and provide more dimensions and accuracy for subsequent data analysis and processing. When the three-dimensional model of the scene is inconsistent with the preset safety inspection point scene model, the optical frequency band is used to transmit the difference area data and the inspection point data to report the abnormal patrol record. As a high-speed, low-interference and highly secure wireless communication technology, optical frequency band transmission can effectively transmit difference area data and related information to achieve timely reporting of abnormal situations. Therefore, the present invention improves the convenience and flexibility of data transmission, accurately measures distance, improves data processing efficiency, enhances the authenticity and comprehensiveness of scene information, and uses optical frequency band transmission to achieve high-speed, low-interference and secure data transmission.

[0010] In this specification, a patrol recorder communication connection terminal device is provided, wherein the patrol recorder communication connection terminal device has a communication connection controller integrated therein, and the communication connection controller is used to execute the patrol recorder communication connection method as described above, and the communication connection controller includes:

[0011] The trigger acquisition module is used to acquire patrol recorder data; acquire patrol point data; calculate the positioning distance of patrol recorder data and patrol point data to generate coordinate distance data;

[0012] The scene reconstruction module is used to perform trigger distance discrimination on the coordinate distance data based on a preset triggerable distance threshold to obtain triggerable distance data; perform overlapping scene video retrieval on the patrol recorder data and the inspection point data based on the triggerable distance data to obtain overlapping scene videos; perform three-dimensional scene reconstruction on the overlapping scene videos to generate a three-dimensional model of the scene;

[0013] The abnormal communication module is used to encode the inspection point data into non-video data based on the scene 3D model to obtain the inspection LoRa signal when the scene 3D model is consistent with the preset safety inspection point scene model; the inspection LoRa signal is forwarded in the gateway to perform abnormal patrol record reporting

[0014] The abnormal communication module is used to perform difference segmentation on the scene three-dimensional model and the preset safety patrol point scene model when they are inconsistent, so as to obtain difference area data; the difference area data and patrol point data are transmitted in the optical frequency band to execute abnormal patrol record reporting.

[0015] The benefit of the present invention is that the coordinate distance data is judged by using a preset triggerable distance threshold, thereby reducing unnecessary data processing and communication load. This intelligent trigger mechanism can effectively reduce system energy consumption and network traffic. Different communication methods are used for data transmission, including LoRa signals and optical frequency band transmission. This multi-channel data transmission strategy improves the reliability and flexibility of communication and increases the system's adaptability to abnormal situations. Based on overlapping scene videos, three-dimensional scene reconstruction is performed, and the inspection point data is encoded using the scene three-dimensional model. This scene perception method can improve the accuracy and reliability of data, and also provide more information for subsequent data processing and transmission. The abnormal patrol record reporting mechanism can detect and report abnormal situations in a timely manner by performing differential segmentation on the scene three-dimensional model and the preset safety inspection point scene model, thereby improving safety and reliability. The benefit of the present invention lies in the design of intelligent trigger mechanism, multi-channel data transmission strategy, scene perception and three-dimensional reconstruction method, and abnormal handling mechanism. These innovations and optimizations help to improve the efficiency, reliability and safety of the system. Therefore, the present invention improves the convenience and flexibility of data transmission, accurately measures distance, improves data processing efficiency, enhances the authenticity and comprehensiveness of scene information, and realizes high-speed, low-interference and secure data transmission by using optical frequency band transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a flowchart of the steps of the communication connection method of the patrol recorder;

[0017] Figure 2 for Figure 1 Detailed implementation steps of step S2 in the flowchart;

[0018] Figure 3 for Figure 1 Detailed implementation steps of step S3 in FIG.

[0019] Figure 4 for Figure 1 Detailed implementation steps of step S4 in FIG.

[0020] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0021] The technical method of the present invention is described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.

[0022] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.

[0023] It should be understood that, although the terms "first" and "second" are used here to describe each unit, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiment, the first unit can be referred to as the second unit, and similarly the second unit can be referred to as the first unit. The term "and / or" used here includes any and all combinations of one or more of the listed associated items.

[0024] To achieve this, please refer to Figures 1 to 4 , a patrol recorder communication connection method, comprising the following steps:

[0025] Step S1: obtaining patrol recorder data; obtaining patrol point data; calculating the positioning distance of the patrol recorder data and the patrol point data to generate coordinate distance data;

[0026] Step S2: based on a preset triggerable distance threshold, the coordinate distance data is subjected to trigger distance discrimination to obtain triggerable distance data; based on the triggerable distance data, the patrol recorder data and the inspection point data are subjected to overlapping scene video retrieval to obtain overlapping scene videos; the overlapping scene videos are subjected to three-dimensional scene reconstruction to generate a scene three-dimensional model;

[0027] Step S3: When the scene 3D model is consistent with the preset security inspection point scene model, the inspection point data is encoded as non-video data based on the scene 3D model to obtain the inspection LoRa signal; the inspection LoRa signal is forwarded in the gateway to perform normal patrol record reporting;

[0028] Step S4: When the scene three-dimensional model and the preset safety patrol point scene model are inconsistent, the scene three-dimensional model and the preset safety patrol point scene model are segmented to obtain difference area data; the difference area data and the patrol point data are transmitted in the optical frequency band to perform abnormal patrol record reporting.

[0029] The present invention realizes the transmission of patrol recorder data and inspection point data through wireless communication technology. Wireless transmission eliminates the limitations of traditional wired connections, provides greater flexibility and convenience for the acquisition and processing of patrol data, and uses wireless communication technology to calculate the positioning distance, and can accurately measure the distance between the patrol recorder and the patrol point. This wireless positioning technology can accurately locate in a complex environment, provide accurate spatial information for subsequent data processing and analysis, and distinguish the coordinate distance data based on the preset triggerable distance threshold, and determine which patrol records meet the set trigger distance conditions. This discrimination method uses wireless communication data for screening, which improves the efficiency and accuracy of data processing. Through wireless communication data, overlapping scene video retrieval can be performed to quickly find the overlapping scene video corresponding to the patrol point position. The application of this wireless communication technology can save time and resources and improve the acquisition efficiency of overlapping scene videos. Using wireless communication data to reconstruct a three-dimensional scene, a three-dimensional model of the scene can be generated. Such wireless communication technology applications can provide more real and comprehensive scene information, and provide more dimensions and accuracy for subsequent data analysis and processing. When the three-dimensional model of the scene is inconsistent with the preset safety inspection point scene model, the optical frequency band is used to transmit the difference area data and the inspection point data to report the abnormal patrol record. As a high-speed, low-interference and highly secure wireless communication technology, optical frequency band transmission can effectively transmit difference area data and related information to achieve timely reporting of abnormal situations. Therefore, the present invention improves the convenience and flexibility of data transmission, accurately measures distance, improves data processing efficiency, enhances the authenticity and comprehensiveness of scene information, and uses optical frequency band transmission to achieve high-speed, low-interference and secure data transmission.

[0030] In the embodiment of the present invention, reference Figure 1 The above is a schematic flow chart of the steps of the patrol recorder communication connection method of the present invention. In this example, the patrol recorder communication connection method includes the following steps:

[0031] Step S1: obtaining patrol recorder data; obtaining patrol point data; calculating the positioning distance of the patrol recorder data and the patrol point data to generate coordinate distance data;

[0032] In an embodiment of the present invention, data is obtained from the patrol recorder using appropriate communication protocols and technologies, which involve Bluetooth, Wi-Fi, or dedicated patrol recorder data download software, obtaining patrol point data through a network connection or a dedicated interface, and obtaining the positioning data of the patrol recorder through a communication connection, which involves GPS positioning, base station positioning or inertial navigation technology, extracting positioning data, such as longitude and latitude coordinates, altitude information, to obtain the coordinate data of the patrol recorder. Coordinate data is extracted from the patrol point data, usually in the data format of longitude and latitude or other geographic coordinate systems. A suitable algorithm is used to calculate the distance between the coordinate data of the patrol recorder and the coordinate data of the patrol point, such as the Euclidean distance, the Manhattan distance or the Harbin distance, and the distance threshold is used to determine whether the patrol recorder has approached or reached the patrol point, and the corresponding coordinate distance data is generated.

[0033] Step S2: based on a preset triggerable distance threshold, the coordinate distance data is subjected to trigger distance discrimination to obtain triggerable distance data; based on the triggerable distance data, the patrol recorder data and the inspection point data are subjected to overlapping scene video retrieval to obtain overlapping scene videos; the overlapping scene videos are subjected to three-dimensional scene reconstruction to generate a scene three-dimensional model;

[0034] In an embodiment of the present invention, a preset triggerable distance threshold is used to compare the coordinate distance data. When the coordinate distance data is less than the preset acceptable distance threshold, it is determined to be a triggerable distance, indicating that the patrol recorder has approached the inspection point. Based on the triggerable distance data, the video data of the corresponding time period is extracted from the patrol recorder data to generate a patrol video file. Monitoring and extracting the inspection point data involves cameras and sensor monitoring equipment to extract monitoring data related to the inspection point, such as videos recorded by monitoring cameras or other perception data. Video scene analysis is performed on the patrol video file and the inspection point monitoring data to identify similar scenes. Computer vision technology and image processing algorithm methods are used to analyze the similarity of video scenes. In similar scene videos, overlapping scenes are cut, which involves video editing software or image processing algorithms to separate the perspective of the patrol recorder and the perspective of the inspection point monitoring. Based on the patrol video file and the inspection point monitoring data, three-dimensional scene reconstruction is performed on the overlapping scene video, which is achieved through computer vision and three-dimensional reconstruction technology to generate a three-dimensional model of the scene.

[0035] Step S3: When the scene 3D model is consistent with the preset security patrol point scene model, the patrol point data is encoded as non-video data based on the scene 3D model to obtain a patrol LoRa signal; the patrol LoRa signal is forwarded in the gateway to perform normal patrol record reporting.

[0036] In an embodiment of the present invention, when the three-dimensional scene model is consistent with the preset safety inspection point scene model, it means that the scene recorded by the patrol recorder matches the preset safety inspection point scene. Based on the three-dimensional scene model, the area corresponding to the inspection point is identified, and the video information in the area is stripped to obtain non-video inspection point data. The non-video inspection point data includes location coordinates, timestamp, and inspection point status information. The non-video inspection point data is encoded so that it can be transmitted through LoRa (low power wide area network). Data encoding involves compression algorithms and encryption technologies to ensure the efficiency and security of data transmission. The encoded data is converted into a LoRa signal, which is suitable for wireless transmission. The encoded inspection LoRa signal is forwarded in the gateway. The gateway forwards the LoRa signal to the corresponding server or cloud platform, and the patrol record report without abnormality is executed on the server or cloud platform. The inspection point data is stored or analyzed in real time to supervise and manage the patrol process.

[0037] Step S4: When the scene three-dimensional model and the preset safety patrol point scene model are inconsistent, the scene three-dimensional model and the preset safety patrol point scene model are segmented to obtain difference area data; the difference area data and the patrol point data are transmitted in the optical frequency band to perform abnormal patrol record reporting.

[0038] In an embodiment of the present invention, when the scene three-dimensional model is inconsistent with the preset safety inspection point scene model, it is necessary to identify the difference area, compare the scene three-dimensional model with the preset safety inspection point scene model, determine the inconsistent area, cut out these difference areas, and extract the corresponding data. The difference area data and the inspection point data are integrated to obtain abnormal situation transmission data. The integration process includes matching the location information of the difference area with the inspection point data to determine which abnormal situations need to be transmitted. The abnormal situation transmission data is incrementally deduplicated at the block level to reduce the repetitiveness and redundancy of data transmission. Incremental block-level deduplication involves identifying repeated data blocks and only transmitting newly added or critical abnormal situation data. The critical abnormal situation transmission data is wirelessly optically transmitted to perform abnormal patrol record reporting. Wireless optical transmission includes using optical fiber communication or other wireless optical transmission technology to ensure high speed and stability of data transmission. The abnormal patrol record reporting is implemented through a dedicated transmission device or system to ensure that abnormal situations are reported and recorded in time.

[0039] Preferably, step S1 comprises the following steps:

[0040] Step S11: Obtain patrol recorder data; obtain patrol point data;

[0041] Step S12: extracting positioning data from the patrol recorder data to obtain the patrol recorder coordinate data;

[0042] Step S13: extracting the coordinate data of the inspection point data to obtain the inspection point coordinate data;

[0043] Step S14: Calculate the coordinate distance of the patrol recorder coordinate data and the inspection point coordinate data to generate coordinate distance data.

[0044] The present invention can realize real-time monitoring of patrol tasks by acquiring patrol recorder data and inspection point data. This helps to ensure the timeliness and accuracy of safety inspections. By extracting positioning data from patrol recorder data and obtaining patrol recorder coordinate data, it helps to determine the precise position of the patrol recorder, thereby improving positioning accuracy. By extracting coordinate data from inspection point data and obtaining inspection point coordinate data, accurate task guidance can be provided for patrol personnel to help them conduct inspections according to a predetermined route. Coordinate distance calculation is performed on patrol recorder coordinate data and inspection point coordinate data to generate coordinate distance data, which can help managers understand the distance between patrol recorders and inspection points and evaluate the coverage and efficiency of inspections. The generated coordinate distance data can also be used for further data analysis, such as determining inspection point coverage and discovering optimization opportunities for inspection paths, thereby improving the efficiency and quality of safety inspections, helping to improve the real-time, accuracy and efficiency of safety inspections, and promoting the smooth execution and management of patrol tasks.

[0045] In an embodiment of the present invention, data is obtained from the patrol recorder using appropriate communication protocols and technologies, which involve Bluetooth, Wi-Fi, or dedicated patrol recorder data download software, obtaining patrol point data through a network connection or a dedicated interface, and obtaining the positioning data of the patrol recorder through a communication connection, which involves GPS positioning, base station positioning or inertial navigation technology, extracting positioning data, such as longitude and latitude coordinates, altitude information, to obtain the coordinate data of the patrol recorder. Coordinate data is extracted from the patrol point data, usually in the data format of longitude and latitude or other geographic coordinate systems. A suitable algorithm is used to calculate the distance between the coordinate data of the patrol recorder and the coordinate data of the patrol point, such as the Euclidean distance, the Manhattan distance or the Harbin distance, and the distance threshold is used to determine whether the patrol recorder has approached or reached the patrol point, and the corresponding coordinate distance data is generated.

[0046] Preferably, step S2 comprises the following steps:

[0047] Step S21: performing distance comparison on the coordinate distance data based on a preset triggerable distance threshold, and when the coordinate distance data is less than a preset acceptable distance threshold, it is determined to be a triggerable distance, and performing patrol video extraction on the patrol recorder data based on the triggerable distance data to obtain a patrol video file;

[0048] Step S22: performing inspection point monitoring extraction on the inspection point data to obtain inspection point monitoring data;

[0049] Step S23: Performing video scene analysis on the patrol video file and the patrol point monitoring data to generate similar scene videos;

[0050] Step S24: cutting the overlapping scenes of similar scene videos to obtain overlapping scene videos;

[0051] Step S25: reconstruct the overlapping scene videos in three dimensions based on the patrol video files and the patrol point monitoring data to generate a three-dimensional model of the scene.

[0052] The present invention compares the coordinate distance data based on a preset triggerable distance threshold. When the distance is less than the threshold, it is determined to be a triggerable distance, and the relevant patrol video is extracted. This can effectively reduce the use of video storage space, retain only the required video clips, save resources and facilitate subsequent analysis and review. Monitoring and extracting the inspection point data to obtain the inspection point monitoring data can further improve the monitoring scope and quality of the inspection task and ensure the comprehensiveness and accuracy of the safety inspection. Video scene analysis is performed on the patrol video file and the inspection point monitoring data to generate similar scene videos. This helps to identify existing anomalies or safety hazards and improve the effect of safety monitoring. Overlapping scene cutting of similar scene videos helps to divide the scene into smaller units, improve the perception and understanding of scene changes, and then analyze and process data more finely. Three-dimensional scene reconstruction based on video files and monitoring data can generate a more intuitive scene model, help understand and analyze the actual environment, and provide a more accurate reference for subsequent safety planning and management. It helps to improve the efficiency, accuracy and comprehensiveness of safety inspections, and also provides important support for subsequent data analysis and decision-making.

[0053] As an example of the present invention, refer to Figure 2 As shown, in this example, step S2 includes:

[0054] Step S21: performing distance comparison on the coordinate distance data based on a preset triggerable distance threshold, and when the coordinate distance data is less than a preset acceptable distance threshold, it is determined to be a triggerable distance, and performing patrol video extraction on the patrol recorder data based on the triggerable distance data to obtain a patrol video file;

[0055] In an embodiment of the present invention, the patrol recorder collects coordinate distance data through a built-in sensor and transmits it to a central control system or server for processing. This involves the use of wireless communication technology, such as Wi-Fi, Bluetooth or RFID, to transmit data in real time or periodically. On the central control system or server, a preset triggerable distance threshold is set. This threshold is determined according to the specific application scenario and requirements, and is usually configured by the system administrator according to actual conditions. The received coordinate distance data is compared with the preset triggerable distance threshold. When the coordinate distance data is less than the preset acceptable distance threshold, the system determines it as a triggerable distance, indicating that a patrol recorder is approaching or passing through a specific location or area; when the coordinate distance data is greater than the preset acceptable distance threshold, the system determines it as an untriggerable distance, indicating that no patrol recorder is approaching or passing through a specific location or area. When the system determines it as a triggerable distance, it automatically triggers the extraction of video data from the patrol recorder. This involves sending an instruction to the patrol recorder, requiring it to start recording a video and transmit the recorded video file to the central control system or server; when the system determines it as an untriggerable distance, the system does nothing directly and does not proceed to the next step. The received patrol video files are processed and stored, and are usually associated with other relevant data, such as timestamps and location information, for subsequent analysis and review.

[0056] Step S22: performing inspection point monitoring extraction on the inspection point data to obtain inspection point monitoring data;

[0057] In the embodiment of the present invention, according to the location and number of the inspection point, the corresponding video monitoring system or device is queried to obtain the video data related to the inspection point, and the video of the segment or time period related to the inspection point is extracted from the video data. Video editing software or programming technology can be used to accurately capture the video segment related to the inspection point according to the timestamp or other identification. The extracted video data is converted or encoded as necessary to ensure its compatibility and readability. The extracted inspection point monitoring data is stored in an appropriate storage medium or system, and necessary backup is performed to ensure the security and reliability of the data.

[0058] Step S23: Performing video scene analysis on the patrol video file and the patrol point monitoring data to generate similar scene videos;

[0059] In an embodiment of the present invention, computer vision technology is used to extract scene features from patrol video files and patrol point monitoring data. This may include color, texture, shape, and motion features. A similarity calculation algorithm (such as cosine similarity and Euclidean distance) is used to compare and calculate different video scene features to determine the similarity between them. Based on the results of the similarity calculation, scene matching and screening are performed on the patrol video files and patrol point monitoring data to find video clips or frames similar to the target scene. Similar video clips or frames are synthesized to generate similar scene videos. Video editing software or programming technology can be used to achieve scene synthesis. The generated similar scene videos are output as video files, and necessary storage and backup are performed to ensure the security and reliability of the data.

[0060] Step S24: cutting the overlapping scenes of similar scene videos to obtain overlapping scene videos;

[0061] In an embodiment of the present invention, continuous frames in similar scene videos are compared to calculate the similarity between them. Image processing and computer vision techniques, such as structural similarity (SSIM) indicators or other similarity algorithms, can be used. A similarity threshold is set based on the calculation result of the similarity. When the similarity between continuous frames exceeds the threshold, they are considered to belong to the same overlapping scene. According to the similarity threshold, the similar scene video is cut and the continuous frames are grouped into different overlapping scenes. Cutting can be achieved by marking the starting and ending positions of continuous frames or assigning them to different time periods or video files. The continuous frames of each overlapping scene are synthesized to generate the corresponding overlapping scene video. Video editing software or programming technology can be used to achieve scene synthesis. The generated overlapping scene video is output as a video file, and necessary storage and backup are performed to ensure the security and reliability of the data.

[0062] Step S25: reconstruct the overlapping scene videos in three dimensions based on the patrol video files and the patrol point monitoring data to generate a three-dimensional model of the scene.

[0063] In the embodiment of the present invention, overlapping scene videos, patrol video files and inspection point monitoring data are collected and sorted to ensure the integrity and availability of the data. For the cameras in the inspection point monitoring data, camera calibration is performed to obtain the intrinsic and extrinsic parameters of the camera. The continuous frames in the overlapping scene video are parsed, image information is extracted, and the extrinsic parameters of the camera are obtained. Computer vision technology is used to extract feature points such as corner points and edges from the parsed video frames, and the feature points between different video frames are matched to establish a correspondence between frames. According to the matching relationship of the feature points, the movement of the camera between consecutive frames is estimated to obtain the change in the camera's posture. The depth information of the feature points and the change in the camera's posture are used to generate point clouds for the parsed video frames. The point clouds generated from different video frames are fused to obtain more complete three-dimensional point cloud data. Based on the point cloud data, a three-dimensional reconstruction algorithm, such as three-dimensional mesh generation and voxelization, is used to generate a three-dimensional model of the scene. The generated three-dimensional model is optimized and repaired to remove noise and inconsistency and improve the model quality. Render and visualize the generated 3D scene model for easy observation and analysis, output the generated scene 3D model to common 3D model formats (such as OBJ, PLY), and perform necessary storage and backup.

[0064] Preferably, step S24 includes the following steps:

[0065] Step S241: extract matching features from similar scene videos to obtain matching feature data;

[0066] Step S242: performing affine transformation correction on the matching feature data to generate corrected matching feature data;

[0067] Step S243: calibrating the overlapped area of ​​the corrected matching feature data to obtain overlapped area data;

[0068] Step S244: performing regional scene segmentation on similar scene videos based on the overlapping region data to obtain overlapping scene videos.

[0069] The present invention can obtain key feature information in similar scene videos by matching feature extraction. These features can be used in subsequent analysis and processing steps, such as scene matching and motion estimation. By performing affine transformation correction on the matching feature data, the rotation, translation and scaling distortion of the image can be corrected, and the accuracy and stability of feature matching can be improved. : By calibrating the overlapping area, the overlapping part in the similar scene video can be determined. This helps the subsequent regional scene cutting step to ensure that only the video clips of the overlapping part are extracted, reducing redundant and repeated content. Based on the overlapping area data, the similar scene video is cut to extract the overlapping scene video. This helps to reduce the amount of data and the complexity of processing, and focus on the analysis and application of the overlapping part. It helps to extract and process key information in similar scene videos and obtain the overlapping scene video therefrom. Through accurate feature matching, correction and cutting, the utilization efficiency of data can be improved, and subsequent scene analysis, comparison and other related tasks can be supported.

[0070] In an embodiment of the present invention, a sequence of image frames is extracted frame by frame from a video of a similar scene, and features are extracted for each image frame. Common features include corner points, edges, scale-invariant feature transform (SIFT), and accelerated robust features (SURF). These features can be extracted by computer vision algorithms, such as local feature descriptors, to match features between adjacent frames and establish a correspondence between frames. Common matching algorithms include nearest neighbor matching and RANSAC based on feature descriptors. According to the matching feature data, an affine transformation (translation, rotation, scaling) is performed to correct the matching feature data into a unified coordinate system, generate corrected matching feature data, and ensure that the feature points are accurately positioned in the corrected feature data. Based on the corrected matching feature data, a region detection algorithm (such as connected region analysis and boundary detection) is performed to detect objects or scene regions in the video frame, match regions of adjacent frames, find similar regions or objects, and calibrate the overlapping regions in the similar scene video according to the region matching results to determine the boundaries or ranges of the overlapping regions. Based on the overlapping area data, the similar scene videos are segmented, the video clips containing the overlapping areas are extracted, and the extracted video clips are combined into the overlapping scene videos to ensure that only the contents of the overlapping areas are included.

[0071] Preferably, step S25 includes the following steps:

[0072] Step S251: extracting feature descriptors from overlapping scene videos to obtain scene feature descriptors;

[0073] Step S252: performing camera spatial positioning on the patrol video file and patrol point monitoring data based on the scene feature descriptor to generate camera orientation data;

[0074] Step S253: performing parallax calculation on the overlapping scene videos according to the camera orientation data to obtain pixel displacement difference;

[0075] Step S254: converting the pixel displacement difference into a depth value to generate a scene depth map;

[0076] Step S255: reconstruct the overlapping scene 3D by overlaying the scene feature descriptor and the scene depth map to generate a scene 3D model.

[0077] The present invention can capture key feature information in the scene by extracting scene feature descriptors, and provide the necessary data basis for subsequent camera positioning, parallax calculation and three-dimensional reconstruction. Through camera spatial positioning, the position and angle of the patrol video and patrol point monitoring data in the scene can be determined, thereby realizing spatial positioning and directional observation of the patrol process. This helps to monitor and analyze the accuracy and completeness of patrol records, and improve the reliability and efficiency of patrol work. Through parallax calculation, the pixel displacement difference between different perspectives in the overlapping scene video can be obtained. These displacement differences can be used for subsequent depth estimation and three-dimensional reconstruction, further providing the depth information and geometric structure of the scene, and helping to understand the spatial relationship of the scene. Through depth value conversion, the pixel displacement difference can be converted into the depth value of each pixel point in the scene. The generated scene depth map can provide the depth information of the scene, help understand the spatial structure and object position of the scene, and provide a basis for subsequent three-dimensional reconstruction. Through three-dimensional reconstruction of the scene feature descriptor and the scene depth map, a three-dimensional model of the scene can be generated. This model can provide a more intuitive and accurate scene representation, and provide richer scene information for the communication connection method of the patrol recorder. At the same time, more analysis and applications can be performed based on the three-dimensional model, such as path planning and virtual navigation, to improve the function and efficiency of the patrol recorder. The benefits of the present invention include providing key feature information, achieving spatial positioning and observation, providing depth information, and generating a three-dimensional model, which help to improve the application value and performance of the patrol recorder.

[0078] In an embodiment of the present invention, a sequence of image frames is extracted frame by frame from the overlapping scene video, and features are extracted for each image frame. A feature descriptor algorithm such as SIFT (Scale Invariant Feature Transform), SURF (Speeded Robust Features) or ORB (Rotation Edge Binarization) can be used. A feature descriptor is a vector representation that describes local features of an image and can be used for subsequent matching and positioning. The features in the patrol video file and the patrol point monitoring data are matched using a scene feature descriptor. The corresponding feature point pairs in the video frame and the monitoring data are found by a matching algorithm (such as nearest neighbor, RANSAC), and the spatial pose (including position and direction) of the camera is calculated based on the corresponding relationship between the feature point pairs using triangulation or other positioning methods. These calculation results can be used to determine the position and orientation of the camera in the scene. The disparity (i.e., the pixel displacement difference relative to the camera) of each feature point in the camera coordinate system is calculated using the camera orientation data and the corresponding feature points in the overlapping scene video. The disparity can be obtained by triangulation or other disparity calculation methods. Depth is inferred using the disparity value and the camera intrinsic parameters (including the focal length and principal point parameters of the camera). Based on the relationship between disparity and depth, the depth value of each pixel can be calculated, and the calculated depth value can be mapped to the corresponding pixel position to generate a scene depth map. The depth map is a grayscale image, and each pixel represents the scene depth at that position. Three-dimensional reconstruction is performed using scene feature descriptors and scene depth maps. Three-dimensional reconstruction algorithms such as structured light, stereo vision, or dense reconstruction algorithms can be used. These algorithms can restore the three-dimensional structure of overlapping scenes based on feature points and depth information, and three-dimensional models can be generated and expressed based on the three-dimensional point cloud data generated by the three-dimensional reconstruction algorithm. Point cloud data can be converted into a visual three-dimensional model of the scene using point cloud processing software or three-dimensional modeling tools.

[0079] Preferably, step S253 includes:

[0080] Calculate the disparity field of the overlapping scene video according to the camera orientation data to obtain the scene disparity field data;

[0081] Smoothing the scene disparity field data to obtain denoised scene disparity field data;

[0082] Perform pixel position integration on the denoised scene disparity field data to generate time-step pixel displacement;

[0083] The difference of the time step pixel displacement is calculated to obtain the pixel displacement difference

[0084] The present invention can obtain the pixel displacement difference between different viewing angles in the scene by calculating the disparity field data. These data can be used for subsequent displacement calculation and analysis, provide the movement and change information of the objects in the scene, and help understand the spatial structure and dynamic characteristics of the scene. By smoothing the scene disparity field data, noise and discontinuity can be reduced, and the quality and reliability of the data can be improved. The denoised data is more suitable for subsequent displacement calculation and analysis, and provides more accurate and stable displacement information. Through pixel position integration, the scene disparity field data can be converted into time step pixel displacement. These displacement data can be used to analyze the motion trajectory and speed change of the objects in the scene, and provide more detailed and comprehensive motion feature information. Through difference calculation, the pixel displacement difference between adjacent time steps can be obtained. These difference data can be used to analyze the motion speed and direction change of the objects in the scene, and provide more accurate and detailed displacement change information. Provide the displacement difference of the scene, remove noise, and provide motion trajectory and speed change information. This information helps to understand the dynamic characteristics of the scene, monitor the motion of the object, and provide more comprehensive and accurate data support for the communication connection method of the patrol recorder. By analyzing and applying the displacement difference, the positioning accuracy, path planning and motion monitoring functions of the patrol recorder can be improved, thereby improving the efficiency and reliability of the patrol work.

[0085] In an embodiment of the present invention, the disparity value of each pixel is calculated using the camera orientation data and the corresponding feature points in the overlapping scene video. The disparity value represents the difference in pixel displacement between different perspectives in the scene, and can be calculated by a stereoscopic vision algorithm (such as SGBM, BM). The scene disparity field data is smoothed using a filtering algorithm to reduce noise and discontinuity. Commonly used smoothing methods include mean filtering, median filtering, and Gaussian filtering. The denoised scene disparity field data is pixel-wise integrated to obtain the accumulated displacement of each pixel in time. It can be obtained by accumulating the disparity value of each pixel. The time step pixel displacement is differenced to calculate the displacement difference between adjacent time steps. It can be obtained by a simple subtraction operation. The time step pixel displacement is differenced to calculate the displacement difference between adjacent time steps. It can be obtained by a simple subtraction operation.

[0086] Preferably, step S3 comprises the following steps:

[0087] Step S31: when the scene 3D model is consistent with the preset safety inspection point scene model, the inspection point data is subjected to video stripping based on the scene 3D model to obtain non-video inspection point data;

[0088] Step S32: Encode the non-video inspection point data to generate an inspection LoRa signal;

[0089] Step S33: forward the patrol LoRa signal in the gateway to report the patrol record without abnormality.

[0090] The present invention can determine the location and attributes of the inspection point by comparing the scene three-dimensional model with the preset safety inspection point scene model. Based on this information, non-video inspection point data can be stripped from the video, that is, only other relevant data of the inspection point can be included. In this way, important information related to the inspection point can be extracted, which is convenient for subsequent processing and analysis. By encoding the non-video inspection point data, the relevant information of the inspection point can be converted into an inspection LoRa signal. LoRa is a low-power long-distance wireless communication technology with a wide coverage range and low power consumption. Encoding the non-video inspection point data into an inspection LoRa signal can realize the wireless transmission of the inspection data, and can perform data communication within a large range. By forwarding the inspection LoRa signal in the gateway, the transmission and reporting of the inspection data can be realized. The gateway can serve as a transfer node to forward the inspection LoRa signal to a designated receiver or server. In this way, the stable transmission and timely reporting of the inspection data can be ensured, which helps to monitor and record abnormal conditions during the inspection process and provide real-time patrol records. The benefits include extracting relevant information of inspection points, realizing wireless transmission and communication of inspection data, and ensuring stable transmission and timely reporting of inspection data. Through these steps, the data collection and transmission efficiency of patrol recorders can be improved, the time and workload of manual operation can be reduced, more reliable and real-time inspection records can be provided, and support can be provided for the management and improvement of patrol work.

[0091] As an example of the present invention, refer to Figure 3 As shown, in this example, step S3 includes:

[0092] Step S31: when the scene 3D model is consistent with the preset safety inspection point scene model, the inspection point data is subjected to video stripping based on the scene 3D model to obtain non-video inspection point data;

[0093] In an embodiment of the present invention, the three-dimensional model data of the scene is obtained, and the model includes objects, structures and geometric information in the scene, and the preset safety inspection point scene model is obtained, and the model describes the location and attributes of the preset inspection point. The three-dimensional model of the scene and the preset safety inspection point scene model are compared, and by matching the location information of the inspection point and performing overlapping comparison on the models, it is determined whether the two are consistent. If they are consistent, it means that the inspection point and the scene model are matched successfully, and the next step of video stripping operation can be performed; if they are inconsistent, the video clips related to the inspection point are located and extracted in the video data in the scene, and the non-video inspection point data is stripped, that is, other data related to the inspection point, such as timestamps and inspection point attributes, are retained.

[0094] Step S32: Encode the non-video inspection point data to generate an inspection LoRa signal;

[0095] In an embodiment of the present invention, the stripped non-video inspection point data is encoded and converted into a data format suitable for LoRa communication. The data encoding may include format conversion and compression of the location, attributes and other key information of the inspection point so as to transmit it under limited communication bandwidth and resource constraints. According to the LoRa communication protocol, the encoded inspection point data is converted into a inspection LoRa signal, that is, it is converted into a data signal suitable for LoRa wireless communication.

[0096] Step S33: forward the patrol LoRa signal in the gateway to report the patrol record without abnormality.

[0097] In an embodiment of the present invention, the generated inspection LoRa signal is sent to a gateway device in the area where the patrol recorder is located. The gateway device serves as a transit node, receives the inspection LoRa signal, and performs data processing and forwarding operations. The gateway device forwards the inspection LoRa signal to a designated receiver or server according to a preset communication connection method and protocol. After the receiver or server receives the inspection LoRa signal, it performs further data decoding and processing to execute a reporting operation of normal patrol records. Through the forwarding in the gateway, the stable transmission and timely reporting of the inspection data are ensured, and real-time monitoring and recording of patrol records are realized.

[0098] Preferably, step S4 comprises the following steps:

[0099] Step S41: when the scene three-dimensional model and the preset safety inspection point scene model are inconsistent, the scene three-dimensional model and the preset safety inspection point scene model are cut into different regions to obtain different region data;

[0100] Step S42: integrating the difference area data and the inspection point data to obtain abnormal situation transmission data;

[0101] Step S43: performing incremental block-level deduplication on the abnormal situation transmission data to obtain key abnormal situation transmission data;

[0102] Step S44: wirelessly transmit the key abnormal situation transmission data to perform abnormal patrol record reporting.

[0103] When the scene three-dimensional model of the present invention is inconsistent with the preset safety inspection point scene model, the difference between the two can be quickly identified by cutting the difference area, and the location of the abnormal situation can be accurately determined. This helps to timely discover potential safety hazards or system configuration errors, and improves the accuracy and efficiency of inspections. Integrating the difference area data and the inspection point data can associate the abnormal situation with the inspection point information, providing a basis for subsequent abnormal situation analysis and processing. Such data integration can help monitoring personnel better understand the background and context of the abnormal situation, so as to formulate countermeasures more accurately. By incremental block-level deduplication, the redundancy and repetition of data transmission can be effectively reduced, and the cost and bandwidth occupancy of data transmission can be reduced. Such a processing method can optimize the efficiency of data transmission, ensure the timely reporting and processing of key abnormal situations, and save communication resources at the same time. Using wireless optical transmission for abnormal patrol record reporting can achieve fast and safe data transmission, avoiding the limitations of traditional wired connection methods. Optical transmission has the characteristics of high speed and stability, which can ensure the timely reporting of abnormal situations and ensure the integrity and reliability of data. It combines scene model matching, data integration, deduplication processing and efficient transmission technology to provide effective support for the timely discovery, reporting and processing of abnormal situations, and improves the efficiency and reliability of the patrol recorder communication connection method.

[0104] As an example of the present invention, refer to Figure 4 As shown, in this example, step S4 includes:

[0105] Step S41: when the scene three-dimensional model and the preset safety inspection point scene model are inconsistent, the scene three-dimensional model and the preset safety inspection point scene model are cut into different regions to obtain different region data;

[0106] In the embodiment of the present invention, a professional scene modeling software or tool is used to compare the three-dimensional model of the actual scene with the preset safety inspection point scene model. By comparing, the difference between the actual scene and the preset scene is determined, including the inconsistency in position, structure, and objects. The area where the inspection point is inconsistent with the preset scene model is marked in the scene three-dimensional model, and the area is cut. By marking and cutting, the inspection point and the difference area around it are accurately identified, and these areas include missing objects, newly added objects, and position deviations. Relevant data of the difference area, such as coordinate information, size, and shape, are extracted from the scene three-dimensional model. According to the specific situation of the inconsistency between the inspection point and the preset scene model, the abnormal situation is identified and classified, such as missing, newly added, and offset. By identifying and classifying the abnormal situation, guidance and basis are provided for subsequent processing and repair, and the problem is solved in a targeted manner. According to the classification and impact of the abnormal situation, corresponding processing suggestions are put forward, such as repairing missing objects, adjusting positions, and updating models, to help relevant personnel understand the severity of the problem and take appropriate measures to solve it, so as to ensure the consistency and safety of the scene model with the actual scene.

[0107] Step S42: integrating the difference area data and the inspection point data to obtain abnormal situation transmission data;

[0108] In an embodiment of the present invention, the difference area data obtained by cutting the difference area of ​​the scene three-dimensional model and the preset safety inspection point scene model are integrated with the inspection point data, and the data of the two are integrated, and the location information of the abnormal situation is associated with the relevant data of the inspection point, so as to provide a basis and basis for the subsequent abnormal situation processing. Based on the integrated data, abnormal situation transmission data is generated, including the location, type, and size information of the difference area, and the format of the generated abnormal situation transmission data is standardized to ensure the uniformity and readability of the data, simplify the process of data processing and transmission, and reduce errors or confusion caused by inconsistent data formats. The normalized abnormal situation transmission data is verified and checked to ensure the integrity and accuracy of the data, and the verified and checked abnormal situation transmission data is stored in the corresponding database or file system to provide support for subsequent data analysis, processing and query, while ensuring the security and traceability of the data.

[0109] Step S43: performing incremental block-level deduplication on the abnormal situation transmission data to obtain key abnormal situation transmission data;

[0110] In an embodiment of the present invention, all abnormal situation transmission data are loaded, and incremental block-level deduplication processing is prepared, and the abnormal situation transmission data generated previously is loaded into the system for subsequent deduplication processing. The loaded abnormal situation transmission data is divided into blocks according to a preset block size to form data blocks of appropriate size, and the data is divided into blocks according to the block size to facilitate subsequent deduplication operations. An incremental block-level deduplication algorithm is applied to each data block to identify and delete duplicate data blocks. The incremental block-level deduplication algorithm is used to identify the same or similar data blocks and delete them as duplicate data, thereby reducing data redundancy and improving storage utilization. Key abnormal situation transmission data is extracted from the data after deduplication processing, which only contains different and critical abnormal situation transmission data. The extracted key abnormal situation transmission data is integrated and stored in a corresponding database or file system, and the key abnormal situation transmission data is integrated and stored to facilitate subsequent analysis, query and application, while ensuring the security and traceability of the data.

[0111] Step S44: wirelessly transmit the key abnormal situation transmission data to perform abnormal patrol record reporting.

[0112] In the embodiment of the present invention, it is ensured that the optical transmission equipment is in working state, including optical fiber, transmitter and receiver equipment. Before performing optical transmission, it is necessary to ensure that all relevant optical transmission equipment is ready to ensure smooth transmission. Encode the key abnormal situation transmission data so that it can be transmitted in the optical transmission, and convert the digitized data into a signal form that can be recognized and transmitted by the optical transmission equipment to ensure that the data can be accurately transmitted. Establish an optical transmission connection between the transmitting end and the receiving end to ensure that the transmission channel is unobstructed. Before data transmission, it is necessary to establish a reliable optical transmission connection to ensure that the data can be accurately and stably transmitted to the receiving end. Send the encoded key abnormal situation transmission data to the receiving end through the optical transmission equipment, receive the optical transmission data received by the receiving end, and decode and restore it to the original data form, and decode it to restore the original key abnormal situation transmission data. Report the decoded abnormal situation transmission data to the relevant system or platform for subsequent processing and analysis, wherein the decoded data can be reported as an abnormal patrol record so as to timely handle and track the abnormal situation.

[0113] Preferably, step S44 includes the following steps:

[0114] Step S441: encoding the key abnormal situation transmission data based on the transmission required condition data to obtain an abnormal situation optical signal;

[0115] Step S442: performing multi-wavelength multiplexing transmission on the abnormal situation optical signal to generate an abnormal situation transmission optical signal;

[0116] Step S443: performing optical fiber amplification on the abnormal transmission optical signal to obtain an amplified transmission optical signal;

[0117] Step S444: Based on the preset receiving end, the amplified transmission optical signal is demodulated by wavelength division multiplexing to generate a receiving end optical signal to perform abnormal patrol record reporting.

[0118] The present invention can ensure the integrity and reliability of data during transmission by encoding key abnormal situation transmission data. Coding can also improve the efficiency of data transmission, ensure that the transmitted data can accurately express the abnormal situation, thereby helping the monitoring system or patrol recorder to better understand and handle the abnormal situation. The use of multi-wavelength multiplexing transmission can improve the transmission efficiency and capacity, allowing multiple optical signals of different wavelengths to be transmitted in the same optical fiber. This technology helps to transmit multiple abnormal situation data at the same time under limited communication resources, thereby improving the overall performance of the system. Optical fiber amplification ensures that the signal maintains sufficient strength during transmission and reduces the impact of signal attenuation. This is crucial for long-distance transmission and ensuring data transmission quality, especially when the patrol recorder monitoring device needs to transmit data remotely. Wavelength division multiplexing demodulation can demodulate optical signals of multiple wavelengths into original abnormal situation optical signals, ensuring that the receiving end can accurately obtain the transmitted data. This helps to accurately record and analyze abnormal situations at the receiving end, as well as report and handle abnormal situations in a timely manner. The efficiency, reliability and capacity of the communication connection are improved, thereby better meeting the needs of the patrol recorder monitoring device for data transmission.

[0119] In the embodiment of the present invention, according to the data of the conditions required for transmission, a suitable coding algorithm is used to encode the key abnormal situation transmission data. This includes data compression and error correction coding technology to ensure the reliability and efficiency of data transmission. After data encoding, the encoded data is converted into a corresponding optical signal, that is, an abnormal situation optical signal. This involves optical modulation technology, a process of converting a digital signal into an optical signal. The generated abnormal situation optical signal is multi-wavelength multiplexed, that is, multiple optical signals of different wavelengths are combined into one optical fiber for transmission. This can improve the transmission capacity and efficiency of the optical fiber. The optical signal in the transmission process is amplified by optical fiber to enhance the signal strength and transmission distance. This is usually achieved through an optical fiber amplifier, which can make the signal not affected by attenuation when transmitted in the optical fiber. At the receiving end, according to the preset receiving end configuration, the amplified transmission optical signal is demodulated by wavelength division multiplexing. This is a process of demodulating the multi-wavelength multiplexed optical signal and restoring it to the original abnormal situation optical signal. After wavelength division multiplexing demodulation, a receiving end optical signal is generated, that is, it is restored to the original abnormal situation optical signal. These optical signals can be used to perform abnormal patrol record reporting operations and transmit abnormal situation data to the receiving end device.

[0120] In this specification, a patrol recorder communication connection terminal device is provided, wherein the patrol recorder communication connection terminal device has a communication connection controller integrated therein, and the communication connection controller is used to execute the patrol recorder communication connection method as described above, and the communication connection controller includes:

[0121] The trigger acquisition module is used to acquire patrol recorder data; acquire patrol point data; calculate the positioning distance of patrol recorder data and patrol point data to generate coordinate distance data;

[0122] The scene reconstruction module is used to perform trigger distance discrimination on the coordinate distance data based on a preset triggerable distance threshold to obtain triggerable distance data; perform overlapping scene video retrieval on the patrol recorder data and the inspection point data based on the triggerable distance data to obtain overlapping scene videos; perform three-dimensional scene reconstruction on the overlapping scene videos to generate a three-dimensional model of the scene;

[0123] The abnormal communication module is used to encode the inspection point data into non-video data based on the scene 3D model to obtain the inspection LoRa signal when the scene 3D model is consistent with the preset safety inspection point scene model; the inspection LoRa signal is forwarded in the gateway to perform abnormal patrol record reporting

[0124] The abnormal communication module is used to perform difference segmentation on the scene three-dimensional model and the preset safety patrol point scene model when they are inconsistent, so as to obtain difference area data; the difference area data and patrol point data are transmitted in the optical frequency band to execute abnormal patrol record reporting.

[0125] The benefit of the present invention is that the coordinate distance data is judged by using a preset triggerable distance threshold, thereby reducing unnecessary data processing and communication load. This intelligent trigger mechanism can effectively reduce system energy consumption and network traffic. Different communication methods are used for data transmission, including LoRa signals and optical frequency band transmission. This multi-channel data transmission strategy improves the reliability and flexibility of communication and increases the system's adaptability to abnormal situations. Based on overlapping scene videos, three-dimensional scene reconstruction is performed, and the inspection point data is encoded using the scene three-dimensional model. This scene perception method can improve the accuracy and reliability of data, and also provide more information for subsequent data processing and transmission. The abnormal patrol record reporting mechanism can detect and report abnormal situations in a timely manner by performing differential segmentation on the scene three-dimensional model and the preset safety inspection point scene model, thereby improving safety and reliability. The benefit of the present invention lies in the design of intelligent trigger mechanism, multi-channel data transmission strategy, scene perception and three-dimensional reconstruction method, and abnormal handling mechanism. These innovations and optimizations help to improve the efficiency, reliability and safety of the system. Therefore, the present invention improves the convenience and flexibility of data transmission, accurately measures distance, improves data processing efficiency, enhances the authenticity and comprehensiveness of scene information, and realizes high-speed, low-interference and secure data transmission by using optical frequency band transmission.

[0126] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points of view, and the scope of the present invention is limited by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the same elements of the application documents are included in the present invention.

[0127] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.

Claims

1. A patrol recorder communication connection method, characterized in that: The following steps are involved: Step S1: Obtain patrol recorder data; Get inspection point data; Calculate the positioning distance of patrol recorder data and inspection point data to generate coordinate distance data; Step S2: based on a preset triggerable distance threshold, the coordinate distance data is subjected to trigger distance discrimination to obtain triggerable distance data; based on the triggerable distance data, the patrol recorder data and the inspection point data are subjected to overlapping scene video retrieval to obtain overlapping scene videos; the overlapping scene videos are subjected to three-dimensional scene reconstruction to generate a scene three-dimensional model; Step S3: When the scene 3D model is consistent with the preset security inspection point scene model, the inspection point data is encoded as non-video data based on the scene 3D model to obtain the inspection LoRa signal; the inspection LoRa signal is forwarded in the gateway to perform normal patrol record reporting; Step S4: When the scene three-dimensional model and the preset safety patrol point scene model are inconsistent, the scene three-dimensional model and the preset safety patrol point scene model are segmented to obtain difference area data; the difference area data and the patrol point data are transmitted in the optical frequency band to perform abnormal patrol record reporting.

2. The patrol recorder communication connection method according to claim 1, characterized in that: Step S1 includes the following steps: Step S11: Obtain patrol recorder data; obtain patrol point data; Step S12: extracting positioning data from the patrol recorder data to obtain the patrol recorder coordinate data; Step S13: extracting the coordinate data of the inspection point data to obtain the inspection point coordinate data; Step S14: Calculate the coordinate distance of the patrol recorder coordinate data and the inspection point coordinate data to generate coordinate distance data.

3. The patrol recorder communication connection method according to claim 1, characterized in that: Step S2 includes the following steps: Step S21: performing distance comparison on the coordinate distance data based on a preset triggerable distance threshold, and when the coordinate distance data is less than a preset acceptable distance threshold, it is determined to be a triggerable distance, and performing patrol video extraction on the patrol recorder data based on the triggerable distance data to obtain a patrol video file; Step S22: performing inspection point monitoring extraction on the inspection point data to obtain inspection point monitoring data; Step S23: Performing video scene analysis on the patrol video file and the patrol point monitoring data to generate similar scene videos; Step S24: cutting the overlapping scenes of similar scene videos to obtain overlapping scene videos; Step S25: reconstruct the overlapping scene videos in three dimensions based on the patrol video files and the patrol point monitoring data to generate a three-dimensional model of the scene.

4. The patrol recorder communication connection method according to claim 3, characterized in that: Step S24 includes the following steps: Step S241: extract matching features from similar scene videos to obtain matching feature data; Step S242: performing affine transformation correction on the matching feature data to generate corrected matching feature data; Step S243: calibrating the overlapped area of ​​the corrected matching feature data to obtain overlapped area data; Step S244: performing regional scene segmentation on similar scene videos based on the overlapping region data to obtain overlapping scene videos.

5. The patrol recorder communication connection method according to claim 3, characterized in that: Step S25 includes the following steps: Step S251: extracting feature descriptors from overlapping scene videos to obtain scene feature descriptors; Step S252: performing camera spatial positioning on the patrol video file and patrol point monitoring data based on the scene feature descriptor to generate camera orientation data; Step S253: performing parallax calculation on the overlapping scene videos according to the camera orientation data to obtain pixel displacement difference; Step S254: converting the pixel displacement difference into a depth value to generate a scene depth map; Step S255: reconstruct the overlapping scene 3D by overlaying the scene feature descriptor and the scene depth map to generate a scene 3D model.

6. The patrol recorder communication connection method according to claim 5, characterized in that: The disparity calculation of the overlapping scene videos according to the camera orientation data to obtain the pixel displacement difference specifically includes: Calculate the disparity field of the overlapping scene video according to the camera orientation data to obtain the scene disparity field data; Smoothing the scene disparity field data to obtain denoised scene disparity field data; Perform pixel position integration on the denoised scene disparity field data to generate time-step pixel displacement; The pixel displacement of the time step is interpolated to obtain the pixel displacement difference.

7. The patrol recorder communication connection method according to claim 1, characterized in that: Step S3 includes the following steps: Step S31: when the scene 3D model is consistent with the preset safety inspection point scene model, the inspection point data is subjected to video stripping based on the scene 3D model to obtain non-video inspection point data; Step S32: Encode the non-video inspection point data to generate an inspection LoRa signal; Step S33: forward the patrol LoRa signal in the gateway to report the patrol record without abnormality.

8. The patrol recorder communication connection method according to claim 1, characterized in that: Step S4 includes the following steps: Step S41: when the scene three-dimensional model and the preset safety inspection point scene model are inconsistent, the scene three-dimensional model and the preset safety inspection point scene model are cut into different regions to obtain different region data; Step S42: integrating the difference area data and the inspection point data to obtain abnormal situation transmission data; Step S43: performing incremental block-level deduplication on the abnormal situation transmission data to obtain key abnormal situation transmission data; Step S44: wirelessly transmit the key abnormal situation transmission data to perform abnormal patrol record reporting.

9. The patrol recorder communication connection method according to claim 8, characterized in that: Step S44 includes the following steps: Step S441: encoding the key abnormal situation transmission data based on the transmission required condition data to obtain an abnormal situation optical signal; Step S442: performing multi-wavelength multiplexing transmission on the abnormal situation optical signal to generate an abnormal situation transmission optical signal; Step S443: performing optical fiber amplification on the abnormal transmission optical signal to obtain an amplified transmission optical signal; Step S444: Based on the preset receiving end, the amplified transmission optical signal is demodulated by wavelength division multiplexing to generate a receiving end optical signal to perform abnormal patrol record reporting.

10. A patrol recorder communication connection terminal device, characterized in that: The patrol recorder communication connection terminal device has a communication connection controller integrated therein, and the communication connection controller is used to execute the patrol recorder communication connection method according to claim 1, and the communication connection controller includes: The trigger acquisition module is used to acquire patrol recorder data; acquire patrol point data; calculate the positioning distance of patrol recorder data and patrol point data to generate coordinate distance data; The scene reconstruction module is used to perform trigger distance discrimination on the coordinate distance data based on a preset triggerable distance threshold to obtain triggerable distance data; perform overlapping scene video retrieval on the patrol recorder data and the inspection point data based on the triggerable distance data to obtain overlapping scene videos; perform three-dimensional scene reconstruction on the overlapping scene videos to generate a three-dimensional model of the scene; The abnormal communication module is used to encode the inspection point data into non-video data based on the scene 3D model to obtain the inspection LoRa signal when the scene 3D model is consistent with the preset safety inspection point scene model; the inspection LoRa signal is forwarded in the gateway to perform abnormal patrol record reporting The abnormal communication module is used to perform difference segmentation on the scene three-dimensional model and the preset safety patrol point scene model when they are inconsistent, so as to obtain difference area data; the difference area data and patrol point data are transmitted in the optical frequency band to execute abnormal patrol record reporting.

Images