A data synchronization and storage method suitable for large short-wave station

Abstract

The embodiment of the application provides a data synchronization and storage method suitable for a large short-wave station, comprising: installing a direct sampling receiver access antenna element under each array element of a large array short-wave station; taking a plurality of channels of direct sampling data as a group according to actual computing power; and accessing a drawing server through an optical fiber; accessing each receiver with an external synchronous clock; assigning a continuous time stamp to each frame of data sent by the receiver to the drawing server; drawing specific frequency points of the multi-channel direct sampling data by each drawing server, and broadcasting to a data aggregation server through a gigabit switching network; establishing a streaming data buffer by the data aggregation server, receiving data packets sent by the distributed drawing server, taking all data marked with the same time stamp as multi-channel unit frame data as a benchmark, and pushing the multi-channel unit frame data to a to-be-stored queue; storing the multi-channel unit frame data in a specific format; and establishing a monitoring protection mechanism by the data aggregation server.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of short wave communication reconnaissance, and particularly relates to a data synchronization and storage method suitable for a large short wave station. BACKGROUND

[0002] Short wave communication is widely used in military, political and other fields due to its strong anti-destroying ability, long-distance communication, mature technology, low cost, convenient maintenance and other characteristics. In the field of military application, short wave communication generally adopts an array antenna, and reconnaissance and direction finding are performed through the form of array of antenna units.

[0003] A traditional short wave antenna array is deployed in a regular circular or L-shaped distribution, and the number of antenna array elements ranges from several to dozens. A typical multi-layer circular fixed direction finding station divides antenna array elements into multiple layers according to different radii with the center of the circle as the center, and each layer of antenna array elements usually has dozens of elements. In actual use, a specified single-layer antenna array element data is input through an antenna coupler. In a reconnaissance station, directional antennas with different directivities are arranged in an array, and usually dozens of directional antennas cover a range of 360°. In actual use, only a few array element data are used as analysis input. Whether for reconnaissance or direction finding, the number of synchronous array element channels required is not large, so in the current array data receiving, synchronization is usually completed inside the receiver, and then transmitted to the back end. However, once the number of array elements is more than one hundred, the current short wave station multi-channel data acquisition method is no longer applicable.

[0004] When the number of array elements reaches more than one hundred, the realization of data synchronization inside the receiver is no longer practical, and there are problems such as distributed multi-channel data distribution and aggregation of the receiver, multi-channel data synchronization, abnormal processing and fault compatibility in multi-channel data storage. Based on this, the present application designs a large array short wave signal synchronization and data storage method. The problems of long distance between short wave station array elements, more than one hundred data aggregation and storage, and distributed data transmission guarantee are researched and analyzed, and a large array short wave signal synchronization and data storage method is proposed, which is applied to short wave channel multi-channel data receiving and storage for subsequent signal processing and analysis. SUMMARY

[0005] In view of the above problems existing in the prior art, the embodiment of the present application provides a data synchronization and storage method suitable for a large short wave station, aiming at the problems of distributed multi-channel data distribution and convergence, multi-channel data synchronization, and abnormal processing and fault compatibility in multi-channel data storage when the number of array elements reaches a certain order in a large array short wave station, a large array short wave signal synchronization and data storage method is proposed, a short wave wideband direct sampling receiver is used to realize short wave full-band data reception, an external clock synchronization device is used to synchronize the time of multi-array element data, multi-channel narrowband data are extracted and distributed in a service form, data convergence and frame synchronization are completed in a pipeline collection mode, and a multi-channel data file storage format is designed to realize single file storage of multi-channel signals. Meanwhile, a fault compatibility and abnormal processing mechanism is designed to ensure that the remaining normal channels can still work normally in the case of a fault of a receiving front end.

[0006] The embodiment of the present application provides a data synchronization and storage method suitable for a large short wave station, comprising:

[0007] Step 1: install a direct sampling receiver to access an antenna element of each array element of a large array short wave station, and according to the actual computing power, a plurality of channels of direct sampling data are taken as a group, and a plurality of distributed extraction servers are used to realize the reception of all array element direct sampling data.

[0008] Step 2: access each receiver with an external synchronization clock, assign a continuous time stamp to each frame of data sent by the receiver to the extraction server, and ensure that the clocks of all antenna element collected data are consistent;

[0009] Step 3: each extraction server extracts a specific frequency point from the multi-channel direct sampling data, and the time stamp transmitted by the receiver is added to each frame of data packet extracted, and the data packet is broadcast to the data convergence server through a gigabit switching network;

[0010] Step 4: the data convergence server establishes a streaming data buffer, receives the data packet sent by the distributed extraction server, takes all data marked with the same time stamp as a multi-channel unit frame data as a basis for the synchronization result within a fixed cache time, and pushes the multi-channel unit frame data to a to-be-stored queue;

[0011] Step 5: store the multi-channel unit frame data in a specific format, so that the number of real-time storage files for each frequency point is 1;

[0012] Step 6: the data convergence server establishes a monitoring protection mechanism, and monitors the data flow and the to-be-stored queue in real time, reports the abnormal condition in time, starts a business self-recovery mechanism, and ensures the normal operation of the business and other businesses of the convergence server.

[0013] In some embodiments of the present application, the data sent from each extraction server to the aggregation server via the switching network is sequentially sorted in ascending order of time stamp information.

[0014] In some embodiments of the present application, the aggregation server, in the process of receiving each frame of data, establishes a circular data buffer queue with a buffer length of M frame durations, and each frame of data buffer unit data structure includes data time stamp, data channel identifier, data source, data body, and data information, wherein the data information at least includes frequency point, bandwidth, and sampling rate.

[0015] In some embodiments of the present application, the aggregation server, in the process of receiving each frame of data, records the maximum value of the current received data time stamp as T max Whenever a new data packet is received, the unit index Index at which the data should be buffered is calculated by taking the modulus of M of the data time stamp.

[0016] Under normal circumstances, the data time stamp is cumulatively added by 1, and the update of the unit index Index is sequentially added to the circular buffer queue.

[0017] The current maximum time stamp T max is compared with the data time stamp. If the current data time stamp is consistent with T max , or smaller than T max but the difference is within M, the data is parsed and placed into the corresponding buffer unit.

[0018] If the current data time stamp is greater than T max by 1, the current maximum time stamp T max is updated, and the count C R of the received multi-channel data is recorded as 1. If the value of C R is greater than 2*M, the data in the buffer unit index Index is copied to the storage queue, the data in the buffer unit index Index is reset, the data is parsed, and the data is placed into the buffer unit Index.

[0019] In other cases, the value of C R is greater than 2*M, and the current data time stamp is greater than T max by 2 or more, or the current data time stamp is smaller than T max and the difference is greater than M, indicating that the time stamp of the data packet is abnormal, and the data packet will be discarded.

[0020] In some embodiments of the present application, when the data aggregation task is just started, the time at which each extraction server receives the task instruction is earlier or later, and combined with the reasons for program startup and network fluctuation, the multi-channel data of the first few frames is incomplete.

[0021] In order to ensure the integrity of the aggregated data, when C RWhen the value is greater than 2*M, the cached data is pushed into the storage queue.

[0022] In some embodiments of the present application, when data is stored, each frame of data is stored in a set unit format, which specifically includes timestamp information, data identification of N-channel data presence or absence, and N-channel data bodies arranged in sequence, and all stored data is sequentially stored in time sequence;

[0023] After each frame of data is written, the written multi-channel data count C W is counted.

[0024] In some embodiments of the present application, the channel data presence or absence identification defined in the storage unit format is used to mark whether the channel data is stored when actually collected and received, which is suitable for the case of missing abnormal data in the front end or manually setting part of the channel for collection. By assigning a true value to only the channel identification of the actually stored data, the subsequent data reading and analysis are guided for data verification.

[0025] In some embodiments of the present application, when the workflow is started, the daemon thread monitors the synchronization storage program in real time, ensures that it is restarted when it abnormally exits, and reconnects the service.

[0026] In some embodiments of the present application, a plurality of timers are set to monitor the system state, including program memory monitoring, storage data frame count monitoring, received data frame count monitoring, and multi-channel synchronization monitoring.

[0027] The program memory monitoring refers to monitoring the memory occupied by the synchronization collection program when the synchronization storage program is started and run, and setting a maximum threshold. When the memory usage is greater than the maximum threshold, the self-protection exit and restart mechanism is enabled to restart the program.

[0028] The storage data frame count monitoring refers to monitoring the written multi-channel data count C W . The difference between C W and C R is calculated. Under normal circumstances, the writing is timely and the difference is small. When the writing is not timely, the difference will increase. When the difference is greater than the set maximum value, it indicates that a large amount of data is accumulated in the memory, and the exit and restart mechanism is enabled to release the memory to protect the normal operation of the program.

[0029] The received data frame count is monitored by monitoring the received unit frame count C R . If C R does not change between two monitoring intervals, it indicates that there is a problem with data reception, which needs to be reported. To ensure the continuity of the stored data, the synchronization storage service needs to be restarted.

[0030] Multi-channel synchronous monitoring is the state monitoring of whether the multi-channel data in the current data frame exists when each cache frame enters the storage queue, and the abnormal channel distribution is reported in time when the channel number is less than N, which helps to locate the front-end exception.

[0031] Compared with the prior art, the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application has the beneficial effects that: the use of external clock for multi-array clock synchronization is specified, so that a single receiver does not need to bear the synchronization function of too many channels and can be distributedly deployed at different antenna arrays; meanwhile, a distributed data aggregation synchronization method is designed. The data aggregation server completes the reception and synchronization of distributed narrowband data in a fixed-time streaming buffer, which can effectively adapt to the data loss caused by the missing of the front end, extraction exception and network fluctuation, and further, a specific format short-wave data storage method conforming to actual application is proposed, and the multi-channel data is stored in a specific format, for example, when 100 frequency points are extracted at the same time, the file IO operation handle reaches 10,000, which is unreasonable for the operating system, and when 1 file is used for each frequency point, only 100 operation handles are used, which reduces the IO operation and conforms to the actual application. BRIEF DESCRIPTION OF DRAWINGS

[0032] Figure 1 The equipment composition and data flow of the application scenario of the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application are shown.

[0033] Figure 2 The data flow of the data sent by the single extraction server to the aggregation server in the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application is shown.

[0034] Figure 3 The synchronization processing process when the aggregation server receives the distributed data packet in the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application is shown.

[0035] Figure 4 The multi-channel data storage format defined by the application in the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application is shown.

[0036] Figure 5 The program monitoring protection mechanism designed by the application in the data synchronization and storage method suitable for large short-wave stations provided by the embodiment of the application is shown. DETAILED DESCRIPTION

[0037] In order for those skilled in the art to better understand the technical solutions of the application, the application will be described in detail below with reference to the drawings and specific embodiments.

[0038] Various embodiments and features of this application are described herein with reference to the accompanying drawings.

[0039] These and other features of this application will become apparent from the following description of preferred forms of embodiments given as non-limiting examples, with reference to the accompanying drawings.

[0040] It should also be understood that although this application has been described with reference to some specific examples, those skilled in the art can certainly implement many other equivalent forms of this application, which have the features described in the claims and are therefore all within the scope of protection defined herein.

[0041] The above and other aspects, features and advantages of this application will become more apparent when taken in conjunction with the accompanying drawings and in view of the following detailed description.

[0042] Specific embodiments of this application are described below with reference to the accompanying drawings; however, it should be understood that the claimed embodiments are merely examples of this application, which can be implemented in various ways. Well-known and / or repeated functions and structures are not described in detail to ascertain the true intent based on the user's historical operations, and to avoid unnecessary or redundant details that would obscure this application. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but merely serve as the basis and representative basis for the claims to teach those skilled in the art to use this application in various ways with substantially any suitable detailed structure.

[0043] This specification may use the phrases “in one embodiment,” “in another embodiment,” “in yet another embodiment,” or “in other embodiments,” all of which may refer to one or more of the same or different embodiments according to this application.

[0044] This invention provides a data synchronization and storage method suitable for large shortwave arrays, such as... Figures 1 to 5 As shown, the method includes:

[0045] Step 1: Install a direct acquisition receiver under each array element of the large array shortwave array and connect it to the antenna array element. Based on the actual computing power, take several channels of direct acquisition data as a group and connect them to an extraction server through optical fiber. The whole system is realized by multiple distributed extraction servers to receive the direct acquisition data of all array elements.

[0046] Step 2: Connect an external synchronization clock to each receiver and assign a continuous timestamp to each frame of data sent by the receiver to the extraction server to ensure that the clocks of all antenna units are consistent in collecting data.

[0047] Step 3: Each extraction server extracts data from the multi-channel direct acquisition data at a specific frequency point, appends the timestamp from the receiver to each extracted data packet, and broadcasts it to the data aggregation server through a 10 Gigabit switching network.

[0048] Step 4: The data aggregation server establishes a streaming data buffer, receives data packets sent from the distributed extraction server, and synchronizes the results within a fixed cache time, and pushes all data with the same timestamp as multi-channel unit frame data to the storage queue;

[0049] Step 5: Store the multi-channel unit frame data in a specific format, so that the number of real-time storage files for each frequency point is 1;

[0050] Step 6: The data aggregation server establishes a monitoring and protection mechanism to monitor the data flow and the storage queue in real time, reports any abnormal conditions in time, and starts the business self-recovery mechanism to ensure the normal operation of the business and other businesses of the aggregation server.

[0051] To facilitate the understanding of the above technical solutions, the following will be described in conjunction with the drawings and specific examples as follows:

[0052] Figure 1 The method data flow chart of the application mainly includes a synchronous clock unit, an antenna array element, a receiver unit, an extraction server, a gigabit switching network, and a data aggregation server. The sky wave signal enters the receiver through the antenna array element with N channels, the synchronous clock unit assigns the time stamp to the data of the receiving unit in an external timing manner to complete the multi-channel direct sampling data synchronization, the direct sampling data is transmitted to multiple extraction servers through an optical fiber, each extraction server completes narrowband sampling, and the data is distributed to the data aggregation server through the gigabit switching network.

[0053] Figure 2 The overall process of receiving specific frequency narrowband data and completing data synchronization in each data aggregation server. The data sent from each extraction server to the aggregation server through the switching network is definitely in order, and the time stamp information is definitely in order. However, due to the distributed characteristics of the data sent by different extraction servers, network fluctuations may exist, and the arrival time is mixed, that is, although the overall data time stamp is sequentially accumulated, the data with smaller time stamp may arrive later than the data with larger time stamp in a short time.

[0054] Figure 3 The processing process of the aggregation server when receiving each frame of data is shown. A cyclic data buffer queue with a cache length of M frames is established, and each frame of cache unit data structure includes data timestamp, data channel identifier, data source, data body, and data information (frequency point, bandwidth, sampling rate, etc.). Let the maximum value of the current received data timestamp be T max, whenever receiving a new data packet, calculate the unit index Index that the data should be cached by data timestamp modulo M, because data timestamp is normally cumulative plus 1, so the update of unit index Index is also sequential addition for circular buffer queue. Compare the current maximum timestamp T max with data timestamp, if the current data timestamp is consistent with T max , or smaller than T max , but the difference is within M, then parse the data and put the data into the corresponding cache unit; if the current data timestamp is greater than T max by 1, update the current maximum timestamp T max , and record the received multi-channel data count C R plus 1, judge whether the value of C R is greater than 2*M, if yes, copy the data in the cache unit index Index to the storage queue, and then reset the data buffer of the cache unit index Index, then parse the data and put the data into the cache unit Index; otherwise, if the value of C R is greater than 2*M and the current data timestamp is greater than T max by 2 or more, or the current data timestamp is smaller than T max and the difference is greater than M, it means that the timestamp of the data packet is abnormal, and the data packet will be discarded.

[0055] In particular, when the data aggregation task is just started, the time when each extraction server receives the task instruction is earlier or later, combined with program startup and network fluctuation, etc., it will cause the multi-channel data of the first few frames (estimated to be less than M) to be incomplete, therefore, in order to guarantee the integrity of the aggregated data, only when the value of C R is greater than 2*M, the cached data is pushed into the storage queue, in order to avoid the asynchronous nature of the task distribution time when starting the task, causing the missing of the stored multi-channel data.

[0056] Figure 4 The format of the storage data unit, each frame of data is stored according to the unit format, which specifically includes timestamp information, data identification of N-channel data, and N-channel data body arranged in order, all stored data are stored in sequence. After each frame of data is written, the count of written multi-channel data C W is incremented by 1.

[0057] The channel data identification defined in the storage unit format is used to mark whether the channel data is stored when actually collected and received, which is suitable for the case of missing abnormal data in the front end, or manually setting part of the channel for collection, by assigning true value to the channel identification of the actually stored data, to guide the data verification during subsequent data reading and analysis.

[0058] Figure 5The abnormal monitoring measures taken in the data synchronization storage process. When the workflow is started, the daemon thread monitors the synchronization storage program in real time, ensures that it is restarted when it exits abnormally, and reconnects the business. At the same time, multiple timers are set to monitor the system state, including program memory monitoring, storage data frame count monitoring, received data frame count monitoring, and multi-channel synchronization monitoring.

[0059] Program memory monitoring refers to monitoring the memory occupied by the synchronization collection program when the synchronization storage program is started and running, and setting a maximum threshold. When the memory usage is greater than the maximum threshold, the self-protection exit and restart mechanism is enabled, and the program is restarted. Storage data frame count monitoring refers to monitoring the count C W of the multi-channel data C W + C R . Under normal circumstances, the difference is small when writing in time, and the difference will increase when writing is not timely. When the difference is greater than the maximum value set, it means that a large amount of data is accumulated in the memory, and the exit and restart mechanism is enabled to release the memory to protect the normal operation of the program. Received data frame count monitoring is to monitor the received unit frame count C R . If the C R value does not change between two monitoring intervals, it indicates that there is a problem with data reception, which needs to be reported. To ensure the continuity of stored data, the synchronization storage business needs to be restarted. Multi-channel synchronization monitoring is to monitor the status of the multi-channel data in the current data frame when the cache frame enters the storage queue. When the number of channels is less than N, the abnormal channel distribution is reported in time to help locate the front-end exception.

[0060] The above technical solution has been applied in the construction of a certain short-wave station. In this example, the number of short-wave array channels N is 100, the time scale calculated by the synchronization clock is a long integer value calculated by the Beidou timing, the fixed length M of the cache frame is set to 10, and the real-time data rate of a single short-wave frequency point for data storage is about 29Mb / s at a sampling rate of 9600. During boundary testing, the number of parallel collection frequency points reached 100, and the real-time data flow written to the storage reached 600MB / s, and the program ran normally. In actual use, when encountering front-end exceptions such as antenna maintenance, receiver power failure, and network congestion, the program can still store data for normal channels and mark them in the channel identification bit, achieving normal operation.

[0061] The data synchronization and storage method suitable for large short-wave stations provided by the above-mentioned embodiments of the present application can synchronize multiple array elements by using an external clock, so that a single receiver does not need to undertake the synchronization function of too many channels and can be distributed and arranged in different antenna arrays; meanwhile, a distributed data aggregation synchronization method is designed. The data aggregation server receives and synchronizes distributed narrowband data by using a fixed-time streaming buffer, which can effectively adapt to data loss caused by missing front ends, abnormal extraction and network fluctuations, and further, a short-wave data storage method in a specific format suitable for practical application is proposed, and the specific format stores multi-channel data. Taking 100 as an example, if the conventional multi-channel data storage is one file for each channel, when 100 frequency points are extracted at the same time, the file IO operation handle reaches 10,000, which is unreasonable for the operating system. If there is one file for each frequency point, there are only 100 operation handles, which reduces the IO operation and is suitable for practical application.

[0062] The above embodiments are only exemplary embodiments of the present application and are not used to limit the present application, and the protection scope of the present application is defined by the claims. Those skilled in the art can make various modifications or equivalent replacements to the present application within the spirit and protection scope of the present application, and such modifications or equivalent replacements shall also be considered to fall within the protection scope of the present application.

Claims

1. A method for data synchronization and storage suitable for large shortwave sites, characterized in that, Comprise: Step 1: Install a direct sampling receiver access antenna element under each element of a large array short wave station, based on actual computing power, with several channels of direct sampling data as a group, access a draw server through optical fiber, and realize the reception of all element direct sampling data by multiple distributed draw servers; Step 2: Access each receiver with an external synchronous clock, and assign a continuous timestamp to each frame of data sent by the receiver to the draw server to ensure that the clocks of all antenna unit data collection are consistent; Step 3: Each draw server extracts specific frequency points from multi-channel direct sampling data, and adds the timestamp received from the receiver to each frame of data packet extracted, and broadcasts it to the data aggregation server through a gigabit switching network; Step 4: The data aggregation server establishes a streaming data buffer area to receive data packets sent by the distributed draw server, and takes the synchronous result within a fixed buffer time as the basis to push all data marked with the same timestamp as multi-channel unit frame data to the storage queue; Step 5: Store multi-channel unit frame data in a specific format so that the number of real-time storage files for each frequency point is 1; Step 6: The data aggregation server establishes a monitoring and protection mechanism to monitor the data flow and the storage queue in real time, reports any abnormal conditions in time, and starts the business self-recovery mechanism to ensure the normal operation of the business and other businesses of the aggregation server.

2. The data synchronization and storage method suitable for large short wave stations according to claim 1, characterized in that: The data sent from each draw server to the aggregation server through the switching network is sequentially sorted in ascending order according to the timestamp information.

3. The data synchronization and storage method suitable for large short wave stations according to claim 2, characterized in that: The processing process of the aggregation server when receiving each frame of data, a circular data buffer queue with a buffer length of M frame time is established, each frame of buffer unit data structure includes data timestamp, data channel identifier, data source, data body and data information, and the data information at least includes frequency point, bandwidth and sampling rate.

4. The data synchronization and storage method suitable for large short wave stations according to claim 3, characterized in that: The processing procedure of the convergence server when receiving each frame of data, record the maximum value of current received data timestamp as T max Whenever a new data packet is received, calculate the unit index Index that the data should be cached according to the data timestamp modulo M. Under normal circumstances, the data timestamp is added by 1, and the update of the unit index Index adds the sequence of the circular buffer queue; Compare current maximum timestamp T max With data timestamp, if current data timestamp is consistent with T max Or smaller than T max But the difference is within M, analyze data and put data into corresponding cache unit; If the current data timestamp is T max If the value is greater than 1, then update the current maximum timestamp T. max And record the number of multi-channel data received, C. R Add 1, and determine the current state of C. R If the value is greater than 2*M, copy the data in the cache unit index Index to the queue to be stored, reset the data buffer of the data in the single cache meta index Index, and then parse the data and put the data into the cache unit Index. In other cases, C R is greater than 2*M and the current data timestamp is greater than T max by more than 2, or the current data timestamp is less than T max by more than 2 and the difference is greater than M, then the timestamp of the data packet is abnormal and will be discarded.

5. The data synchronization and storage method suitable for large short wave stations according to claim 4, characterized in that: When the data aggregation task is just started, the time when each draw server receives the task instruction has early and late, combined with the reasons of program startup and network fluctuation, resulting in incomplete multi-channel data of the first few frames; To protect the integrity of the converged data, in C R When the value is greater than 2*M, the cached data is pushed into the storage queue.

6. The data synchronization and storage method suitable for large short wave stations according to claim 5, characterized in that: When storing data, each frame of data is stored in a set unit format, which specifically includes timestamp information, data identifier of N channel data, and N channel data body arranged in order, and all stored data are stored in sequence; After each frame of data is written, increment the multichannel data count C W Add 1.

7. The data synchronization and storage method suitable for large short wave stations according to claim 6, characterized in that: The channel defined in the storage unit format has a data identification, which is used to mark whether the data of the channel is stored when actually collected and received, is suitable for the case that the front-end abnormal data is missing or the manual setting of the collection part channel, and by assigning a true value to the channel identification of the actual stored data, the data verification during the subsequent data reading analysis is guided.

8. The data synchronization and storage method suitable for large short-wave sites according to claim 7, characterized in that, When the workflow is started, the daemon thread monitors the synchronization storage program in real time, guarantees the restart when the synchronization storage program abnormally exits, and reconnects the service.

9. The data synchronization and storage method suitable for large short-wave sites according to claim 8, characterized in that, A plurality of timers are set to monitor the system state, including program memory monitoring, storage data frame count monitoring, received data frame count monitoring, and multi-channel synchronization monitoring; The program memory monitoring refers to that when the synchronization storage program is started and runs, the memory occupied by the synchronization collection program is monitored in real time, and a maximum threshold is set, when the memory usage is greater than the maximum threshold, the self-protection exit restart mechanism is enabled, and the program is restarted; Storage data frame count monitoring refers to the count of data written to multiple channels (C). W Monitoring and calculating C W Add C R The difference is small under normal circumstances when writing is timely. When writing is not timely, the difference will increase. When the difference is greater than the set maximum value, it indicates that a large amount of data is piled up in memory. To protect the normal operation of the program, the exit and restart mechanism is enabled to release memory. The received data frame count is the count C of unit frames received R Monitoring is performed, such as in two monitoring intervals C R If the value has not changed, it indicates that there is a problem with data reception, which needs to be reported, and in order to ensure the continuity of stored data, the synchronization storage service needs to be restarted; The multi-channel synchronization monitoring is to monitor the state of the multi-channel data in the current data frame when each cache frame enters the storage queue, and when the number of channels is less than N, the abnormal channel distribution is reported in time to help locate the front-end exception.

Images