A method for correlation analysis of optical fiber signals based on different regions

Abstract

The present invention discloses a method for correlation analysis of optical fiber signals based on different regions, comprising the following steps: collecting optical fiber line data of each region; synchronizing the collected optical fiber line data of each region, and uniformly aggregating the data to a correlation processing node; comparing the uniformly aggregating optical fiber line data of each region according to a certain strategy, and generating a correlation analysis record. The technical solution of the present invention realizes automatic correlation analysis of optical fiber signals in different regions.

Description

Technical Field

[0001] The present invention relates to the technical field of data communication, and in particular to a method for analyzing light signal correlation based on different regions. Background Art

[0002] Most of the existing methods for analyzing the correlation of optical fiber lines are manual analysis. The existing analysis process of optical fiber lines is roughly as follows: each place collects signals from the optical fiber lines respectively, each place summarizes the collected frame structure data and manually imports them into the analysis library, and calculates the possible identical optical fiber lines by comparing all the frame structure data summarized in the analysis library, and again compares the possible identical optical fiber lines for the location of the frame structure, and finds the associated optical fiber lines when the frame structure is consistent with the corresponding location of the location. However, the existing analysis process has the following defects: the existing correlation analysis process is relatively inefficient, and the process is not fully automated as a whole. The correlation analysis process involves the collection of optical fiber line data in different areas. Due to the differences in the hardware or network environment of the optical fiber signal collection equipment, the collected signals are inconsistent. The original technology is difficult to meet the needs of simultaneous collection in different areas. The comparison of frame structure signals and the comparison of location signals are both processed by manual statistics.

[0003] Therefore, the prior art has defects and needs to be improved. Summary of the invention

[0004] The main purpose of the present invention is to propose a method for correlation analysis of optical fiber signals based on different regions, aiming to realize automatic correlation analysis of optical fiber signals in different regions.

[0005] To achieve the above object, the present invention proposes a method for analyzing optical fiber signal correlation based on different regions, comprising the following steps:

[0006] S1: Collecting optical fiber line data in each region, specifically including: obtaining the region and line information to be collected from the data source, generating correlation analysis tasks for each region, and distributing the correlation analysis tasks to each region;

[0007] S2: Synchronize the collected optical fiber line data of each area and aggregate the data to the associated processing node, specifically including: obtaining information of each area and establishing communication with the data source of each area; obtaining metadata of the business data to be synchronized, and starting to synchronize the business data according to the metadata information of the business data;

[0008] S3: Compare the unified and summarized optical fiber line data of each region according to a certain strategy to generate correlation analysis records, including: obtaining information of each region, obtaining business information of the corresponding region from the local data warehouse based on the information of each region, and performing preliminary correlation analysis; obtaining the flow data of the line from the local data warehouse based on the data after the preliminary correlation analysis, and generating correlation analysis records.

[0009] Preferably, the information obtained for each area includes ID, server IP, port, and authentication information.

[0010] Preferably, in step S1, the optical fiber lines in each area need to replace the collected lines through hardware equipment before signal analysis. After the replacement of each area is completed, each area is time synchronized. After the time synchronization is completed, signal collection begins.

[0011] Preferably, in step S2, communication is established with the data sources in each region through multi-threading technology, wherein synchronization of the optical fiber line information includes original optical fiber, combined wave, single wave, frame structure data, and IP flow data in each region.

[0012] Preferably, in step S2, after obtaining the business data, a global ID of the business data is generated based on the regional ID. The production rules of the global ID are mainly composed of 8 bytes. The first byte represents the region, the second byte represents the department, the third byte represents the group, the fourth byte is reserved, and the fifth to eighth bytes represent the self-increment ID. The generation of global ID data can ensure that the data in the entire region is not repeated.

[0013] Preferably, in step S2, if the data synchronization feedback fails, log information is recorded in real time, and a retry mechanism is attempted. The retry mechanism includes the following exceptions: data inconsistency exception, timeout exception, and breakpoint exception.

[0014] Preferably, in step S3, the combined wave, single wave and frame structure data of the area are first obtained and preliminary association is performed. The association logic mainly compares the signal types of each line and each level of frame structure in a recursive manner, and the same signal types between different lines.

[0015] Preferably, in step S3, after acquiring the flow data of the line, an associated analysis record is obtained according to the location of the flow IP and the electrical layer analysis of the frame structure, and an in-depth analysis is performed according to the same proportional relationship between the locations of the IP flows.

[0016] Compared with the prior art, the present invention has the following beneficial effects:

[0017] This solution solves the problem of ID conflicts when synchronizing business data in different regions;

[0018] This solution solves the problem of collecting data in different areas while maintaining consistent time;

[0019] This solution meets the requirements of fully automated association analysis in certain usage scenarios; BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0021] Figure 1 It is a schematic diagram of the overall technical architecture of the present invention;

[0022] Figure 2 A schematic diagram of the processing flow of the analysis and scheduling component of the present invention;

[0023] Figure 3 It is a schematic diagram of the processing flow of the task control component of the present invention;

[0024] Figure 4 This is a schematic diagram of the processing flow of the data synchronization component of the present invention;

[0025] Figure 5 This is a schematic diagram of the processing flow of the association analysis component of the present invention;

[0026] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0027] This embodiment proposes a method for analyzing optical fiber signal correlation based on different regions. Figure 1 The method includes a task control component for executing step S1, a data synchronization component for executing step S2, an association analysis component for executing step S3, and an analysis scheduling component for overall scheduling.

[0028] refer to Figure 2 The analysis and scheduling component is responsible for the overall scheduling of the correlation analysis function. It realizes a series of orderly process management such as task control, data synchronization, and correlation analysis through the analysis and scheduling component, and plays the role of the overall scheduling of the correlation analysis function. The analysis and scheduling component is the overall scheduling center of the optical fiber line correlation analysis method. It usually starts under specific conditions, such as running at a specific time every day. The specific process is described as follows:

[0029] The analysis and scheduling component performs self-checks on related components before preparing to run, the main purpose of which is to check whether each component is running normally;

[0030] After all components are ready, the analysis and scheduling component obtains all regional information from the database and records the ID, server IP, port, and authentication information of each region;

[0031] After the information of each area is loaded, the task control component is called to prepare to start collecting data;

[0032] After the task control component collects data, the data synchronization component runs the data synchronization function, and the analysis and scheduling component is in a suspended state;

[0033] After receiving feedback from the data synchronization component, the analysis and scheduling component proceeds to the next step: if the feedback fails, the analysis and scheduling component records the log information in real time and tries the retry mechanism; if the feedback succeeds, the analysis and scheduling component calls the association analysis component to start association analysis of data in different regions;

[0034] The retry mechanism of the analysis and scheduling component includes the following exceptions: data inconsistency exception, timeout exception, and breakpoint exception. Under the timeout exception retry mechanism, the analysis and scheduling component will retry according to the configured retry mechanism. If the retry fails, the log will be recorded and the manual intervention state will be entered. Under the breakpoint exception retry mechanism, the analysis and scheduling component will start breakpoint retransmission according to the state point of the synchronized data. If the data is not abnormal, it is usually caused by business data errors and requires manual intervention.

[0035] When the associated analysis component is in working state, the analysis scheduling component is in suspended state;

[0036] After the association analysis is completed, the analysis and scheduling component determines whether there is an associated line. If so, the task control component is called to start data collection. If not, the analysis and scheduling component ends.

[0037] Further, refer to Figure 3 , the task control component obtains the area and line information to be collected from the data source, generates the association analysis tasks for each area, and distributes the association analysis tasks to each area; specifically:

[0038] The analysis and scheduling component notifies the task control component to start processing information collection;

[0039] The task control component obtains the area and route information that needs to be collected from the data source;

[0040] After receiving the signal from each area that it can process the associated analysis task, the task control component starts generating tasks for each area;

[0041] The task control component will distribute tasks to the task collection processors in each area, informing them to prepare to process the associated analysis tasks;

[0042] After receiving the instruction from each region that the task collection is ready, the task control component will asynchronously send instructions to each region to start collection;

[0043] Since the optical fiber lines in each area are different, the collected lines need to be switched through hardware equipment before line signal analysis, so the switching time in different areas is also different; the task control component will continuously monitor whether the line switching process in each area is completed, until each area feedbacks the command of line switching completion, the task control component will inform each area to synchronize the time;

[0044] After receiving the instruction that the time synchronization of each area is completed, the mission control component will simultaneously send out the collection instruction to each area to start collecting signals;

[0045] After the task control component waits for each area to complete signal collection, it notifies the analysis and scheduling component to complete the task scheduling;

[0046] The task control component has self-recovery capabilities under various exception handling mechanisms, such as line switching, collection failure, and timeout processing.

[0047] Further, refer to Figure 4 The data synchronization component synchronizes the collected optical fiber line data of each area and aggregates the data to the associated processing node, including: obtaining information of each area and establishing communication with the data source of each area; obtaining metadata of the business data to be synchronized, and starting to synchronize business data according to the metadata information of the business data; the specific process is as follows:

[0048] Obtain regional information from the general dispatcher, including IP, port, and authentication information;

[0049] The data synchronization component uses multi-threading technology to establish communication with each regional data source;

[0050] After each region is connected, the data synchronization component obtains the business data metadata that needs to be synchronized from the configuration; and starts synchronizing business data based on the business data metadata information;

[0051] The synchronization of optical fiber line information mainly involves the original optical fiber, combined wave, single wave, frame structure data, IP traffic data, etc. of each region; after the data synchronization component obtains the business data according to the metadata information, it generates the global ID of the business data according to the regional ID. The production rules of the global ID are mainly composed of 8 bytes. The first byte represents the region, the second byte represents the department, the third byte represents the group, the fourth byte is reserved, and the fifth to eighth bytes represent the self-increment ID. The generation of global ID data can ensure that the data of the entire region is not repeated;

[0052] After the data synchronization component completes the synchronization, it will feedback the success or failure information to the analysis and scheduling component and proceed to the next step.

[0053] Further, refer to Figure 5 The correlation analysis component compares the unified and summarized optical fiber line data of each area according to a certain strategy to generate correlation analysis records, including: obtaining information of each area, obtaining business information of the corresponding area from the local data warehouse according to the information of each area, and performing preliminary correlation analysis; first obtaining the combined wave, single wave and frame structure data of the area, and performing preliminary correlation. The correlation logic mainly compares the signal types of each line and each level of frame structure in a recursive manner. If the same signal type between different lines accounts for a certain proportion of the total line signal type (the proportion relationship can be configured according to the needs of the business scenario), the preliminary correlation is successful.

[0054] Based on the data after preliminary correlation analysis, the traffic data of the line is obtained from the local data warehouse, and the correlation analysis record is analyzed according to the location of the traffic IP and the electrical layer of the frame structure; the amount of data for in-depth analysis is large, and it is mainly determined based on the same proportional relationship between the locations of IP traffic; after the correlation analysis component is completed, it is fed back to the analysis and scheduling component and the correlation analysis record after in-depth analysis is saved.

[0055] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for analyzing optical fiber signal correlation based on different regions, characterized in that: The steps include: S1: Collecting optical fiber line data in each region, specifically including: obtaining the region and line information to be collected from the data source, generating correlation analysis tasks for each region, and distributing the correlation analysis tasks to each region; S2: Synchronize the collected optical fiber line data of each area and aggregate the data to the associated processing node, specifically including: obtaining information of each area and establishing communication with the data source of each area; obtaining metadata of the business data to be synchronized, and starting to synchronize the business data according to the metadata information of the business data; S3: Compare the unified and summarized optical fiber line data of each region according to a certain strategy to generate a correlation analysis record, which specifically includes: obtaining information of each region, obtaining business information of the corresponding region from the local data warehouse based on the information of each region, and performing a preliminary correlation analysis; obtaining the flow data of the line from the local data warehouse based on the data after the preliminary correlation analysis, and generating a correlation analysis record; Get information about each area including ID, server IP, port, and authentication information; In step S1, before performing signal analysis, the optical fiber lines in each area need to replace the collected lines through hardware equipment. After the replacement of each area is completed, each area is time synchronized. After the time synchronization is completed, signal collection begins; In step S2, communication is established with the data sources in each region through multi-threading technology, wherein the synchronization of the optical fiber line information includes the original optical fiber, combined wave, single wave, frame structure data, and IP flow data in each region; In step S2, after obtaining the business data, a global ID of the business data is generated according to the regional ID. The production rule of the global ID consists of 8 bytes, the first byte represents the region, the second byte represents the department, the third byte represents the group, the fourth byte is reserved, and the fifth to eighth bytes represent the self-increment ID. The generation of the global ID data ensures that the data of the entire region is not repeated; In step S3, the combined wave, single wave and frame structure data of the area are first obtained and preliminary association is performed. The association logic is to recursively compare the signal types of each line and each level of frame structure, and the same signal types between different lines; In step S3, after obtaining the flow data of the line, the correlation analysis record is obtained according to the location of the flow IP and the frame structure electrical layer analysis, and the in-depth analysis is performed according to the same proportional relationship of the location of the IP flow.

2. The optical fiber signal correlation analysis method based on different regions according to claim 1, characterized in that: In step S2, if the data synchronization feedback fails, the log information is recorded in real time and a retry mechanism is attempted. The retry mechanism includes the following exceptions: data inconsistency exception, timeout exception, and breakpoint exception.

Images