A method and device for actively discovering missing data on a communication big data platform

Abstract

The present invention relates to the field of communication technology, and discloses a method and device for actively discovering data missing on a communication big data platform. The present invention proposes corresponding solution strategies for various complex and common data missing scenarios in the communication big data platform. Specifically, for the complex scenario where each parsing device cannot parse the corresponding data packet due to changes in network element configuration information, the present invention obtains the network element configuration information by automatically parsing the data packet, and sends it to the corresponding parsing device by the convergence and diversion device to improve the parsing parameters, so that the parsing device can parse the data packet and avoid discarding data and causing data missing. The present invention improves the automatic detection rate of data missing, which is beneficial to improving the data integrity of the big data communication platform.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method and device for actively discovering missing data on a communication big data platform. Background Art

[0002] When the existing operator data multiplexing and collection system is collecting and transmitting data, it usually multiplexes the network element interface data of each operator's existing network that needs to be collected, and the corresponding front-end aggregation device aggregates the data of each multiplexing point, and then transmits it to the aggregation and distribution device through the aggregation link. The aggregation and distribution device distributes the data to different analysis devices for analysis according to the preset analysis rules, and the analysis device transmits the analyzed data to the communication big data platform for analysis.

[0003] The accuracy of data analysis is closely related to the integrity of the collected data. In order to ensure the integrity of the data collected by the communication big data platform, any changes in the network element links or configurations of each operator need to be fed back to the communication big data platform. Due to the complex links and personnel involved in the changes in network element links or configurations, the corresponding change feedback information is difficult to synchronize to the communication big data platform in a timely manner, resulting in data missing problems on the communication big data platform.

[0004] The applicant analyzed various data missing situations and concluded that the data missing situations caused by changes in network element links and configurations are mainly divided into the following categories:

[0005] (1) Due to changes in NE links, cutover, etc., the corresponding NE configuration information (mainly IP address information) has changed. The changed NE configuration information has not been synchronized to the aggregation and distribution devices in a timely manner, making it impossible for the parsing device to parse the corresponding NE interface data;

[0006] (2) The operator adds a new network element to the existing network, but the related links of the new network element are not connected to the aggregation link, resulting in missing link data of the new network element;

[0007] (3) The link capacity of existing network elements in the operator's existing network has been expanded, and the data of the newly added links has not been synchronized to the communication big data platform in a timely manner, resulting in data loss of the newly added links;

[0008] (4) Data loss due to the data source traffic of the aggregation link or analysis link being greater than the transmission bandwidth;

[0009] (5) Packet loss caused by uncertain factors such as physical failure of the aggregation link.

[0010] Among the above data missing situations, the above three data missing situations are relatively common and are an important component of data missing. However, due to the complex causes of data missing, it is difficult to detect missing data by simple detection methods. The existing data missing detection system for the big data communication platform can only realize simple detection of data missing situations such as items (4) and (5), and cannot realize active detection of scenarios with complex causes that occur frequently. Summary of the invention

[0011] The present invention provides a method and device for actively discovering data missing on a communication big data platform, which solves the technical problem that the existing data missing detection method for the big data communication platform cannot realize active detection of data missing scenarios with complex causes and which occur frequently, so as to improve the integrity of data collection on the big data communication platform as much as possible.

[0012] A first aspect of the present invention provides a method for actively discovering data missing on a communication big data platform, wherein the communication big data platform includes a convergence and shunting device and parsing devices connected to the convergence and shunting device, and the method includes:

[0013] Acquire the network element interface data packet that cannot be parsed by the aggregation and distribution device;

[0014] Parsing the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information;

[0015] The network element configuration information is sent to the convergence and distribution device, so that when the convergence and distribution device distributes the network element interface data packet that cannot be parsed, the corresponding network element configuration information is transmitted to the corresponding parsing device in advance or synchronously.

[0016] According to an achievable manner of the first aspect of the present invention, the obtaining of a network element interface data packet that cannot be parsed by the convergence and distribution device includes:

[0017] Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple;

[0018] The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be parsed.

[0019] According to an achievable manner of the first aspect of the present invention, the method further includes:

[0020] Acquire global signaling data of the operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network;

[0021] Searching for corresponding data services in the convergence and distribution device according to the identification information of each network element;

[0022] If there is a network element for which no corresponding data service is found among the network elements, the network element for which no corresponding data service is found is regarded as a missing network element;

[0023] Sending information for prompting the corresponding operator to access the network element, the information including the identifier of the missing network element.

[0024] According to an achievable manner of the first aspect of the present invention, the method further includes:

[0025] Determining the data resolution rate of each of the analysis devices;

[0026] If the data resolution rate of the resolution device is lower than a preset data resolution rate threshold, obtaining a link IP address associated with the data resolution rate;

[0027] The link IP address is used as the IP address of the expansion link that is not connected to the aggregation link, and operation and maintenance indication information including the link IP address is sent to the corresponding operation and maintenance terminal.

[0028] A second aspect of the present invention provides a device for actively discovering data missing on a communication big data platform, wherein the communication big data platform includes a convergence and shunting device and parsing devices connected to the convergence and shunting device, and the device includes:

[0029] A first acquisition module, used to acquire a network element interface data packet that cannot be parsed by the convergence and distribution device;

[0030] A parsing module, used to parse the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information;

[0031] The first sending module is used to send the network element configuration information to the convergence and distribution device, so that when the convergence and distribution device distributes the network element interface data packet that cannot be parsed, it transmits the corresponding network element configuration information to the corresponding parsing device in advance or synchronously.

[0032] According to an achievable manner of the second aspect of the present invention, the first acquisition module is specifically configured to:

[0033] Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple;

[0034] The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be parsed.

[0035] According to an achievable manner of the second aspect of the present invention, the device further includes:

[0036] A second acquisition module is used to acquire global signaling data of an operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network;

[0037] A search module, used to search for corresponding data services in the convergence and distribution device according to the identification information of each network element;

[0038] A missing network element determination module, configured to, when a network element for which a corresponding data service cannot be found among the network elements, regard the network element for which a corresponding data service cannot be found as a missing network element;

[0039] The second sending module is used to send information for prompting the corresponding operator to access the network element, wherein the information includes the identifier of the missing network element.

[0040] According to an achievable manner of the second aspect of the present invention, the device further includes:

[0041] A detection module, used to determine the data resolution rate of each of the resolution devices;

[0042] A third acquisition module, configured to acquire a link IP address associated with the data resolution rate when the data resolution rate of the resolution device is lower than a preset data resolution rate threshold;

[0043] The third sending module is used to use the link IP address as the IP address of the expansion link that is not connected to the aggregation link, and send the operation and maintenance indication information including the link IP address to the corresponding operation and maintenance terminal.

[0044] A third aspect of the present invention provides a device for actively discovering missing data on a communication big data platform, comprising:

[0045] A memory for storing instructions; wherein the instructions are instructions that can implement the method for actively discovering missing data on a communication big data platform as described in any of the above-mentioned methods;

[0046] A processor is used to execute instructions in the memory.

[0047] A fourth aspect of the present invention is a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for actively discovering missing data on a communication big data platform as described in any of the above-implemented methods.

[0048] It can be seen from the above technical solutions that the present invention has the following advantages:

[0049] The present invention obtains network element interface data packets that cannot be parsed by the convergence and shunting devices of the big data communication platform, and parses the network element interface data packets to obtain corresponding network element configuration information including IP address information, and then sends the network element configuration information to each parsing device of the big data communication platform; when the network element configuration information changes but is not synchronized to the convergence and shunting devices, it will make it difficult for each parsing device to parse the corresponding network element interface data. For this complex and common data missing scenario, the present invention automatically parses the network element interface data packets that cannot be parsed by the convergence and shunting devices, and the obtained parsing results are sent by the convergence and shunting devices to the corresponding parsing devices to improve the parsing parameters, so that the parsing devices can parse this type of network element interface data packets to avoid discarding data and causing data missing. The method is simple and convenient, improves the automatic detection rate of data missing, and is beneficial to improving the data integrity of the big data communication platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0051] Figure 1 A flowchart of a method for actively discovering missing data on a communication big data platform provided by an optional embodiment of the present invention;

[0052] Figure 2 A structural connection block diagram of a device for actively discovering missing data on a communication big data platform provided as an optional embodiment of the present invention.

[0053] Reference numerals:

[0054] 1-first acquisition module; 2-analysis module; 3-first sending module. DETAILED DESCRIPTION

[0055] The embodiments of the present invention provide a method and device for actively discovering data missing on a communication big data platform, which are used to solve the technical problem that the existing data missing detection method for a big data communication platform cannot realize active detection of data missing scenarios with complex causes and which occur frequently.

[0056] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0057] The present invention provides a method for actively discovering data missing of a communication big data platform, wherein the communication big data platform comprises a convergence and diversion device and various parsing devices connected to the convergence and diversion device.

[0058] As part of the communication big data platform, the convergence and distribution equipment is connected to the front-end convergence equipment of each operator's existing network, so as to realize the data interaction between the communication big data platform and the existing network of each operator. After receiving the aggregated network element interface data packet sent by the front-end convergence equipment, the convergence and distribution equipment distributes the data to different parsing devices for parsing according to the preset parsing rules.

[0059] See also Figure 1 , Figure 1 A flow chart of a method for actively discovering missing data on a communication big data platform provided by an embodiment of the present invention is shown.

[0060] The present invention provides a method for actively discovering missing data on a communication big data platform, comprising steps S1-S3.

[0061] Step S1, obtaining a network element interface data packet that cannot be parsed by a convergence and distribution device.

[0062] The “network element interface data packet that cannot be parsed” refers to the network element interface data packet that cannot be identified by the aggregation and distribution device through the existing network element configuration information.

[0063] In an achievable manner, the obtaining of a network element interface data packet that cannot be parsed by the convergence and distribution device includes:

[0064] Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple;

[0065] The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be parsed.

[0066] In this embodiment, the convergence and distribution device determines whether there are any packets that cannot be parsed in the received network element interface data packets based on the five-tuple information of the network element interface data packets. The five-tuple is a set of five quantities: source IP address, source port, destination IP address, destination port, and transport layer protocol. In specific implementation, the convergence and distribution device matches the source IP address and / or destination IP address of the network element interface data packet with the corresponding preset standard address. If the network element interface data packet includes other address information other than the preset standard address, it is determined that the network element interface data packet cannot be parsed.

[0067] Step S2, parsing the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information.

[0068] The parsing of the network element interface data packet mainly involves automatically analyzing the IP address in the network element interface data packet and the transmission protocol of the data packet.

[0069] In specific implementation, a new automatic analysis device can be added to the big data communication platform to parse the network element interface data packets that cannot be recognized by the aggregation and distribution devices, so as to obtain the corresponding network element configuration information.

[0070] Step S3, sending the network element configuration information to the convergence and distribution device, so that when the convergence and distribution device distributes the network element interface data packet that cannot be parsed, it transmits the corresponding network element configuration information to the corresponding parsing device in advance or synchronously.

[0071] When a new network element or a new link enters the convergence link in the existing network, the newly added network element interface data packet has entered the convergence and diversion device of the big data communication platform through the convergence link. However, since the operator did not synchronize the parameters of the changed network element configuration information with the convergence and diversion device in time, the original convergence and diversion device was unable to recognize the data traffic outside the configuration, which directly caused the loss of valid data. In view of this complex and common data loss scenario, the above-mentioned embodiment of the present invention automatically parses the network element interface data packet that the convergence and diversion device cannot parse, and the obtained parsing result is sent by the convergence and diversion device to the corresponding parsing device to improve the parsing parameters, so that the parsing device can parse this type of network element interface data packet to avoid discarding data and causing data loss. The method is simple and convenient, and improves the automatic detection rate of data loss, which is beneficial to improving the data integrity of the big data communication platform.

[0072] In one implementation, the method further includes:

[0073] Acquire global signaling data of the operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network;

[0074] Searching for corresponding data services in the convergence and distribution device according to the identification information of each network element;

[0075] If there is a network element for which no corresponding data service is found among the network elements, the network element for which no corresponding data service is found is regarded as a missing network element;

[0076] Sending information for prompting the corresponding operator to access the network element, the information including the identifier of the missing network element.

[0077] The method of this embodiment is used for the second data missing situation mentioned above, that is, the operator adds a new network element to the existing network, and the related link of the new network element is not connected to the aggregation link, resulting in the loss of data on the interface of the new network element. In the second data missing situation, since the missing data does not enter the aggregation and diversion equipment, it is difficult to find the missing data through simple missing detection. When this happens, it will cause great harm to the data integrity.

[0078] For network elements that appear in global signaling, if the corresponding data service appears in the convergence and diversion device, it means that the network element is an accessed network element. If the corresponding data service does not appear in the convergence and diversion device, it means that the relevant link of the network element is not connected to the convergence link. Based on this, the embodiment of the present invention obtains the network element information of the network through the interface analysis of the global signaling, and then analyzes the network element information obtained by the statistical communication big data platform, and compares the two to obtain the missing part of the network element. By sending information to the corresponding operator to prompt the access of the network element, the operator can realize the access of the network element as soon as possible to solve the problem of missing data.

[0079] In one implementation, the method further includes:

[0080] Determining the data resolution rate of each of the analysis devices;

[0081] If the data resolution rate of the resolution device is lower than a preset data resolution rate threshold, obtaining a link IP address associated with the data resolution rate;

[0082] The link IP address is used as the IP address of the expansion link that is not connected to the aggregation link, and operation and maintenance indication information including the link IP address is sent to the corresponding operation and maintenance terminal.

[0083] Among them, the data resolution rate is a comprehensive analysis indicator of the communication big data platform. Specifically, the signaling of different interfaces of the communication big data platform can be collected, and multiple different signalings with the same field can be analyzed to obtain the overlap rate of the same field in the different signalings, and the overlap rate is the data resolution rate. It should be noted that the data resolution rate can also be obtained by analysis of other existing analysis equipment. The method for determining or obtaining the data resolution rate belongs to the prior art, and the method for obtaining or determining the data resolution rate is not limited in this embodiment.

[0084] The method of this embodiment is used to address the third data loss situation mentioned above, that is, there is a link expansion in the existing network element interface of the operator's existing network, and the newly added link data is not synchronized to the communication big data platform in time, resulting in data loss of the newly added link. For data loss in this case, since it is only the expansion of the original link, it does not involve the configuration synchronization of the convergence and diversion equipment. However, for data loss in this case, the data resolution rate of the resolution device responsible for this IP address will decrease.

[0085] When the resolution device shows a drop in data resolution, it means that the link associated with this data resolution has missed data. By determining the IP address of the link corresponding to the data resolution, the IP address of the expansion can be clearly identified. By sending the operation and maintenance instruction information including the link IP address to the corresponding operation and maintenance terminal, the operation and maintenance personnel can be guided to quickly locate the network element interface that is not connected to the expansion, and accurately and quickly solve the data missing problem.

[0086] The present invention also provides a device for actively discovering data missingness of a communication big data platform, wherein the communication big data platform includes a convergence and diversion device and various parsing devices connected to the convergence and diversion device.

[0087] See also Figure 2 , Figure 2 A structural connection block diagram of a device for actively discovering missing data on a communication big data platform provided by an embodiment of the present invention is shown.

[0088] An embodiment of the present invention provides a device for actively discovering missing data on a communication big data platform, comprising:

[0089] A first acquisition module 1 is used to acquire a network element interface data packet that cannot be parsed by the convergence and distribution device;

[0090] Parsing module 2, used to parse the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information;

[0091] The first sending module 3 is used to send the network element configuration information to the convergence and distribution device, so that when the convergence and distribution device distributes the network element interface data packet that cannot be parsed, it transmits the corresponding network element configuration information to the corresponding parsing device in advance or synchronously.

[0092] In one achievable manner, the first acquisition module 1 is specifically used for:

[0093] Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple;

[0094] The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be parsed.

[0095] In one possible implementation, the device further includes:

[0096] A second acquisition module is used to acquire global signaling data of an operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network;

[0097] A search module, used to search for corresponding data services in the convergence and distribution device according to the identification information of each network element;

[0098] A missing network element determination module, configured to, when a network element for which a corresponding data service cannot be found among the network elements, regard the network element for which a corresponding data service cannot be found as a missing network element;

[0099] The second sending module is used to send information for prompting the corresponding operator to access the network element, wherein the information includes the identifier of the missing network element.

[0100] In one possible implementation, the device further includes:

[0101] A detection module, used to determine the data resolution rate of each of the resolution devices;

[0102] A third acquisition module, configured to acquire a link IP address associated with the data resolution rate when the data resolution rate of the resolution device is lower than a preset data resolution rate threshold;

[0103] The third sending module is used to use the link IP address as the IP address of the expansion link that is not connected to the aggregation link, and send the operation and maintenance indication information including the link IP address to the corresponding operation and maintenance terminal.

[0104] The present invention also provides a device for actively discovering missing data on a communication big data platform, comprising:

[0105] A memory for storing instructions; wherein the instructions are instructions that can implement the method for actively discovering missing data on a communication big data platform as described in any one of the above embodiments;

[0106] A processor is used to execute instructions in the memory.

[0107] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method for actively discovering missing data on a communication big data platform as described in any one of the above embodiments is implemented.

[0108] The three data missing discovery strategies proposed in this application can correspondingly solve the complex and difficult-to-find data missing problems proposed in this application. Actively detecting data missing on the big data communication platform through the data missing discovery strategy of this application can greatly increase the proportion of data missing discovery and ultimately improve the platform data analysis performance.

[0109] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes and effects of the system devices and modules described above can refer to the corresponding processes and effects in the aforementioned method embodiments, and will not be repeated here.

[0110] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0111] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0112] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional modules.

[0113] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0114] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for actively discovering data missing in a communication big data platform, wherein the communication big data platform comprises a convergence and diversion device and analysis devices connected to the convergence and diversion device, characterized in that: The method comprises: Acquire a network element interface data packet that cannot be identified by the aggregation and distribution device through existing network element configuration information; Parsing the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information; Sending the network element configuration information to the convergence and distribution device, so that when the convergence and distribution device distributes the network element interface data packet that cannot be identified by the existing network element configuration information, the corresponding network element configuration information is transmitted to the corresponding parsing device in advance or synchronously; Determining the data resolution rate of each of the analysis devices; If the data resolution rate of the resolution device is lower than a preset data resolution rate threshold, obtaining a link IP address associated with the data resolution rate; Using the link IP address as the IP address of the expansion link that is not connected to the aggregation link, and sending operation and maintenance instruction information including the link IP address to the corresponding operation and maintenance terminal; The data resolution is specifically: Collect signaling from different interfaces of the communication big data platform; A plurality of different signalings having the same field are analyzed to obtain overlapping rates of the same field in the different signalings.

2. The method for actively discovering missing data on a communication big data platform according to claim 1, characterized in that: The obtaining of a network element interface data packet that cannot be identified by the convergence and distribution device through existing network element configuration information includes: Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple; The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be identified through the existing network element configuration information.

3. The method for actively discovering missing data on a communication big data platform according to claim 1, characterized in that: The method further comprises: Acquire global signaling data of the operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network; Searching for corresponding data services in the convergence and distribution device according to the identification information of each network element; If there is a network element for which no corresponding data service is found among the network elements, the network element for which no corresponding data service is found is regarded as a missing network element; Sending information for prompting the corresponding operator to access the network element, the information including the identifier of the missing network element.

4. A data missing active discovery device for a communication big data platform, the communication big data platform comprising a convergence and diversion device and various analysis devices connected to the convergence and diversion device, characterized in that: The device comprises: A first acquisition module is used to acquire a network element interface data packet that cannot be identified by the convergence and distribution device through existing network element configuration information; A parsing module, used to parse the network element interface data packet to obtain corresponding network element configuration information, wherein the network element configuration information includes IP address information; A first sending module, configured to send the network element configuration information to the convergence and distribution device, so that the convergence and distribution device transmits the corresponding network element configuration information to the corresponding parsing device in advance or synchronously when distributing the network element interface data packet that cannot be identified by the existing network element configuration information; A detection module, used to determine the data resolution rate of each of the resolution devices; A third acquisition module, configured to acquire a link IP address associated with the data resolution rate when the data resolution rate of the resolution device is lower than a preset data resolution rate threshold; A third sending module, configured to use the link IP address as the IP address of the expansion link that is not connected to the aggregation link, and send the operation and maintenance indication information including the link IP address to the corresponding operation and maintenance terminal; The data resolution is specifically: Collect signaling from different interfaces of the communication big data platform; A plurality of different signalings having the same field are analyzed to obtain overlapping rates of the same field in the different signalings.

5. The device for actively discovering missing data on a communication big data platform according to claim 4, characterized in that: The first acquisition module is specifically used for: Receiving a network element interface data packet sent by the convergence and distribution device, wherein the network element interface data packet is sent by the convergence and distribution device when its quintuple does not match a preset standard quintuple; The network element interface data packet sent by the convergence and distribution device is used as the network element interface data packet that cannot be identified through the existing network element configuration information.

6. The device for actively discovering missing data on a communication big data platform according to claim 4, characterized in that: The device also includes: A second acquisition module is used to acquire global signaling data of an operator's existing network, where the global signaling data includes identification information of each network element in the operator's existing network; A search module, used to search for corresponding data services in the convergence and distribution device according to the identification information of each network element; A missing network element determination module, configured to, when a network element for which a corresponding data service cannot be found among the network elements, regard the network element for which a corresponding data service cannot be found as a missing network element; The second sending module is used to send information for prompting the corresponding operator to access the network element, wherein the information includes the identifier of the missing network element.

7. A data missing active discovery device for a communication big data platform, characterized in that: include: A memory for storing instructions; wherein the instructions are instructions that can implement the method for actively discovering missing data on a communication big data platform as described in any one of claims 1 to 3; A processor is used to execute instructions in the memory.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the method for actively discovering missing data on a communication big data platform as described in any one of claims 1 to 3 is implemented.

Images