A processing system for communication big data

Abstract

The present invention relates to the field of communication technology, and in particular to a communication big data processing system, comprising a phase differentiation strategy module, an information assurance module, a test module, a processing module and a dynamic observation module; the phase differentiation strategy module establishes the projects and goals to be optimized by the user, and selects the most suitable optimization method and strategy to optimize the communication big data; the information assurance module performs testing before the selected strategy is put into use to ensure that the optimized strategy will not cause damage to information, resulting in information errors or losses; the test module tests whether the processing system can improve relevant values, and classifies the communication big data after the test is completed; a processing scheme is selected by comparison, and after all adjustments and optimizations are completed, the processing module is put into operation. The present invention solves the problem that the existing communication data processing needs to process massive data, and has low efficiency and low computational complexity.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a system for processing communication big data. Background Art

[0002] The amount of data in the mobile communication network is too large. With the continuous popularization of mobile network communications in my country, especially the vigorous promotion of the use of mobile networks, the number of mobile network users in my country has continued to rise. Although my country's mobile network communications have been greatly developed and improved, the amount of data generated by mobile communication networks is still rising. In some peak areas or times of mobile network use, the base stations of the mobile networks show insufficient load capacity or mobile network communications are stuck. At the same time, even if users can use it smoothly, it is difficult for relevant mobile network providers to complete data collection work well. Especially in the work link of data storage, it is difficult for technical personnel to process and analyze data in a timely manner, and the storage time of data is greatly restricted. Only by doing a good job in the storage of data can we ensure that technical personnel can use and analyze it reasonably and further optimize the application of mobile communication networks.

[0003] In recent years, big data has become a topic of extensive exploration in the field of communications, because the current mobile communication system is in the context of a big data environment. Big data has great resource value and information commercial value. It has become a valuable asset for communication companies and a reflection of the strength and competitiveness of the mobile communication industry. It has certain economic value and role. With the continuous improvement of online payment and network processing capabilities, handling the security of big data is the top priority of all issues. Mobile network providers need to continuously optimize and adjust to make mobile networks more secure and reliable during use. However, existing communication data processing often requires processing massive amounts of data, which has the problems of low efficiency and low computing capacity. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention discloses a communication big data processing system, which is used to solve the problems of low efficiency and low computational load in the existing communication data processing, which often requires processing massive data.

[0005] The present invention is achieved through the following technical solutions:

[0006] The present invention discloses a communication big data processing system, comprising a phase differentiation strategy module, an information assurance module, a test module, a processing module and a dynamic observation module; the phase differentiation strategy module establishes the projects and goals to be optimized by the user, and selects the most suitable optimization method and strategy to optimize the communication big data; the information assurance module performs testing before the selected strategy is put into use, to ensure that the optimized strategy will not cause damage to information, cause information error or loss; the test module tests whether the processing system can improve relevant values, and classifies the communication big data after the test is completed; a processing scheme is selected by comparison, and after all adjustments and optimizations are completed, the processing module is put into operation; the dynamic observation module performs real-time dynamic observation on the processing system, and timely adjusts special situations or error situations to ensure smooth use by the user.

[0007] Preferably, the processing system further comprises a collection module, which collects the communication big data in a queue persistence manner and sends it to the stage differentiation strategy module for data analysis.

[0008] Preferably, the related values ​​include at least one of a computing rate of the communication big data and a storage capacity of the communication big data.

[0009] Preferably, the processing module includes an application storage module and a virtual storage module; the virtual storage module performs certain analysis and screening before the communication big data enters, stores the communication information with consistent structure on a preset unified information platform, and performs systematic centralized management and processing.

[0010] Preferably, the application storage module adopts the storage virtualization strategy of the virtual storage module to perform storage analysis on the communication data generated by the unified information platform.

[0011] Preferably, during the analysis and screening process, the virtual storage module automatically filters the collected communication big data and removes duplicate and invalid communication big data; and transmits the processed communication big data through a communication link.

[0012] Preferably, the dynamic observation module performs real-time dynamic observation on the traffic configuration transmitted by the communication link, and if the transmitted traffic configuration exceeds a preset threshold in the communication link, the generated data is sorted.

[0013] Preferably, when the traffic configuration is transmitted through multiple communication links, the dynamic observation module prioritizes each traffic configuration according to a preset priority sorting rule, and transmits the data in sequence from high to low priority.

[0014] Preferably, the processing module distributes the traffic of the communication big data to ensure that the communication big data is transmitted without attenuation.

[0015] Preferably, the processing system also includes a distribution module, which obtains the communication big data from the application storage module by asynchronous capture, and parses the communication big data by a corresponding parsing method; and distributes and transmits the parsed communication big data according to the corresponding communication link.

[0016] The beneficial effects of the present invention are:

[0017] 1. The communication big data processing system of the present invention processes the communication big data in a classified manner, and removes duplicate and invalid data before processing, thereby improving the efficiency of communication big data processing. The present invention realizes the rapid collection of big data and the stable transmission of big data; the remote control operation of the control terminal based on the Internet of Things of big data.

[0018] 2. Aiming at the daily updated mobile communication network users and the ever-increasing amount of information data, the present invention adopts the application storage and data processing functions of big data to better perform feedback calculations on the data submitted by users, and further improves the optimization and integration of communication big data.

[0019] 3. The present invention conducts systematic centralized management and processing to improve the speed of computing and processing of communication big data, provide better feedback to users, effectively reduce the space and energy required to store large amounts of data, and further reduce possible dynamic changes in data, thereby reducing the difficulty and cost of data management and enabling mobile network providers to better optimize services. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 It is a schematic diagram of the system structure of the present invention. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] Example 1

[0024] This embodiment provides a communication big data processing system, see Figure 1 , including a stage differentiation strategy module 3, an information assurance module 4, a testing module 6, a processing module 5 and a dynamic observation module 9; the processing system 1 also includes a collection module 2, which collects the communication big data in a queue persistence manner and sends it to the stage differentiation strategy module 3 for data analysis.

[0025] The communication big data processing system of the present invention processes the communication big data in a classified manner and removes duplicate and invalid data before processing, thereby improving the efficiency of communication big data processing. The present invention realizes the rapid collection and stable transmission of big data; and the remote control operation of the control terminal based on the Internet of Things of big data.

[0026] The stage differentiation strategy module 3 establishes the projects and goals to be optimized by the user, and selects the most suitable optimization method and strategy to optimize the communication big data; the information assurance module 4 performs testing before the selected strategy is put into use to ensure that the optimized strategy will not cause damage to the information and cause information errors or losses; the test module 6 tests whether the processing system 1 can improve the relevant values, and classifies the communication big data after the test is completed.

[0027] The related values ​​include at least one of a computing rate of the communication big data and a storage capacity of the communication big data.

[0028] A processing solution is selected by comparison, and after all adjustments and optimizations are completed, the processing module 5 is put into operation; the processing module 5 distributes the traffic of the communication big data to ensure that the communication big data is transmitted without attenuation.

[0029] The processing module 5 includes an application storage module 7 and a virtual storage module 8; the virtual storage module 8 performs certain analysis and screening before the communication big data enters, stores the communication information with consistent structure on a preset unified information platform, and performs systematic centralized management and processing.

[0030] The application storage module 7 adopts the storage virtualization strategy of the virtual storage module 8 to perform storage analysis on the communication data generated by the unified information platform. During the analysis and screening process, the virtual storage module 8 automatically filters the collected communication big data and removes duplicate and invalid communication big data; the processed communication big data is transmitted through a communication link.

[0031] The dynamic observation module 9 performs real-time dynamic observation on the processing system 1 and makes timely adjustments to special situations or error situations to ensure smooth use by the user.

[0032] The dynamic observation module 9 performs real-time dynamic observation on the flow configuration transmitted by the communication link. If the transmitted flow configuration exceeds a preset threshold in the communication link, the generated data is sorted.

[0033] When the traffic configuration is transmitted through multiple communication links, the dynamic observation module 9 prioritizes each traffic configuration according to a preset priority sorting rule, and transmits the data in sequence from high to low priority.

[0034] The processing system 1 also includes a distribution module 10, which obtains the communication big data from the application storage module 7 by asynchronous capture, and parses the communication big data by a corresponding parsing method; and distributes and transmits the parsed communication big data according to the corresponding communication link.

[0035] Aiming at the daily updated mobile communication network users and the increasing amount of information data, the present invention adopts the application storage and data processing functions of big data to better perform feedback calculation on the data submitted by users, and further improves the work of optimizing and integrating communication big data.

[0036] The present invention performs systematic centralized management and processing to increase the speed of computing and processing of communication big data, provide better feedback to users, effectively reduce the space and energy required to store large amounts of data, and further reduce possible dynamic changes in data, thereby reducing the difficulty and cost of data management and better enabling mobile network providers to optimize services.

[0037] Example 2

[0038] This embodiment discloses a communication big data processing system of embodiment 1. This embodiment also discloses that the processing system 1 is provided with an anti-virus module. The anti-virus module strengthens virus detection management and virus removal based on relevant technologies of mobile network security, and prevents Trojans, viruses, etc. created by some lawless elements for illegal profits from invading users' devices, thereby stealing personal user information.

[0039] The antivirus module determines whether the multiple communication big data are unified after the collection module 2 collects data and before the distribution module 10 distributes the data, evaluates whether there are any abnormalities in the communication data to be distributed, and promptly records whether the entry time of the current communication data is correct. When there is an abnormality, the data of the current communication link is packaged to prevent interference with other transmission data and ensure user safety.

[0040] The communication big data processing system of the present invention processes the communication big data in a classified manner and removes duplicate and invalid data before processing, thereby improving the efficiency of communication big data processing. The present invention realizes the rapid collection and stable transmission of big data; and the remote control operation of the control terminal based on the Internet of Things of big data.

[0041] Aiming at the daily updated mobile communication network users and the increasing amount of information data, the present invention adopts the application storage and data processing functions of big data to better perform feedback calculation on the data submitted by users, and further improves the work of optimizing and integrating communication big data.

[0042] The present invention performs systematic centralized management and processing to increase the speed of computing and processing of communication big data, provide better feedback to users, effectively reduce the space and energy required to store large amounts of data, and further reduce possible dynamic changes in data, thereby reducing the difficulty and cost of data management and better enabling mobile network providers to optimize services.

[0043] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A communication big data processing system, characterized by: It comprises a phase differentiation strategy module (3), an information assurance module (4), a test module (6), a processing module (5) and a dynamic observation module (9); the phase differentiation strategy module (3) determines the items and goals to be optimized by the user, and selects the most suitable optimization method and strategy to optimize the communication big data; the information assurance module (4) performs a test before the selected strategy is put into use, to ensure that the optimized strategy will not cause damage to information, resulting in information errors or loss; the test module (6) tests whether the processing system (1) can improve relevant values, and classifies the communication big data after the test is completed; a processing solution is selected by comparison, and after all adjustments and optimizations are completed, it is put into operation in the processing module (5); the dynamic observation module (9) performs real-time dynamic observation on the processing system (1), and makes timely adjustments to special situations or errors to ensure smooth use by the user; The processing module (5) includes an application storage module (7) and a virtual storage module (8); the virtual storage module (8) performs certain analysis and screening before the communication big data enters, stores the communication information with consistent structure on a preset unified information platform, and performs systematic centralized management and processing.

2. A communication big data processing system according to claim 1, characterized in that: The processing system (1) further comprises a collection module (2), wherein the collection module (2) collects the communication big data in a queue persistence manner and sends the data to the stage differentiation strategy module (3) for data analysis.

3. The communication big data processing system according to claim 1, characterized in that: The related values ​​include at least one of a computing rate of the communication big data and a storage capacity of the communication big data.

4. The communication big data processing system according to claim 1, characterized in that: The application storage module (7) adopts the storage virtualization strategy of the virtual storage module (8) to perform storage analysis on the communication data generated by the unified information platform.

5. The communication big data processing system according to claim 1, characterized in that: During the analysis and screening process, the virtual storage module (8) automatically filters the collected communication big data and removes duplicate and invalid communication big data; The processed communication big data is transmitted via a communication link.

6. A communication big data processing system according to claim 5, characterized in that: The dynamic observation module (9) performs real-time dynamic observation on the flow configuration transmitted by the communication link, and if the transmitted flow configuration exceeds a preset threshold in the communication link, the generated data is sorted.

7. The communication big data processing system according to claim 6, characterized in that: When the traffic configuration is transmitted via a plurality of the communication links, the dynamic observation module (9) prioritizes each of the traffic configurations according to a preset priority ranking rule, and transmits the data in sequence from high to low priority.

8. The communication big data processing system according to claim 1, characterized in that: The processing module (5) distributes the traffic of the communication big data to ensure that the communication big data is transmitted without attenuation.

9. The communication big data processing system according to claim 1, characterized in that: The processing system (1) further comprises a distribution module (10), wherein the distribution module (10) obtains the communication big data from the application storage module (7) by asynchronous capture, and parses the communication big data by a corresponding parsing method; and distributes and transmits the parsed communication big data according to the corresponding communication link.

Images