A method and apparatus for processing massive business data of smart cables

Abstract

The embodiment of the present application discloses a method and device for processing massive business data of an intelligent cable. The technical solution provided by the embodiment of the present application pre-builds processing rules for various types of business data of the intelligent cable through the management node, binds the processing rules with the corresponding processing nodes to build a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship; the management node receives the business data reported by each intelligent cable and determines the corresponding processing rules according to the data type information of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; after each processing node receives the business data, it processes the business data according to the corresponding processing rules. The use of the above-mentioned technical means can alleviate the pressure of massive business data processing in the system background, improve the efficiency of business data processing, and solve the technical problem of low efficiency in processing massive business data of intelligent cables.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of intelligent cable technology, and in particular, to a method and device for processing massive business data of an intelligent cable. Background Art

[0002] With the rapid development of my country's communications industry, the demand for cables as the basis for power or signal transmission is also increasing day by day. At present, in order to better monitor the operation status of cables in real time and achieve better operation and maintenance effects of cables, the operation and maintenance settings of cables are becoming more and more intelligent. Through the detection settings of relevant operation status, intelligent cables can realize real-time monitoring of cable parameters such as voltage, current, local current, etc., and can even monitor cable faults and daily operation status, so as to better realize the operation management of cables and optimize the operation and maintenance effects of cables. In addition to operation monitoring data, intelligent cables will also generate various types of business data such as service requests and configuration management during operation. By collecting various types of business data of intelligent cables, the server can realize different business processing during the operation of intelligent cables and realize more intelligent cable operation and management.

[0003] However, due to the large number of intelligent cable lines and relatively wide coverage, intelligent cables will generate a large amount of business data during operation. The huge amount of business data will be uniformly aggregated to the system background server for processing, which will cause greater data processing pressure on the system background server, affecting the processing efficiency of business data, and further affecting the normal operation of intelligent cables. Summary of the invention

[0004] The embodiments of the present application provide a method and device for processing massive business data of an intelligent cable, which can alleviate the pressure of processing massive business data in the system background, improve the efficiency of business data processing, and solve the technical problem of low efficiency in processing massive business data of the intelligent cable.

[0005] In a first aspect, an embodiment of the present application provides a method for processing massive business data of an intelligent cable, comprising:

[0006] The management node pre-builds processing rules for various types of business data of the intelligent cable, binds the processing rules with corresponding processing nodes to build a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship;

[0007] The management node receives service data reported by each intelligent cable, wherein the service data includes data type information and data transmission timestamp;

[0008] The management node determines the corresponding processing rule according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rule, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp;

[0009] After receiving the business data, each of the processing nodes processes the business data according to the corresponding processing rules, and during the processing, generates abnormal information in real time according to the business data with abnormal processing and reports it to the management node.

[0010] Furthermore, after each of the processing nodes receives the service data and processes the service data according to the corresponding processing rule, the method further includes:

[0011] The processing node periodically reports the service data processing result to the management node for storage according to the set reporting sequence, and the reporting sequence of each processing node is different.

[0012] Furthermore, after generating abnormal information according to the business data for processing abnormalities in real time and reporting it to the management node, it also includes:

[0013] The management node processes the exception information by cycling through all the pre-stored processing rules, and outputs an exception prompt when the processing fails, so as to prompt manual intervention to process the exception information.

[0014] Furthermore, after generating abnormal information according to the business data for processing abnormalities in real time and reporting it to the management node, it also includes:

[0015] The management node updates the processing rule of the corresponding processing node based on the abnormal information, and sends the new processing rule to the corresponding processing node for updating.

[0016] Further, after processing the business data according to the corresponding processing rule, it also includes:

[0017] The management node counts the processing volume of each type of business data within a set time period, and adjusts the processing rules corresponding to each processing node according to the processing volume.

[0018] Further, after processing the business data according to the corresponding processing rule, it also includes:

[0019] When the processing node is newly added, the management node allocates corresponding processing rules to the newly added processing node according to the newly added services of the system or the processing volume of each type of service data within a set time period.

[0020] Further, after processing the business data according to the corresponding processing rule, it also includes:

[0021] The processing node collects statistics of the abnormal information within a set time period, determines abnormal cable nodes based on the statistical results, and reports the abnormal cable nodes to the management node.

[0022] In a second aspect, an embodiment of the present application provides a massive business data processing device for an intelligent cable, comprising:

[0023] A construction module, used to pre-construct processing rules for various types of business data of intelligent cables through a management node, bind the processing rules with corresponding processing nodes to construct a mapping relationship, and distribute the processing rules to each corresponding processing node based on the mapping relationship;

[0024] A receiving module, used for receiving service data reported by each intelligent cable through the management node, wherein the service data includes data type information and data sending timestamp;

[0025] A distribution module, configured to determine the corresponding processing rule according to the data type information of each business data through the management node, query the mapping relationship according to the corresponding processing rule, determine the processing node of each business data, and distribute each business data to the corresponding processing node according to the sending timestamp;

[0026] The processing module is used to process the business data according to the corresponding processing rules after receiving the business data through each processing node, and during the processing, generate abnormal information in real time according to the business data with abnormal processing and report it to the management node.

[0027] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0028] memory and one or more processors;

[0029] The memory is used to store one or more programs;

[0030] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for processing massive business data of the intelligent cable as described in the first aspect.

[0031] In a fourth aspect, an embodiment of the present application provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the method for processing massive business data of the intelligent cable as described in the first aspect.

[0032] The embodiment of the present application pre-builds processing rules for various types of business data of intelligent cables through the management node, binds the processing rules with the corresponding processing nodes to build a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship; the management node receives the business data reported by each intelligent cable, and the business data includes data type information and data sending timestamp; the management node determines the corresponding processing rules according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rules, determines the processing nodes of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; after each processing node receives the business data, it processes the business data according to the corresponding processing rules, and in the process of processing, generates abnormal information in real time according to the abnormal business data and reports it to the management node. The above-mentioned technical means can alleviate the pressure of massive business data processing in the system background, improve the efficiency of business data processing, and solve the technical problem of low efficiency in massive business data processing of intelligent cables. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a flow chart of a method for processing massive business data of an intelligent cable provided in Embodiment 1 of the present application;

[0034] Figure 2 It is a structural diagram of the business data processing system in Embodiment 1 of the present application;

[0035] Figure 3 It is a structural schematic diagram of a massive business data processing device of an intelligent cable provided in Embodiment 2 of the present application;

[0036] Figure 4 It is a structural schematic diagram of an electronic device provided in Example 3 of the present application. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all of the content is shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0038] Embodiment 1:

[0039] Figure 1 A flowchart of a method for processing massive business data of an intelligent cable provided in the first embodiment of the present application is given. The method for processing massive business data of an intelligent cable provided in this embodiment can be executed by a massive business data processing device of an intelligent cable. The massive business data processing device of the intelligent cable can be implemented by software and / or hardware. The massive business data processing device of the intelligent cable can be composed of two or more physical entities, or can be composed of one physical entity. Generally speaking, the massive business data processing device of the intelligent cable can be a processing device such as a business data processing system of the intelligent cable.

[0040] The following description is made by taking the intelligent cable business data processing system as an example to implement the intelligent cable mass business data processing method. Figure 1 The method for processing massive business data of the intelligent cable specifically includes:

[0041] S110, the management node pre-constructs processing rules for various types of business data of the intelligent cable, binds the processing rules with corresponding processing nodes to construct a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship.

[0042] Specifically, when processing business data, the present application uniformly receives the business data uploaded by each cable node of the intelligent cable through the management node. Based on the received business data, the embodiment of the present application adopts multiple processing nodes to be responsible for the business data processing work of the corresponding business type, so as to alleviate the business data processing pressure of the system, realize the efficient processing of massive business data, and improve the processing efficiency of massive business data of the intelligent cable. It is understandable that in order to realize various types of business services, the intelligent cable will set up multiple cable nodes along the cable, and perform various types of business work such as operation monitoring, service request, configuration management, etc. through the cable nodes. The cable nodes will perform these business work by interacting with the management node. Therefore, the management node is required to efficiently process the business data reported by the cable node to ensure the normal operation of the intelligent cable.

[0043] Prior to this, the management node pre-sets corresponding processing rules according to all types of business data, and the processing rules are used to process the corresponding types of business data. For example, for the intelligent cable operation monitoring data such as current and voltage, it is necessary to store the cable node ID of the corresponding data sending end, and generate the monitoring curve of the corresponding cable node based on the data analysis of the monitoring data. In addition, according to actual needs, big data analysis can also be performed based on the monitoring data of the current cable node to predict the future operation status of the cable node. For the operation monitoring data of the cable node, it is necessary to set the processing rules for operation monitoring data storage, analysis and prediction to realize the processing of this type of business data. For another example, for the configuration information update request, it is necessary to return the latest version of the configuration information to the cable node according to the configuration information update request. For the processing of this type of business data, it is necessary to pre-set the corresponding configuration information update rules. Based on this, the management node pre-sets the corresponding processing rules for different types of business data, binds the processing rules of each type of business data to the processing node, and constructs a mapping relationship. The processing rules need to include the business type identification of the business data to be processed, so as to facilitate the subsequent mapping relationship query according to the business type identification. Based on the constructed mapping relationship, the corresponding processing rules can be assigned to each processing node according to the mapping relationship.

[0044] Specifically, Figure 2 As shown, a structural diagram of the business data processing system of an embodiment of the present application is provided. Among them, the business data processing system includes a cable node 11, a management node 12 and a processing node 13. The business data reported by the corresponding cable node 11 is uniformly reported to the management node 12. The management node 12 determines the data type information of the business data, determines the processing rules of the business data according to the data type information, and then determines the processing node 13 configured with the corresponding processing rules by querying the preset mapping relationship, and sends the business data to the corresponding processing node 13 for processing. It should be noted that, corresponding to an intelligent cable line, in order to perform various types of business operations, it is necessary to set multiple cable nodes along the intelligent cable, and the cable nodes perform various types of business operations such as operation monitoring, service requests and even configuration management. And the various types of business data generated by the corresponding cable nodes are uploaded to the management node so that the management node can process them accordingly. The management node will determine the type of business data generated by each cable node in advance, pre-configure processing rules for each type of business data, and then assign the processing rules to each processing node for subsequent distribution processing of business data.

[0045] It should be noted that when configuring the processing rules, one or more processing rules can be distributed to a processing node, and adaptive distribution can be performed according to the computing power of the processing node and the data volume of each type of business data. It is understandable that if the computing power of a processing node can meet the processing of multiple business data, multiple processing rules can be distributed to the processing node, so as to make full use of the computing power of the processing node, save the layout cost of the processing node, and avoid the waste of computing resources. Similarly, for a type of business data, if its data volume is relatively large, a single processing node is difficult to meet the processing of the huge data volume of this type of business data, then the corresponding processing rules need to be distributed to multiple processing nodes, and subsequently when distributing this type of business data, each processing node configured with the corresponding processing rules will receive and process the business data according to its current computing power adaptability. In this way, the computing power of each processing node can also be fully utilized to avoid the situation where business data is not processed in time and a single processing node has a large processing pressure.

[0046] S120, the management node receives service data reported by each intelligent cable, the service data including data type information and data sending timestamp;

[0047] S130. The management node determines the corresponding processing rule according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rule, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp.

[0048] Furthermore, after completing the distribution of processing rules, during the operation of the business data processing system, the cable node will generate a large amount of business data. After the business data is generated by the cable node, it will be uniformly reported to the management node, and the management node will uniformly receive the business data. In the embodiment of the present application, corresponding to each business data, the data type information and data sending timestamp corresponding to the business data are included. When the cable node reports the business data to the management node, the data type information of the current business data and the corresponding data sending timestamp are added to the business data, so as to facilitate the subsequent management node to distribute the business data.

[0049] On the management node side, after receiving the business data, the data type information and data sending timestamp contained in the business data are first parsed. Then, the processing rules required to process the business data are determined according to the data type information, and then the pre-set mapping relationship is queried according to the processing rules to determine the processing node for processing the current business data. For each received business data, its processing node is determined in the above manner, and then distributed to each processing node in the order of the data sending timestamp.

[0050] Optionally, the management node can set up corresponding data processing queues for business data of different business types. After determining the data type information of the business data, the business data is added to the corresponding data processing queue according to the data type information. Business data is arranged in the data processing queue according to the data sending timestamp. For each processing node, according to its own configured processing rules, it receives business data in the corresponding data processing queue according to the order of data sending timestamps for processing, so as to ensure the orderly processing of business data and further improve the efficiency of business data processing.

[0051] S140, after receiving the business data, each of the processing nodes processes the business data according to the corresponding processing rules, and during the processing, generates exception information in real time according to the abnormal business data and reports it to the management node.

[0052] Further, for each processing node, after receiving the business data, the business data can be processed according to the processing rules configured by itself. For example, for the operation monitoring data of the corresponding intelligent cable, after receiving this part of the business data, the processing node first organizes and stores it according to the processing rules, determines the data transmission source of the business data, that is, the corresponding cable node ID, and then stores the business data in the storage area of ​​the corresponding cable node ID according to the data transmission timestamp, so as to complete the storage of the operation monitoring data of the corresponding cable node, so as to facilitate the operation and maintenance of the intelligent cable. Further, data analysis is performed based on the business data to determine whether the current cable node has an abnormal operation, and an abnormality report is performed when an abnormal operation occurs. Further, based on the current business data and the historical data of the corresponding cable node, a monitoring curve diagram of the corresponding cable node can be generated, so that the subsequent management node can call the monitoring curve diagram when performing operation monitoring. In addition, according to actual needs, big data analysis can also be performed based on the monitoring data of the current cable node to predict the future operation status of the cable node. According to the specific processing contents of the actual setting of the processing rules, the processing node adaptively performs the processing operation of the business data. And after completing the processing, the processing result is stored or returned to the management node. In addition, for business data of some service request types, after the processing node completes the business data according to the processing rules, it will return the processing results to the corresponding cable node, so that the cable node can process the corresponding service request based on the processing results returned by the processing node.

[0053] In one embodiment, the processing node periodically reports the service data processing results to the management node for storage according to the set reporting sequence, and the reporting sequence of each processing node is different. It can be understood that the processing results of the corresponding service data need to be periodically summarized to the management node so that the management node can understand the processing status of each service of the intelligent cable and perform relevant operation and maintenance management operations based on the service data processing results. Then the processing node reports the processing results according to different reporting sequences when periodically reporting the service data processing results. Due to the large number of processing nodes, if the processing results are uniformly reported at a unified time node, it will cause the management results to generate greater data reception and processing pressure. Therefore, the embodiment of the present application sets different processing result reporting sequences for different processing nodes to achieve staggered reporting of processing results. For example, according to the number of processing nodes, a day is divided into a corresponding number of time periods, and each processing node reports the processing results in the corresponding time period. By reporting the processing results in time periods, on the one hand, the data receiving pressure of the management node is relieved. At the same time, the storage or processing of the processing results is relatively stable and efficient.

[0054] Optionally, during the business data processing, there may be some business data that cannot be processed by the current processing rules or that fails to be processed. For this part of the business data, in order to ensure the stability and timeliness of business processing, it is necessary to generate exception information based on the business data with abnormal processing and report it to the management node. The exception information indicates which business data has a processing exception. Based on this exception information, the management node will further reprocess the business data to ensure successful data processing.

[0055] Furthermore, when processing exception information, the management node processes the exception information by cycling through all the pre-stored processing rules, and when the processing fails, an exception prompt is output to prompt manual intervention to process the exception information. It is understandable that for business data that fails to be processed, there may be a situation where the business data is incorrectly allocated or the existing processing rules of the processing node are insufficient to process the corresponding business data. Then, after receiving the exception information, the management node will first process the exception information according to all its pre-configured processing rules. After processing the exception information in sequence through the processing rules, if the exception information is successfully processed, the exception information processing process ends. If the exception information is not successfully processed, it means that the current system has processing rules that cannot handle the exception. At this time, an exception prompt is output to inform the operation and maintenance personnel to manually process the exception information. In this way, the processing efficiency of exception information can be improved and the information processing effect can be optimized.

[0056] In one embodiment, the management node updates the processing rules of the corresponding processing node based on the abnormal information, and sends the new processing rules to the corresponding processing node for updating. It is understandable that, for the abnormal information that cannot be processed by the corresponding existing processing rules, after the abnormal prompt, the existing processing rules can be manually updated, and the processing rules are updated to meet the processing of the abnormal information. In addition, after completing the abnormal information processing, in order to ensure that the corresponding processing node can independently complete the business data processing and avoid the situation of abnormal processing again, the updated processing rules are further synchronized to the corresponding processing node to ensure the stability and effectiveness of the corresponding processing node in processing business data. In addition, when processing abnormal information in a round-robin manner, if it is found that there is a processing rule that can process the abnormal information, then after completing the processing, this processing rule is synchronized to the processing node that processes the abnormality to ensure that the corresponding processing node can independently complete the business data processing and avoid the situation of abnormal processing again.

[0057] Further, during the operation of the corresponding business data processing system, the abnormal information generated by the processing node is processed, and the processing node counts the abnormal information within the set time period, determines the abnormal cable node based on the statistical results, and reports the abnormal cable node to the management node. It can be understood that when the processing node generates abnormal information, it indicates that the existing processing rules cannot process the business data. If it is found through data statistics within a period of time that the processing node often generates abnormal information when processing the business data of a certain cable node, it indicates that the cable node may have an abnormal operation, causing its business data to be abnormal, and a high-frequency processing failure occurs. Based on this, the embodiment of the present application counts the abnormal information within the set time period by the processing node. If the abnormal information of the business data of a certain cable node within the set time period reaches the set quantity threshold, the cable node is determined to be an abnormal cable node, and the abnormal cable node is reported to the management node, so that the management node can handle the abnormal situation of the cable node in a timely manner and ensure the stable operation of the cable node.

[0058] In one embodiment, the management node counts the processing volume of each type of business data within a set time period, and adjusts the processing rules corresponding to each processing node according to the processing volume. It can be understood that by counting the processing volume of each type of business data, for business data with a large processing volume, processing nodes can be adaptively added to process the business data. For business data with a small processing volume, the computing power of the corresponding processing node is relatively sufficient, and other business data can be allocated for processing. Based on this, the present application adaptively allocates processing rules for business data with a large processing volume to processing nodes with sufficient computing power according to the processing volume of each type of business data and the computing power of each processing node, so as to use the processing node to process the corresponding business data, realize the computing power balance of the processing node, further improve the processing efficiency of the business data, and optimize the utilization rate of the processing node. In addition, according to actual needs, when the existing processing node cannot meet the processing of a certain business data, a processing node can also be adaptively added, and the processing node can be configured with processing rules for business data with a large processing volume, so as to ensure the efficient processing of the corresponding type of business data and the stable operation of the business data processing system.

[0059] In one embodiment, when the business data processing system adds the processing node, the management node allocates corresponding processing rules to the newly added processing node according to the newly added business of the system or the processing volume of each type of business data within a set time period. It can be understood that in order to make full use of the computing resources of the processing node, avoid the waste of computing resources of some processing nodes, and ensure that all types of business data can be processed in time, it is necessary to allocate appropriate processing rules to the newly added processing node when each processing node is added. Among them, if other types of business data are newly added to the system, the processing rules of the newly added business are preferentially allocated to the processing node to ensure that the business data of the newly added business can be processed stably. In addition, it is also possible to determine the business data type with a large processing volume according to the processing volume of each type of business data within a set time period, and allocate the processing rules of this type of business data to the newly added processing node, so that the system can provide sufficient computing resources to process business data with a large processing volume.

[0060] In the above, the processing rules of various types of business data of the intelligent cable are pre-built through the management node, the processing rules are bound to the corresponding processing nodes to build a mapping relationship, and the processing rules are distributed to each corresponding processing node based on the mapping relationship; the management node receives the business data reported by each intelligent cable, and the business data includes data type information and data sending timestamp; the management node determines the corresponding processing rules according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rules, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; after each processing node receives the business data, it processes the business data according to the corresponding processing rules, and in the process of processing, generates abnormal information in real time according to the abnormal business data and reports it to the management node. The above technical means can alleviate the pressure of massive business data processing in the system background, improve the efficiency of business data processing, and solve the technical problem of low efficiency in massive business data processing of intelligent cables.

[0061] Embodiment 2:

[0062] Based on the above embodiments, Figure 3 This is a schematic diagram of the structure of a massive business data processing device for an intelligent cable provided in the second embodiment of the present application. Figure 3 The massive business data processing device of the intelligent cable provided in this embodiment specifically includes: a construction module 21, a receiving module 22, a distribution module 23 and a processing module 24.

[0063] The construction module is used to pre-construct processing rules for various types of business data of the intelligent cable through the management node, bind the processing rules with the corresponding processing nodes to build a mapping relationship, and distribute the processing rules to each corresponding processing node based on the mapping relationship;

[0064] A receiving module, used for receiving service data reported by each intelligent cable through the management node, wherein the service data includes data type information and data sending timestamp;

[0065] A distribution module, configured to determine the corresponding processing rule according to the data type information of each business data through the management node, query the mapping relationship according to the corresponding processing rule, determine the processing node of each business data, and distribute each business data to the corresponding processing node according to the sending timestamp;

[0066] The processing module is used to process the business data according to the corresponding processing rules after receiving the business data through each processing node, and during the processing, generate abnormal information in real time according to the business data with abnormal processing and report it to the management node.

[0067] Specifically, the massive business data processing device of the intelligent cable also includes:

[0068] The reporting module is used to periodically report the business data processing results to the management node for storage through the processing node according to the set reporting timing, and the reporting timing of each processing node is different.

[0069] The prompt module is used to process the abnormal information by cycling through all the pre-stored processing rules through the management node, and output an abnormal prompt when the processing fails, so as to prompt manual intervention to process the abnormal information.

[0070] An updating module is used to update the processing rule of the corresponding processing node based on the abnormal information through the management node, and send the new processing rule to the corresponding processing node for updating.

[0071] The adjustment module is used to collect statistics on the processing volume of each type of business data within a set time period through the management node, and adjust the processing rules corresponding to each processing node according to the processing volume.

[0072] The new module is used to allocate corresponding processing rules to the newly added processing nodes when the processing nodes are newly added, according to the newly added services of the system or the processing volume of various types of business data within a set time period.

[0073] The statistical module is used to collect statistics of the abnormal information within a set time period through the processing node, determine the abnormal cable node based on the statistical results, and report the abnormal cable node to the management node.

[0074] In the above, the processing rules of various types of business data of the intelligent cable are pre-built through the management node, the processing rules are bound to the corresponding processing nodes to build a mapping relationship, and the processing rules are distributed to each corresponding processing node based on the mapping relationship; the management node receives the business data reported by each intelligent cable, and the business data includes data type information and data sending timestamp; the management node determines the corresponding processing rules according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rules, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; after each processing node receives the business data, it processes the business data according to the corresponding processing rules, and in the process of processing, generates abnormal information in real time according to the abnormal business data and reports it to the management node. The above technical means can alleviate the pressure of massive business data processing in the system background, improve the efficiency of business data processing, and solve the technical problem of low efficiency in massive business data processing of intelligent cables.

[0075] The massive business data processing device of the intelligent cable provided in the second embodiment of the present application can be used to execute the massive business data processing method of the intelligent cable provided in the above-mentioned first embodiment, and has corresponding functions and beneficial effects.

[0076] Embodiment three:

[0077] Embodiment 3 of the present application provides an electronic device, referring to Figure 4 The electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device can be one or more, and the number of memories in the electronic device can be one or more. The processor 31, the memory 32, the communication module 33, the input device 34, and the output device 35 of the electronic device can be connected via a bus or other means.

[0078] The memory 32, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as the program instructions / modules corresponding to the mass business data processing method of the intelligent cable described in any embodiment of the present application (for example, the building module, receiving module, distribution module and processing module in the mass business data processing device of the intelligent cable). The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0079] The communication module 33 is used for data transmission.

[0080] The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, realizes the above-mentioned method for processing massive business data of the intelligent cable.

[0081] The input device 34 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 35 may include a display device such as a display screen.

[0082] The electronic device provided above can be used to execute the method for processing massive business data of the intelligent cable provided in the above embodiment 1, and has corresponding functions and beneficial effects.

[0083] Embodiment 4:

[0084] The embodiment of the present application also provides a storage medium containing computer executable instructions, which are used to execute a method for processing massive business data of an intelligent cable when executed by a computer processor. The method for processing massive business data of an intelligent cable includes: a management node pre-constructs processing rules for various types of business data of the intelligent cable, binds the processing rules with corresponding processing nodes to construct a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship; the management node receives business data reported by each intelligent cable, and the business data includes data type information and data sending timestamp; the management node determines the corresponding processing rule according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rule, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; after receiving the business data, each processing node processes the business data according to the corresponding processing rule, and during the processing, generates abnormal information in real time according to the abnormal business data and reports it to the management node.

[0085] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape device; computer system memory or random access memory, such as DRAM, DDRRAM, SRAM, EDORAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (for example, in different computer systems connected by a network). The storage medium may store program instructions (for example, embodied as a computer program) that can be executed by one or more processors.

[0086] Of course, the storage medium containing computer executable instructions provided in the embodiment of the present application, whose computer executable instructions are not limited to the massive business data processing method of the intelligent cable as described above, can also execute related operations in the massive business data processing method of the intelligent cable provided in any embodiment of the present application.

[0087] The massive business data processing device, storage medium and electronic device of the intelligent cable provided in the above embodiments can execute the massive business data processing method of the intelligent cable provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the massive business data processing method of the intelligent cable provided in any embodiment of the present application.

[0088] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A method for processing massive business data of an intelligent cable, characterized in that: include: The management node pre-constructs processing rules for various types of business data of the intelligent cable, binds the processing rules with corresponding processing nodes to construct a mapping relationship, and distributes the processing rules to each corresponding processing node based on the mapping relationship, wherein the binding of the processing rules with corresponding processing nodes to construct a mapping relationship includes: constructing a mapping relationship between the processing rules and the corresponding processing nodes according to the computing power of the processing nodes and the data volume of each type of business data, if the computing power of a single processing node meets the data volume processing of different types of business data, then binding multiple processing rules with the processing nodes to construct a mapping relationship, if a single processing node cannot meet the data volume processing of the same type of business data, then binding the corresponding processing rules with multiple processing nodes to construct a mapping relationship, the management node pre-sets corresponding processing rules according to all types of business data, and the processing rules are used for operation monitoring, service request, and configuration management of corresponding types of business data; The management node receives service data reported by each intelligent cable, wherein the service data includes data type information and data transmission timestamp; The management node determines the corresponding processing rule according to the data type information of each business data, queries the mapping relationship according to the corresponding processing rule, determines the processing node of each business data, and distributes each business data to the corresponding processing node according to the sending timestamp; After receiving the business data, each processing node processes the business data according to the corresponding processing rules, and in the process of processing, generates abnormal information in real time according to the abnormal business data and reports it to the management node. The management node updates the processing rules of the corresponding processing node based on the abnormal information, and sends the new processing rules to the corresponding processing node for updating; The processing node periodically reports the service data processing result to the management node for storage according to the set reporting sequence, and the reporting sequence of each processing node is different; The management node processes the exception information by cycling through all the pre-stored processing rules, and outputs an exception prompt when the processing fails, so as to prompt manual intervention to process the exception information; The management node counts the processing volume of each type of business data within a set time period, and adjusts the processing rules corresponding to each processing node according to the processing volume; When the processing node is newly added, the management node allocates corresponding processing rules to the newly added processing node according to the newly added services of the system or the processing volume of each type of service data within a set time period.

2. The method for processing massive business data of an intelligent cable according to claim 1, characterized in that: After processing the business data according to the corresponding processing rule, the method further includes: The processing node collects statistics of the abnormal information within a set time period, determines abnormal cable nodes based on the statistical results, and reports the abnormal cable nodes to the management node.

3. A massive business data processing device for an intelligent cable, characterized in that: include: A construction module is used to pre-construct processing rules for various types of business data of the intelligent cable through a management node, bind the processing rules with corresponding processing nodes to construct a mapping relationship, and distribute the processing rules to each corresponding processing node based on the mapping relationship. The construction module is specifically used to construct a mapping relationship between the processing rules and the corresponding processing nodes according to the computing power of the processing nodes and the data volume of each type of business data. If the computing power of a single processing node meets the data volume processing of different types of business data, multiple processing rules are bound to the processing node to construct a mapping relationship. If a single processing node cannot meet the data volume processing of the same type of business data, the corresponding processing rules are bound to multiple processing nodes to construct a mapping relationship. The management node pre-sets corresponding processing rules according to all types of business data, and the processing rules are used to perform operation monitoring, service requests, and configuration management of corresponding types of business data; A receiving module, used for receiving service data reported by each intelligent cable through the management node, wherein the service data includes data type information and data sending timestamp; A distribution module, configured to determine the corresponding processing rule according to the data type information of each business data through the management node, query the mapping relationship according to the corresponding processing rule, determine the processing node of each business data, and distribute each business data to the corresponding processing node according to the sending timestamp; A processing module, configured to process the business data according to the corresponding processing rules after receiving the business data through each of the processing nodes, and during the processing, generate abnormal information in real time according to the abnormal business data and report it to the management node; An updating module, configured to update the processing rule of the corresponding processing node based on the abnormal information through the management node, and send the new processing rule to the corresponding processing node for updating; A reporting module, used for periodically reporting the service data processing results to the management node for storage through the processing node according to a set reporting sequence, wherein the reporting sequence of each processing node is different; A prompt module, used to process the exception information by cycling through all the pre-stored processing rules through the management node, and output an exception prompt when the processing fails, so as to prompt manual intervention to process the exception information; An adjustment module, configured to collect statistics on the processing volume of each type of business data within a set time period through the management node, and adjust the processing rules corresponding to each processing node according to the processing volume; The new module is used to allocate corresponding processing rules to the newly added processing nodes when the processing nodes are newly added, according to the newly added services of the system or the processing volume of various types of business data within a set time period.

4. An electronic device, characterized in that: include: memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method for processing massive business data of the intelligent cable as described in any one of claims 1-2.

5. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions, when executed by a computer processor, are used to execute the method for processing massive business data of an intelligent cable as described in any one of claims 1-2.

Images