User-defined data packet loss analysis system and method based on communication equipment

Abstract

The invention discloses a self-defined data packet loss analysis system and method based on communication equipment, and relates to the technical field of industrial internet. Comprising a packet capture data reading unit used for reading and decoding a data packet of which the suffix name is a PCAP file; the transmission protocol screening unit is used for screening a specific protocol data packet from the captured data packets; the data packet load extraction unit is used for extracting useful information in the specific protocol data packet; the information preprocessing unit is used for preprocessing the useful information to obtain first information; the user-defined data packet screening unit is used for identifying the user-defined data packets in the first information; and the analysis and report unit is used for analyzing the custom data packet, identifying the packet loss trend and generating an analysis report. According to the method, specific custom data packets can be captured and processed through custom screening, extraction, conversion and analysis technologies, so that the packet loss problem possibly occurring between the Internet of Things equipment and the server can be quickly positioned and analyzed.

Description

Technical Field

[0001] The present invention relates to the technical field of industrial Internet, and in particular to a custom data packet loss analysis system and method based on communication equipment. Background Art

[0002] With the rapid development of the Industrial Internet, the demand for communication between devices is increasing, and the frequency and complexity of communication are also increasing. In this context, the stability of data packet transmission is particularly critical to the performance of the entire Industrial Internet system. Once a data packet is lost during transmission, it will not only affect the efficiency of the system operation, but may also cause a series of safety hazards.

[0003] Among the existing network analysis tools, well-known tools such as Wireshark, although they can effectively capture and analyze network packets, often show certain limitations when processing specific custom packets. These tools are often insufficient in flexibility and efficiency when adapting to the complex industrial Internet environment, especially when facing special protocols and custom data formats. They may not be able to provide in-depth analysis for specific application scenarios, resulting in inefficiency in locating and analyzing packet loss problems.

[0004] Therefore, for those skilled in the art, how to quickly and accurately locate and analyze packet loss is an urgent problem to be solved. Summary of the invention

[0005] The purpose of the present invention is to provide a custom data packet loss analysis system and method based on communication equipment to solve the problems raised in the background technology. Through custom screening, extraction, conversion and analysis techniques, specific custom data packets are captured and processed, so as to quickly locate and analyze the possible packet loss problems between IoT devices and servers.

[0006] To achieve the above object, the present invention provides the following solutions: On the one hand, a custom data packet loss analysis system based on a communication device is provided, comprising:

[0007] The packet capture data reading unit is used to read and decode the data packets with the suffix of PCAP file;

[0008] A transport protocol filtering unit is used to filter packets of a specific protocol from packets captured in a PCAP file;

[0009] A data packet payload extraction unit, used to extract useful information from the specific protocol data packet;

[0010] An information preprocessing unit, configured to perform a preprocessing operation on the useful information to obtain first information;

[0011] a user-defined data packet screening unit, configured to identify the user-defined data packet in the first information;

[0012] The analysis and reporting unit is used to analyze the custom data packets, identify packet loss trends and generate analysis reports.

[0013] Preferably, the information preprocessing unit includes a timestamp time zone proofreading unit and a base conversion unit; wherein the timestamp time zone proofreading unit is used to process and unify the timestamp information of useful information in different device logs; the base conversion unit is used to convert the binary data of the useful information in the specific protocol data packet into hexadecimal or other base representation.

[0014] Preferably, the packet capture data reading unit includes:

[0015] File interface, used to interact with the system storing PCAP files;

[0016] Decoder, used to decode the binary data in the PCAP file into a readable packet format.

[0017] Preferably, the transmission protocol screening unit includes:

[0018] A protocol identifier, used to identify and select the specific protocol data packets in the PCAP file;

[0019] The filter is used to exclude data packets of other protocols and ensure that only data packets of the specific protocol are processed.

[0020] Preferably, the data packet load extraction unit includes:

[0021] A payload extractor, used for extracting a payload and related information from the specific protocol data packet;

[0022] A data parser is used to parse the useful information extracted by the payload extractor.

[0023] Preferably, the timestamp time zone correction unit includes:

[0024] Time zone identifier, used to identify the original time zone of timestamps in PCAP files;

[0025] A time synchronizer is used to convert recognized timestamps into a unified UTC time format.

[0026] Preferably, the custom data packet screening unit includes:

[0027] A content identifier, used to identify and extract specific content in the custom data packet;

[0028] The pattern matching engine is used to perform string matching or pattern recognition on the extracted specific content.

[0029] Preferably, the useful information includes: source IP address and port number, destination IP address and port number, and effective load.

[0030] On the other hand, a method for analyzing packet loss based on a custom data packet of a communication device is provided, and the specific steps include the following:

[0031] Read and decode data packets with the suffix PCAP file;

[0032] Filter specific protocol packets from packets captured in PCAP files;

[0033] Extracting useful information from the specific protocol data packet;

[0034] Performing a preprocessing operation on the useful information to obtain first information;

[0035] identifying a custom data packet in the first information;

[0036] The custom data packet is analyzed to identify packet loss trends and generate an analysis report.

[0037] According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects: the present invention can parse custom data packets that cannot be recognized by general network analysis tools, and through custom screening, extraction, conversion and analysis technologies, it can capture and process specific custom data packets, thereby quickly locating and analyzing possible packet loss problems between IoT devices and servers, reducing the tediousness of fault location troubleshooting to improve the efficiency and security of IoT device operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0039] Figure 1 is a system structure diagram of the present invention;

[0040] Figure 2 The figure is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] The purpose of the present invention is to provide a custom data packet loss analysis system based on communication equipment, such as Figure 1 As shown, including:

[0043] The packet capture data reading unit is used to read and decode the data packets with the suffix of PCAP file;

[0044] A transport protocol filtering unit is used to filter packets of a specific protocol from packets captured in a PCAP file;

[0045] A data packet payload extraction unit, used to extract useful information from a specific protocol data packet;

[0046] An information preprocessing unit, used for performing a preprocessing operation on the useful information to obtain first information;

[0047] a user-defined data packet screening unit, configured to identify the user-defined data packet in the first information;

[0048] The analysis and reporting unit is used to analyze custom data packets, identify packet loss trends and generate analysis reports.

[0049] Furthermore, the function of the packet capture data reading unit is to read and decode data packets stored in a file with a suffix of PCAP. PCAP file is a file format containing data packet data, which is usually generated by network analysis tools such as tcpdump between IoT devices and is used to capture and store data packets transmitted on the network.

[0050] The packet capture data reading unit includes: a file interface for interacting with the system storing the PCAP file; a decoder for decoding the binary data in the PCAP file into a readable data packet format. During the packet capture data reading process, the unit will perform a data integrity check to ensure that the data packet information extracted from the PCAP file is complete and undamaged.

[0051] Furthermore, the role of the transport protocol filtering unit is to implement the key packet filtering function in the custom packet loss analysis system. It is mainly responsible for filtering and selecting the code of a specific network layer, so as to perform refined management of the captured network packets. Specifically, the task of this unit is to filter packets of various custom transport protocols based on the UDP / TCP (User Datagram Protocol / Transmission Control Protocol) layer. By filtering the packets captured in the PCAP file, the unit ensures that only packets with the UDP / TCP layer or other specific protocols are included in the analysis process.

[0052] The transport protocol filtering unit includes: a protocol identifier for identifying and selecting the specific protocol data packets in the PCAP file; a filter for excluding data packets of other protocols and determining to process only the specific protocol data packets. The transport protocol filtering unit will only process those data packets captured in the PCAP file that meet the requirements of the specific protocol. This means that analysts can quickly locate the data packets of interest from a large amount of data and improve the efficiency of analysis. Through screening, analysts can focus on one or several types of communications and ignore other types of network traffic. This focus helps to deeply understand the characteristics and behaviors of specific communications in a complex network environment. In short, the transport protocol filtering unit provides an efficient way for the custom data packet loss analysis system to focus on the communication of a specific network layer through its precise data packet filtering capabilities. This not only optimizes the analysis process, but also improves the efficiency of network monitoring and troubleshooting, which is of great significance for ensuring the stability and security of the industrial Internet.

[0053] Furthermore, the data packet payload extraction unit includes: a payload extractor for extracting effective payload and related information from the specific protocol data packet; and a data parser for parsing the useful information extracted by the payload extractor. The data packet payload extraction unit is a key component in the custom data packet loss analysis system, and its main function is to process the specific data packets filtered out by the transport protocol filtering unit. The unit is responsible for extracting useful information from the filtered data packets for subsequent analysis and processing. It extracts and utilizes information by traversing the previously created list of data packets containing the protocol and performing a series of sophisticated operations on each data packet in the list.

[0054] The specific workflow of the packet payload extraction unit is as follows:

[0055] List traversal: The packet payload extraction unit first traverses the specific protocol packet list generated by the transport protocol filtering unit. This list contains all filtered packets that meet the specific protocol standards.

[0056] Information Extraction: For each packet in the list, the unit performs the following operations to extract information:

[0057] UDP layer information: Extract the source IP address and port number of the UDP layer, as well as the destination IP address and port number. This information is crucial for tracking and identifying the initiator and receiver of network communications.

[0058] Payload: The unit will separate the payload of the current UDP packet, that is, the data part. This is the core content of the data packet, which may contain sensor data, control commands or other business-related information.

[0059] Original Payload: The unit also preserves the original payload of the data packet, which is useful for application scenarios that require the original data for analysis.

[0060] Data content: For the data content of this layer, the unit will extract specific data information, which may involve parsing of specific protocols.

[0061] Unparsed data: The unit will also record the unparsed parts of the data packet for subsequent in-depth analysis.

[0062] Furthermore, the information preprocessing unit includes a timestamp time zone proofreading unit and a base conversion unit; wherein the timestamp time zone proofreading unit is used to process and unify the timestamp information of useful information in different device logs; the base conversion unit is used to convert the binary data of useful information in a specific protocol data packet into hexadecimal or other base representation.

[0063] In a distributed system, since each node may be located in different geographical locations, their timestamps are often affected by the local time zone, which requires a dedicated unit to convert and proofread these timestamps to ensure data consistency and comparability.

[0064] The timestamp time zone calibration unit includes:

[0065] Time zone identifier, used to identify the original time zone of timestamps in PCAP files;

[0066] A time synchronizer is used to convert recognized timestamps into a unified UTC time format.

[0067] The main task of the timestamp time zone calibration unit is to convert timestamps expressed in different time zones into a unified UTC format. As an international time standard, UTC provides a unified time reference, so that time data from different nodes can be directly compared and analyzed. Distributed system time synchronization: In a distributed system, since each node may run independently, their time synchronization is often difficult to ensure. This unit helps overcome the time synchronization problem caused by time zone differences by standardizing the time of each node to UTC, which is crucial to ensure the overall coordinated operation of the system.

[0068] The hexadecimal conversion unit converts raw binary data into hexadecimal representation. Hexadecimal representation converts each byte (8-bit binary number) into two hexadecimal digits (one hexadecimal digit for every four binary digits), which not only reduces the length of the data but also improves the readability of the data. When debugging network problems or analyzing data packets, the hexadecimal representation method makes it easier to quickly identify data patterns and structures, which is essential for understanding the composition of data packets, identifying protocol fields, and parsing data content.

[0069] Furthermore, the custom data packet screening unit includes: a content identifier for identifying and extracting specific content in the custom data packet; and a pattern matching engine for performing string matching or pattern recognition on the extracted specific content.

[0070] The main function of the custom packet filter unit is to process the packet contents that general network analysis tools such as Wireshark do not support direct scripting for complex processing. As a powerful network analysis tool, Wireshark provides the function of defining display filters to filter packets, but it is unable to perform complex string matching or pattern recognition when processing the original payload of the packet, especially the custom packet fields.

[0071] The functions of the custom packet filtering unit are mainly reflected in the following aspects:

[0072] Expand Wireshark functionality: Although Wireshark is powerful, it has limitations when processing custom packets and complex packet contents. Custom packet filtering units make up for this deficiency, and they can handle packet analysis tasks that are difficult for Wireshark to implement directly.

[0073] Complex content filtering: In Wireshark, display filters are defined mainly for packet filtering based on protocol fields. It is difficult to perform complex string matching or pattern recognition on the raw data in the packet payload. This unit implements the filtering and analysis of these complex patterns.

[0074] Custom Packet Field Processing: Packets that contain custom fields may not be parsed effectively by Wireshark's built-in functions. The Custom Packet Filter unit is able to recognize and process these custom fields, providing analysts with the ability to gain in-depth understanding of packet contents.

[0075] Pattern recognition: The unit is able to perform pattern recognition on the contents of data packets, which is particularly important for discovering specific patterns or abnormal behavior in data packets. This capability is particularly useful in network monitoring and security analysis.

[0076] Flexibility: The custom packet filtering unit is designed to be highly flexible and can be configured and adjusted to suit different analysis requirements. This flexibility makes the unit a powerful tool for handling complex network packet analysis tasks.

[0077] Scripting and Automation: The unit supports the use of scripting and automation tools to process packets, which enables analysts to write custom scripts to implement specific packet analysis logic and further improve analysis efficiency.

[0078] Powerful data processing capabilities: With this unit, analysts can perform in-depth analysis of captured data packets, including deep mining of packet payloads, thereby revealing hidden information and potential problems in network communications.

[0079] On the other hand, a method for analyzing packet loss based on a custom data packet of a communication device is provided, such as Figure 2 As shown, the specific steps include the following:

[0080] Read and decode data packets with the suffix PCAP file;

[0081] Filter specific protocol packets from packets captured in PCAP files;

[0082] Extract useful information from specific protocol packets;

[0083] Performing a preprocessing operation on the useful information to obtain first information;

[0084] identifying a custom data packet in the first information;

[0085] Analyze custom data packets, identify packet loss trends, and generate analysis reports.

[0086] Furthermore, the specific process is as follows:

[0087] First, the network administrator or analyst will use a packet capture tool to capture network packets between IoT devices. This step is done by running the packet capture tool on the device and configuring appropriate filtering rules. The captured packets contain all the information transmitted through the network interface, which is recorded in real time and saved as a PCAP file. PCAP files are a standard file format used to store captured network packets for subsequent analysis and review.

[0088] Next, the packet capture data reading unit starts working, which is responsible for reading the data in the PCAP file and decoding the data packet. This process involves parsing key information such as the packet header information, payload content, and timestamp, providing the necessary data basis for subsequent analysis steps.

[0089] Then, the transport protocol filtering unit comes into play. It filters out packets of custom transport protocols based on the UDP / TCP layer from the decoded packets according to preset rules and protocol standards. This step is crucial because it focuses the analysis on specific network communications, filters out irrelevant traffic, and improves analysis efficiency.

[0090] The packet payload extraction unit then extracts relevant information from the filtered packets, including source IP address and port number, destination IP address and port number, and payload, etc. This information is crucial for analyzing the specific content and structure of network communications.

[0091] The timestamp time zone calibration unit converts the extracted timestamp information into a unified UTC time format. This step ensures that the time information of all data packets is compared and analyzed under the same time reference, thus ensuring the consistency and accuracy of the analysis.

[0092] The base conversion unit is responsible for converting the binary data in the data packet into hexadecimal or other base representations. This conversion makes the data packet content easier to read and analyze, especially when performing pattern recognition and string matching.

[0093] The custom packet filtering unit filters packet contents based on user-defined patterns or strings, further narrowing the scope of analysis to focus on specific packet contents.

[0094] The analysis and reporting unit conducts in-depth analysis on the filtered and converted data, identifies packet loss trends and patterns, and generates detailed analysis reports. These reports are important for understanding network conditions, diagnosing problems, and optimizing network performance.

[0095] The user sets the PCAP file path, sets the filtering parameters, starts the analysis process, and views the final analysis results. The user interface provides a friendly interactive experience, making the analysis process more intuitive and efficient. The data storage module is responsible for storing the analysis results for users to retrieve and export. These stored data can provide support for subsequent analysis and auditing.

[0096] The innovation of this patent is that it provides a system that can parse custom data packets that cannot be recognized by general network analysis tools. Through customized screening, extraction, conversion and analysis technology, it can capture and process specific custom data packets, thereby quickly locating and analyzing possible packet loss problems between IoT devices and servers.

[0097] The principles and implementation methods of the present invention are described in this article using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A custom data packet loss analysis system based on communication equipment, characterized in that: It includes a packet capture data reading unit, which is used to read and decode data packets with a suffix of PCAP file; A transport protocol filtering unit is used to filter packets of a specific protocol from packets captured in a PCAP file; A data packet payload extraction unit, used to extract useful information from the specific protocol data packet; An information preprocessing unit, configured to perform a preprocessing operation on the useful information to obtain first information; a user-defined data packet screening unit, configured to identify the user-defined data packet in the first information; The analysis and reporting unit is used to analyze the custom data packets, identify packet loss trends and generate analysis reports.

2. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The information preprocessing unit includes a timestamp time zone proofreading unit and a base conversion unit; wherein the timestamp time zone proofreading unit is used to process and unify the timestamp information of useful information in different device logs; the base conversion unit is used to convert the binary data of the useful information in the specific protocol data packet into hexadecimal or other base representation.

3. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The packet capture data reading unit comprises: File interface, used to interact with the system storing PCAP files; Decoder, used to decode the binary data in the PCAP file into a readable packet format.

4. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The transmission protocol screening unit comprises: A protocol identifier, used to identify and select the specific protocol data packets in the PCAP file; The filter is used to exclude data packets of other protocols and ensure that only data packets of the specific protocol are processed.

5. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The data packet load extraction unit comprises: A payload extractor, used for extracting a payload and related information from the specific protocol data packet; A data parser is used to parse the useful information extracted by the payload extractor.

6. The self-defined data packet loss analysis system based on communication equipment according to claim 2, characterized in that: The timestamp time zone correction unit comprises: Time zone identifier, used to identify the original time zone of timestamps in PCAP files; A time synchronizer is used to convert recognized timestamps into a unified UTC time format.

7. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The custom data packet screening unit comprises: A content identifier, used to identify and extract specific content in the custom data packet; The pattern matching engine is used to perform string matching or pattern recognition on the extracted specific content.

8. The self-defined data packet loss analysis system based on communication equipment according to claim 1, characterized in that: The useful information includes: source IP address and port number, destination IP address and port number, and effective load.

9. A method for analyzing packet loss based on a custom data packet of a communication device, characterized in that: The specific steps include the following: Read and decode data packets with the suffix PCAP file; Filter specific protocol packets from packets captured in PCAP files; Extracting useful information from the specific protocol data packet; Performing a preprocessing operation on the useful information to obtain first information; identifying a custom data packet in the first information; The custom data packet is analyzed to identify packet loss trends and generate an analysis report.

Images