Method, device and system for processing TSN collector data

Abstract

The invention provides a TSN collector data processing method, device and system, and the method comprises the steps: collecting a data frame of a TSN collector, adding a synchronization head, a time label, a serial number and a length to the data frame, and obtaining the data frame containing a collection information label; data frames containing acquisition information labels are screened according to a pre-configuration rule, key parameters are extracted and packaged again, and it is ensured that low-delay and high-reliability transmission of key service flow is achieved; and carrying out full-amount storage on the data frames containing the acquisition information labels. According to the invention, data screening and forwarding and total data storage of multiple paths of TSN data frames can be realized, and the real-time performance and integrity of data processing and storage are ensured.

Description

Technical Field

[0001] This invention belongs to the field of computer network technology and relates to a method, apparatus and system for processing TSN collector data. Background Technology

[0002] Time-Sensitive Networking (TSN) is a protocol standard extension based on Ethernet, developed by the IEEE 802.1 TSN Task Group. While retaining the best-effort communication capabilities of traditional Ethernet, it ensures deterministic, low-latency transmission of high-priority critical traffic through enhanced mechanisms. TSN is commonly used in industrial and automotive fields to meet the application requirements of low latency and high reliability. For TSN data acquisition and monitoring, high throughput and real-time performance are required of the acquisition system.

[0003] Previous TSN acquisition methods were designed only for data exchange and latency, without proposing methods for selecting parameters to forward data and recording all data for data monitoring and recording. Summary of the Invention

[0004] This invention provides a data acquisition, selection, forwarding, and storage control method and system for a TSN collector to solve the technical problems of real-time data selection parameter forwarding and storage, and full storage of 10Gbps data. This invention can realize multi-port switching reception and storage of data frames, which helps to reduce data frame reception delay and improve data frame processing efficiency.

[0005] The technical solution is as follows: In a first aspect, the present invention provides a method for processing TSN collector data, comprising the following steps: Collect data frames from the TSN collector and add a synchronization header, timestamp, sequence number, and length to the data frames to obtain data frames containing collection information tags; Data frames containing collection information tags are filtered according to pre-configured rules, key parameters are extracted and reassembled to ensure low-latency and high-reliability transmission of critical business traffic; Store all data frames containing the collected information tags.

[0006] Furthermore, the data frames acquired by the TSN collector are added with a synchronization header, timestamp, sequence number, and length to obtain data frames containing acquisition information tags, as detailed below: The data frame encapsulation is parsed layer by layer to obtain data status information; Parse the status information; Determine whether the data frame is complete based on the parsing results of the status information; Once the data frame is complete, add a synchronization header, timestamp, sequence number, and length to the data frame.

[0007] Furthermore, the method also includes: parsing the DC time code and AC time code using a clock device to obtain the Precision Time Protocol (PTP) data frame, and determining the time tag based on the PTP data frame.

[0008] Furthermore, the process of filtering data frames containing collection information tags according to pre-configured rules, extracting key parameters, and reassembling packets is as follows: Pre-configured rules are generated based on the obtained VLAN ID, priority tag, source / destination MAC address, and data offset; Parse the Virtual Local Area Network Identifier (VLAN ID), Priority Tag, Source / Destination MAC Address, and Data Offset in data frames containing collected information tags, and compare the parsed results with pre-configured rules; Unnecessary fields are removed, resulting in multiple small frames which are then stored in a buffer queue, reducing transmission costs. Multiple small frame payloads in the buffer queue are grouped and merged into a large frame data; Add a synchronization header, timestamp, sequence number, length, and filter label to large frames of data.

[0009] Furthermore, the feature is that the data frames containing the collected information tags are stored in full, specifically as follows: Based on the data port number, different data frames are stored in multiple memory locations; Based on data flow priority information, data in different memories are stored in a cache queue for caching; The data frame to be invoked is determined based on the multi-port data storage traffic, and the data frame to be invoked in the cache queue is written to the storage space.

[0010] Furthermore, the feature is that the step of determining the data frame to be invoked based on the multi-port data storage traffic is as follows: Port requests are handled using a latch-then-arbitrate method: ports are sorted in a time-division manner according to their priority level, with higher priority levels resulting in earlier output of data frames; data frames from ports with the same priority level are output in the order in which they were acquired.

[0011] Secondly, a processing device for TSN collector data, characterized in that it comprises: The data acquisition module is used to acquire data frames from the TSN collector and add synchronization headers, timestamps, serial numbers and lengths to the data frames to obtain data frames containing acquisition information tags. The data filtering module is used to filter data frames containing collection information tags according to pre-configured rules, extract key parameters and reassemble packets to ensure low-latency and high-reliability transmission of critical business traffic; The full storage module is used to store all data frames containing the collected information tags.

[0012] A TSN collector data processing system, characterized in that it includes the TSN collector data processing device as described in claim 7, a TSN collector, a storage module, and a target terminal. The data processing device of the TSN collector collects data frames from the TSN collector and adds a synchronization header, time tag, sequence number and length to the data frames to obtain data frames containing collection information tags; it filters the data frames containing collection information tags according to pre-configured rules, extracts key parameters and reassembles them, and sends them to the target terminal; at the same time, the data frames containing collection information tags are sent to the storage module for full storage.

[0013] Compared with the prior art, the present invention has the following beneficial technical effects: During data frame acquisition, synchronization headers, timestamps, sequence numbers, and lengths are added to facilitate message identification and subsequent parameter filtering and storage control. A TSN data filtering strategy is proposed, which involves parsing and storing filtering conditions, parsing data frame encapsulation, comparing it with the filtering conditions, and removing unnecessary fields to reduce transmission latency and enhance transmission efficiency. Based on the filtering information, important data is filtered in real time, ensuring the reliability and real-time performance of data frames during the filtering and forwarding process. Through point-to-point high-speed serial data transmission and multi-channel data read / write control, a four-signal communication method (request, response, completion, and error) is employed to ensure smooth multi-channel data storage control, avoiding data congestion, delays, and stuttering, achieving full, complete, and accurate data storage. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. The drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is the data traffic architecture of the present invention; Figure 2 This is a flowchart of the method of the present invention; Figure 3 This is a system module diagram of the present invention; Figure 4 Timing diagram of the data acquisition interface in this embodiment of the invention; Figure 5 Timing diagram of the storage interface in an embodiment of the present invention. Detailed Implementation

[0016] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0017] The features and illustrative embodiments of various aspects of the present invention will now be described in detail. Numerous specific details are set forth in the following detailed description to provide a thorough understanding of the invention. However, it will be apparent to those skilled in the art that the invention may be practiced without requiring some of these specific details. The following description of embodiments is merely intended to provide a better understanding of the invention by illustrating examples of the invention. The invention is by no means limited to any specific setups and methods set forth below, but covers any improvements, substitutions, and modifications to structures, methods, and devices without departing from the spirit of the invention. Well-known structures and techniques are not shown in the drawings and the following description to avoid unnecessarily obscuring the invention.

[0018] It should be noted that, unless otherwise specified, the embodiments of the present invention and the features thereof can be combined with each other, and the various embodiments can be referenced and cited in each other. The present invention will now be described in detail with reference to the accompanying drawings and embodiments.

[0019] The present invention will be further described in detail below with reference to the embodiments and accompanying drawings, but the embodiments of the present invention are not limited thereto.

[0020] See Figure 2 This invention provides a processing method for a TSN collector, including data acquisition, parameter selection and forwarding, and full storage control, as detailed below: Step 1-1: Receive data frames and complete data frame parsing, classification, and buffering. This mainly involves synchronizing TSN transmission words, synchronizing communication link status, monitoring port status, and completing data frame information parsing and multi-rate configuration. Through rate matching and information synchronization, timely acquisition of all data frames is ensured.

[0021] Steps 1-2: Check the additional codewords, source and destination addresses, and CRC check values ​​of the data frames to perform error statistics, frame assembly, discard frames with incorrect check results, and report error information to the sender. This process enables the aggregation, framing, and transmission of TSN data frames. It ensures reduced processing load on other modules and minimizes internal system data traffic, avoiding congestion caused by high traffic volumes.

[0022] Steps 1-3: Differentiate and cache PTP and data frames. PTP data frames are time-synchronized to determine timestamps, ensuring that all modules and the system maintain local clock synchronization. Data frames are categorized into filtered data frames and stored data frames for download.

[0023] Step 2-1: Generate pre-configured rules based on the obtained VLAN ID, priority tag, source / destination MAC address, and data offset. Parse the filtering conditions, receive filtering data frames, parse the VLAN ID, priority tag, source / destination MAC address, and data offset in the data frames, compare them with the filtering conditions, retain the filtered data, remove unnecessary fields, and store them in the cache queue. By comparing the filtering information simultaneously, the processing latency of the filtering data frames is reduced, and the processing efficiency is improved.

[0024] Step 2-2: Data frames in the buffer unit are received, packaged, and sent in parallel, and then filtered and packaged for output. This processing method helps optimize data output response time and improves real-time performance.

[0025] Step 3-1: Receive and store data frames, and regulate the data flow through storage scheduling to achieve storage accuracy under high-volume data conditions.

[0026] Step 3-2: Complete the data frame read / write in the storage area.

[0027] This invention provides a data acquisition, parameter selection, forwarding, and full data storage control method for a TSN (Transmission of Signals) collector. It includes three main steps: receiving verification data frames, filtering parameters within the data frames, and storing the full data. Simultaneously, it processes and downloads local timecode to achieve time synchronization between modules, enabling real-time filtering and complete storage of TSN data. This effectively optimizes the processing response time of TSN data acquisition and ensures synchronized storage integrity.

[0028] See Figure 3 This invention provides a data acquisition, parameter selection and forwarding, and full storage control system for a TSN data collector, as detailed below: Step 1, Data Acquisition Module: This module is divided into a TSN data frame receiving unit and a TSN transmission processing unit. It performs data integrity verification and CRC verification. It discards excessively short frames, marks excessively long frames or data frames with CRC errors, and reports these messages. It provides independent buffer queues for PTP and data frames, and schedules the output of data frames from different channels according to strict priority.

[0029] Step 2, TSN Filtering Processing Unit: This unit parses and stores pre-configured filtering rules, which include VLAN ID, priority tag, source / destination MAC address, data offset, etc. It parses the encapsulated data frames and compares them with the above filtering conditions, removing unnecessary fields to reduce transmission latency and improve transmission efficiency.

[0030] Step 3, Data Storage Module: This module consists of a receiving control unit and a multi-port storage control unit. It enables high-speed point-to-point serial data transmission, allowing multiple data streams to control a single storage interface, thus enabling read / write access to a storage area.

[0031] Example 1 like Figure 1 As shown, a data acquisition, selection, forwarding, and storage control method for a TSN collector includes the following steps: Step 1: Collect data frames and add synchronization headers, timestamps, sequence numbers, and lengths to the data frames to obtain data frames containing collection information tags; Preferably, data frames are acquired, and a synchronization header, timestamp, sequence number, and length are added to the data frames to obtain data frames containing acquisition information tags, as follows: Receive data frames and perform data frame parsing, classification, and buffering. The main functions include synchronizing TSN transmission words, synchronizing communication link status, monitoring port status, and completing data frame information parsing and multi-rate configuration. By using rate matching and information synchronization, we ensure that all data frames are collected in a timely manner. The system checks the additional codewords, source address, destination address, and CRC check value of the data frame to perform error statistics, frame assembly, discard frames with incorrect checks, and report error information to the sender. It also performs TSN data frame aggregation, framing, and transmission processing. Differentiate and cache PTP and data frames. Perform time synchronization on PTP and data frames to ensure that all modules and the system maintain local clock synchronization.

[0032] Step 2: Filter data frames according to pre-configured rules, extract key parameters and reassemble packets to ensure low-latency and high-reliability transmission of critical business traffic; Preferably, the pre-configured rules filter data frames, extract key parameters, and reassemble packets, as follows: Complete the policy configuration information and parse the filtering conditions, including VLAN ID, priority label, source / destination MAC address, and data offset; Parse the data frame encapsulation and compare it with the above filtering criteria; Remove unnecessary fields to reduce transmission latency and improve transmission efficiency; Multiple small-frame payloads are grouped and merged into a large-frame data; Encapsulate large frame data and add dedicated tags.

[0033] Preferably, the completed strategy configuration information and the parsed filtering conditions are as follows: Parse and store the data filtering criteria information; Data filtering criteria information is mapped into the receiving buffer queue; Receive data frames and parse and encapsulate the data frames. Perform data frame comparison and filtering operations.

[0034] Preferably, the removal of unnecessary fields is specifically as follows: For redundant data, data comparison is performed to achieve data frame copying and elimination; Keep data that meets the filtering criteria and discard the rest of the data packets.

[0035] Preferably, the added special tag includes frame data length, time information, sequence number, etc.

[0036] Step 3: Store multiple TSN data frames to achieve storage control.

[0037] Preferably, the data frame storage control is as follows: Based on the data port number, different data frames are stored in multiple memory locations; Based on the data flow priority information, data from different memory locations are stored in the queue cache; Based on the multi-port data storage traffic scheduling control, cached data is written to the storage space.

[0038] Preferably, the data storage traffic scheduling control is as follows: Port requests are handled using a latch-then-arbitrate method. Read and write ports are processed in a time-sharing manner according to their respective priority levels. The higher the priority, the earlier it is processed. If the priorities are the same, they are processed in order of priority.

[0039] Preferably, the storage space is specifically as follows: The data storage space is divided according to the number of ports for acquiring data, and the data storage space contains multiple data storage partitions; Before mounting, perform repair checks on multiple storage partitions.

[0040] Example 2 like Figure 3 This paper illustrates a method for controlling data acquisition, selection, forwarding, and storage of a TSN (Transmission Signal Network) collector, comprising the following steps: The data acquisition module implements network data frame encapsulation and parsing.

[0041] The TSN data frame receiving unit mainly performs data frame verification and data frame discrimination. For example... Figure 4The diagram shows the data reception timing. Frames that are too short are discarded during verification. Frames that are too long or have CRC errors are marked and reported to the network management module. After verification, the data frame's data type is determined, and the data frame is transmitted to the next processing module according to its type.

[0042] The TSN transmission processing unit mainly completes the transmission scheduling control of synchronization messages, flow control messages, and normal forwarding messages, and completes the differential transmission control and selection of multicast and broadcast queue numbers.

[0043] The data storage module implements data storage scheduling control and storage.

[0044] The multi-port storage controller's write port uses four signals—request, response, completion, and error—to complete handshake communication with external modules. When an external port needs to perform a read / write operation, it sends a port request. Based on the current busy / idle status of the operation and the priority level of each read / write port, a response is generated for the write request to the port; after receiving the response, the write port cancels the port write request. After the write operation is completed, a write completion message is sent to the port; at the same time, the response to the write request to the port is canceled. If a failure occurs during the write access process, an error flag is generated while canceling the response; Port requests are handled using a latch-then-arbitrate approach. When a port request is received, the permission count for that request is incremented first, and then arbitration is performed. When multiple requests exist, after a high-priority request is processed, the permission count for a low-priority request is incremented by 1 to increase the probability of the low-priority request being processed next. Once a request is being processed and its response is completed, its priority processing permission count is reset to 0.

[0045] like Figure 5 As shown, no port requests were received, and the priority count values ​​for all four port requests were the initial values. Upon receiving a read request from "Read Port 1", a write request is generated from "Write Port 1", and the priority count values ​​of "Read Port 1" and "Write Port 1" are incremented by 1; Based on the current port requests, "Write Port 1" has the highest priority count, so the "Write Port 1" request is processed first, and a response is generated for the "Write Port 1" request; at the same time, at T1, a read request is received from "Read Port 2", and a write request is generated from "Write Port 2", and its priority count is incremented by 1; The write request for "Write Port 1" is processed. At time T2, the request processing ends, a processing completion is generated, the priority counter value of "Write Port 1" is cleared to zero, and the priority counter values ​​of other unresponsive ports are updated. After the previous "Write to Port 1" request is processed, "Write to Port 2" has the highest priority count among the current port requests, so "Write to Port 2" request is processed first and a response is sent to "Write to Port 2"; the processing of "Write to Port 2" request ends, a completion message is generated, the priority count of "Write to Port 2" is cleared to zero, and the priority counts of other unresponsive ports are updated. After the previous "write port 2" request is processed, according to the current port requests, "read port 1" has the highest priority count, so the "read port 1" request is processed first, and a response is sent to "read port 1"; upon receiving the write request from "write port 2", its priority count returns to its initial value; the processing of the "read port 1" request ends, a completion is generated, and the priority count of "read port 1" is cleared to zero, and the priority counts of other unresponsive ports are updated; After the previous "read port 1" request is processed, according to the current port requests, "write port 2" has the highest priority count value, so the "write port 2" request is processed first, and a response is generated to "write port 2"; at time T6, the processing of the "write port 2" request ends, a completion is generated, and the priority count value of "write port 2" is cleared to zero, and the priority count values ​​of other unresponded request ports are updated; After the previous "write port 2" request is processed, the "read port 2" request is processed first because it has the highest priority count among the current port requests. A response is then sent to "read port 2". Once the processing of the "read port 2" request is completed, the priority count of "read port 2" is cleared to zero, and the priority counts of other ports that have not responded to the request are updated. The priority count for all four port requests is 0, meaning there are no requests to process. MPSC is waiting for new requests.

[0046] An embodiment of the present invention provides a data processing apparatus for a TSN collector to implement the method of the present invention, comprising: The data acquisition module is used to acquire data frames from the TSN collector and add synchronization headers, timestamps, serial numbers and lengths to the data frames to obtain data frames containing acquisition information tags. The data filtering module is used to filter data frames containing collection information tags according to pre-configured rules, extract key parameters and reassemble packets to ensure low-latency and high-reliability transmission of critical business traffic; The full storage module is used to store all data frames containing the collected information tags.

[0047] One embodiment of the present invention provides a TSN collector data processing system, including a TSN collector data processing device, a TSN collector, a storage module, and a target terminal. The data processing device of the TSN collector collects data frames from the TSN collector and adds a synchronization header, time tag, sequence number and length to the data frames to obtain data frames containing collection information tags; it filters the data frames containing collection information tags according to pre-configured rules, extracts key parameters and reassembles them, and sends them to the target terminal; at the same time, the data frames containing collection information tags are sent to the storage module for full storage.

[0048] The target terminal can be a monitoring terminal. The TSN data processing unit outputs filtered data to the monitoring terminal based on pre-configured rules for VLAN ID, priority tag, source / destination MAC address, and data offset, which are of key information of interest to the user, thereby realizing the monitoring function.

[0049] The target terminal can also be a data acquisition and processing device. The data processing device of the TSN collector outputs filtered data into the data acquisition and processing device based on the pre-configured rules of VLAN ID, priority tag, source / destination MAC address, and data offset, which are of key information of interest to the user. This function reduces the data traffic of the data acquisition and processing device and alleviates its resource consumption and hardware overhead.

[0050] The target terminal can also be other devices; this invention does not limit the target terminal.

[0051] This invention achieves real-time monitoring and post-analysis of TSN data through acquisition, filtering, and storage. During data frame acquisition, synchronization headers, timestamps, sequence numbers, and lengths are added to facilitate message identification and subsequent parameter filtering and storage control. A TSN data filtering strategy is proposed, which involves parsing and storing filtering conditions, parsing data frame encapsulation, comparing it with the aforementioned filtering conditions, and removing unnecessary fields to reduce transmission latency and enhance transmission efficiency. Based on the filtering information, important data is filtered in real time, ensuring the reliability and real-time performance of data frames during the filtering and forwarding process. Through point-to-point high-speed serial data transmission and multi-channel data read / write control, using four signal communication methods (request, response, completion, and error) ensures smooth multi-channel data storage control, avoiding data congestion, delays, and stuttering, and achieving full, complete, and accurate data storage.

[0052] The above detailed embodiments are a description of the present invention. It should not be considered that the specific embodiments of the present invention are limited to these descriptions. For those skilled in the art, several simple deductions and substitutions can be made without departing from the concept of the present invention, and all of these should be considered to fall within the protection scope of the present invention.

Claims

1. A method for processing data from a Time-Sensitive Network (TSN) data collector, characterized in that, Includes the following steps: Collect data frames from the TSN collector and add a synchronization header, timestamp, sequence number, and length to the data frames to obtain data frames containing collection information tags; Data frames containing collection information tags are filtered according to pre-configured rules, key parameters are extracted and reassembled to ensure low-latency and high-reliability transmission of critical business traffic; Store all data frames containing the collected information tags.

2. The method according to claim 1, characterized in that, The process involves collecting data frames from the TSN collector and adding a synchronization header, timestamp, sequence number, and length to each data frame, resulting in a data frame containing collection information tags, as detailed below: The data frame encapsulation is parsed layer by layer to obtain data status information; Parse the status information; Determine whether the data frame is complete based on the parsing results of the status information; Once the data frame is complete, add a synchronization header, timestamp, sequence number, and length to the data frame.

3. The method according to claim 1, characterized in that, The method further includes: parsing the DC time code and AC time code using a clock device to obtain the Precision Time Protocol (PTP) data frame, and determining the time tag based on the PTP data frame.

4. The method according to claim 1, characterized in that, The process of filtering data frames containing collected information tags according to pre-configured rules, extracting key parameters, and reassembling packets is as follows: Pre-configured rules are generated based on the obtained Virtual Local Area Network (VLAN) identifier, priority label, source / destination MAC address, and data offset. Parse the VLAN ID, priority tag, source / destination MAC address, and data offset in the data frame containing the information collection tag, and compare the parsed results with the pre-configured rules; Unnecessary fields are removed, resulting in multiple small frames which are then stored in a buffer queue, reducing transmission costs. Multiple small frame payloads in the buffer queue are grouped and merged into a large frame data; Add a synchronization header, timestamp, sequence number, length, and filter label to large frames of data.

5. The method according to claim 1, characterized in that, The process of storing all data frames containing the collected information tags is as follows: Based on the data port number, different data frames are stored in multiple memory locations; Based on data flow priority information, data in different memories are stored in a cache queue for caching; The data frame to be invoked is determined based on the multi-port data storage traffic, and the data frame to be invoked in the cache queue is written to the storage space.

6. The method according to claim 5, characterized in that, The process of determining the data frame to be invoked based on the multi-port data storage traffic is as follows: Port requests are handled using a latch-then-arbitrate method: ports are sorted in a time-division manner according to their priority level, with higher priority levels resulting in earlier output of data frames; data frames from ports with the same priority level are output in the order in which they were acquired.

7. A processing apparatus for TSN collector data to perform the method according to any one of claims 1 to 6, characterized in that, include: The data acquisition module is used to acquire data frames from the TSN collector and add synchronization headers, timestamps, serial numbers and lengths to the data frames to obtain data frames containing acquisition information tags. The data filtering module is used to filter data frames containing collection information tags according to pre-configured rules, extract key parameters and reassemble packets to ensure low-latency and high-reliability transmission of critical business traffic; The full storage module is used to store all data frames containing the collected information tags.

8. A data processing system for a TSN data collector, characterized in that, Includes the TSN collector data processing device as described in claim 7, a TSN collector, a storage module, and a target terminal. The data processing device of the TSN collector collects the data frames of the TSN collector and adds a synchronization header, time tag, sequence number and length to the data frames to obtain data frames containing collection information tags; according to the pre-configured rules, the data frames containing collection information tags are filtered, key parameters are extracted and reassembled, and then sent to the target terminal. At the same time, the data frames containing the collected information tags are sent to the storage module for full storage.

Images