Data transmission method for industrial and visual integrated equipment

Abstract

The invention belongs to the field of data transmission, and discloses a data transmission method for industrial and visual integrated equipment. Comprising the following steps: establishing a data label framework, and performing category identification and priority division on data streams according to the data label framework; respectively designing transmission requirements by using time-aware shaping, traffic reservation and frame priority scheduling according to the category of the output data stream; respectively transmitting the industrial control data stream, the AI analysis data stream and the video data stream according to designed transmission requirements; a transmission process is arranged on a visual interface, interface interaction is carried out, and efficient transmission of data of the industrial-visual integrated equipment is realized.

Description

Technical Field

[0001] The present invention relates to the field of data transmission, and more specifically, to a data transmission method for industrial-visual integrated equipment. Background Art

[0002] There are many types of data streams in industrial vision integrated equipment, including industrial control data streams, AI analysis data streams, and video data streams. These data streams have different characteristics and requirements. Among the data streams, industrial control data streams have strict real-time requirements, AI analysis data streams require higher computing and transmission efficiency, and video data streams have higher bandwidth requirements. If there is a lack of priority management, it is easy to cause key data (such as industrial control data streams) to be delayed or lost.

[0003] Industrial network bandwidth is limited, and the simultaneous transmission of multiple data streams will lead to insufficient bandwidth resources and network congestion. In industrial environments, the real-time and reliability of data transmission are very high, especially the transmission delay of industrial control data streams may cause production failures. Low-priority data streams (such as video data streams) are easily blocked for a long time in traditional priority scheduling, resulting in low transmission efficiency.

[0004] In view of this, the present invention proposes a data transmission method for an industrial-visual integrated device to solve the above problem. Summary of the invention

[0005] In order to overcome the above-mentioned defects of the prior art and to achieve the above-mentioned purpose, the present invention provides the following technical solutions: A data transmission method for an industrial-visual integrated device, comprising: S1, establishing a data label framework, and classifying and prioritizing data streams according to the data label framework; S2, according to the output data flow category, use time-aware shaping, flow reservation and frame priority scheduling to design transmission requirements respectively; S3, transmit the industrial control data stream, AI analysis data stream and video data stream respectively according to the designed transmission requirements; S4. Arrange the transmission process on a visual interface and conduct interface interaction.

[0006] Preferably, the method for establishing the data label framework includes: The data stream categories include industrial control information stream, AI analysis result stream, and video stream; Set exclusive sites and interfaces for each category of data flow, generate numerical numbers through one-hot encoding, use numerical numbers to mark the sites and interfaces for data transmission, and identify the category fragments of the data flow through the combination of site numbers and interface numbers; Set a blank data frame, fill in the frame header, timestamp, category segment, data content, check code and frame tail in order, forming a (frame header, timestamp, category segment, data content, check code, frame tail) format, which is recorded as the data frame of the data stream; Set the input of the data label framework to the original data stream and the output to the data stream labeled with the data frame.

[0007] Preferably, the data frame is added with an extension field, and the expression is (data frame, extension field), and the extension field can be allocated to the frame header, timestamp, category fragment, data content, checksum and frame tail.

[0008] Preferably, the method for classifying and prioritizing data streams according to a data tag framework includes: Extract the category fragment of the data flow and preliminarily identify the category of the data flow according to the site number and interface number; Check whether the category segment of the data stream is unique. If it is unique, output the classification of the data stream according to the category segment. If it is not unique, output a warning message to indicate that the data stream is wrong. Define the priorities of industrial control information flow, AI analysis result flow, and video flow from high to low.

[0009] Preferably, the method for using the time-aware shaping includes: The time window of industrial control data flow is defined as , the time window for AI to analyze data flow is , the time window of the video data stream is ; Real-time statistics of industrial control data flow, AI analysis data flow and video data flow , and ,and , , ,in, , and is a priority weight parameter that satisfies 0; Set the constraints to ; Set the network period to , then the time window of each type of data flow is: ,in, is the time window of industrial control data stream, To analyze the time window of the data stream, is the time window of the video data stream.

[0010] Preferably, the method for using the traffic reservation includes: Real-time monitoring of the total bandwidth of the network ; Set the bandwidth allocation method to ,in, Bandwidth allocated for industrial control data flows, Bandwidth allocated for AI analysis data streams, The bandwidth allocated for the video data stream, The minimum bandwidth allocated for video data streaming.

[0011] Preferably, the method for using the frame priority scheduling includes: The priority queue mechanism defined by the IEEE802.1Q standard is used to map each type of data flow to a different priority queue: The industrial control data stream is mapped to the industrial control data queue and is defined as the highest priority; the AI ​​analysis data stream is mapped to the AI ​​analysis result queue and is defined as the second highest priority; the video data stream is mapped to the video data queue and is defined as the lowest priority; Packets are sent according to the priority scheduling rules so that high priority queues always take precedence over low priority queues.

[0012] Preferably, the transmission method of the industrial control data stream, AI analysis data stream and video data stream includes: Set up a transmission mechanism for each data category distribution; Industrial control data flow Exclusive bandwidth transmission within the time window; AI analyzes data flow Transmission within the time window; Video data stream Transmission within the time window.

[0013] Preferably, the transmission mechanism is set for each data category distribution, specifically including: Configure a small buffer queue for industrial control data flow at the receiving end and set hour, As the bandwidth threshold, the industrial control data flow preempts the bandwidth of the low priority data flow until When the bandwidth threshold is reached, the bandwidth is stopped. AI analyzes data streams and configures multi-path transmission mechanisms; Divide the video data stream into key frames and normal frames, and set the transmission order so that key frames take precedence over normal frames.

[0014] Preferably, the visual interface includes a terminal page of a computer or a display interface of a mobile device, and performs interface interaction with the user; After receiving the data, the industrial display screen parses the data according to the type identifier in the frame header. The industrial information and video images corresponding to the industrial control data stream and video stream are displayed in partitions on the same display screen. The results of AI analysis of the data stream are directly fed back to the industrial control system.

[0015] The technical effects and advantages of the data transmission method for industrial and visual integrated equipment of the present invention are as follows: 1. Data streams are classified and identified through the data tag framework, and a combination of site numbers and interface numbers is used to ensure the uniqueness of data stream categories and the accuracy of identification. In data stream classification, by checking whether the category fragment is unique, data stream error detection and warning functions are provided to enhance the security of the system. Clear priority definitions (industrial control data stream>AI analysis data stream>video data stream) are adopted, and the priority queue mechanism of the IEEE802.1Q standard is used to ensure the priority scheduling of high-priority data streams.

[0016] 2. Through time-aware shaping and traffic reservation mechanisms, bandwidth allocation is dynamically adjusted to avoid waste of bandwidth resources and conflicts in data transmission. The time window mechanism and frame priority scheduling ensure the real-time transmission of high-priority data such as industrial control data streams. Dynamic bandwidth allocation and time window mechanisms make network resource allocation more reasonable, improve bandwidth utilization, and reduce the risk of network congestion. By prioritizing key frames (I frames) and ordinary frames (P frames / B frames) of video streams, the transmission efficiency and display effect of video data streams are improved.

[0017] Dynamic bandwidth allocation and time window mechanism make network resource allocation more reasonable, improve bandwidth utilization and reduce the risk of network congestion.

[0018] 3. The data transmission process is displayed through a visual interface, which makes it easier for users to intuitively understand the data flow status and improves the transparency and operability of the system. The visual interface presents the data transmission process to users intuitively, enhancing the user's control over the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A schematic diagram of a data transmission method for an industrial-visual integrated device according to the present invention; Figure 2 The present invention is a schematic diagram of a data transmission system for industrial and visual integrated equipment. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] Example 1 See also Figure 1 As shown, the industrial control equipment site is often an application scenario that combines the industrial automation control system with the video surveillance system, and the two are highly coordinated. However, due to technical and conceptual reasons, the two were previously two independent systems, so there was independent construction and repeated construction, and ultimately the central control personnel manually integrated the information. However, with the development of science and technology, industrial automation systems have also seen the emergence of industrial information display screens that display industrial information. For the sake of equipment utilization, the present invention combines industrial information content with video display content and AI intelligent video judgment results with industrial automatic control systems. A combination of industrial information and video results has been achieved.

[0022] Based on the above description, in order to achieve "industrial information and video images share a display, and realize efficient transmission of video data, industrial control information and AI analysis results in the same network", the data transmission method needs to be based on TSN (time-sensitive network) and combine data level priority, communication protocol and hardware adaptation solution. The following are the detailed steps for data transmission method design.

[0023] S1. Establish a data labeling framework and classify and prioritize data streams based on the data labeling framework; The method of establishing the data labeling framework includes: The data stream categories include industrial control information stream, AI analysis result stream, and video stream; The specific explanation is as follows: Industrial control information flow: Features: High real-time requirements, extremely low latency tolerance, and high reliability requirements.

[0024] Priority: Highest.

[0025] Data examples: PLC control instructions, sensor feedback data.

[0026] Bandwidth allocation: fixed bandwidth, priority guarantee.

[0027] AI analysis result flow: Features: Requires high reliability and timing consistency, but has slightly lower latency requirements.

[0028] Priority: Second highest.

[0029] Data examples: machine vision inspection results, predictive analysis data.

[0030] Bandwidth allocation: Dynamic adjustment, giving priority to ensuring timing consistency.

[0031] Video Stream: Features: High latency tolerance, allowing a certain amount of frame loss, but requiring smoothness.

[0032] Priority: Lowest.

[0033] Data example: real-time surveillance video stream.

[0034] Bandwidth allocation: Use the remaining bandwidth and adjust dynamically.

[0035] Set exclusive sites and interfaces for each category of data flow, generate numerical numbers (different for each category) through one-hot encoding, use the numerical numbers to mark the sites and interfaces for data transmission, and identify the category fragments of the data flow through the combination of site numbers and interface numbers; Site numbering rules: Industrial control site number range: 001-100.

[0036] AI analysis site number range: 101-200.

[0037] Video streaming site number range: 201-300.

[0038] Interface numbering rules: The interface numbers for each site are assigned based on their function, for example: Industrial control interface number: I001-I010.

[0039] AI analysis interface number: I101-I110.

[0040] Video stream interface number: I201-I210.

[0041] The combination of site number and interface number can uniquely identify the source of the data flow. For example: Site number 005 + interface number I003: industrial control information flow.

[0042] Site number 150 + interface number I105: AI analysis result flow.

[0043] Site number 250+interface number I205: video stream.

[0044] The data frame format must meet the requirements of identifying data categories and ensuring real-time performance. The following is the optimized design of the frame format: Set a blank data frame, fill in the frame header, timestamp, category segment, data content, check code and frame tail in order, forming a (frame header, timestamp, category segment, data content, check code, frame tail) format, which is recorded as the data frame of the data stream; For example: Field Name length describe Frame Header 16 bits Includes frame type identification. Timestamp 32bits The timestamp of data generation, used for timing synchronization and delay calculation. Category Snippets 8bits Specifies the combination of a data flow station number and an interface number. Data content Variable length The actual data content. Check code 16 bits Data checksum, used to detect transmission errors. Frame end 1byte Marks the end of the frame Set the input of the data label framework to the original data stream and the output to the data stream labeled with the data frame.

[0045] The current data frame format is fixed. Although it meets existing needs, new data types (such as sensor data, alarm information, etc.) may need to be added in the future. The existing format lacks scalability. Therefore, a more flexible frame format is designed to add extensible fields.

[0046] If an extended field is added to a data frame, the format is (data frame, extended field). The extended field can be assigned to the frame header, timestamp, category fragment, data content, checksum and frame trailer.

[0047] Methods for classifying and prioritizing data streams based on the data labeling framework include: Extract the category fragment of the data flow and preliminarily identify the category of the data flow according to the site number and interface number; Check whether the category segment of the data stream is unique. If it is unique, output the classification of the data stream according to the category segment. If it is not unique, output a warning message to identify the data stream error.

[0048] Parse the data stream category from the category fragment field of the data frame. Ensure that the category fragment is unique to avoid classification conflicts.

[0049] Define the priorities of industrial control information flow, AI analysis result flow, and video flow from high to low; S2, according to the output data flow category, use time-aware shaping, flow reservation and frame priority scheduling to design transmission requirements respectively; To ensure the transmission requirements of different data streams, the core functions of TSN are adopted, including time-aware shaping (TAS), stream reservation protocol (SRP) and frame priority scheduling.

[0050] Time-aware shaping ensures that high-priority data streams monopolize network resources within a specific time period by defining time windows. However, for fixed time windows, high-priority tasks (such as industrial control data) always occupy larger time windows, which wastes bandwidth even if the actual data volume is small at certain moments. In addition, low-priority streams (such as video streams) may be severely restricted under high load conditions, resulting in reduced video transmission quality. Therefore, the present invention adopts a dynamic time window allocation mechanism to dynamically adjust the time window size according to the actual data flow and network load conditions. The implementation method is as follows: Ways to use time-aware shaping include: The time window of industrial control data flow is defined as , the time window for AI to analyze data flow is , the time window of the video data stream is ; Use the traffic monitoring module to count the data volume of industrial control data flow, AI analysis data flow and video data flow in real time , and ,and , , ,in, , and is a priority weight parameter that satisfies 0; The working principle is: First, the traffic monitoring module counts the data volume of different data flows in real time. Then, the time window weight of each data flow is calculated based on the data volume of each data flow and the preset priority weight parameter. The time window weight reflects the relative importance of each data flow at the current moment. The higher the weight, the more processing resources the data flow will obtain in the next time window.

[0051] This method of dynamically adjusting the time window weight can effectively optimize the priority of data processing and improve the system's response speed and processing efficiency. In practical applications, this model can be used in various scenarios that require real-time data processing, such as network traffic monitoring, video stream processing, etc. Through precise control, the system's performance and user experience can be significantly improved.

[0052] Set the constraints to ; Set the network period to , then the time window of each type of data flow is: ,in, is the time window of industrial control data stream, To analyze the time window of the data stream, is the time window of the video data stream; The working principle is: In each network cycle, the system allocates network resources according to the defined time window. Exclusive network resources. AI analyzes data flow in time windows The video data stream is in the time window Exclusive network resources.

[0053] Traffic reservation can be used in the following ways: Real-time monitoring of the total bandwidth of the network ; Set the bandwidth allocation method to ,in, Bandwidth allocated for industrial control data flows, Bandwidth allocated for AI analysis data streams, The bandwidth allocated for the video data stream, The minimum bandwidth allocated to the video data stream; the video data stream is allocated the least bandwidth. The minimum bandwidth is used to set the minimum bandwidth protection threshold for the video stream, that is, no matter how high the load is, ensure that the video stream occupies at least .

[0054] The usage of frame priority scheduling includes: The priority queue mechanism defined by the IEEE802.1Q standard is used to map each type of data flow to a different priority queue: The industrial control data stream is mapped to the industrial control data queue and is defined as the highest priority; the AI ​​analysis data stream is mapped to the AI ​​analysis result queue and is defined as the second highest priority; the video data stream is mapped to the video data queue and is defined as the lowest priority; Packets are sent according to the priority scheduling rules so that high priority queues always take precedence over low priority queues.

[0055] S3, transmit the industrial control data stream, AI analysis data stream and video data stream respectively according to the designed transmission requirements; The transmission methods of industrial control data streams, AI analysis data streams, and video data streams include: Set up a transmission mechanism for each data category distribution; Industrial control data flow Exclusive bandwidth transmission within the time window to ensure real-time performance.

[0056] AI analyzes data flow Transmit within the time window; ensure reliability.

[0057] Video data stream Transmit within the time window; ensure smoothness.

[0058] Each data category distribution sets a transmission mechanism, including: Although industrial control data has the highest priority, extreme delays may still occur under high traffic load or network failure conditions, resulting in substandard real-time performance. Configure a small buffer queue for industrial control data streams on the receiving end to avoid data loss or delays caused by network jitter. hour, is the bandwidth threshold, that is, when the network load reaches a certain threshold, the industrial control data flow will occupy the bandwidth of the low-priority data flow until When the bandwidth threshold is reached, the occupation stops, ensuring real-time performance.

[0059] Configure a multi-path transmission mechanism for AI analysis data streams. Configure a multi-path transmission mechanism for AI analysis data streams (such as combining TSN's frame replication and elimination mechanism) to transmit redundant data frames on independent physical paths to ensure data reliability.

[0060] Since the video stream has the lowest priority, serious frame loss or freeze may occur when the network load is high, affecting the monitoring effect. The video data stream is divided into key frames (I frames) and ordinary frames (P frames / B frames), and the transmission order is set so that key frames take precedence over ordinary frames; in bad situations, some ordinary frames are discarded to ensure the overall quality of the video stream.

[0061] S4. Arrange the transmission process on a visual interface and conduct interface interaction.

[0062] The visual interface includes the terminal page of the computer or the display interface of the mobile device, and interacts with the user.

[0063] After receiving the data, the industrial display screen parses the data according to the type identifier in the frame header. The industrial information and video images corresponding to the industrial control data stream and video stream are displayed in partitions on the same display screen. The results of AI analysis of the data stream are directly fed back to the industrial control system.

[0064] Users can display the data transmission and processing process of the industrial and visual integrated equipment through the computer page (computer display screen, where the computer refers to the smart device, and the mobile device can be a mobile phone or tablet), which is convenient for users to click, query, download and other interactive operations.

[0065] Example 2 See also Figure 2 As shown, the part not described in detail in this embodiment is described in Example 1, and a data transmission system for an industrial-visual integrated device is provided, including: The data stream identification and classification module is used to establish a data label framework and classify and prioritize data streams according to the data label framework; The transmission demand design module is used to design the transmission demand according to the output data flow category using time-aware shaping, traffic reservation and frame priority scheduling; Data transmission module, used to transmit industrial control data stream, AI analysis data stream and video data stream respectively according to the designed transmission requirements; The visualization module is used to arrange the transmission process on a visualization interface for interface interaction; each module is connected by wired and / or wireless means to achieve efficient data transmission.

[0066] Example 3 See also Figure 1 and Figure 2 As shown, this embodiment discloses an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the operation mode of the data transmission method for an industrial-visual integrated device provided above is implemented.

[0067] Since the electronic device introduced in this embodiment is an electronic device used to implement a data transmission method for an industrial-visual integrated device in the embodiment of the present application, based on the data transmission method for an industrial-visual integrated device introduced in the embodiment of the present application, a person skilled in the art can understand the specific implementation of the electronic device of the present embodiment and its various variations, so how the electronic device implements the method in the embodiment of the present application is not described in detail here. As long as a person skilled in the art implements the electronic device used in the data transmission method for an industrial-visual integrated device in the embodiment of the present application, it belongs to the scope of protection of the present application.

[0068] The above formulas are all dimensionless and numerical calculations. The formula is a formula for the most recent real situation obtained by collecting a large amount of data and performing software simulation. The preset parameters and thresholds in the formula are set by technicians in this field according to actual conditions.

[0069] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technical users in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A data transmission method for an industrial-visual integrated device, characterized in that: include: S1. Establish a data labeling framework and classify and prioritize data streams based on the data labeling framework; S2, according to the output data flow category, use time-aware shaping, flow reservation and frame priority scheduling to design transmission requirements respectively; S3, transmit the industrial control data stream, AI analysis data stream and video data stream respectively according to the designed transmission requirements; S4. Arrange the transmission process on a visual interface and conduct interface interaction.

2. A data transmission method for an industrial-visual integrated device according to claim 1, characterized in that: The method for establishing the data label framework includes: The data stream categories include industrial control information stream, AI analysis result stream, and video stream; Set exclusive sites and interfaces for each category of data flow, generate numerical numbers through one-hot encoding, use numerical numbers to mark the sites and interfaces for data transmission, and identify the category fragments of the data flow through the combination of site numbers and interface numbers; Set a blank data frame, fill in the frame header, timestamp, category segment, data content, check code and frame tail in order, forming a (frame header, timestamp, category segment, data content, check code, frame tail) format, which is recorded as the data frame of the data stream; Set the input of the data label framework to the original data stream and the output to the data stream labeled with the data frame.

3. A data transmission method for an industrial-visual integrated device according to claim 2, characterized in that: If the data frame adds an extension field, the representation is (data frame, extension field), and the extension field can be allocated to the frame header, timestamp, category fragment, data content, checksum and frame tail.

4. The data transmission method for industrial and visual integrated equipment according to claim 3, characterized in that: The method for classifying and prioritizing data streams according to the data tag framework includes: Extract the category fragment of the data flow and preliminarily identify the category of the data flow according to the site number and interface number; Check whether the category segment of the data stream is unique. If it is unique, output the classification of the data stream according to the category segment. If it is not unique, output a warning message to indicate that the data stream is wrong. Define the priorities of industrial control information flow, AI analysis result flow, and video flow from high to low.

5. The data transmission method for industrial and visual integrated equipment according to claim 4, characterized in that: The method of using the time-aware shaping includes: The time window of industrial control data flow is defined as , the time window for AI to analyze data flow is , the time window of the video data stream is ; Real-time statistics of industrial control data flow, AI analysis data flow and video data flow , and ,and , , ,in, , and is the priority weight parameter; Set the constraints to ; Set the network period to , then the time window of each type of data flow is: ,in, is the time window of industrial control data stream, To analyze the time window of the data stream, is the time window of the video data stream.

6. A data transmission method for an industrial-visual integrated device according to claim 5, characterized in that: The method for using the traffic reservation includes: Real-time monitoring of the total bandwidth of the network ; Set the bandwidth allocation method to ,in, Bandwidth allocated for industrial control data flows, Bandwidth allocated for AI analysis data streams, The bandwidth allocated for the video data stream, The minimum bandwidth allocated for video data streaming.

7. A data transmission method for an industrial-visual integrated device according to claim 6, characterized in that: The method for using the frame priority scheduling includes: The priority queue mechanism defined by the IEEE802.1Q standard is used to map each type of data flow to a different priority queue: The industrial control data stream is mapped to the industrial control data queue and is defined as the highest priority; the AI ​​analysis data stream is mapped to the AI ​​analysis result queue and is defined as the second highest priority; the video data stream is mapped to the video data queue and is defined as the lowest priority; Packets are sent according to the priority scheduling rules so that high priority queues always take precedence over low priority queues.

8. The data transmission method for industrial and visual integrated equipment according to claim 7, characterized in that: The transmission method of the industrial control data stream, AI analysis data stream and video data stream includes: Set up a transmission mechanism for each data category distribution; Industrial control data flow in Exclusive bandwidth transmission within the time window; AI analyzes data flow Transmission within the time window; Video data stream Transmission within the time window.

9. The data transmission method for industrial and visual integrated equipment according to claim 8, characterized in that: The transmission mechanism for each data category distribution is specifically configured as follows: Configure a small buffer queue for industrial control data flow at the receiving end and set hour, As the bandwidth threshold, the industrial control data flow preempts the bandwidth of the low priority data flow until When the bandwidth threshold is reached, the bandwidth is stopped. AI analyzes data streams and configures multi-path transmission mechanisms; Divide the video data stream into key frames and normal frames, and set the transmission order so that key frames take precedence over normal frames.

10. The data transmission method for industrial and visual integrated equipment according to claim 9, characterized in that: The visual interface includes a terminal page of a computer or a display interface of a mobile device, and performs interface interaction with the user; After receiving the data, the industrial display screen parses the data according to the type identifier in the frame header. The industrial information and video images corresponding to the industrial control data stream and video stream are displayed in partitions on the same display screen. The results of AI analysis of the data stream are directly fed back to the industrial control system.

Images