Multi-source data acquisition device and acquisition system based on industrial internet platform

Abstract

This invention relates to the field of multi-source data acquisition technology, and discloses a multi-source data acquisition device and system based on an industrial internet platform, including a main control processing module, a multi-source interface acquisition module, a dynamic switching buffer module, an anomaly isolation module, a time alignment compensation module, and a self-verification transmission module. In this invention, through the collaborative work of the multi-source interface acquisition module and the main control processing module, unified access and processing of different types of data sources in the industrial field are realized. The multi-source interface acquisition module can automatically identify the communication protocol type of the access data source, and calculate the adaptation priority value through the protocol adaptation unit, and perform protocol conversion in sequence according to the priority value, so as to ensure that various heterogeneous protocol data are efficiently and reliably accessed by the main control processing module. At the same time, the main control processing module can receive and process data from each channel in real time, ensuring that the data has completed preliminary protocol unification before entering the dynamic switching buffer module.

Description

Technical Field

[0001] This invention relates to the field of multi-source data acquisition technology, and in particular to a multi-source data acquisition device and system based on an industrial internet platform. Background Technology

[0002] The multi-source data acquisition device based on the industrial internet platform is an intelligent data acquisition and management solution for industrial sites. It can simultaneously access data from various types of industrial equipment, sensors and control systems, support the identification and adaptation of heterogeneous communication protocols, and realize the unified acquisition of multi-source data. The device uses dynamic buffering and priority scheduling to reasonably allocate and process data from different channels in real time, ensuring that critical data is transmitted first.

[0003] In practice, some problems still exist:

[0004] In existing industrial internet platforms, multi-source data acquisition usually relies on a single protocol or fixed interface, which is difficult to adapt to the diverse types of field equipment and complex communication protocols. At the same time, the sampling periods of different data sources vary significantly, resulting in time deviations in the collected data and making it impossible to achieve accurate time alignment and synchronization. During data transmission, due to the unstable network conditions in industrial fields, some data is prone to loss or delay. Traditional data transmission methods lack self-verification and dynamic error correction mechanisms, resulting in the inability to effectively guarantee data integrity and reliability.

[0005] In addition, existing multi-source data acquisition systems have limited ability to handle abnormal data. Once a certain acquisition channel experiences continuous excessive fluctuations or protocol parsing anomalies, the entire system may be interfered with or experience data blockage, affecting the normal operation of other channels. Some systems handle anomalies by manual intervention or simply disconnecting the channel, lacking automated isolation, anomaly marking, and recovery detection mechanisms, and thus failing to achieve secure isolation and rapid recovery of abnormal data.

[0006] At the data processing level, traditional multi-source data acquisition devices struggle to achieve dynamic priority processing and buffer allocation. The processing order of data from different channels is usually fixed, making it impossible to dynamically schedule data based on its magnitude, real-time fluctuation trends, and historical anomaly records. This results in delayed processing of critical data or failure to transmit important event data to the industrial internet platform in a timely manner. Furthermore, when data from different sampling periods is transmitted to the upper-level system, there is a lack of a unified time reference and deviation compensation method, which affects the accuracy of data analysis, historical tracing, and intelligent decision-making.

[0007] In summary, existing technologies have significant shortcomings in multi-source data acquisition, dynamic priority processing, anomaly isolation, time alignment compensation, and self-verification transmission, and cannot meet the high requirements of industrial internet platforms for data real-time performance, integrity, reliability, and traceability. Summary of the Invention

[0008] To address the shortcomings of existing technologies, this invention provides a multi-source data acquisition device and system based on an industrial internet platform, which solves the problem that existing multi-source data acquisition devices cannot meet the high requirements of industrial internet platforms for data real-time performance, integrity, reliability, and traceability.

[0009] To achieve the above objectives, the present invention is implemented through the following technical solution: a multi-source data acquisition device and acquisition system based on an industrial internet platform, including a main control processing module, a multi-source interface acquisition module, a dynamic switching buffer module, an anomaly isolation module, a time alignment compensation module, and a self-verification transmission module;

[0010] The multi-source interface acquisition module is located at the input end of the main control processing module and is electrically connected to the main control processing module. It is used to access different types of data sources in the industrial field and output corresponding acquired data.

[0011] The dynamic switching buffer module is located between the multi-source interface acquisition module and the main control processing module. It is used to cache the acquired data from different data sources in different channels and adjust the order in which the data enters the main control processing module according to the change status of each channel.

[0012] The anomaly isolation module is connected to the main control processing module and is used to interrupt the data input of the corresponding channel when a continuous anomaly is detected in the data of a certain acquisition channel, so as to keep the other acquisition channels working continuously.

[0013] The time alignment compensation module is located inside the main control processing module and is used to establish a unified time reference for data with different sampling periods and to correct time deviations.

[0014] The self-verification transmission module is located at the output end of the main control processing module and is used to generate verification information for the processed data and send it to the industrial internet platform.

[0015] Furthermore, the multi-source interface acquisition module includes a protocol identification unit, a protocol adaptation unit, and a data access unit;

[0016] The protocol identification unit is used to identify the communication protocol type of the access data source;

[0017] The protocol adaptation unit is connected to the protocol identification unit, and calculates the adaptation priority value corresponding to each protocol based on the identification result. The calculation method for the adaptation priority value is as follows:

[0018]

[0019] in, For the first Protocol adaptation priority This refers to the frequency of data changes corresponding to this protocol per unit of time. This is the delay value from the most recent data collection. This is the number of protocol parsing exceptions within a preset period. , , These are the corresponding weighting coefficients;

[0020] The protocol adaptation unit performs protocol conversions sequentially from high to low according to the adaptation priority value, and inputs the converted data to the data access unit.

[0021] Furthermore, the dynamic switching buffer module includes a priority determination unit, a first cache unit, and a second cache unit;

[0022] The priority determination unit is used to: comprehensively calculate the data priority based on the change range of the data collected by each acquisition channel within a unit time, the data delay status, and historical abnormal records, and output the corresponding control signal;

[0023] The first buffer unit is used to receive data from higher priority data channels and provides a fast transmission interface for the main control processing module to read;

[0024] The second buffer unit is used to receive data from lower priority data channels and provides a delayed transmission interface for the main control processing module to read;

[0025] The dynamic switching buffer module is also used to dynamically adjust the data channel allocation among each cache unit, so as to achieve the coordinated operation of fast processing of high-priority data and delayed storage of low-priority data.

[0026] Furthermore, when determining data priority, the priority determination unit also considers the real-time data fluctuation trend and historical abnormal frequency of each acquisition channel. If the data change amplitude of a certain channel is higher than the preset threshold in multiple consecutive sampling periods, the data of that channel is automatically adjusted to enter the first buffer unit priority, and a dynamic scheduling signal is triggered to update the buffer allocation strategy.

[0027] Furthermore, the anomaly isolation module includes an anomaly detection unit, a branch isolation unit, and a recovery detection unit;

[0028] The anomaly detection unit is used to monitor the data of each acquisition channel in real time and determine the abnormal status of the data based on continuous excessive fluctuations or protocol parsing anomalies.

[0029] The branch isolation unit is used to automatically cut off the data input of the abnormal acquisition channel after the abnormal judgment signal is triggered, and to notify the main control processing module and the edge parsing node of the abnormal channel status.

[0030] The anomaly isolation module is also used to temporarily cache and mark abnormal data during the isolation period so that data comparison and anomaly analysis can be performed after recovery.

[0031] Furthermore, the recovery detection unit is used to re-detect the status of the isolated acquisition channel according to a preset detection interval;

[0032] When the test results show that the data has returned to normal, the recovery test unit generates a reset signal to control the branch isolation unit to re-establish the data channel input, and at the same time synchronizes the recovery status to the main control processing module and the edge parsing node;

[0033] The recovery detection unit is also used to record the timestamp of the recovery process and the duration of the anomaly.

[0034] Furthermore, the time alignment compensation module includes a main time axis generation unit, a data mapping unit, and a deviation correction unit;

[0035] The main time axis generation unit is used to generate a unified time reference signal and periodically output it to the data mapping unit and the deviation correction unit.

[0036] The data mapping unit is used to map data from different sampling periods to a unified time node generated by the main time axis, and to mark the original sampling timestamp to retain historical data information;

[0037] The deviation correction unit is used to calculate and adjust the timestamps of each data channel based on the deviation between the actual sampling interval and the unified time node, so as to achieve time synchronization of multi-channel data.

[0038] Furthermore, the deviation correction unit also includes a compensation parameter storage module and a real-time correction unit;

[0039] The compensation parameter storage module is used to record the sampling delay, deviation statistics, and historical correction coefficients for each channel;

[0040] The real-time correction unit dynamically adjusts the data timestamp based on the stored compensation parameters and the current sampling data deviation, and outputs it to the main control processing module.

[0041] Furthermore, the self-verification transmission module includes a check code generation unit, a data packetization unit, and a return verification unit;

[0042] The verification code generation unit is used to generate a unique verification identifier based on the collected data and its timestamp.

[0043] The data grouping unit is used to group the collected data according to a preset length or data type, and the grouped data is sent to the industrial internet platform or edge parsing node through the transmission interface.

[0044] The backhaul verification unit is used to receive the verification results returned by the industrial internet platform, and to trigger data retransmission or adjust the grouping strategy when data loss or error is detected, while feeding back the retransmission information to the main control processing module.

[0045] A multi-source data acquisition system based on an industrial internet platform includes edge parsing nodes, platform receiving nodes, and data backtracking management nodes;

[0046] The edge parsing node is communicatively connected to the multi-source data acquisition device, and is used to receive the acquired data and perform data classification and parsing, protocol verification, anomaly marking, and real-time cache management.

[0047] The edge parsing node is also used to generate an isolation signal when abnormal data is detected, instructing the abnormal isolation module of the multi-source data acquisition device to cut off the corresponding channel, while the abnormal data is delayed and marked and stored in the buffer area.

[0048] The platform receiving node is communicatively connected to the edge parsing node to receive classified and parsed data, establish data mapping relationships between different data sources, and complete data storage, historical record management, and data traceability identification generation.

[0049] The platform receiving node is also used to monitor the data transmission reliability of the edge parsing node based on the back-transmission verification results, and to issue synchronization or retransmission instructions when necessary to ensure the integrity and consistency of multi-source data.

[0050] The data backtracking management node communicates with the platform receiving node to trace the original collection source based on the returned verification identifier, thereby realizing source tracing analysis of multi-source data and abnormal data location.

[0051] Beneficial effects

[0052] This invention provides a multi-source data acquisition device and system based on an industrial internet platform. Compared with existing technologies, it has the following advantages:

[0053] 1. In this invention, the coordinated operation of the multi-source interface acquisition module and the main control processing module enables unified access and processing of different types of data sources in the industrial field. The multi-source interface acquisition module can automatically identify the communication protocol type of the access data source and calculate the adaptation priority value through the protocol adaptation unit. The protocol is converted sequentially according to the priority value to ensure that various heterogeneous protocol data are efficiently and reliably accessed by the main control processing module. At the same time, the main control processing module can receive and process data from each channel in real time, ensuring that the data has completed the initial protocol unification before entering the dynamic switching buffer module, providing a reliable foundation for subsequent dynamic priority processing and data synchronization, thereby improving the compatibility and real-time response capability of the multi-source data acquisition device.

[0054] 2. In this invention, the dynamic switching buffer module and priority determination unit enable dynamic diversion and priority processing of data from each acquisition channel. The priority determination unit comprehensively considers the variation range of the acquired data, data latency, and historical anomaly records, and dynamically adjusts the data from each channel to enter the first buffer unit or the second buffer unit. This ensures the coordinated operation of fast transmission of high-priority data and delayed processing of low-priority data. At the same time, when the data from a certain channel continuously exceeds a preset threshold, the priority determination unit can automatically trigger a dynamic scheduling signal to update the buffer allocation strategy, effectively ensuring the real-time processing capability of key data and significantly improving the stability and data processing efficiency of the multi-source data acquisition device in complex industrial sites.

[0055] 3. In this invention, the abnormal isolation module and recovery detection unit enable timely isolation and safe recovery of abnormal data from the acquisition channels. The abnormal judgment unit monitors the data of each channel in real time. When continuous excessive fluctuations or protocol parsing abnormalities occur, the branch isolation unit automatically cuts off the abnormal channel data input and sends the abnormal status information to the main control processing module and the edge parsing node. The recovery detection unit re-detects the abnormal channel according to the preset detection interval and generates a reset signal to reconstruct the channel input when the data returns to normal. At the same time, it records the recovery timestamp and the duration of the abnormality, providing a reliable basis for subsequent data comparison and abnormal analysis, thereby improving the abnormal handling capability and system reliability of the multi-source data acquisition device.

[0056] 4. In this invention, the time synchronization and transmission reliability of multi-channel data are ensured by setting a time alignment compensation module and a self-verification transmission module. The main time axis generation unit generates a unified time reference signal, and the data mapping unit and deviation correction unit map and correct the deviation of each sampling period data according to the time reference to achieve multi-channel data time synchronization. The self-verification transmission module generates a data verification identifier and performs transmission and return verification of grouped data. When data loss or error is detected, retransmission or adjustment strategies are triggered. Combined with edge parsing nodes, platform receiving nodes and data backtracking management nodes, the multi-source data acquisition system is ensured to have integrity, traceability and anomaly tracing analysis capabilities, thereby significantly improving the intelligence, reliability and security of multi-source data acquisition in the industrial internet platform. Attached Figure Description

[0057] Figure 1 This is a deployment diagram of the multi-source data acquisition device and acquisition system based on the industrial internet platform proposed in this invention;

[0058] Figure 2 This is a schematic diagram of the main control processing module of the multi-source data acquisition device and acquisition system based on the industrial internet platform proposed in this invention. Detailed Implementation

[0059] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0060] Please see Figures 1-2 The present invention provides a technical solution, specifically including the following embodiments:

[0061] Example:

[0062] Multi-source data acquisition device and system based on industrial internet platform, including main control processing module, multi-source interface acquisition module, dynamic switching buffer module, anomaly isolation module, time alignment compensation module and self-verification transmission module;

[0063] The multi-source interface acquisition module is located at the input end of the main control processing module and is electrically connected to the main control processing module. It is used to access different types of data sources in the industrial field and output the corresponding acquired data.

[0064] The dynamic switching buffer module is set between the multi-source interface acquisition module and the main control processing module. It is used to buffer the acquired data from different data sources by channel and adjust the order in which the data enters the main control processing module according to the change status of each channel.

[0065] The anomaly isolation module is connected to the main control processing module and is used to interrupt the data input of the corresponding channel when a continuous anomaly is detected in the data of a certain acquisition channel, so as to keep the other acquisition channels working continuously.

[0066] The time alignment compensation module is located inside the main control processing module. It is used to establish a unified time reference for data with different sampling periods and to correct time deviations.

[0067] The self-verification transmission module is located at the output end of the main control processing module. It is used to generate verification information for the processed data and send it to the industrial internet platform.

[0068] In this embodiment, the main control processing module coordinates the work of each sub-module to ensure that data is buffered and prioritized after being input from the multi-source interface acquisition module. At the same time, the anomaly isolation module continuously monitors the data status of each channel, automatically cuts off the input of abnormal channels and performs temporary marking. The time alignment compensation module maps data from different sampling periods to a unified time base. The self-verification transmission module generates verification information and transmits it to the industrial internet platform, realizing unified acquisition, dynamic management and reliable transmission of multi-channel data.

[0069] The multi-source interface acquisition module includes a protocol identification unit, a protocol adaptation unit, and a data access unit;

[0070] The protocol identification unit is used to identify the communication protocol type of the access data source;

[0071] The protocol adaptation unit is connected to the protocol identification unit, and calculates the adaptation priority value corresponding to each protocol based on the identification result. The calculation method for the adaptation priority value is as follows:

[0072]

[0073] in, For the first Protocol adaptation priority This refers to the frequency of data changes corresponding to this protocol per unit of time. This is the delay value from the most recent data collection. This is the number of protocol parsing exceptions within a preset period. , , These are the corresponding weighting coefficients;

[0074] The protocol adaptation unit performs protocol conversions in descending order of adaptation priority and inputs the converted data into the data access unit.

[0075] In this embodiment, the protocol identification unit analyzes the communication protocols of each access data source in real time, and the protocol adaptation unit performs protocol conversion according to the adaptation priority value. The converted data is then transmitted to the data access unit for the main control processing module to read. High priority protocol data can be processed first, and low priority data is transmitted in sequence. The adaptation priority value calculation is combined with the data change frequency, acquisition delay and number of anomalies to dynamically adjust the data processing order, so as to realize unified access and efficient processing of multi-protocol data.

[0076] The dynamic switching buffer module includes a priority determination unit, a first buffer unit, and a second buffer unit;

[0077] The priority determination unit is used to calculate the data priority based on the change range of the data collected by each acquisition channel within a unit of time, the data delay status, and historical anomaly records, and output the corresponding control signal.

[0078] The first buffer unit is used to receive data from the higher priority data channel and provides a fast transmission interface for the main control processing module to read.

[0079] The second buffer unit is used to receive data from the lower priority data channel and provides a delayed transmission interface for the main control processing module to read;

[0080] The dynamic switching buffer module is also used to dynamically adjust the data channel allocation among various cache units, enabling collaborative work between fast processing of high-priority data and delayed storage of low-priority data.

[0081] In this embodiment, the priority determination unit evaluates the data change amplitude, delay status and historical anomaly records of each channel in real time, and outputs control signals to allocate data to the first buffer unit and the second buffer unit. High-priority data is quickly transmitted for processing by the main control processing module, while low-priority data is stored with delay in the second buffer. The dynamic switching buffer module adjusts the channel allocation according to real-time data fluctuations, realizing the coordinated work of rapid response to critical data and delayed processing of low-priority data, thereby improving the overall data processing efficiency.

[0082] When determining data priority, the priority determination unit also considers the real-time data fluctuation trend and historical anomaly frequency of each acquisition channel. If the data change amplitude of a certain channel exceeds the preset threshold in multiple consecutive sampling periods, the data of that channel will be automatically adjusted to enter the first buffer unit priority, and a dynamic scheduling signal will be triggered to update the buffer allocation strategy.

[0083] In this embodiment, after considering the magnitude of data changes, real-time fluctuation trends, and historical anomaly frequencies, the priority determination unit automatically upgrades the continuous high-fluctuation channel to the priority of the first buffer unit. At the same time, it triggers a dynamic scheduling signal to adjust the buffer allocation strategy, ensuring that critical or sudden data is transmitted and processed first, avoiding abnormal data from blocking other channels, and improving the real-time performance, continuity, and system reliability of multi-source data acquisition.

[0084] The anomaly isolation module includes an anomaly detection unit, a branch isolation unit, and a recovery detection unit;

[0085] The anomaly detection unit is used to monitor the data of each acquisition channel in real time and determine the abnormal status of the data based on continuous excessive fluctuations or protocol parsing anomalies.

[0086] The branch isolation unit is used to automatically cut off the data input of the abnormal acquisition channel after the abnormal judgment signal is triggered, and to notify the main control processing module and the edge parsing node of the abnormal channel status;

[0087] The anomaly isolation module is also used to temporarily cache and mark abnormal data during isolation, so that data comparison and anomaly analysis can be performed after recovery.

[0088] In this embodiment, the anomaly detection unit monitors the data of each acquisition channel in real time and determines whether there are continuous excessive fluctuations or protocol parsing anomalies. After the anomaly detection signal is triggered, the branch isolation unit cuts off the input of the corresponding channel and notifies the main control processing module and the edge parsing node. During the isolation period, the abnormal data is temporarily cached and marked to provide a basis for subsequent recovery detection, data comparison and anomaly analysis, so as to achieve safe isolation of abnormal data and stable operation of the system.

[0089] The recovery detection unit is used to re-detect the status of the isolated collection channel according to a preset detection interval;

[0090] When the test results show that the data has returned to normal, the recovery test unit generates a reset signal to control the branch isolation unit to re-establish the data channel input, and at the same time synchronizes the recovery status to the main control processing module and the edge parsing node;

[0091] The recovery detection unit is also used to record the timestamps of the recovery process and the duration of the anomaly.

[0092] In this embodiment, the recovery detection unit performs status detection on the abnormal channel at preset time intervals and collects real-time data fluctuations. If the continuous detection results show that the data has returned to normal, a reset signal is automatically generated to control the branch isolation unit to restore the channel input. At the same time, the status is restored to the main control processing module and the edge parsing node. The recovery process timestamp and abnormal duration are recorded to provide a basis for anomaly analysis, historical tracing and source tracing, thereby realizing automatic recovery of abnormal channels and maintenance of data continuity.

[0093] The time alignment compensation module includes a main time axis generation unit, a data mapping unit, and a deviation correction unit;

[0094] The main time axis generation unit is used to generate a unified time reference signal and periodically output it to the data mapping unit and the deviation correction unit.

[0095] The data mapping unit is used to map data from different sampling periods to a unified time node generated by the main time axis, and to mark the original sampling timestamp to preserve historical data information;

[0096] The deviation correction unit is used to calculate and adjust the timestamps of each data channel based on the deviation between the actual sampling interval and the unified time node, so as to achieve time synchronization of multi-channel data.

[0097] In this embodiment, the main time axis generation unit periodically outputs a unified time reference signal for use by the data mapping unit and the deviation correction unit. The data mapping unit aligns data from different sampling periods to a unified time node and retains the original timestamp. The deviation correction unit dynamically adjusts the timestamps of each channel according to the sampling interval deviation, ensuring that multi-channel data is synchronously input into the main control processing module, realizing data time alignment and maintenance of historical data integrity, and providing accurate and analyzable time series data for the industrial internet platform.

[0098] The deviation correction unit also includes a compensation parameter storage module and a real-time correction unit;

[0099] The compensation parameter storage module is used to record the sampling delay, deviation statistics, and historical correction coefficients for each channel;

[0100] The real-time correction unit dynamically adjusts the data timestamp based on the stored compensation parameters and the current sampling data deviation, and outputs it to the main control processing module.

[0101] In this embodiment, the compensation parameter storage module records the sampling delay, deviation statistics, and historical correction coefficients of each channel, providing a reference for the real-time correction unit. The real-time correction unit dynamically adjusts the timestamp based on the current sampling data deviation and outputs it to the main control processing module to achieve time synchronization and precise alignment of multi-channel data. At the same time, historical correction records are retained during data processing to analyze and trace abnormal events or sudden data fluctuations, ensuring data reliability and traceability.

[0102] The self-verification transmission module includes a check code generation unit, a data packetization unit, and a return verification unit;

[0103] The verification code generation unit is used to generate a unique verification identifier based on the collected data and its timestamp;

[0104] The data grouping unit is used to group the collected data according to a preset length or data type. The grouped data is then sent to the industrial internet platform or edge parsing node through the transmission interface.

[0105] The backhaul verification unit is used to receive the verification results returned by the industrial internet platform, and to trigger data retransmission or adjust the grouping strategy when data loss or error is detected, while feeding back the retransmission information to the main control processing module.

[0106] In this embodiment, the verification code generation unit generates a unique verification identifier based on the collected data and its timestamp. The data grouping unit groups the collected data by length or type and sends it through the transmission interface. The feedback verification unit receives the verification result returned by the platform. If data loss or abnormality is found, it immediately triggers retransmission or adjusts the grouping strategy and feeds back the retransmission information to the main control processing module. This realizes the self-verification and dynamic error correction function of data transmission, improves data integrity and reliability, and ensures that the data obtained by the industrial internet platform is accurate, continuous and traceable.

[0107] A multi-source data acquisition system based on an industrial internet platform includes edge parsing nodes, platform receiving nodes, and data backtracking management nodes;

[0108] The edge resolution node is connected to the multi-source data acquisition device to receive the acquired data and perform data classification and parsing, protocol verification, anomaly marking, and real-time cache management.

[0109] The edge resolution node is also used to generate an isolation signal when abnormal data is detected, instructing the abnormal isolation module of the multi-source data acquisition device to cut off the corresponding channel, while the abnormal data is delayed and marked and stored in the buffer area.

[0110] The platform receives data from nodes and connects with edge parsing nodes to receive classified and parsed data, establish data mapping relationships between different data sources, and complete data storage, historical record management, and data traceability identification generation.

[0111] The platform receiving node is also used to monitor the data transmission reliability of the edge parsing node based on the back-transmission verification results, and to issue synchronization or retransmission instructions when necessary to ensure the integrity and consistency of multi-source data.

[0112] The data backtracking management node communicates with the platform receiving node to trace the original collection source based on the returned verification identifier, thereby enabling source tracing analysis of multi-source data and location of abnormal data.

[0113] In this embodiment, the edge parsing node receives the collected data sent by the multi-source data acquisition device in real time, performs data classification and parsing, protocol verification, anomaly marking, and cache management. When anomaly data is detected, an isolation signal is generated to notify the acquisition device to disconnect the corresponding channel, and the delay mark is stored in the buffer. The platform receiving node receives the classified and parsed data, establishes a data mapping relationship for storage and historical management, and monitors the reliability of data transmission based on the back-transmission verification results. When necessary, it issues synchronization or retransmission commands. The data backtracking management node uses the verification mark to trace the original acquisition source, realizing anomaly data location, source tracing analysis, and data integrity assurance, thereby improving the reliability and traceability of the multi-source data acquisition system.

[0114] Working Principle: This multi-source data acquisition device uses the main control processing module as its core control unit. Through collaborative work with the multi-source interface acquisition module, dynamic switching buffer module, anomaly isolation module, time alignment compensation module, and self-verification transmission module, it achieves efficient acquisition, reliable transmission, and data integrity assurance of various data sources in the industrial field. The multi-source interface acquisition module is located at the input end of the main control processing module. It is used to connect to different types of sensors, controllers, and other data sources in the industrial field and outputs the acquired data to the main control processing module. During the data access process, the protocol identification unit identifies the communication protocol of the connected data source in real time. The protocol adaptation unit calculates the adaptation priority value of each protocol based on the identification result. The priority value is generated by weighting data change frequency, acquisition delay, and the number of protocol parsing anomalies. Protocol conversion is performed according to the priority value from high to low, and the converted data is input into the data access unit, realizing unified access to heterogeneous data source protocols.

[0115] Before being transmitted to the main control processing module, the incoming data undergoes processing by a dynamic switching buffer module. This module uses a priority determination unit to comprehensively calculate the unit-time data change amplitude, data latency, and historical anomaly records of each acquisition channel, generating a control signal to dynamically allocate data channels to the first and second buffer units. Higher-priority data enters the first buffer unit for fast reading and real-time processing, while lower-priority data enters the second buffer unit for delayed processing. The priority determination unit also dynamically adjusts channel priorities based on real-time data fluctuation trends and historical anomaly frequency, triggering buffer allocation strategy update signals to ensure the real-time performance and processing efficiency of critical data.

[0116] During data acquisition, the anomaly isolation module continuously monitors data from each channel. The anomaly detection unit identifies continuous excessive fluctuations or protocol parsing anomalies, and the branch isolation unit automatically cuts off data input to the abnormal channel, simultaneously sending anomaly status information to the main control processing module and edge parsing nodes. During isolation, abnormal data is temporarily cached and marked for subsequent recovery detection and data comparison. The recovery detection unit re-detects the status of the abnormal channel according to a preset detection interval. When the data returns to normal, a reset signal is generated to control the branch isolation unit to re-establish the data channel input and synchronously restore the status to the main control processing module and edge parsing nodes. The recovery timestamp and anomaly duration are also recorded for data traceability analysis.

[0117] The time alignment compensation module is responsible for mapping data from different sampling periods to a unified time reference. The main time axis generation unit periodically generates a unified time reference signal, the data mapping unit maps data from each sampling period to a unified time node and marks the original sampling timestamp, and the deviation correction unit adjusts the timestamp according to the deviation between the actual sampling interval and the unified time node to ensure time synchronization of multi-channel data. It also dynamically corrects historical deviations through the compensation parameter storage module and the real-time correction unit to improve data synchronization accuracy.

[0118] After time alignment and anomaly handling, the data undergoes integrity verification by the self-verification transmission module. The checksum generation unit generates a unique verification identifier based on the collected data and timestamp. The data grouping unit groups the data according to length or type and sends it to the industrial internet platform or edge parsing node via the transmission interface. The feedback verification unit receives the verification results returned by the platform. If data loss or errors are detected, it triggers retransmission or adjusts the grouping strategy, and feeds back the retransmission information to the main control processing module to ensure data integrity and reliability.

[0119] At the system level, edge parsing nodes receive and classify collected data, perform protocol verification, anomaly marking, and real-time cache management. Upon detecting abnormal data, they generate isolation signals to notify multi-source data acquisition devices to disconnect the corresponding channels and store the anomaly data in a buffer area after delaying its marking. Platform receiving nodes receive the processed data from edge nodes, establish data mapping relationships between different data sources, and complete data storage, historical record management, and traceability identifier generation. Simultaneously, they monitor the reliability of edge node data transmission based on the feedback verification results and issue synchronization or retransmission commands when necessary, ensuring the integrity and consistency of multi-source data. Data backtracking management nodes trace the original collection source through feedback verification identifiers, enabling data source tracing analysis and anomaly location.

[0120] Through the collaborative work of the above modules, this invention realizes heterogeneous access to multi-source data, dynamic priority processing, anomaly isolation, time synchronization, and self-verification transmission, ensuring the real-time performance, integrity, and reliability of the collected data in the industrial internet environment, and significantly improving the intelligence level and security of the multi-source data acquisition system.

[0121] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A multi-source data acquisition device based on an industrial internet platform, characterized in that: It includes a main control processing module, a multi-source interface acquisition module, a dynamic switching buffer module, an anomaly isolation module, a time alignment compensation module, and a self-verification transmission module; The multi-source interface acquisition module is located at the input end of the main control processing module and is electrically connected to the main control processing module. It is used to access different types of data sources in the industrial field and output corresponding acquired data. The dynamic switching buffer module is located between the multi-source interface acquisition module and the main control processing module. It is used to cache the acquired data from different data sources in different channels and adjust the order in which the data enters the main control processing module according to the change status of each channel. The anomaly isolation module is connected to the main control processing module and is used to interrupt the data input of the corresponding channel when a continuous anomaly is detected in the data of a certain acquisition channel, so as to keep the other acquisition channels working continuously. The time alignment compensation module is located inside the main control processing module and is used to establish a unified time reference for data with different sampling periods and to correct time deviations. The self-verification transmission module is located at the output end of the main control processing module and is used to generate verification information for the processed data and send it to the industrial internet platform.

2. The multi-source data acquisition device based on an industrial internet platform according to claim 1, characterized in that: The multi-source interface acquisition module includes a protocol identification unit, a protocol adaptation unit, and a data access unit. The protocol identification unit is used to identify the communication protocol type of the access data source; The protocol adaptation unit is connected to the protocol identification unit, and calculates the adaptation priority value corresponding to each protocol based on the identification result. The calculation method for the adaptation priority value is as follows: in, For the first Protocol adaptation priority This refers to the frequency of data changes corresponding to this protocol per unit of time. This is the delay value from the most recent data collection. This is the number of protocol parsing exceptions within a preset period. , , These are the corresponding weighting coefficients; The protocol adaptation unit performs protocol conversions sequentially from high to low according to the adaptation priority value, and inputs the converted data to the data access unit.

3. The multi-source data acquisition device based on an industrial internet platform according to claim 2, characterized in that: The dynamic switching buffer module includes a priority determination unit, a first cache unit, and a second cache unit; The priority determination unit is used to: comprehensively calculate the data priority based on the change range of the data collected by each acquisition channel within a unit time, the data delay status, and historical abnormal records, and output the corresponding control signal; The first buffer unit is used to receive data from higher priority data channels and provides a fast transmission interface for the main control processing module to read; The second buffer unit is used to receive data from lower priority data channels and provides a delayed transmission interface for the main control processing module to read; The dynamic switching buffer module is also used to dynamically adjust the data channel allocation among each cache unit, so as to achieve the coordinated operation of fast processing of high-priority data and delayed storage of low-priority data.

4. The multi-source data acquisition device based on an industrial internet platform according to claim 3, characterized in that: When determining data priority, the priority determination unit also considers the real-time data fluctuation trend and historical anomaly frequency of each acquisition channel. If the data change amplitude of a certain channel is higher than the preset threshold in multiple consecutive sampling periods, the data of that channel will be automatically adjusted to enter the first buffer unit priority, and a dynamic scheduling signal will be triggered to update the buffer allocation strategy.

5. The multi-source data acquisition device based on an industrial internet platform according to claim 2, characterized in that: The anomaly isolation module includes an anomaly detection unit, a branch isolation unit, and a recovery detection unit; The anomaly detection unit is used to monitor the data of each acquisition channel in real time and determine the abnormal status of the data based on continuous excessive fluctuations or protocol parsing anomalies. The branch isolation unit is used to automatically cut off the data input of the abnormal acquisition channel after the abnormal judgment signal is triggered, and to notify the main control processing module and the edge parsing node of the abnormal channel status. The anomaly isolation module is also used to temporarily cache and mark abnormal data during the isolation period so that data comparison and anomaly analysis can be performed after recovery.

6. The multi-source data acquisition device based on an industrial internet platform according to claim 5, characterized in that: The recovery detection unit is used to re-detect the status of the isolated acquisition channel according to a preset detection interval; When the test results show that the data has returned to normal, the recovery test unit generates a reset signal to control the branch isolation unit to re-establish the data channel input, and at the same time synchronizes the recovery status to the main control processing module and the edge parsing node; The recovery detection unit is also used to record the timestamp of the recovery process and the duration of the anomaly.

7. The multi-source data acquisition device based on an industrial internet platform according to claim 1, characterized in that: The time alignment compensation module includes a main time axis generation unit, a data mapping unit, and a deviation correction unit. The main time axis generation unit is used to generate a unified time reference signal and periodically output it to the data mapping unit and the deviation correction unit. The data mapping unit is used to map data from different sampling periods to a unified time node generated by the main time axis, and to mark the original sampling timestamp to retain historical data information; The deviation correction unit is used to calculate and adjust the timestamps of each data channel based on the deviation between the actual sampling interval and the unified time node, so as to achieve time synchronization of multi-channel data.

8. The multi-source data acquisition device based on an industrial internet platform according to claim 1, characterized in that: The deviation correction unit also includes a compensation parameter storage module and a real-time correction unit; The compensation parameter storage module is used to record the sampling delay, deviation statistics, and historical correction coefficients for each channel; The real-time correction unit dynamically adjusts the data timestamp based on the stored compensation parameters and the current sampling data deviation, and outputs it to the main control processing module.

9. The multi-source data acquisition device based on an industrial internet platform according to claim 1, characterized in that: The self-verification transmission module includes a verification code generation unit, a data packetization unit, and a return verification unit. The verification code generation unit is used to generate a unique verification identifier based on the collected data and its timestamp. The data grouping unit is used to group the collected data according to a preset length or data type, and the grouped data is sent to the industrial internet platform or edge parsing node through the transmission interface. The backhaul verification unit is used to receive the verification results returned by the industrial internet platform, and to trigger data retransmission or adjust the grouping strategy when data loss or error is detected, while feeding back the retransmission information to the main control processing module.

10. A multi-source data acquisition system based on an industrial internet platform, characterized in that: The multi-source data acquisition device described in any one of claims 1-9 includes an edge parsing node, a platform receiving node, and a data backtracking management node; The edge parsing node is communicatively connected to the multi-source data acquisition device, and is used to receive the acquired data and perform data classification and parsing, protocol verification, anomaly marking, and real-time cache management. The edge parsing node is also used to generate an isolation signal when abnormal data is detected, instructing the abnormal isolation module of the multi-source data acquisition device to cut off the corresponding channel, while the abnormal data is delayed and marked and stored in the buffer area. The platform receiving node is communicatively connected to the edge parsing node to receive classified and parsed data, establish data mapping relationships between different data sources, and complete data storage, historical record management, and data traceability identification generation. The platform receiving node is also used to monitor the data transmission reliability of the edge parsing node based on the back-transmission verification results, and to issue synchronization or retransmission instructions when necessary to ensure the integrity and consistency of multi-source data. The data backtracking management node communicates with the platform receiving node to trace the original collection source based on the returned verification identifier, thereby realizing source tracing analysis of multi-source data and abnormal data location.

Images