Data processing system and method based on multi-channel interaction

Abstract

The invention relates to the technical field of computers, and discloses a data processing system based on multichannel interaction, which comprises a data acquisition module, a data storage module, an arbitration module, a data transmission module and a control module, and is characterized in that the data acquisition module is used for acquiring data from a plurality of data sources in parallel; the data storage module is used for independently sorting and caching the data acquired from the corresponding input channel; the arbitration module is used for sorting the data stored in the data storage module; the data transmission module is used for calling data and transmitting the data to the data processing terminal; and the control module is used for receiving a control instruction from the data processing terminal and starting data acquisition, adjusting an arbitration strategy or controlling a data transmission process according to the instruction. According to the invention, through a parallel acquisition mechanism of the data acquisition module, simultaneous access of multiple data sources is realized, and resource waste caused by independent processing of each channel in a traditional method is effectively avoided.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data processing system and method based on multi-channel interaction. Background Art

[0002] In the field of data processing, multi-channel data acquisition technology has been widely used in various scenarios, such as human factors engineering, sensor networks, medical imaging systems, financial trading systems, etc. By collecting data from multiple data sources or sensors at the same time, this technology can capture more comprehensive and detailed information, providing a solid foundation for subsequent data analysis and processing.

[0003] However, when processing multi-channel data, traditional methods often adopt the method of independently processing each channel, lacking an effective resource integration and optimization mechanism, which leads to inefficient utilization of system resources and difficulty in fully leveraging the advantages of multi-channel data; and when processing data synchronization, existing multi-channel data processing systems are often limited by the complexity of transmission paths and the uncontrollability of environmental conditions, resulting in difficulty in ensuring synchronization accuracy, which not only affects the real-time and accuracy of data, but may also cause error accumulation in subsequent processing. Based on this, the present invention designs a data processing system and method based on multi-channel interaction to solve the above problems. Summary of the invention

[0004] The purpose of the present invention is to provide a data processing system and method based on multi-channel interaction, which solves the problems of low efficiency and low precision in the background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0006] A data processing system based on multi-channel interaction includes a data acquisition module, a data storage module, an arbitration module, a data transmission module and a control module.

[0007] The data acquisition module is used to acquire data from multiple data sources in parallel, and each data source is connected to the data acquisition module through an independent input channel;

[0008] The data storage module includes a plurality of cache units for independently sorting and caching data obtained from corresponding input channels;

[0009] The arbitration module is used to sort the data stored in the data storage module according to a preset arbitration strategy and determine the transmission priority of the data;

[0010] The data transmission module includes a plurality of output channels, which are used to retrieve data from the data storage module under the instruction of the arbitration module, and transmit the data to the data processing terminal through the corresponding output channels;

[0011] The control module is used to receive control instructions from the data processing terminal, and start data acquisition, adjust arbitration strategy or control data transmission process according to the instructions.

[0012] Preferably, the data acquisition module includes the following units:

[0013] Input interface unit: used to receive raw data from different data sources;

[0014] Preprocessing unit: performs preliminary cleaning and formatting on the received raw data to adapt to the internal processing requirements of the system.

[0015] The data acquisition module is the entrance of the system and is responsible for receiving data from multiple data sources in parallel. The module includes an input interface unit and a preprocessing unit. The input interface unit is responsible for receiving raw data from different data sources, which may include sensors, databases, network interfaces, etc. Each data source is connected to the data acquisition module through an independent input channel to ensure parallel data acquisition. The preprocessing unit performs preliminary cleaning and formatting on the received raw data to remove noise, correct erroneous data, and convert it into the format required for internal processing of the system. This step is crucial to improving the efficiency of subsequent data processing.

[0016] Preferably, in the data storage module, each cache unit corresponds to an input channel.

[0017] Preferably, the data storage module includes the following units:

[0018] Public memory unit: used to store data sorted by the arbitration module for use by the data transmission module;

[0019] Status monitoring unit: real-time monitoring of the data storage status of each cache unit and public memory unit, including storage capacity, data reading and writing speed and other parameters.

[0020] The data storage module is the data buffer of the system, including multiple cache units and public memory units, as well as a status monitoring unit. In the cache unit, each cache unit corresponds to an input channel, and the data obtained from the channel is independently sorted and cached. This design avoids mutual interference between data and improves the parallelism of data processing. The public memory unit is used to store data sorted by the arbitration module for the data transmission module to call. The design of the public memory unit ensures the unified management and optimization of data before transmission. The status monitoring unit can monitor the data storage status of each cache unit and public memory unit in real time, including parameters such as storage capacity and data reading and writing speed, providing an important basis for system optimization and troubleshooting.

[0021] Preferably, the arbitration module adopts one or a combination of the following arbitration strategies:

[0022] Priority arbitration: Set the priority according to the importance or urgency of the data, and transmit high-priority data first;

[0023] Polling arbitration: retrieve data from each cache unit in turn according to the preset loop order;

[0024] Hybrid arbitration: combines the characteristics of priority arbitration and polling arbitration to flexibly adjust the data transmission order.

[0025] The arbitration module is the decision-making core of the system. It is responsible for sorting the data stored in the data storage module according to the preset arbitration strategy and determining the data transmission priority. The arbitration strategy includes priority arbitration, polling arbitration and mixed arbitration. Priority arbitration sets the priority according to the importance or urgency of the data, and transmits high-priority data first. This strategy is suitable for processing time-sensitive or critical data. Polling arbitration can retrieve data from each cache unit in turn according to the preset loop order. This strategy ensures the fairness and balance of the data. Polling arbitration retrieves data from each cache unit in turn according to the preset loop order. This strategy ensures the fairness and balance of the data.

[0026] Preferably, the data transmission module includes the following units:

[0027] Data encapsulation unit: encapsulates the data retrieved from the public memory unit to adapt to the data format requirements of different output channels;

[0028] Error detection and recovery unit: During data transmission, error detection is performed on the transmitted data and a data recovery mechanism is initiated when an error is found.

[0029] The data transmission module is the output end of the system. It is responsible for transmitting the data sorted by the arbitration module to the data processing terminal through the corresponding output channel. The module includes a data encapsulation unit and an error detection and recovery unit. The data encapsulation unit encapsulates the data retrieved from the public memory unit to adapt to the data format requirements of different output channels. The encapsulation process may include data compression, encryption, adding checksums and other operations to ensure the reliability and security of data transmission. The error detection and recovery unit performs error detection on the transmitted data during the data transmission process. Once an error is found, the data recovery mechanism is immediately activated, such as retransmission, error correction, etc., to ensure the integrity and accuracy of the data.

[0030] Preferably, a method for data processing based on multi-channel interaction is provided, comprising the following steps:

[0031] Step S1: acquiring data from different data sources in parallel through multiple input channels;

[0032] Step S2: independently sort and cache the data obtained from each input channel;

[0033] Step S3: sorting the data stored in the data storage module according to a preset arbitration strategy and determining the data transmission priority;

[0034] Step S4: under the instruction of the arbitration module, retrieve data from the data storage module and transmit it to the data processing terminal through the corresponding output channel;

[0035] Step S5: receiving control instructions from the data processing terminal, and adjusting data acquisition, arbitration strategy or transmission process according to the instructions.

[0036] Preferably, in step S2, the received raw data is preliminarily cleaned and formatted to adapt to the internal processing requirements of the system.

[0037] Preferably, in step S3, the arbitration strategy includes priority arbitration, round-robin arbitration or mixed arbitration.

[0038] Preferably, in step S4, the data retrieved from the public memory unit is encapsulated to adapt to the data format requirements of different output channels; error detection is performed during data transmission, and a data recovery mechanism is started when an error is found.

[0039] During data acquisition, data from different data sources are acquired in parallel through multiple input channels, followed by data preprocessing, and preliminary cleaning and formatting of the received raw data. During data storage, the preprocessed data is stored in the corresponding cache unit for independent sorting and caching. During data arbitration, the data stored in the data storage module is sorted according to the preset arbitration strategy, and the data transmission priority is determined. During data transmission, under the instruction of the arbitration module, data is retrieved from the data storage module and transmitted to the data processing terminal through the corresponding output channel. At the same time, the data is encapsulated and error detection and recovery are performed. During control adjustment, control instructions from the data processing terminal are received, and data acquisition, arbitration strategy or transmission process are adjusted according to the instructions.

[0040] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0041] 1. The present invention realizes the simultaneous access of multiple data sources through the parallel acquisition mechanism of the data acquisition module, effectively avoiding the waste of resources caused by the independent processing of each channel in the traditional method. At the same time, the independent cache unit in the data storage module is combined with the public memory unit, which not only ensures the independent processing and caching of data, but also realizes the unified scheduling of data through the arbitration module, so that system resources are more reasonably allocated and utilized, thereby significantly improving the overall processing efficiency.

[0042] 2. In the present invention, the arbitration module adopts a flexible arbitration strategy (including priority arbitration, polling arbitration and hybrid arbitration), which can dynamically adjust the data transmission order according to actual needs, effectively respond to the challenges brought by the uncontrollable nature of complex transmission paths and environmental conditions, and ensure the synchronization accuracy of the data; the error detection and recovery unit in the data transmission module performs real-time error detection during the data transmission process, and immediately starts the recovery mechanism when an error is found, further ensuring the real-time and accuracy of the data and reducing the possibility of error accumulation.

[0043] 3. In the present invention, the status monitoring unit monitors the data storage status of each cache unit and the public memory unit in real time, providing the system administrator with rich monitoring information, which helps to timely discover and deal with potential system failures or performance bottlenecks; the introduction of error detection and recovery mechanism further enhances the fault tolerance of the system during data transmission, and ensures the integrity and reliability of data even in the face of adverse conditions such as network fluctuations and hardware failures.

[0044] 4. The modular design of the system architecture of the present invention makes each module relatively independent and easy to expand. Both the data acquisition module and the data transmission module support multi-channel access, which can easily cope with the data source or processing requirements that may be increased in the future. By introducing an arbitration module to uniformly sort and prioritize multi-channel data, the complex data synchronization and coordination process in the traditional method is simplified, and the complexity and maintenance cost of system implementation are reduced. The existence of the data preprocessing unit enables the original data to be preliminarily cleaned and formatted before entering the system, providing more standardized and consistent data input for subsequent processing steps, which helps to improve the efficiency and stability of the entire data processing flow. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 A diagram of a data processing system of the present invention;

[0046] Figure 2 It is a diagram showing the system and its branch units of the present invention;

[0047] Figure 3 The data processing method of the present invention is a flowchart. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] Embodiment 1;

[0050] See also Figure 1-Figure 2 In an embodiment of the present invention, a data processing system based on multi-channel interaction includes a data acquisition module, a data storage module, an arbitration module, a data transmission module and a control module.

[0051] The data acquisition module is used to acquire data from multiple data sources in parallel, and each data source is connected to the data acquisition module through an independent input channel;

[0052] The data storage module includes a plurality of cache units for independently sorting and caching data obtained from corresponding input channels;

[0053] The arbitration module is used to sort the data stored in the data storage module according to a preset arbitration strategy and determine the transmission priority of the data;

[0054] The data transmission module includes a plurality of output channels, which are used to retrieve data from the data storage module under the instruction of the arbitration module and transmit the data to the data processing terminal through the corresponding output channels;

[0055] The control module is used to receive control instructions from the data processing terminal and start data acquisition, adjust arbitration strategy or control data transmission process according to the instructions.

[0056] The data acquisition module includes the following units,

[0057] Input interface unit: used to receive raw data from different data sources;

[0058] Preprocessing unit: performs preliminary cleaning and formatting on the received raw data to adapt to the internal processing requirements of the system.

[0059] In the data storage module, each cache unit corresponds to an input channel.

[0060] The data storage module includes the following units:

[0061] Public memory unit: used to store data sorted by the arbitration module for use by the data transmission module;

[0062] Status monitoring unit: real-time monitoring of the data storage status of each cache unit and public memory unit, including storage capacity, data reading and writing speed and other parameters.

[0063] The working principle of the embodiment of the present invention is as follows: the data acquisition module is the entrance of the system, responsible for receiving data from multiple data sources in parallel, and the module includes an input interface unit and a preprocessing unit. The input interface unit is responsible for receiving raw data from different data sources, which may include sensors, databases, network interfaces, etc. Each data source is connected to the data acquisition module through an independent input channel to ensure parallel acquisition of data. The preprocessing unit performs preliminary cleaning and formatting on the received raw data, removes noise, corrects erroneous data, and converts it into the format required for internal processing of the system. This step is crucial to improving the efficiency of subsequent data processing.

[0064] The data storage module is the data buffer of the system, including multiple cache units and public memory units, as well as a status monitoring unit. In the cache unit, each cache unit corresponds to an input channel, and the data obtained from the channel is independently sorted and cached. This design avoids mutual interference between data and improves the parallelism of data processing. The public memory unit is used to store data sorted by the arbitration module for the data transmission module to call. The design of the public memory unit ensures the unified management and optimization of data before transmission. The status monitoring unit can monitor the data storage status of each cache unit and public memory unit in real time, including parameters such as storage capacity and data reading and writing speed, providing an important basis for system optimization and troubleshooting.

[0065] Embodiment 2;

[0066] See also Figure 1-Figure 2 ,The arbitration module adopts one or a combination of the following arbitration strategies,

[0067] Priority arbitration: Set the priority according to the importance or urgency of the data, and transmit high-priority data first;

[0068] Polling arbitration: retrieve data from each cache unit in turn according to the preset loop order;

[0069] Hybrid arbitration: combines the characteristics of priority arbitration and polling arbitration to flexibly adjust the data transmission order.

[0070] The data transmission module includes the following units:

[0071] Data encapsulation unit: encapsulates the data retrieved from the public memory unit to adapt to the data format requirements of different output channels;

[0072] Error detection and recovery unit: During data transmission, error detection is performed on the transmitted data and a data recovery mechanism is initiated when an error is found.

[0073] The working principle of the embodiment of the present invention is as follows: the arbitration module is the decision-making core of the system, which is responsible for sorting the data stored in the data storage module according to the preset arbitration strategy and determining the transmission priority of the data. The arbitration strategy includes priority arbitration, polling arbitration and mixed arbitration. Priority arbitration sets the priority according to the importance or urgency of the data, and transmits high-priority data first. This strategy is suitable for processing time-sensitive or critical data. Polling arbitration can retrieve data from each cache unit in turn according to a preset loop order. This strategy ensures the fairness and balance of the data. Polling arbitration retrieves data from each cache unit in turn according to a preset loop order. This strategy ensures the fairness and balance of the data.

[0074] The data transmission module is the output end of the system. It is responsible for transmitting the data sorted by the arbitration module to the data processing terminal through the corresponding output channel. The module includes a data encapsulation unit and an error detection and recovery unit. The data encapsulation unit encapsulates the data retrieved from the public memory unit to adapt to the data format requirements of different output channels. The encapsulation process may include data compression, encryption, adding checksums and other operations to ensure the reliability and security of data transmission. The error detection and recovery unit performs error detection on the transmitted data during the data transmission process. Once an error is found, the data recovery mechanism is immediately activated, such as retransmission, error correction, etc., to ensure the integrity and accuracy of the data.

[0075] The control module is the command center of the system, responsible for receiving control instructions from the data processing terminal, and starting data acquisition, adjusting arbitration strategies or controlling data transmission processes according to the instructions. Through the flexible scheduling and optimization of the control module, the adaptive and intelligent management of the system is achieved.

[0076] Embodiment 3;

[0077] See also Figure 3 In an embodiment of the present invention, a data processing system based on multi-channel interaction needs to provide a data processing method based on multi-channel interaction, including the following steps:

[0078] Step S1: acquiring data from different data sources in parallel through multiple input channels;

[0079] Step S2: independently sort and cache the data obtained from each input channel;

[0080] Step S3: sorting the data stored in the data storage module according to a preset arbitration strategy and determining the data transmission priority;

[0081] Step S4: under the instruction of the arbitration module, retrieve data from the data storage module and transmit it to the data processing terminal through the corresponding output channel;

[0082] Step S5: receiving control instructions from the data processing terminal, and adjusting data acquisition, arbitration strategy or transmission process according to the instructions.

[0083] In step S2, the received raw data is preliminarily cleaned and formatted to adapt to the internal processing requirements of the system.

[0084] In step S3, the arbitration strategy includes priority arbitration, round-robin arbitration or mixed arbitration.

[0085] In step S4, the data retrieved from the public memory unit is encapsulated to adapt to the data format requirements of different output channels; error detection is performed during the data transmission process, and a data recovery mechanism is started when an error is found.

[0086] The working principle of the embodiment of the present invention is: during data acquisition, data from different data sources are acquired in parallel through multiple input channels, followed by data preprocessing, and preliminary cleaning and formatting of the received raw data. In data storage, the preprocessed data is stored in the corresponding cache unit for independent sorting and caching. In data arbitration, the data stored in the data storage module is sorted according to the preset arbitration strategy, and the data transmission priority is determined. In data transmission, under the instruction of the arbitration module, data is retrieved from the data storage module and transmitted to the data processing terminal through the corresponding output channel. At the same time, the data is encapsulated and error detected and recovered. In control adjustment, control instructions from the data processing terminal are received, and data acquisition, arbitration strategy or transmission process are adjusted according to the instructions.

[0087] Working principle: The data processing system based on multi-channel interaction acquires data from multiple data sources in parallel, sorts and caches them using independent cache units, and then determines the priority of data transmission according to preset strategies (such as priority, polling or mixed arbitration) through the arbitration module. The system includes data acquisition, storage, arbitration, transmission and control modules, and each module works together to ensure efficient and flexible data processing flow. The system can adjust the data processing strategy in real time to meet the needs of different data processing terminals, and the built-in error detection and recovery mechanism enhances the reliability of data transmission. Through the parallel acquisition mechanism of the data acquisition module, simultaneous access to multiple data sources is achieved, effectively avoiding the waste of resources caused by the independent processing of each channel in the traditional method. At the same time, the independent cache unit in the data storage module is combined with the public memory unit, which not only ensures the independent processing and caching of data, but also realizes the unified scheduling of data through the arbitration module, so that system resources are more reasonably allocated and utilized.

[0088] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit thereof, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A data processing system based on multi-channel interaction, comprising a data acquisition module, a data storage module, an arbitration module, a data transmission module and a control module, Features: The data acquisition module is used to acquire data from multiple data sources in parallel, and each data source is connected to the data acquisition module through an independent input channel; The data storage module includes a plurality of cache units for independently sorting and caching data obtained from corresponding input channels; The arbitration module is used to sort the data stored in the data storage module according to a preset arbitration strategy and determine the transmission priority of the data; The data transmission module includes a plurality of output channels, which are used to retrieve data from the data storage module under the instruction of the arbitration module, and transmit the data to the data processing terminal through the corresponding output channels; The control module is used to receive control instructions from the data processing terminal, and start data acquisition, adjust arbitration strategy or control data transmission process according to the instructions.

2. A data processing system based on multi-channel interaction according to claim 1, Features: The data acquisition module includes the following units: Input interface unit: used to receive raw data from different data sources; Preprocessing unit: performs preliminary cleaning and formatting on the received raw data to adapt to the internal processing requirements of the system.

3. A data processing system based on multi-channel interaction according to claim 1, Features: In the data storage module, each cache unit corresponds to an input channel.

4. A data processing system based on multi-channel interaction according to claim 1, Features: The data storage module includes the following units: Public memory unit: used to store data sorted by the arbitration module for use by the data transmission module; Status monitoring unit: real-time monitoring of the data storage status of each cache unit and public memory unit, including storage capacity, data reading and writing speed and other parameters.

5. A data processing system based on multi-channel interaction according to claim 1, Features: The arbitration module adopts one or a combination of the following arbitration strategies: Priority arbitration: Set the priority according to the importance or urgency of the data, and transmit high-priority data first; Polling arbitration: retrieve data from each cache unit in turn according to the preset loop order; Hybrid arbitration: combines the characteristics of priority arbitration and polling arbitration to flexibly adjust the data transmission order.

6. A data processing system based on multi-channel interaction according to claim 1, Features: The data transmission module includes the following units: Data encapsulation unit: encapsulates the data retrieved from the public memory unit to adapt to the data format requirements of different output channels; Error detection and recovery unit: During data transmission, error detection is performed on the transmitted data and a data recovery mechanism is initiated when an error is found.

7. According to the data processing system based on multi-channel interaction described in claim 1, it is necessary to provide a data processing method based on multi-channel interaction. Features: The following steps are included: Step S1: acquiring data from different data sources in parallel through multiple input channels; Step S2: independently sort and cache the data obtained from each input channel; Step S3: sorting the data stored in the data storage module according to a preset arbitration strategy and determining the data transmission priority; Step S4: under the instruction of the arbitration module, retrieve data from the data storage module and transmit it to the data processing terminal through the corresponding output channel; Step S5: receiving control instructions from the data processing terminal, and adjusting data acquisition, arbitration strategy or transmission process according to the instructions.

8. A method for data processing based on multi-channel interaction according to claim 7, Features: In step S2, the received raw data is preliminarily cleaned and formatted to meet the internal processing requirements of the system.

9. The method for data processing based on multi-channel interaction according to claim 7, Features: In step S3, the arbitration strategy includes priority arbitration, round-robin arbitration or mixed arbitration.

10. The method for data processing based on multi-channel interaction according to claim 7, Features: In the step S4, the data retrieved from the public memory unit is packaged to adapt to the data format requirements of different output channels; Error detection is performed during data transmission and data recovery mechanisms are initiated when errors are found.

Images