Data processing system based on Internet of Things
By designing a data processing system based on the Internet of Things, using technologies such as finite state machines and data processing modules, the problem of increasing satellite-ground channel load in satellite and ground Internet of Things communication is solved, and efficient and stable data transmission and analysis are achieved, improving the Data bandwidth utilization.
Patent Information
- Application Number
- CN202410995438.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2024-12-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
With the acceleration of intelligent process, satellites and ground-based Internet of Things communication is frequent, resulting in increased load on the satellite-ground channel link and frequent transmission and operation failures. It is necessary to design a data processing system for intelligent management control and efficient analysis and processing.
Design a data processing system based on the Internet of Things, analyze Ethernet data frames through a finite state machine, optimize data transmission protocol, simulate data information and frame analysis management, and collect and transmit data transmission processing information, including data processing module , management analysis module and acquisition and transmission module to realize data bit width conversion, cross-clock domain processing and protocol optimization.
It effectively improves the extraction and reception of payload data, improves the efficiency and stability of payload data transmission, reduces transmission logic design and resource consumption, reduces channel redundancy, and improves data bandwidth utilization.
Smart Images

Figure CN119094543A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data processing, and in particular to a data processing system based on the Internet of Things. Background Art
[0002] With the continuous maturity of 5G communication network technology and the advancement and deployment of low-orbit satellite constellations, the trend of integration between satellite communication networks and ground communication networks is becoming increasingly obvious. The ground 5G communication network opens the curtain of the Internet of Everything with its advantages of large bandwidth, low latency and flexible networking. Compared with the ground communication network, satellite communication provides high-quality communication services to global users with its advantages of full coverage, fast speed, convenient networking and no influence from terrain. The satellite Internet of Things composed of ground communication technology and low-orbit satellite constellations will become an important way to realize the Internet of Everything. However, with the acceleration of the intelligent process, the communication between satellites and ground Internet of Things is becoming more and more frequent, and the amount of satellite link payload data is also increasing, which seriously increases the load of the satellite-to-ground channel link and easily leads to transmission operation failures. Therefore, it is necessary to design a data processing system based on the Internet of Things for intelligent management control and efficient analysis and processing. Summary of the invention
[0003] The purpose of the present invention is to provide a data processing system based on the Internet of Things to solve the problems raised in the above background technology.
[0004] In order to solve the above technical problems, the present invention provides the following technical solutions: a data processing method based on the Internet of Things, comprising: Manage and control the reception and transmission of payload data; Optimize transmission management of data transmission protocols; Conduct data information simulation and data frame analysis and management; Collect and transmit data transmission processing information.
[0005] According to the above technical solution, the management and control of receiving and sending the payload data includes: The Ethernet data frame is parsed through the finite state machine, and the data information is processed by FIFO receiving buffer; Through the inverse design of Ethernet receiving processing, the destination MAC address, payload data length and payload data FIFO signal of the previous stage transmission are uploaded, and the data is framed and sent to the internal sending interface through the finite state machine.
[0006] According to the above technical solution, the optimization of the data transmission protocol includes: Optimize transmission management for the operation of uplink and downlink protocols.
[0007] According to the above technical solution, the simulation of data information and data frame analysis management include: Pre-filter the baseband simulated load data generated by the ground sensor equipment and extract the effective information of the simulated load data; After completing the pre-filtering of the payload data, the processed payload data is encapsulated through the on-board link transmission protocol; After receiving the encapsulation result information of the payload data, the Ethernet frame carrying the digital information and the analog payload data are framed and sent.
[0008] According to the above technical solution, the acquisition and transmission of data transmission processing information includes: Collect the time and corresponding resource consumption information of each processing step of data transmission, and organize and plan them in the form of a table; The organized and planned tabular data information will be transmitted to the staff for review and analysis, providing a reliable reference for subsequent optimization processing.
[0009] According to the above technical solution, a data processing system based on the Internet of Things includes: A data processing module is used to manage and control the reception and transmission of payload data; Management and analysis module, used for data information simulation and data frame analysis and management; The acquisition and transmission module is used to acquire and transmit data transmission processing information.
[0010] According to the above technical solution, the data processing module includes: A data receiving module is used for data receiving buffer management; The sending management module is used to manage the transmission and sending of data; The protocol processing module is used to optimize the transmission protocol.
[0011] According to the above technical solution, the management and analysis module includes: Data simulation module, used for simulation control of transmission data; Encapsulation management module, used for encapsulating data information; The framing analysis module is used to perform framing analysis control of data frames.
[0012] According to the above technical solution, the acquisition and transmission module includes: The collection and recording module is used to collect and record the operation data information; The data transmission module is used to transmit and process data information.
[0013] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: the present invention, by providing a data processing module, a management and analysis module, and an acquisition and transmission module, can effectively meet the data bit width requirements in the process of data information transmission, greatly improve the extraction and reception of effective payload data, and make the transmission of payload data more efficient and stable, reduce the design of transmission logic and the corresponding resource consumption, and at the same time make the operation analysis of payload data transmission more efficient and stable, effectively reduce channel redundancy and improve data bandwidth utilization. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 is a flow chart of a data processing method based on the Internet of Things provided by Embodiment 1 of the present invention; Figure 2 This is a module structure diagram of a data processing system based on the Internet of Things provided in Embodiment 2 of the present invention. DETAILED DESCRIPTION
[0015] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0016] Embodiment 1: Figure 1 This is a flow chart of a data processing method based on the Internet of Things provided in Embodiment 1 of the present invention. This embodiment can be applied to a data processing system. The method can be executed by a data processing system based on the Internet of Things provided in an embodiment of the present invention. The system is composed of multiple software and hardware modules, such as Figure 1 As shown, the method specifically comprises the following steps: S101, managing and controlling the reception and transmission of payload data; Exemplarily, in an embodiment of the present invention, the Ethernet data frame is parsed by a finite state machine, and the data information is received and cached in a FIFO; in this step, the data received by the receiving interface is first parsed and converted into three groups of FIFO interfaces for downlink data, and data reception is performed when the transmission signal is valid. The source MAC address, source IP address, payload data length, payload data and other information of the Ethernet data frame are parsed in sequence according to the internal finite state machine jump. At the same time, after the cached source MAC address, source IP address, payload data length and payload data information are read out, the source address, payload length and payload data are cached in the data FIFO to achieve data bit width conversion and cross-clock domain processing, and can effectively meet the data bit width requirements during data information transmission, greatly improving the extraction and reception of effective payload data.
[0017] Through the inverse design of Ethernet receiving processing, the destination MAC address, payload data length and payload data FIFO signal of the previous stage transmission are uploaded, and the data framing is implemented through the finite state machine to send it to the internal sending interface; in this step, the source address, payload length and payload data are cached in the data FIFO to realize data bit width conversion and cross-clock domain processing, and the read data and write data clock values are set respectively according to the operation processing requirements to meet the bit width requirements for sending data to Ethernet, and data is sent when the signal is valid, and the destination MAC address, payload data length and payload data and other information are sent and transmitted in the Ethernet data frame format according to the internal finite state machine jump, and the signal output is 1. When the feedback signal is received, it indicates that the data transmission is completed. At this time, the signal output is 0. Through this processing, the transmission of payload data can be made more efficient and stable, and the design of transmission logic and corresponding resource consumption can be reduced.
[0018] S102, optimizing transmission management of data transmission protocol; Exemplarily, in an embodiment of the present invention, the operation of the uplink protocol and the downlink protocol is optimized for transmission management; in this step, the uplink protocol is controlled to mainly parse the received field bus protocol data and extract valid user data, and judge according to the service type carried by the data frame. If the current data frame type is a digital service mode, the user data is encapsulated in accordance with the Ethernet protocol and then sent for processing; if the current data frame type is an analog service mode, the sampling frequency field is judged while obtaining the analog net load data, and the analog net load data of different sampling frequencies are cached in different FFO channels for transmission analysis; the downlink protocol mainly completes the sending of digital and analog load data through protocol parsing of the effective load data parsed by the frame processing module. Through this processing, the load data transmission operation analysis can be made more efficient and stable.
[0019] S103, performing data information simulation and data frame analysis management; Exemplarily, in an embodiment of the present invention, the baseband analog load data generated by the ground sensor equipment is pre-filtered, and the effective information of the analog load data is extracted; in this step, the edge processing of the low-frequency band-limited signal, the electrocardiogram signal and the audio signal is first used as the design indicator, wherein the low-frequency band-limited signal is mixedly simulated using a sine wave signal with a frequency of a set value, the electrocardiogram signal is simulated using the electrocardiogram signal in the arrhythmia database, and the audio signal is simulated using a noisy speech signal composed of a speech signal and Gaussian white noise with a sampling frequency required for the corresponding operation, and in the analog load data processing, in order to change the relative proportion of the frequency components contained in the signal or filter out certain frequency components to achieve the signal preprocessing effect, the effective load components in the analog load data source are further extracted by a digital finite impulse response filter with a strict linear phase, a stable system and a flexible design method. Through this processing, channel redundancy can be effectively reduced and data bandwidth utilization can be improved.
[0020] After completing the pre-filtering processing of the payload data, the processed payload data is encapsulated through the on-board link transmission protocol; in this step, the link transmission protocol selects a K code and a D code combination sequence to specify the link preamble, frame start and end flags to ensure that there is no confusion with the payload data field, and the control payload data field is filled by packaging the Ethernet frame of the digital type sensor device payload data and the analog payload data, wherein the link transmission protocol frame format is: link preamble, frame start, frame header, Ethernet frame, analog payload, frame end, and at the same time, the Ethernet frame and the processed analog payload data are encapsulated as valid data by the dedicated link transmission protocol.
[0021] After receiving the encapsulation result information of the payload data, the Ethernet frame carrying the digital information and the analog payload data are framed and sent. In this step, the Ethernet frame and the analog payload data are first cached through the FIFO. When the system input rate exceeds the set FIFO cache data, it is discarded. When the system input rate is less than the data cache capacity of this design, when the Ethernet frame FIFO carrying the digital information and the analog payload data FIFO are not empty and each meets the data volume requirement carried by the link transmission protocol, the finite state machine is used to start framing and sending. Through this processing, the problems of differences in satellite-to-ground link transmission protocols and low link transmission utilization are effectively solved.
[0022] S104, collecting and transmitting data transmission processing information; Exemplarily, in an embodiment of the present invention, the time and corresponding resource consumption information of each processing step of data transmission are collected and organized and planned in the form of a table; The organized and planned tabular data information will be transmitted to the staff for review and analysis, providing a reliable reference for subsequent optimization processing.
[0023] Embodiment 2: Embodiment 2 of the present invention provides a data processing system based on the Internet of Things. Figure 2 A schematic diagram of the module structure of a data processing system based on the Internet of Things provided in the second embodiment is shown in FIG. Figure 2 As shown, the system includes: A data processing module is used to manage and control the reception and transmission of payload data; Management and analysis module, used for data information simulation and data frame analysis and management; The acquisition and transmission module is used to acquire and transmit data transmission processing information.
[0024] In some embodiments of the present invention, the data processing module includes: A data receiving module is used for data receiving buffer management; The sending management module is used to manage the transmission and sending of data; The protocol processing module is used to optimize the transmission protocol.
[0025] In some embodiments of the present invention, the management analysis module includes: Data simulation module, used for simulation control of transmission data; Encapsulation management module, used for encapsulating data information; The framing analysis module is used to perform framing analysis control of data frames.
[0026] In some embodiments of the present invention, the acquisition and transmission module includes: The collection and recording module is used to collect and record the operation data information; The data transmission module is used to transmit and process data information.
[0027] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0028] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A data processing method based on the Internet of Things, characterized in that: include: Manage and control the reception and transmission of payload data; Optimize transmission management of data transmission protocols; Conduct data information simulation and data frame analysis and management; Collect and transmit data transmission processing information.
2. The data processing method based on the Internet of Things according to claim 1 is characterized in that: The management and control of receiving and sending the payload data includes: The Ethernet data frame is parsed through the finite state machine, and the data information is processed by FIFO receiving buffer; Through the inverse design of Ethernet receiving processing, the destination MAC address, payload data length and payload data FIFO signal of the previous stage transmission are uploaded, and the data is framed and sent to the internal sending interface through the finite state machine.
3. The data processing method based on the Internet of Things according to claim 1 is characterized in that: The optimizing transmission management of the data transmission protocol includes: Optimize transmission management for the operation of uplink and downlink protocols.
4. The data processing method based on the Internet of Things according to claim 1, characterized in that: The simulation of data information and data frame analysis management include: Pre-filter the baseband simulated load data generated by the ground sensor equipment and extract the effective information of the simulated load data; After completing the pre-filtering of the payload data, the processed payload data is encapsulated through the on-board link transmission protocol; After receiving the encapsulation result information of the payload data, the Ethernet frame carrying the digital information and the analog payload data are framed and sent.
5. The data processing method based on the Internet of Things according to claim 1 is characterized in that: The collecting and transmitting of the data transmission processing information includes: Collect the time and corresponding resource consumption information of each processing step of data transmission, and organize and plan them in the form of a table; The organized and planned tabular data information will be transmitted to the staff for review and analysis, providing a reliable reference for subsequent optimization processing.
6. A data processing system based on the Internet of Things, characterized in that: include: A data processing module is used to manage and control the reception and transmission of payload data; Management and analysis module, used for data information simulation and data frame analysis and management; The acquisition and transmission module is used to acquire and transmit data transmission processing information.
7. The data processing system based on the Internet of Things according to claim 6, characterized in that: The data processing module comprises: A data receiving module is used for data receiving buffer management; The sending management module is used to manage the transmission and sending of data; The protocol processing module is used to optimize the transmission protocol.
8. The data processing system based on the Internet of Things according to claim 6, characterized in that: The management and analysis module includes: Data simulation module, used for simulation control of transmission data; Encapsulation management module, used for encapsulating data information; The framing analysis module is used to perform framing analysis control of data frames.
9. The data processing system based on the Internet of Things according to claim 6, characterized in that: The acquisition and transmission module comprises: The collection and recording module is used to collect and record the operation data information; The data transmission module is used to transmit and process data information.
Citation Information
Patent Citations
High-speed wireless transmission method and device for multi-channel analog / digital mixing signal
CN101106712A
FPGA (Field Programmable Gate Array)-based Ethernet audio transmission system
CN106788906A
Reliability method of wireless radio frequency GFSK networking communication
CN109561426A
SOC-based electric power direct current system fault recording and broadcasting method
CN111339025A
Data link service processing system and method for networked encryption transmission
CN114598384A
