Multi-source heterogeneous terminal equipment rapid integration and scheduling system and method
By designing a multi-source heterogeneous terminal equipment rapid integration and scheduling system, the problems of low integration and scheduling efficiency, low scalability, poor compatibility and high maintenance costs in the prior art are solved, and efficient terminal equipment integration and scheduling are achieved, reducing maintenance costs.
Patent Information
- Application Number
- CN202510510528.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-23
- Publication Date
- 2025-05-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The prior art has problems such as poor compatibility, low scheduling efficiency, low data reading efficiency, low scalability and high maintenance costs in the integration and scheduling of multi-terminal equipment.
A multi-source heterogeneous terminal equipment rapid integration and scheduling system is designed, including parameter configuration unit, data processing unit, protocol conversion unit, terminal communication unit and data storage unit. Through the coordinated work of these modules, automated integration and scheduling of multiple terminal equipment is realized.
It improves the integration efficiency of terminal equipment, enhances the scalability of the system, improves scheduling performance, reduces maintenance costs, and improves the compatibility of data services.
Smart Images

Figure CN120050153A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of information and communication technologies, and particularly relates to a multi-source heterogeneous terminal device rapid integration and scheduling system and method. Background Art
[0002] With the rapid development of the Internet of Things and intelligent devices, a large number of terminal devices have emerged in the market. In the research and development of application systems, it is often necessary to interact with numerous heterogeneous terminal devices. Due to differences in manufacturing years, manufacturers, and technical standards, these devices usually have different communication protocols, data protocols, and parameter configurations. This heterogeneity has made the communication and scheduling between terminal devices and application systems extremely complex and difficult during the research and development process of application systems for automated centralized monitoring of multiple devices. Therefore, how to effectively and quickly integrate the data of multiple heterogeneous terminal devices into the application system and achieve coordinated scheduling of multiple devices has become an important topic in the current technological development. Existing technical solutions often have the following problems: Poor compatibility: Inconsistent protocols between different terminals lead to difficult integration.
[0003] Low scheduling efficiency: Existing scheduling methods lack a unified management platform, the scheduling process is complex, and the response time is long.
[0004] Low data reading efficiency: Inconsistent data protocols between different terminals result in low data reading and conversion efficiency.
[0005] Low scalability: Different devices have different communication protocols, and the same device has multiple protocol versions, making it difficult to update and iterate the device attachment system.
[0006] High maintenance cost: Multiple devices need to be managed separately, and multiple sets of devices require multiple sets of management software, all of which require dedicated personnel for management, resulting in huge research and development and maintenance costs.
[0007] Therefore, there is an urgent need for a general system and method that can rapidly integrate and schedule multiple terminal devices. Summary of the Invention
[0008] The purpose of the present invention is to provide a multi-source heterogeneous terminal device rapid integration and scheduling system and method, which provides a friendly user operation interface. Users can quickly complete the integration and scheduling of various application systems and the heterogeneous terminal devices connected thereto, solving the problems of low efficiency, low scalability, poor compatibility, and high maintenance cost in multi-terminal integration and scheduling in the prior art, and having broad application prospects.
[0009] The technical solution adopted by the present invention is a multi-source heterogeneous terminal device rapid integration and scheduling system, including a parameter configuration unit, a data processing unit, a protocol conversion unit, a terminal communication unit, and a data storage unit, wherein: The parameter configuration unit is responsible for the parameter configuration of each application system, the parameter configuration of each terminal device, the data protocol configuration, and the communication protocol configuration; the data processing unit, the protocol conversion unit, and the terminal communication unit read the configuration information through the parameter configuration unit as needed during operation, providing a basis for application data services, data protocol conversion, and communication protocol scheduling; The data processing unit is responsible for collecting and receiving various types of data from upstream and downstream, reading the configuration information of relevant applications through the parameter configuration unit, and performing data reception, reorganization, and storage; the data processing unit is also responsible for storing the converted standard protocol data in the data storage unit or pushing it to the corresponding application system as needed; After receiving the data forwarded from upstream and downstream, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then calls the corresponding data protocol to convert standard protocol data or non-standard protocol data, stores the standard protocol data in the standard database of the data storage unit, and finally forwards the converted data to upstream and downstream as needed; The terminal communication unit receives the commands parsed by the protocol conversion unit, reads the configuration information of relevant terminals through the parameter configuration unit, loads the communication protocol, and issues communication commands that can be recognized by various terminal devices to achieve the scheduling of different terminals; the terminal communication unit is also responsible for receiving various types of data reported by terminal devices, storing them in the original database of the data storage unit, and feeding them back to the protocol conversion unit; The data storage unit is responsible for the storage management of data; The data storage unit includes a standard database, an original database, a data backup library, and a cache; the standard database is used to store the converted standard protocol data; the original database is used to store the original data reported by terminal devices; the data backup library is used to store data that needs to be retained for a long time; the cache is used to store and retrieve data for application system services and other frequently used data.
[0010] Furthermore, the parameter configuration unit includes application parameter configuration, terminal parameter configuration, data protocol management, and communication protocol management; the application parameter configuration is used to set and register the information parameters of each application system, supporting the administrator to flexibly set and adjust relevant parameters according to the different data requirements of each application system; the terminal parameter configuration is used to set and manage the interaction parameters between each terminal device and the system of the present invention to ensure that each terminal device can be correctly recognized and connected by the system of the present invention; the data protocol management is used to define and manage the formats and rules of various data transmitted in the system of the present invention and support the arbitrary extension of protocol configuration according to new devices; the communication protocol management is used to configure and manage the communication protocols between the system of the present invention and each terminal device to ensure that the system of the present invention and each terminal device can communicate through wired or wireless means.
[0011] Furthermore, the specific steps of the application parameter configuration include: (1) Data model definition; (2) Configuration interface; (3) Parameter persistence; (4) Parameter verification; (5) Parameter application; The specific steps of the terminal parameter configuration include: (1) Device identification; (2) Create parameter template; (3) Parse input parameters; (4) Configuration application; The specific steps of the data protocol management include: (1) Protocol support; (2) Protocol configuration; (3) Protocol self-adaptation; (4) Protocol application; The specific steps of the communication protocol management include: (1) Build protocol library; (2) Graphical configuration; (3) Extend new communication protocols in a componentized manner; (4) Protocol self-check.
[0012] Furthermore, the data processing unit includes data reception, data recombination, data service, and data access; the data reception is used to collect and receive data from upstream and downstream, maintain the communication between the system of the present invention and each terminal device and each application system, monitor data transmission, capture incoming data streams, and ensure the integrity and accuracy of data; the data recombination is used to perform format conversion and structured processing on the received data; the data service is used to provide the converted data to each application system and terminal device; the data access is used to manage and control the storage and retrieval of data, implement the definition of data storage strategies and data access control, ensure that data can be efficiently transmitted, and at the same time support fast and reliable read operations.
[0013] Furthermore, the specific steps of the data reception include: (1) Establish a communication interface; (2) Data monitoring; (3) Data verification; (4) Buffer management; The specific steps of the data recombination include: (1) The parser identifies the received data; (2) Data cleaning; (3) Format conversion; (4) Data standardization; The specific steps of the data service include: (1) Provide an API interface; (2) Integrate a computing engine; (3) Ensure data security; The specific steps of the data access include: (1) Database integration; (2) Data indexing; (3) Data persistence; (4) Backup and recovery; (5) Data optimization.
[0014] Further, the protocol conversion unit includes command parsing, data protocol scheduling, parsing of raw data, and parsing of standard protocol data; the command parsing is used to understand and process control commands or requests sent from various application systems; the data protocol scheduling is used to manage and coordinate the conversion and communication between different data protocols, dynamically select an appropriate data protocol for data parsing according to the data type of the current communication data source, and ensure that the data is transmitted and processed according to the correct protocol; the parsing of raw data is used to process and convert the unprocessed raw data sent by each terminal device, identify and parse the raw data format, and convert the data from the local format of each terminal device into the standard format agreed upon by the system of the present invention; the parsing of standard protocol data is used to parse and identify the standard data format agreed upon by the system of the present invention and convert it into a data format recognizable by the current communication device, facilitating the flow of data between different application systems and terminal devices.
[0015] Further, the specific steps of the command parsing include: (1) Protocol identification; (2) Semantic analysis; (3) Command conversion; (4) Verification and routing; The specific steps of the data protocol scheduling include: (1) Protocol preloading; (2) Dynamic loading; (3) Protocol adaptation; The specific steps of the parsing of raw data include: (1) Data format identification; (2) Data decoding; (3) Data verification; (4) Data mapping; The specific steps of the parsing of standard protocol data include: (1) Standard format definition; (2) Data conversion; (3) Data encapsulation; (4)Data serialization.
[0016] Furthermore, the terminal communication unit includes command reception, communication protocol loading, and terminal communication. The command reception is used to receive control commands, configuration instructions, or query requests for the terminal device from each application system, responsible for listening for and receiving various commands, performing preliminary parsing and verification of the commands, and passing them to the subsequent processing module to execute corresponding operations. The communication protocol loading is used to load and initialize the communication protocol used by the current communication device to support the communication between the system of the present invention and each terminal device. The terminal communication is used to implement data communication between the system of the present invention and each terminal device, and perform actual data transmission operations, ensuring that the data is correctly transmitted according to the established communication protocol, and at the same time handling possible communication errors and exceptions.
[0017] Furthermore, the specific steps of the command reception include: (1)The listening service continuously listens; (2)Command parsing; (3)Command conversion; (4)Authentication and authorization; The specific steps of the communication protocol loading include: (1)Protocol identification; (2)Communication establishment; (3)Communication maintenance; The specific steps of the terminal communication include: (1)Data sending; (2)Data receiving; (3)Error handling; (4)Flow control; (5)Communication monitoring.
[0018] A method for rapid integration and scheduling of multi-source heterogeneous terminal devices is implemented through the above-mentioned multi-source heterogeneous terminal device rapid integration and scheduling system, and includes the following steps: S1, Parameter configuration: Configure the information of application system parameters, terminal device parameters, data protocols, and communication protocols in the parameter configuration unit according to actual needs; S2, Command reception and processing: The application system issues a terminal device control command to the system of the present invention, and the command is routed to the data processing unit. The data processing unit automatically calls the configuration information of the relevant application read by the parameter configuration unit and parses the command according to the configuration information; If it is a query command, first check whether the query content exists in the cache of the data storage unit. If it exists, return directly; if it does not exist, directly issue the command. If it is other types of commands, directly issue them; S3. According to the protocol conversion command: The terminal device control command is forwarded to the protocol conversion unit via the data processing unit. After receiving the command, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then parses the command and reorganizes the command into a protocol command recognizable by the terminal device according to the corresponding data protocol, and then issues the command to the terminal communication unit; S4. Issue the command to the terminal device: The terminal communication unit receives the command parsed by the protocol conversion unit, reads the relevant configuration information through the parameter configuration unit to load the communication protocol, and issues communication commands recognizable by various terminal devices to achieve the scheduling of different terminal devices; S5. Terminal device monitoring: When initializing, the terminal communication unit traverses all terminal devices that need to be monitored in the system of the present invention, schedules the communication protocol according to the configuration information of the terminal device, establishes a connection with the terminal device and monitors the terminal device; After receiving the information reported by the terminal device, the terminal communication unit stores the original data in the original database of the data storage unit and returns it to the protocol conversion unit; S6. According to the protocol conversion data: After receiving the original data returned by the terminal communication unit, the protocol conversion unit first reads the data protocol configuration through the parameter configuration unit, then loads the corresponding data protocol to parse the original data, reorganizes the data according to the standard protocol, and finally stores the standard protocol data in the standard database of the data storage unit and forwards it to the data processing unit; S7. Data reorganization: After receiving the standard protocol data returned by the protocol conversion unit, the data processing unit first reads the application system configuration information through the parameter configuration unit, then reorganizes the data according to the data format required by the application system and updates the cache of the data storage unit, and finally returns the data according to the interaction mode required by the application system; S8. Data storage: During the use of the system of the present invention, the converted standard protocol data is managed by the standard database; the original data reported by each terminal device is managed by the original database; the data that needs to be retained for a long time is managed by the data backup library; the cache is used to store and retrieve data for application system services and other frequently used data.
[0019] The beneficial effects of the present invention are as follows: (1) Improve the integration efficiency: The access of new devices does not require complex configuration. Through automatic discovery and protocol adaptation, the time and labor costs of device integration can be greatly reduced, and the integration efficiency can be improved.
[0020] (2) Enhance system scalability: Support multiple communication protocols and device types, adapt to different application scenarios, and have good scalability.
[0021] (3) Improve scheduling performance: The application of intelligent scheduling algorithms makes the utilization rate of device resources higher and the response time significantly reduced.
[0022] (4) Reduce maintenance costs: The establishment of a unified management platform reduces the need for separate maintenance of each terminal and simplifies system operation and maintenance.
[0023] (5) Improve compatibility: Integrate protocol data of different types and versions to generate standard protocol data, improving the compatibility of data services. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 It is a composition diagram of the multi-source heterogeneous terminal device rapid integration and scheduling system of the present invention.
[0025] Figure 2 It is an overall working flow chart of an embodiment of the present invention.
[0026] Figure 3 It is an application schematic diagram of an embodiment of the present invention.
[0027] Figure 4 It is a flow chart of parameter configuration of an embodiment of the present invention.
[0028] Figure 5 It is a flow chart of command reception and processing of an embodiment of the present invention.
[0029] Figure 6 It is a flow chart of converting commands according to protocols of an embodiment of the present invention.
[0030] Figure 7 It is a flow chart of sending commands to terminal devices of an embodiment of the present invention.
[0031] Figure 8 It is a flow chart of terminal device monitoring of an embodiment of the present invention.
[0032] Figure 9 It is a flow chart of converting data according to protocols of an embodiment of the present invention.
[0033] Figure 10 It is a flow chart of data recombination of an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0034] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the technical solutions of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments.
[0035] The present invention particularly relates to protocol conversion and communication scheduling technologies. Aiming at the scenario where there are a wide variety and complexity of interface protocols and communication methods when integrating various heterogeneous terminal devices such as in-vehicle, airborne, spaceborne devices in automobiles, airplanes, drones, satellites, ships, etc., a multi-source heterogeneous terminal device rapid integration and scheduling system and method are provided, which provides a friendly user operation interface, creates a high-speed rasterized channel for real-time scheduling and transmission of data between multiple application systems and multi-source heterogeneous terminal devices, facilitates users to quickly complete the integration and scheduling of each application system and the heterogeneous terminal devices connected thereto through the present invention, solves the problems of low efficiency, low scalability, poor compatibility, and high maintenance cost in the prior art for multi-terminal integration and scheduling, has a wide range of application prospects, and provides strong technical support for fields such as the Internet of Things, centralized monitoring, and intelligent devices.
[0036] A multi-source heterogeneous terminal device rapid integration and scheduling system, as Figure 1 shown, includes a parameter configuration unit, a data processing unit, a protocol conversion unit, a terminal communication unit, and a data storage unit.
[0037] I. Parameter Configuration Unit The parameter configuration unit is responsible for parameter configuration of each application system, parameter configuration of each terminal device, data protocol configuration, and communication protocol configuration, etc., providing a flexible and extensible configuration and management environment for the system of the present invention. The data processing unit, protocol conversion unit, and terminal communication unit read configuration information through the parameter configuration unit as needed during operation, providing a basis for application data services, data protocol conversion, and communication protocol scheduling; ensuring that the program can adapt to the communication protocol to establish communication with the terminal device, scheduling the data protocol to parse the reported terminal device information, and providing data services in the format required by the application system.
[0038] The parameter configuration unit includes application parameter configuration, terminal parameter configuration, data protocol management, and communication protocol management.
[0039] 1. Application Parameter Configuration The application parameter configuration is used to set and register information parameters of each application system (such as application identification information, request content, interaction method, data acquisition frequency, and data processing rules, etc.), supporting the administrator to flexibly set and adjust relevant parameters according to the different data requirements of each application system.
[0040] The specific steps of the application parameter configuration are as follows: (1) Data Model Definition Define a data model according to the device parameters actually required by each application system. This model describes the name, type, range, default value, and possible values of each parameter.
[0041] (2) Configuration Interface The system of the present invention provides a graphical user interface (GUI) that supports system administrators or users to customize display parameters according to monitoring requirements.
[0042] (3) Parameter Persistence Store the configured parameters in a database or configuration file for loading when the system starts or when needed.
[0043] (4) Parameter Validation After the application parameters are modified, perform validation to ensure that the parameter values are within the allowed range and conform to the expected data format. For example: the validity of communication addresses and tokens.
[0044] (5) Parameter Application Load the parameter values into the data storage unit through the application logic to ensure that the program runs according to the configuration.
[0045] 2. Terminal Parameter Configuration Terminal parameter configuration is used to set and manage the interaction parameters between each terminal device and the system of the present invention (such as device ID, device type, communication protocol, data protocol, multicast address, port, driver version, and security settings, etc.), ensuring that each terminal device can be correctly identified and connected by the system of the present invention.
[0046] The specific steps of terminal parameter configuration are as follows: (1) Device Identification Identify and connect each terminal device and obtain its basic information.
[0047] (2) Create Parameter Template Create parameter templates for different types of terminal devices, including the parameter settings unique to each device.
[0048] (3) Parse Input Parameters Automatically identify the device status parameters (such as XML, JSON, EXCEL, etc.) by reading the terminal device configuration file.
[0049] (4) Configuration Application Load the parameter values into the terminal communication unit through the application logic to ensure that the terminal communication unit dynamically switches connection channels.
[0050] 3. Data Protocol Management Data protocol management is used to define and manage the formats and rules of various data transmitted in the system of the present invention (such as encoding, compression, encryption, packaging, and parsing of data protocols, etc.), and supports arbitrary extension of protocol configuration according to new devices.
[0051] The specific steps of data protocol management are as follows: (1) Protocol Support The system of the present invention integrates multiple data protocols, including industry - common, enterprise - owned, user - defined, etc. Users can extend new protocols by adding key information such as the length, version, and flag of the protocol header.
[0052] (2)Protocol Configuration The system of the present invention provides a graphical interface for configuring key information of data protocols, such as: packet - header information, data format, encoding method, synchronization frequency, etc.
[0053] (3)Protocol Self - Adaptation In the case of unknown current data - packet protocol, the protocol conversion unit will load the registered data protocols in the system of the present invention for attempt to parse, and automatically lock the data protocol with the data packet header and data field completely matching for data parsing.
[0054] (4)Protocol Application When the system of the present invention is initialized, it pre - loads the registered data protocols into the memory to support the protocol conversion unit to schedule and load protocols at any time.
[0055] 4. Communication Protocol Management Communication protocol management is used to configure and manage the communication protocols between the system of the present invention and each terminal device, ensuring that the system of the present invention and each terminal device can communicate through wired or wireless means.
[0056] The specific steps of communication protocol management are as follows: (1)Build a Protocol Library The system of the present invention builds a communication protocol library, which contains various communication protocols (such as UDP (User Datagram Protocol), PDXP (Data Exchange Protocol used in aerospace TT&C systems), FEP (Embedded Platform Protocol), etc.).
[0057] (2)Graphical Configuration The system of the present invention provides a user - friendly graphical interface for administrators to maintain communication protocols, such as: network address, port, type, security information, etc.
[0058] (3)Expand New Communication Protocols in a Component - based Manner The system of the present invention supports expanding new communication protocols in the form of components. The components include protocol dependencies, configuration loading logic, communication instantiation logic, and initialization code, etc.
[0059] (4)Protocol Self - Check Test the validity of the protocol according to the configuration, and can automatically complete the missing general information or prompt the missing key information to ensure that the registered communication protocols are complete and available.
[0060] II. Data Processing Unit The data processing unit is responsible for collecting and receiving various types of data from upstream and downstream, reading the configuration information of relevant applications through the parameter configuration unit, and performing data reception, reorganization, and storage operations; the data processing unit is also responsible for storing the converted standard protocol data into the data storage unit or pushing it to the corresponding application system as needed.
[0061] The data processing unit includes data reception, data reorganization, data services, and data storage. The data processing unit can efficiently process data from different application systems and different terminal devices, ensure the smooth flow of data in the present invention, and provide high-quality data support for upper-layer applications.
[0062] 1. Data Reception Data reception is used to collect and receive data from upstream and downstream (such as control commands, status parameters, production data, user inputs, and logs), maintain the communication between the system of the present invention and each terminal device and application system, monitor data changes, capture incoming data streams, and ensure the integrity and accuracy of the data.
[0063] The specific steps of data reception are as follows: (1) Establish a communication interface Establish and maintain a communication interface with the terminal device, supporting multiple communication protocols (such as UDP, PDXP, FEP, etc.).
[0064] (2) Data monitoring Perform data monitoring according to the communication ports registered by the parameter configuration unit, and capture the data streams incoming from the terminal device in real time.
[0065] (3) Data verification Perform preliminary integrity, format, and validity verification on the received data.
[0066] (4) Buffer management Use a buffer or queue to manage the received data to ensure the orderly processing of the data.
[0067] 2. Data Reorganization Data reorganization is used to perform format conversion and structured processing on the received data. Specifically, process the received data according to the data requirements registered by the application parameter configuration, and quickly convert it into a predefined standard data protocol format.
[0068] The specific steps of data reorganization are as follows: (1) The parser identifies the received data The system of the present invention has a built-in data parser to identify the type, size, content, etc. of the received data.
[0069] (2)Data cleaning Remove invalid data, correct errors, and fill in missing values to improve data quality.
[0070] (3)Format conversion Convert the data into the data models required by each application according to the data requirements registered in the application parameters configuration.
[0071] (4)Data standardization Perform standardization processing on the data to make it conform to the specifications of data storage and processing.
[0072] 3. Data services Based on the data resource pool collected and scheduled by the system of the present invention, the data service provides a secure and standardized service interface for each application system such as the monitoring system and the business system, and is used to provide the converted data to each application system and terminal device.
[0073] The specific steps of the data service are as follows: (1)Provide API interfaces Provide API interfaces to allow users or applications to access and obtain data through RESTful or other means.
[0074] (2)Integrate the computing engine Integrate the computing engine to support real-time or batch computing of data, such as aggregation, statistics, analysis, etc.
[0075] (3)Ensure data security Ensure the security of the data service, including user authentication, permission control, data encryption, etc.
[0076] 4. Data access Data access is used to manage and control the storage and retrieval of data, implement the definition of data storage strategies (such as data partitioning, indexing, backup, and recovery strategies), and data access control (such as user authentication, permission management, and data encryption), ensure that the data can be efficiently transmitted, and at the same time support fast and reliable read operations.
[0077] The specific steps of data access are as follows: (1)Database integration Adapt to mainstream relational databases such as MySQL and DM, and the system builds an in-memory database Redis to improve the efficiency of data access.
[0078] (2)Data indexing Create indexes for general data structures to improve the efficiency of data query and retrieval.
[0079] (3)Data persistence Ensure that the data can be securely and reliably stored on disks or other persistent storage media.
[0080] (4) Backup and Recovery The system of the present invention implements a data backup and recovery strategy by means of regular full - volume backup and real - time incremental backup to prevent data loss or damage.
[0081] (5) Data Optimization Optimize the data model according to the data access pattern to improve the response time and throughput.
[0082] III. Protocol Conversion Unit After receiving the data (control commands of terminal devices and various types of information reported by terminal devices) forwarded from upstream and downstream, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then calls the corresponding data protocol to convert standard protocol data or non - standard protocol data, stores the standard protocol data in the standard database of the data storage unit, and finally forwards the converted data upstream and downstream as required.
[0083] The protocol conversion unit includes command parsing, data protocol scheduling, parsing of raw data, and parsing of standard protocol data. The protocol conversion unit ensures that data of different terminal devices can flow seamlessly in the system of the present invention, and at the same time provides a flexible way for the system of the present invention to integrate and manage various heterogeneous terminal devices.
[0084] 1. Command Parsing Command parsing is used to understand and process control commands or requests sent from each application system (such as device configuration update instructions, data acquisition instructions, and device control instructions, etc.). By calling the registered data protocol of the parameter configuration unit to parse and identify the above - mentioned commands, the commands are converted from the proprietary command formats of each application system into an instruction set recognizable by the target terminal device for further processing and response.
[0085] The specific steps of command parsing are as follows: (1) Protocol Identification Identify the protocol type used by the commands sent by the terminal device.
[0086] (2) Semantic Analysis Use a parser to analyze the semantics of the command and extract the key elements and parameters of the command.
[0087] (3) Command Conversion Convert the extracted command elements and parameters into a format recognizable by the corresponding terminal for further operations.
[0088] (4) Verification and Routing Verify the command to ensure that it conforms to the expected format and permission requirements, and then route the command to the corresponding processing module.
[0089] 2. Data Protocol Scheduling Data protocol scheduling is used to manage and coordinate the conversion and communication between different data protocols, dynamically select the appropriate data protocol for data parsing according to the data type of the current communication data source, ensure that the data is parsed and processed according to the correct protocol, including protocol initialization, maintenance, and termination.
[0090] The specific steps of data protocol scheduling are as follows: (1) Protocol Preloading Preload the data protocols registered in the data protocol management into the cache for easy scheduling at any time.
[0091] (2) Dynamic Loading The protocol conversion unit dynamically loads the data protocol according to the data protocol used in the current data packet to parse the data packet.
[0092] (3) Protocol Adaptation In the case where the data protocol used by the data packet is unknown, automatically adapt the data protocols registered in the data protocol management, identify the packet header and data, and perform data parsing with the completely matching protocol.
[0093] 3. Parse Raw Data Parsing raw data is used to process the unprocessed raw data sent by each terminal device, identify and parse the raw data format, and convert the data from the local format of each terminal device to the standard format agreed upon by the present invention.
[0094] The specific steps of parsing raw data are as follows: (1) Data Format Identification Identify the format of the raw data (such as text, binary, image, etc.), and lock the data protocol used by the raw data by extracting key parameters.
[0095] (2) Data Decoding Decode the current data packet according to the locked data protocol and convert it into a readable format.
[0096] (3) Data Verification Verify the decoded data to ensure data integrity and accuracy.
[0097] (4) Data Mapping Map the data to the data model or structure inside the system of the present invention for easy data storage.
[0098] 4. Parse Standard Protocol Data Parsing standard protocol data is used to parse and identify the standard data format agreed upon by the system of the present invention, and convert it into a data format recognizable by the current communication device, facilitating the flow of data between different application systems and terminal devices.
[0099] The specific steps for parsing standard protocol data are as follows: (1) Standard format definition The system of the present invention stipulates a standard data format and protocol to improve data interoperability, enhance data accuracy and integrity, and facilitate cross-platform data transmission.
[0100] (2) Data conversion The parsed data is converted into a data format recognizable by the terminal device as needed.
[0101] (3) Data encapsulation Encapsulate data according to standard protocols and data models, including necessary metadata and header information.
[0102] (4) Data serialization Serialize data into a format suitable for network transmission to facilitate providing data services to various applications.
[0103] 4. Terminal Communication Unit The terminal communication unit receives the command parsed by the protocol conversion unit, reads the configuration information of the relevant terminal through the parameter configuration unit, loads the communication protocol, and sends recognizable communication commands to various terminal devices to realize scheduling of different terminals; at the same time, the terminal communication unit is also responsible for receiving various types of data reported by the terminal devices, storing them in the original database of the data storage unit, and feeding them back to the protocol conversion unit.
[0104] The terminal communication unit includes command reception, communication protocol loading and terminal communication. The terminal communication unit can ensure that the communication between the system of the present invention and the terminal equipment is reliable and efficient, and also provides sufficient flexibility to support various types of terminal equipment and communication protocols.
[0105] 1. Command reception Command reception is used to receive control commands, configuration instructions or query requests for terminal devices from various application systems. It is responsible for monitoring and receiving various commands, performing preliminary analysis and verification of the commands, and passing them to subsequent processing modules to perform corresponding operations.
[0106] The specific steps of command reception are as follows: (1) Monitoring service continues to monitor The monitoring service is started according to the application parameters registered by the application configuration module, and the service continuously monitors the command requests from each application.
[0107] (2) Command parsing After receiving the command, the parser is used to parse the command and extract the command content and parameters.
[0108] (3) Command conversion Repackage the parsed commands according to the data protocol used by the current terminal device.
[0109] (4) Authentication and Authorization Perform authentication and authorization checks on the received commands to ensure that the command sources are legal and meet the permission requirements.
[0110] 2. Communication Protocol Loading Communication protocol loading is used to load and initialize the communication protocol used by the current communication device to support the communication between the system of the present invention and each terminal device. Detect the protocol types supported by the terminal device, dynamically load the corresponding protocol modules, and configure protocol parameters (such as network address, port, encryption settings, etc.) to ensure that the terminal communication unit of the terminal device can perform data transmission according to the predetermined communication rules.
[0111] The specific steps of communication protocol loading are as follows: (1) Protocol Identification Identify the communication protocols supported by the terminal device by means of device identification and configuration reading.
[0112] (2) Communication Establishment Preload the communication protocol in combination with the device information, load the driver program, library files and related, and establish communication with the terminal device.
[0113] (3) Communication Maintenance Maintain the communication connection with each terminal device, and monitor the information reported by the terminal in real time to ensure that interaction with the corresponding terminal can be carried out at any time.
[0114] 3. Terminal Communication Terminal communication is used to implement data communication between the system of the present invention and each terminal device, and perform actual data transmission operations (including data sending, receiving, confirmation and retransmission), ensure that data is correctly transmitted according to the established communication protocol, and handle possible communication errors and exceptions at the same time.
[0115] The specific steps of terminal communication are as follows: (1) Data Sending Package and send the data to the terminal device according to the communication protocol.
[0116] (2) Data Receiving Receive data from the terminal device and perform preliminary processing, such as verification, de - encapsulation, etc.
[0117] (3) Error Handling Implement an error detection and recovery mechanism to handle errors in the communication process, such as timeouts, retransmissions, etc.
[0118] (4) Flow Control Manage data traffic to avoid network congestion and device overload. On the one hand, reasonably allocate terminal communication traffic according to the request priorities of the application parties, and on the other hand, perform load balancing according to the actual communication pressure.
[0119] (5)Communication monitoring Monitor the communication status, including connection status, data transfer rate, error rate, etc., to ensure the stability and efficiency of communication.
[0120] V. Data storage unit The data storage unit is responsible for data storage management.
[0121] The data storage unit includes a standard database, an original database, a data backup library, and a cache. The standard database is used to store the converted standard protocol data; the original database is used to store the original data reported by the terminal devices; the data backup library is used to store the data that needs to be retained for a long time; the cache is used to store and retrieve the data for the application system services and other frequently used data.
[0122] A method for rapid integration and scheduling of multi-source heterogeneous terminal devices is implemented through the above-mentioned multi-source heterogeneous terminal device rapid integration and scheduling system, and includes the following steps: S1, Parameter configuration: Configure the information of each application system parameter, terminal device parameter, data protocol, and communication protocol in the parameter configuration unit according to actual needs.
[0123] S2, Command reception and processing: The application system issues a terminal device control command to the system of the present invention, and the command is routed to the data processing unit. The data processing unit automatically calls the configuration information of the relevant application read by the parameter configuration unit and parses the command according to the configuration information; If it is a query command, first check whether the query content exists in the cache of the data storage unit. If it exists, return directly; if it does not exist, directly issue the command. If it is other types of commands, directly issue them.
[0124] S3, Convert the command according to the protocol: The terminal device control command is forwarded by the data processing unit to the protocol conversion unit. After receiving the command, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then parses the command and reorganizes the command into a protocol command recognizable by the terminal device according to the corresponding data protocol, and then issues the command to the terminal communication unit.
[0125] S4, Issue the command to the terminal device: The terminal communication unit receives the commands parsed by the protocol conversion unit, reads relevant configuration information through the parameter configuration unit to load the communication protocol, and issues communication commands recognizable by various terminal devices to achieve the scheduling of different terminal devices.
[0126] S5, Terminal device monitoring: When initializing, the terminal communication unit traverses all terminal devices that need to be monitored in the system of the present invention, schedules the communication protocol according to the configuration information of the terminal devices, establishes a connection with the terminal devices and monitors the terminal devices; After receiving the information reported by the terminal device, the terminal communication unit stores this original data in the original database of the data storage unit and returns it to the protocol conversion unit.
[0127] S6, Data conversion according to protocol: After receiving the original data returned by the terminal communication unit, the protocol conversion unit first reads the data protocol configuration through the parameter configuration unit, then loads the corresponding data protocol to parse the original data, reorganizes the data according to the standard protocol, and finally stores the standard protocol data in the standard database of the data storage unit and forwards it to the data processing unit.
[0128] S7, Data reorganization: After receiving the standard protocol data returned by the protocol conversion unit, the data processing unit first reads the application system configuration information through the parameter configuration unit, then reorganizes the data according to the data format required by the application system and updates the cache of the data storage unit, and finally returns the data according to the interaction method required by the application system.
[0129] S8, Data storage.
[0130] During the use of the system of the present invention, the converted standard protocol data is managed by the standard database; the original data reported by each terminal device is managed by the original database; the data that needs to be retained for a long time is managed by the data backup library; the cache is used to store and retrieve data for application system services and other frequently used data.
[0131] Embodiment 1 In a certain centralized monitoring and scheduling project, it is necessary to connect various devices connected to terminals such as on-vehicle, on-aircraft, and on-satellite to various application systems such as the already established centralized monitoring system and business system, and provide data services for these application systems. The terminal devices to be connected all have their own control software, but their communication protocols are different (UDP, PDXP, FEP...), and their data protocols are also different (different devices have different protocols, and the same protocol has different versions, such as protocol 1.1, protocol 1.2, protocol 2.1, protocol 3.1, protocol 3.2, protocol 3.3...).
[0132] In order to reduce the integration difficulty, improve the data service ability, enhance the system scalability, and compress the R & D cost, the present invention is adopted for the integration and scheduling of multi-source heterogeneous terminal devices, specifically as Figure 2 , Figure 3 shown.
[0133] During the project construction process, the integration of multi-source heterogeneous terminal devices was quickly completed through the present invention; the system of the present invention sends relevant commands to each terminal device to complete the scheduling of the terminal device; receives various types of data reported by the terminal device and feeds it back to the centralized monitoring system; automatically performs the conversion of standard protocol data / non-standard protocol data during the communication process. The specific steps are as follows: 1. Parameter configuration Configure the information of each application system parameter, terminal device parameter, data protocol, and communication protocol in the parameter configuration unit of the system of the present invention according to actual needs, as Figure 4 shown. The specific process of parameter configuration is as follows: (1) Each application system administrator starts the parameter configuration operation in the system of the present invention; (2) The system of the present invention checks whether there is a corresponding data protocol according to the data protocol input by each application system administrator; (3) If there is no corresponding data protocol, jump out of the data protocol addition page and prompt each administrator to add the corresponding data protocol first; (4) If there is a corresponding data protocol, the system of the present invention performs a communication protocol check to determine whether there is a corresponding communication protocol; (5) If there is no corresponding communication protocol, jump out of the communication protocol addition page and prompt each administrator to add the corresponding communication protocol first; (6) If there is a corresponding communication protocol, pop up the application information filling page and prompt each administrator to fill in the application information; (7) After the application information is filled in and automatically checked by the system of the present invention without error, pop up the data protocol selection page and prompt each administrator to select the corresponding data protocol; (8) After the data protocol is selected and automatically checked without error, pop up the communication protocol selection page and prompt each administrator to select the corresponding communication protocol; (9) After all information is configured, each administrator can click the "Save" button to end the parameter configuration operation.
[0134] 2. Command reception and processing The application system issues a terminal device control command to the system of the present invention. This command is routed to the data processing unit of the system of the present invention. The data processing unit automatically calls the configuration information of the relevant application read by the parameter configuration unit and parses the command according to the configuration information, as Figure 5 shown. The specific process of command reception and processing is as follows: (1) Receive the request commands sent by each application system to the system of the present invention; (2) Invoke the "parameter configuration" unit to read the configuration information of relevant applications; (3) The system of the present invention automatically authenticates the requester's authority and determines whether the request content has been authorized; (4) If the "authentication" fails, pop up the corresponding feedback prompt information to each system administrator; (5) If the "authentication" passes, parse the command according to the configured information; (6) After the command parsing is completed, the system of the present invention automatically identifies the command content; (7) If the command is a query command, check the cached data. If the data satisfying the command exists in the cache, directly push the corresponding data to the corresponding interface; (8) If the command is a query command and the corresponding data does not exist in the cache, or the command is other commands, issue a request according to the command content; (9) Feed back the request result to the application side.
[0135] 3. Convert commands according to the protocol As Figure 6 shown, the terminal device control command is forwarded to the protocol conversion unit via the data processing unit. After receiving the command, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then parses the command and reorganizes the command into a protocol command recognizable by the terminal device according to the corresponding data protocol, and then issues the command to the terminal communication unit.
[0136] 4. Issue commands to terminal devices As Figure 7 shown, the terminal communication unit receives the command parsed by the protocol conversion unit, loads the communication protocol by reading the relevant configuration information through the parameter configuration unit, and issues communication commands recognizable by various terminal devices, so as to realize the scheduling of different terminal devices.
[0137] 5. Terminal device monitoring As Figure 8 shown, when initializing, the terminal communication unit traverses all terminal devices that need to be monitored by the system of the present invention, schedules the communication protocol according to the configuration information of the terminal devices, establishes a connection with the terminal devices and monitors the terminal devices. After receiving the information reported by the terminal devices, the terminal communication unit stores this original data in the original database and returns it to the protocol conversion unit.
[0138] 6. Convert data according to the protocol As Figure 9As shown, after the protocol conversion unit receives the original data returned by the terminal communication unit, it first reads the data protocol configuration through the parameter configuration unit, then loads the corresponding data protocol to parse the original data, reorganizes the data according to the standard protocol, and finally stores the standard protocol data in the standard database and forwards it to the data processing unit.
[0139] 7. Data Reorganization As Figure 10 shown, after the data processing unit receives the standard protocol data returned by the protocol conversion unit, it first reads the application system configuration information through the parameter configuration unit, then reorganizes the data according to the data format required by the application system and updates the cache, and finally returns the data according to the interaction method required by the application system.
[0140] 8. Data Storage During the use of the system of the present invention, the converted standard protocol data is managed by the standard database; the original data reported by each terminal device is managed by the original database; the data that needs to be retained for a long time is managed by the data backup library; the cache is used to store and retrieve data for the application system service and other frequently used data.
[0141] The content not described in detail in the specification of the present invention belongs to the prior art in the technical field of the present invention.
Claims
1. A multi-source heterogeneous terminal equipment rapid integration and scheduling system, characterized in that: It includes a parameter configuration unit, a data processing unit, a protocol conversion unit, a terminal communication unit and a data storage unit, wherein: The parameter configuration unit is responsible for the configuration of parameters of each application system, each terminal device, data protocol configuration and communication protocol configuration; the data processing unit, protocol conversion unit and terminal communication unit read the configuration information through the parameter configuration unit as needed during operation, providing a basis for application data services, data protocol conversion and communication protocol scheduling; The data processing unit is responsible for collecting and receiving various types of data from upstream and downstream, reading the configuration information of related applications through the parameter configuration unit, and receiving, reorganizing and accessing data; the data processing unit is also responsible for storing the converted standard protocol data in the data storage unit, or pushing it to the corresponding application system as needed; After receiving the data forwarded from upstream and downstream, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then calls the corresponding data protocol to convert the standard protocol data or non-standard protocol data, and stores the standard protocol data in the standard database of the data storage unit, and finally forwards the converted data upstream and downstream as needed; The terminal communication unit receives the command parsed by the protocol conversion unit, reads the configuration information of the relevant terminal through the parameter configuration unit, loads the communication protocol, and sends the communication commands that can be recognized by various terminal devices to realize the scheduling of different terminals; the terminal communication unit is also responsible for receiving various data reported by the terminal device, storing it in the original database of the data storage unit, and feeding it back to the protocol conversion unit; The data storage unit is responsible for data storage management; The data storage unit includes a standard database, an original database, a data backup library and a cache; the standard database is used to store the converted standard protocol data; the original database is used to store the original data reported by the terminal device; the data backup library is used to store data that needs to be retained for a long time; the cache is used to store and orient the data of application system services and other frequently used data.
2. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 1 is characterized in that: The parameter configuration unit includes application parameter configuration, terminal parameter configuration, data protocol management and communication protocol management; the application parameter configuration is used to set and register information parameters of each application system, and supports administrators to flexibly set and adjust relevant parameters according to different data requirements of each application system; the terminal parameter configuration is used to set and manage the interaction parameters between each terminal device and the system of the present invention, ensuring that each terminal device can be correctly identified and connected by the system of the present invention; the data protocol management is used to define and manage the formats and rules of various data transmitted in the system of the present invention, and supports arbitrary expansion of protocol configuration according to new devices; the communication protocol management is used to configure and manage the communication protocol between the system of the present invention and each terminal device, ensuring that the system of the present invention and each terminal device can communicate via wired or wireless means.
3. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 2 is characterized in that: The specific steps of the application parameter configuration include: (1) Data model definition; (2) Configuration interface; (3) Parameter persistence; (4) Parameter verification; (5) Parameter application; The specific steps of terminal parameter configuration include: (1) Device identification; (2) Create a parameter template; (3) Parsing input parameters; (4) Configure the application; The specific steps of the data protocol management include: (1) Protocol support; (2) Protocol configuration; (3) Protocol self-adaptation; (4) Protocol application; The specific steps of the communication protocol management include: (1) Build a protocol library; (2) Graphical configuration; (3) Expand new communication protocols in a componentized manner; (4) Protocol self-check.
4. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 1 is characterized in that: The data processing unit includes data reception, data reorganization, data service and data access; the data reception is used to collect and receive data from upstream and downstream, maintain the communication between the system of the present invention and each terminal device and each application system, monitor data transmission, capture incoming data streams, and ensure the integrity and accuracy of the data; the data reorganization is used to convert the format and structure the received data; the data service is used to provide the converted data to each application system and terminal device; the data access is used to manage and control the storage and retrieval of data, realize the definition of data storage strategy and data access control, ensure that data can be transmitted efficiently, and support fast and reliable reading operations.
5. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 4 is characterized in that: The specific steps of data receiving include: (1) Establish a communication interface; (2) Data monitoring; (3) Data verification; (4) Buffer management; The specific steps of data reorganization include: (1) The parser identifies the received data; (2) Data cleaning; (3) Format conversion; (4) Data standardization; The specific steps of the data service include: (1) Providing API interface; (2) Integrated computing engine; (3) Ensure data security; The specific steps of data access include: (1) Database integration; (2) Data index; (3) Data persistence; (4) Backup and recovery; (5) Data optimization.
6. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 1 is characterized in that: The protocol conversion unit includes command parsing, data protocol scheduling, parsing raw data and parsing standard protocol data; the command parsing is used to understand and process control commands or requests sent from various application systems; the data protocol scheduling is used to manage and coordinate the conversion and communication between different data protocols, dynamically select the appropriate data protocol for data parsing according to the data type of the current communication data source, and ensure that the data is transmitted and processed according to the correct protocol; The parsed raw data is used to process and convert the unprocessed raw data sent by each terminal device, identify and parse the raw data format, and convert the data from the local format of each terminal device to the standard format agreed upon by the system of the present invention; the parsed standard protocol data is used to parse and identify the standard data format agreed upon by the system of the present invention, and convert it into a data format recognizable by the current communication device, so as to facilitate the flow of data between different application systems and terminal devices.
7. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 6 is characterized in that: The specific steps of command parsing include: (1) Protocol identification; (2) Semantic analysis; (3) Command conversion; (4) Authentication and routing; The specific steps of the data protocol scheduling include: (1) Protocol preloading; (2) Dynamic loading; (3) Protocol adaptation; The specific steps of analyzing the original data include: (1) Data format identification; (2) Data decoding; (3) Data verification; (4) Data mapping; The specific steps of parsing the standard protocol data include: (1) Standard format definition; (2) Data conversion; (3) Data encapsulation; (4) Data serialization.
8. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 1 is characterized in that: The terminal communication unit includes command reception, communication protocol loading and terminal communication; the command reception is used to receive control commands, configuration instructions or query requests for terminal devices from various application systems, and is responsible for monitoring and receiving various commands, performing preliminary parsing and verification of the commands, and passing them to subsequent processing modules to perform corresponding operations; the communication protocol loading is used to load and initialize the communication protocol used by the current communication device to support communication between the system of the present invention and various terminal devices; the terminal communication is used to realize data communication between the system of the present invention and various terminal devices, and perform actual data transmission operations to ensure that data is correctly transmitted according to the established communication protocol, while handling possible communication errors and exceptions.
9. The multi-source heterogeneous terminal equipment rapid integration and scheduling system according to claim 8, characterized in that: The specific steps of command receiving include: (1) The monitoring service continues to monitor; (2) Command parsing; (3) Command conversion; (4) Authentication and authorization; The specific steps of loading the communication protocol include: (1) Protocol identification; (2) Communication establishment; (3) Communication maintenance; The specific steps of the terminal communication include: (1) Data transmission; (2) Data reception; (3) Error handling; (4) Flow control; (5) Communications monitoring.
10. A method for rapid integration and scheduling of multi-source heterogeneous terminal devices, implemented according to the system for rapid integration and scheduling of multi-source heterogeneous terminal devices according to any one of claims 1 to 9, characterized in that: The following steps are involved: S1, parameter configuration: According to actual needs, information configuration of each application system parameter, terminal device parameter, data protocol and communication protocol is performed in the parameter configuration unit; S2, command reception and processing: The application system sends a terminal device control command to the system of the present invention, and the command is routed to the data processing unit. The data processing unit automatically calls the configuration information of the relevant application read by the parameter configuration unit and parses the command according to the configuration information; If it is a query command, first check whether the query content exists in the cache of the data storage unit. If it exists, return it directly. If it does not exist, send the command directly. If it is other types of commands, send it directly. S3, convert commands by protocol: The terminal device control command is forwarded to the protocol conversion unit via the data processing unit. After receiving the command, the protocol conversion unit first reads the data protocol configuration information through the parameter configuration unit, then parses the command and reassembles the command into a protocol command recognizable by the terminal device according to the corresponding data protocol, and then sends the command to the terminal communication unit; S4, send a command to the terminal device: The terminal communication unit receives the command parsed by the protocol conversion unit, reads the relevant configuration information through the parameter configuration unit to load the communication protocol, and sends the communication commands that can be recognized by various terminal devices to realize the scheduling of different terminal devices; S5, terminal device monitoring: The terminal communication unit traverses all the terminal devices that the system of the present invention needs to monitor during initialization, schedules the communication protocol according to the configuration information of the terminal device, establishes a connection with the terminal device and monitors the terminal device; After receiving the information reported by the terminal device, the terminal communication unit stores the original data in the original database of the data storage unit and returns it to the protocol conversion unit; S6, convert data according to protocol: After receiving the original data returned by the terminal communication unit, the protocol conversion unit first reads the data protocol configuration through the parameter configuration unit, then loads the corresponding data protocol to parse the original data, then reorganizes the data according to the standard protocol, and finally stores the standard protocol data in the standard database of the data storage unit and forwards it to the data processing unit; S7, data reorganization: After receiving the standard protocol data returned by the protocol conversion unit, the data processing unit first reads the application system configuration information through the parameter configuration unit, then reorganizes the data according to the data format required by the application system and updates the cache of the data storage unit, and finally returns the data according to the interaction method required by the application system; S8, Data storage: During the use of the system of the present invention, the converted standard protocol data is managed by the standard database; the original data reported by each terminal device is managed by the original database; the data that needs to be stored for a long time is managed by the data backup library; The cache is used to store and direct data served by the application system and other frequently used data.
Citation Information
Patent Citations
Edge proxy gateway
CN116055575A
Data management method and device for multi-terminal access gateway
CN117201631A
Cited By
Station control subsystem communication configuration design based on heterogeneous network protocol
CN121283857A