Heterogeneous unmanned device access handling apparatus and method

Abstract

The application belongs to the technical field of communication, and discloses a heterogeneous unmanned device access processing device and method. The access processing device comprises five parts of a first module, a second module, a fourth module, a third module and a fifth module. Through the cooperative work of the modules, the access and flexible adjustment of various heterogeneous unmanned devices can be supported at a low cost, and effective network security protection capability is provided to meet the needs of unmanned application fields in terms of integrated cost and security.

Description

Technical Field

[0001] This application belongs to the field of communication technology, and in particular relates to a heterogeneous unmanned equipment access processing device and method. Background Technology

[0002] Unmanned equipment is increasingly widely used in various fields, and its level of intelligence is constantly improving. It is gradually evolving from single devices performing simple tasks to multiple devices collaboratively performing complex tasks. How to connect multiple unmanned devices, acquire sensory information, and perform unified control is a crucial foundation for realizing collaborative work among multiple unmanned devices.

[0003] Unmanned aerial vehicles (UAVs) typically consist of a control station and unmanned platforms. The controller connects to one or more UAVs via telemetry and data transmission communication links, enabling operation control and data transmission. Depending on the scale of the UAVs, the relationship between the control station and the UAVs may be one-to-one or one-to-many. If unified control of a large number of complex UAVs is required, the control station generally consists of multiple communication devices and device control terminals. Communication devices include data transmission and telemetry terminals, each of which may connect to one or more UAVs. The device control terminal (or server) provides functions such as processing data transmitted from the UAVs and providing a human-machine interface, serving as the "brain" of the multi-UAV system. Multiple devices within the control station are connected via a network, which may physically be a local area network (LAN) or a wide area network (WAN), potentially including various network and security equipment. Figure 1 As shown.

[0004] Figure 1 In the current design, multiple unmanned devices can be connected and exchange data, supporting unified data processing and control of multiple unmanned devices on the device control terminal. However, the communication and control mechanisms between the control station and various unmanned devices are tightly coupled, which to some extent limits the independent update and evolution of the control program and unmanned devices. Especially when the system needs to integrate multiple heterogeneous unmanned devices from different manufacturers with different communication protocols, it will face some challenges in terms of cost, scalability, and security.

[0005] (1) The communication data protocols of different unmanned devices may be significantly different. When it is necessary to replace unmanned devices or upgrade the control program, it is necessary to modify the unmanned control and data processing software of the device control terminal, and it may also be necessary to modify parameters such as firewall security policies and network forwarding policies in the network. If the unmanned devices and system applications belong to multiple different manufacturers, it will bring a lot of new work.

[0006] (2) Different unmanned devices may have different security levels, but the system has not established appropriate security protection measures on the control station side, which may lead to malicious personnel using a certain unmanned device as a springboard to attack other unmanned devices or device control terminals in the system, causing serious impact.

[0007] (3) Many small unmanned equipment products with simple functions on the market adopt integrated unmanned control stations, that is, the measurement and control / data transmission communication and unmanned operation program are integrated in a single remote control device. They do not directly provide separate communication terminals and equipment control terminal products. They cannot be integrated into the system without separate customization.

[0008] Therefore, there is an urgent need to design a processing method that is more adaptable to the access of various heterogeneous unmanned devices. First, it should provide good scalability to adapt to the flexible access of unmanned devices with various technologies. Second, it should have a sound security protection mechanism to support the rapid integration and application of various heterogeneous unmanned devices. Summary of the Invention

[0009] The purpose of this application is to overcome the problems of the prior art by disclosing a heterogeneous unmanned equipment access processing device and method, which can support the access and flexible adjustment of multiple heterogeneous unmanned equipment at a low cost and provide effective network security protection capabilities to meet the needs of unmanned application fields in terms of integration cost and security.

[0010] On the one hand, the objective of this application is achieved through the following technical solution:

[0011] A heterogeneous unmanned equipment access processing device, the heterogeneous unmanned equipment access processing device comprising:

[0012] Several first modules are deployed on the equipment control terminal of each unmanned device, and are used as interfaces for issuing control commands to the unmanned device and for extracting and uploading data at the equipment control terminal.

[0013] Several second modules are connected point-to-point to the equipment control terminal of each unmanned device, so as to realize the connection between the access processing device and the equipment control terminal of each unmanned device, so as to send control commands to the corresponding first module and receive the feedback data sent from the first module.

[0014] The third module, through a robust security design, enables controlled data exchange between modules within the access processing device via independent channels.

[0015] The fourth module establishes a data connection with each of the first modules through the third module to realize the identity authentication and access control of various heterogeneous unmanned devices, and to adapt and convert different control commands and returned data. The conversion process includes converting the data uploaded by the unmanned devices into the same format and sending it to the fifth module, and converting the control commands issued by the fifth module into data formats that can be recognized by different unmanned devices and sending them to different device control terminals.

[0016] The fifth module performs comprehensive processing of the data uploaded by the fourth module, generates control commands for each unmanned device, and sends them to the fourth module. The fifth module is also connected to an external centralized device control terminal to provide a human-machine interface for the operator.

[0017] According to a preferred embodiment, the first module is embedded in the software of the device control terminal.

[0018] According to a preferred embodiment, the robust security design within the third module includes: independent switching channels, network isolation, and traffic filtering measures.

[0019] According to a preferred embodiment, the data exchange relationship within the third module is as follows:

[0020] The second module and the fourth module can exchange data bidirectionally, and the fourth module and the fifth module can exchange data bidirectionally. However, different second modules cannot exchange data directly, and the second module and the fifth module cannot exchange data directly.

[0021] On the other hand, this application also discloses:

[0022] A method for processing heterogeneous unmanned equipment access, based on the aforementioned access processing device, the method comprising:

[0023] S1. A security authentication process is executed between the first module and the fourth module. The fourth module controls the third module to open the corresponding business data exchange path.

[0024] S2. The first module obtains the data to be collected and uploaded according to the external interface protocol of the device control terminal, and sends it to the fourth module through the second module;

[0025] S3. The second module performs internal and external interface conversion, sending the data sent by the first module to the third module;

[0026] S4. The third module will exchange the collected data received from the second module with the fourth module;

[0027] S5. After receiving the collected data from various unmanned devices, the fourth module performs data normalization processing, converting data of different formats into the same data format, and then sends the converted data to the third module.

[0028] S6. The third module will exchange the collected data received from the fourth module with the fifth module;

[0029] S7. The fifth module receives collected data in the same format from different unmanned devices from the third module, performs comprehensive processing as needed, and realizes joint environmental perception and data fusion of multiple devices.

[0030] S8. The fifth module generates control commands for each unmanned device based on user operations or preset strategies and sends them to the third module.

[0031] S9. The third module switches the control commands to the fourth module;

[0032] S10. The fourth module converts the control commands sent from the fifth module into control commands that meet the data format requirements of different unmanned equipment, and then sends them to the third module.

[0033] S11, The third module will exchange control commands for different unmanned devices with the corresponding second module;

[0034] S12. The second module performs internal and external interface conversion and sends control commands to the connected first module.

[0035] S13. The first module sends control commands to the device control terminal according to the external interface protocol of the device control terminal, and the device control terminal executes the subsequent commands.

[0036] According to a preferred embodiment, the heterogeneous unmanned equipment access processing method further includes: S0, generating a device identity identifier in the first module of each unmanned equipment.

[0037] According to a preferred embodiment, in step S2, the data collected and uploaded includes: unmanned equipment data and unmanned equipment operating status data.

[0038] The aforementioned main solution and its various further alternative solutions can be freely combined to form multiple solutions, all of which are solutions that can be adopted and are claimed in this application. Those skilled in the art, after understanding the solution of this application, will realize that there are many combinations based on the prior art and common general knowledge, all of which are technical solutions to be protected in this application, and will not be exhaustively listed here.

[0039] The beneficial effects of this application are:

[0040] 1) Perform data and command normalization conversion processing on unmanned devices with different interface protocols and data interface protocols, so that the types of unmanned devices in the system can be flexibly expanded and unmanned devices can be quickly upgraded.

[0041] 2) For the comprehensive data processing and control functions of unmanned equipment, only a single protocol needs to be processed, which facilitates rapid iteration of the application on the centralized control side and reduces the cost of application innovation;

[0042] 3) It can be connected through the equipment control terminal provided by the unmanned equipment itself, and can be widely adapted to a variety of unmanned equipment without special modification;

[0043] 4) The use of highly secure partitioning and isolation methods improves the security of the system and avoids systemic impact caused by the infiltration of a single unmanned device. Attached Figure Description

[0044] Figure 1 This is the existing method for accessing multiple unmanned devices;

[0045] Figure 2 This is a schematic diagram of the principle structure of the heterogeneous unmanned equipment access processing device of this application;

[0046] Figure 3 This is a flowchart illustrating the heterogeneous unmanned equipment access processing method of this application. Detailed Implementation

[0047] The following specific examples illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be noted that, unless otherwise specified, the following embodiments and features in the embodiments can be combined with each other.

[0048] It should be noted that similar reference numerals and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In the description of this application, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the figures, or the orientation or positional relationship commonly used when the product of this application is in use. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application. Furthermore, the terms "first," "second," and "third," etc., are only used to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0049] In the description of this application, it should also be noted that, unless otherwise expressly specified and limited, the terms "set up," "install," "connect," and "link" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0050] Furthermore, it should be noted that unless otherwise specified in this application, the specific structures, connections, positions, power sources, etc. involved are all things that a person skilled in the art can know without creative effort based on the prior art.

[0051] refer to Figure 2 , Figure 3 As shown, this application discloses a heterogeneous unmanned equipment access processing device, which includes: a plurality of first modules, a plurality of second modules, a third module, a fourth module, and a fifth module.

[0052] Preferably, each first module is deployed on the device control terminal of each unmanned device. It is generally software embedded in the device control terminal and is used as an interface for issuing control commands to the unmanned device and for extracting and uploading data at the device control terminal.

[0053] Preferably, the second module is connected point-to-point to the device control terminal of each unmanned device, so as to realize the connection between the access processing device and the device control terminal of each unmanned device, so as to send control commands to the corresponding first module and receive the feedback data sent from the first module.

[0054] Preferably, the third module employs a robust security design (including but not limited to independent switching channels, network isolation, and traffic filtering) to enable controlled data exchange between modules within the access processing device via independent channels.

[0055] The data exchange relationships are as follows: bidirectional exchange between the second module and the fourth module, bidirectional exchange between the fourth module and the fifth module, but data cannot be directly exchanged between different second modules, and data cannot be directly exchanged between the second module and the fifth module.

[0056] Preferably, the fourth module establishes a data connection with each of the first modules via the third module to realize the identity authentication and access control of various heterogeneous unmanned devices, and to adapt and convert different control commands and transmitted data.

[0057] The conversion process includes converting the data uploaded by the unmanned equipment into the same format and sending it to the fifth module, and converting the control commands issued by the fifth module into data formats that can be recognized by different unmanned equipment and sending them to different equipment control terminals.

[0058] Preferably, the fifth module performs comprehensive processing of the data uploaded by the fourth module, generates control commands for each unmanned device, and sends them to the fourth module. The fifth module is connected to an external centralized device control terminal to provide a human-machine interface for the operator.

[0059] The specific methods for handling the integration of multiple heterogeneous unmanned devices are as follows:

[0060] Step S0: Generate device identification in the first module of each unmanned device.

[0061] Step S1: The first module and the fourth module perform a security authentication process, and the fourth module controls the third module to open the corresponding business data exchange channel.

[0062] Step S2: The first module obtains the data to be collected and uploaded according to the external interface protocol of the device control terminal, such as unmanned equipment data including environmental images and unmanned equipment operating status data, and sends it to the fourth module through the second module.

[0063] Step S3: The second module performs internal and external interface conversion, sending the data sent by the first module to the third module.

[0064] Step S4: The third module exchanges the collected data received from the second module with the fourth module.

[0065] Step S5: After receiving the collected data from various unmanned devices, the fourth module performs data normalization processing, converting data of different formats into the same data format, and then sends the converted data to the third module.

[0066] Step S6: The third module exchanges the collected data received from the fourth module with the fifth module.

[0067] Step S7: The fifth module receives the same format of collected data from different unmanned devices from the fourth module, performs comprehensive processing as needed, and realizes multi-device joint environmental perception and data fusion.

[0068] Step S8: The fifth module generates control commands for each unmanned device based on user operation or preset strategy and sends them to the third module.

[0069] Step S9: The third module exchanges the control commands to the fourth module.

[0070] Step S10: The fourth module converts the control commands sent by the fifth module into control commands that meet the data format requirements of different unmanned equipment, and then sends them to the third module.

[0071] Step S11: The third module exchanges control commands for different unmanned devices with the corresponding second module.

[0072] Step S12: The second module performs internal and external interface conversion and sends control commands to the connected first module.

[0073] Step S13: The first module sends control commands to the device control terminal according to the external interface protocol of the device control terminal, and the device control terminal executes the subsequent commands.

[0074] This application normalizes and converts data and commands for unmanned devices with different interface protocols and data interface protocols, enabling flexible expansion of unmanned device types and rapid upgrades. The comprehensive data processing and control functions of unmanned devices only require handling a single protocol, facilitating rapid iteration of the centralized control application and reducing the cost of application innovation. The application uses the device control terminal provided by the unmanned device itself for connection, allowing for broad adaptation to various unmanned devices without special modifications. Furthermore, the application employs highly secure partitioning and isolation methods to improve system security and prevent systemic impact caused by the infiltration of a single unmanned device.

[0075] Application Cases

[0076] In an example of an access processing device that utilizes a variety of heterogeneous unmanned devices for environmental image capture, the relevant functional entities include multiple device control terminals (containing access agent software, i.e., the first module), one access processing device (containing n second modules, one third module, one fourth module, and one fifth module), and one centralized device control terminal.

[0077] Each unmanned device's control terminal embeds access agent software. The control terminal connects to the access processing device via Ethernet, USB, or Wi-Fi interfaces. Inside the access processing device, a third module connects to the second, fourth, and fifth modules via Ethernet. This third module is implemented using dedicated programmable hardware and only supports data exchange through preset channels and formats. The fifth module connects to the centralized device control terminal via an Ethernet interface.

[0078] Based on the corresponding access processing device, the specific implementation steps include:

[0079] Step S1: The access agent software in each device control terminal performs two-way authentication with the fourth module based on the preset unmanned device identity (through the second and third modules; similar connection forwarding relationships will not be elaborated on later).

[0080] In step S2, after authentication is completed, the fourth module controls the third module to open the business data exchange channel with the corresponding access agent, and then bidirectional data communication can be carried out with the access agent.

[0081] Step S3: The access agent obtains the action status and captured image data of the unmanned device from the device control terminal and sends it to the fourth module. The data format and encapsulation protocol of different unmanned devices can be different.

[0082] Step S4: The fourth module converts data from multiple protocol formats into a single protocol format.

[0083] Step S5: The fourth module sends the converted single-format data to the fifth module.

[0084] Steps S6-7: The fifth module processes multiple data streams, enables functions such as image fusion, and can provide information such as the status and images of unmanned equipment to the centralized equipment control terminal.

[0085] Step S8: The operator issues new unmanned equipment movement and shooting operations through the centralized equipment control terminal.

[0086] In steps S9-S10, the fifth module generates control commands for the unmanned equipment based on user operations and sends them to the fourth module.

[0087] Steps S11-12: The fourth module converts the control commands, converts them into the corresponding format according to the interface protocol rules of different unmanned devices, and then sends them to the corresponding access agent software.

[0088] Step S13: The access agent software sends control commands to the device control terminal for execution.

[0089] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A heterogeneous unmanned equipment access processing device, characterized in that, The heterogeneous unmanned equipment access processing device includes: Several first modules are deployed on the equipment control terminal of each unmanned device, and are used as interfaces for issuing control commands to the unmanned device and for extracting and uploading data at the equipment control terminal. Several second modules are connected point-to-point to the equipment control terminal of each unmanned device, so as to realize the connection between the access processing device and the equipment control terminal of each unmanned device, so as to send control commands to the corresponding first module and receive the feedback data sent from the first module. The third module, through a robust security design, enables controlled data exchange between modules within the access processing device via independent channels. The fourth module establishes a data connection with each of the first modules through the third module to realize the identity authentication and access control of various heterogeneous unmanned devices, and to adapt and convert different control commands and returned data. The conversion process includes converting the data uploaded by the unmanned devices into the same format and sending it to the fifth module, and converting the control commands issued by the fifth module into data formats that can be recognized by different unmanned devices and sending them to different device control terminals. The fifth module performs comprehensive processing of the data uploaded by the fourth module, generates control commands for each unmanned device, and sends them to the fourth module. The fifth module is also connected to an external centralized device control terminal to provide a human-machine interface for the operator.

2. The heterogeneous unmanned equipment access processing device as described in claim 1, characterized in that, The first module is embedded in the software of the device control terminal.

3. The heterogeneous unmanned equipment access processing device as described in claim 1, characterized in that, The robust security design within the third module includes: independent switching channels, network isolation, and traffic filtering measures.

4. The heterogeneous unmanned equipment access processing device as described in claim 3, characterized in that, The data exchange relationship within the third module is as follows: The second module and the fourth module can exchange data bidirectionally, and the fourth module and the fifth module can exchange data bidirectionally. However, different second modules cannot exchange data directly, and the second module and the fifth module cannot exchange data directly.

5. A method for processing heterogeneous unmanned equipment access, characterized in that, Based on the access processing apparatus according to any one of claims 1 to 4, the heterogeneous unmanned equipment access processing method includes: S1. A security authentication process is executed between the first module and the fourth module. The fourth module controls the third module to open the corresponding business data exchange path. S2. The first module obtains the data to be collected and uploaded according to the external interface protocol of the device control terminal, and sends it to the fourth module through the second module; S3. The second module performs internal and external interface conversion, sending the data sent by the first module to the third module; S4. The third module will exchange the collected data received from the second module with the fourth module; S5. After receiving the collected data from various unmanned devices, the fourth module performs data normalization processing, converting data of different formats into the same data format, and then sends the converted data to the third module. S6. The third module will exchange the collected data received from the fourth module with the fifth module; S7. The fifth module receives collected data in the same format from different unmanned devices from the third module, performs comprehensive processing as needed, and realizes joint environmental perception and data fusion of multiple devices. S8. The fifth module generates control commands for each unmanned device based on user operations or preset strategies and sends them to the third module. S9. The third module switches the control commands to the fourth module; S10. The fourth module converts the control commands sent from the fifth module into control commands that meet the data format requirements of different unmanned equipment, and then sends them to the third module. S11, The third module will exchange control commands for different unmanned devices with the corresponding second module; S12. The second module performs internal and external interface conversion and sends control commands to the connected first module. S13. The first module sends control commands to the device control terminal according to the external interface protocol of the device control terminal, and the device control terminal executes the subsequent commands.

6. The heterogeneous unmanned equipment access processing method as described in claim 5, characterized in that, The heterogeneous unmanned equipment access processing method further includes: S0, generating a device identity identifier in the first module of each unmanned equipment.

7. The heterogeneous unmanned equipment access processing method as described in claim 5, characterized in that, In step S2, the data collected and uploaded includes: data collected by the unmanned equipment and data on the operating status of the unmanned equipment.

Images