A distributed network data remote capture system based on cloud technology

Abstract

This invention relates to a distributed network data remote capture system based on cloud technology, comprising: at least one TAP device, wherein the TAP device is installed at the exit of the target network; each TAP device interacts with the cloud through a control channel; each TAP device interacts with a restoration device through a service channel; each TAP device can access the Internet. The TAP device installation conditions of this invention are relaxed, and the adoption of cloud technology makes it possible to centrally manage a large number of devices and services, thus making the system more flexible.

Description

Technical Field

[0001] This invention relates to the field of communication technology, specifically to a distributed network data remote capture system based on cloud technology. Background Technology

[0002] Numerous data acquisition and analysis systems are widely used in fields such as cybersecurity, network data analysis, and criminal investigation. These systems typically involve both software and hardware operating simultaneously. From traditional data analysis platforms to remote data analysis platforms, network data acquisition and analysis have become highly convenient and efficient. However, with the development of these fields, the volume of target data and the variety of end-user access methods have exploded. For the ever-increasing number of hardware platforms and numerous distributed systems, a pressing issue arises: how to maintain efficient management of these systems. Summary of the Invention

[0003] The purpose of this invention is to provide a distributed network data remote capture system based on cloud technology to solve the problems mentioned in the background.

[0004] To achieve the above objectives, the present invention provides the following technical solution: a distributed network data remote capture system based on cloud technology, comprising: at least one TAP device, wherein the TAP device is installed at the exit of the target network; each TAP device interacts with the cloud through a control channel; each TAP device interacts with a restoration device through a service channel; and each TAP device can access the Internet.

[0005] Optionally, the cloud is a device management platform that manages multiple TAP devices in a unified manner, enabling one or more of the following: viewing device status, viewing target network-related information, and viewing downstream access network user information.

[0006] Optionally, the TAP device supports one or more of the following: FTTX access mode and electrical Ethernet line access mode, including but not limited to.

[0007] Optionally, the restoration device is equipped with multiple mirror ports, and the target data collected by the restoration device is distributed as needed to one or more third-party data analysis devices on the same network.

[0008] Optionally, the restoration device has NAT functionality, allowing the actual network exit of the target data to be migrated from the target network to the network where the restoration device is located.

[0009] Optionally, the TAP device borrows a line under the target network, the cloud reports a feature message, the message contains basic information and verification information of the TAP device; the cloud starts to manage the TAP device after receiving the feature message and passing the verification.

[0010] Optionally, the cloud remotely manages the online TAP device, when it is determined that the service data of the TAP device needs the corresponding restoration device, the cloud allocates the data of the TAP device to the corresponding restoration device, and the cloud can always manage the TAP device in the whole process.

[0011] Compared with the prior art, the beneficial effects of the present application are:

[0012] The present application is a distributed network data remote grabbing system based on cloud technology, the TAP device has loose erection conditions, the adoption of cloud technology makes it possible to centrally manage a large number of devices and services, and the system is more flexible. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 The control method flowchart of the present application. DETAILED DESCRIPTION

[0014] In order to further illustrate the technical means and effects adopted by the present application to achieve the predetermined invention purposes, the specific embodiments, structures, features and effects according to the present application are described in detail below in combination with the drawings and preferred embodiments.

[0015] As shown in Figure 1 A distributed network data remote grabbing system based on cloud technology, comprising: at least one TAP device, the TAP device is erected at the outlet of the target network; each TAP device interacts with the cloud through a control channel; each TAP device interacts with a restoration device through a service channel; each TAP device can access the Internet to realize data backhaul.

[0016] The cloud is a device management platform, the TAP device does not directly communicate with any restoration device in the default state, instead, it communicates with the cloud, the cloud uniformly manages multiple TAP devices, and can realize one or more of device state viewing, target network related information viewing, and downstream access network user information viewing.

[0017] When the TAP device needs to confirm the network address of the corresponding remote network restoration device, the cloud can play the role of "allocator", that is, through the management channel, using the confirmed address, the TAP device is allocated to the corresponding remote network restoration device for use; when the network address of the remote restoration device corresponding to the TAP device is changed, the TAP device can be configured and modified again through the cloud; when the remote restoration device of the TAP device is offline due to various possible reasons, the TAP device can be recycled by the cloud, so as to be re-allocated.

[0018] The application adopts a management channel and a service channel separated from each other. The management channel is a channel for bidirectional communication between the TAP device and the cloud, and the service channel is a channel for the TAP device to send data of a target network to a restoration device, and a channel for the restoration device to inject data to the target network. The application can realize the effect of separating management from service, so that the remote network restoration device can focus on processing the received data without needing to manage the front end, and the cloud can focus on managing all TAP devices without needing to care about massive service traffic. The application has great flexibility, and the management channel and the service channel can also be shared in essence to be compatible with a traditional distributed mode.

[0019] The TAP device supports one or more of FTTX access modes and electrical Ethernet lines, but is not limited to them.

[0020] The restoration device plays a role of collecting and distributing a large amount of target data, and still supports remote management of the TAP device. The restoration device is provided with multiple groups of mirror ports, and the target data collected by the restoration device can be distributed to one or more third-party data analysis devices under the same network on demand. The restoration device has a NAT function, allowing the actual network exit of the target data to be migrated from the target network to the network where the restoration device is located.

[0021] The TAP device borrows a line under the target network, the cloud reports a characteristic message, the message contains basic information and verification information of the TAP device; the cloud starts to manage the TAP device after receiving the characteristic message and passing the verification.

[0022] The cloud remotely manages the online TAP device, and when it is determined that the service data of the TAP device needs the corresponding restoration device, the cloud allocates the data of the TAP device to the corresponding restoration device, and in the whole process, the cloud can always manage the TAP device.

[0023] The high compatibility of the hardware device of the application can meet most application scenarios, reduces the compatibility cost and complexity of the system, and achieves complete separation of the business logic and the target network type. Secondly, the construction cost and difficulty of the TAP device and the network restoration device are greatly reduced due to the line type self-adaptation, optical path attenuation automatic adjustment and user line multiplexing technology. Most importantly, due to the use of the cloud, the unified centralized management of a large number of devices and services becomes possible, and the flexibility of the system is stronger.

[0024] The above is only a preferred embodiment of the application, and does not limit the application in any form. Although the application has been disclosed as above with a preferred embodiment, it is not intended to limit the application. Any person skilled in the art can make some changes or modifications to the above disclosed technical content to obtain equivalent embodiments with equivalent changes, without departing from the technical solution of the application. Any modification, change, modification and modification of the above embodiments according to the technical essence of the application are still within the scope of the technical solution of the application.

Claims

1. A cloud technology-based distributed network data remote crawling system, characterized in that, The application relates to a network data recovery system, comprising: at least one TAP device, which is arranged at the outlet of a target network; each TAP device interacts with a cloud through a control channel; each TAP device interacts with a restoration device through a service channel; each TAP device can access the Internet; the cloud is a device management platform, which uniformly manages a plurality of TAP devices, and realizes one or more of the following functions: device state checking, target network related information checking, downstream access network user information checking, etc.; the TAP device supports one or more of the following modes: FTTX access mode and electrical Ethernet line access mode, etc.; the restoration device is provided with a plurality of image ports, and target data collected by the restoration device is distributed to one or more third-party data analysis devices in the same network as required; the restoration device has a NAT function, which allows the actual network outlet of target data to be migrated from a target network to a network where the restoration device is located; the TAP device borrows a line in the target network, and reports a characteristic message to the cloud, wherein the message contains basic information and verification information of the TAP device; after receiving the characteristic message and passing the verification, the cloud starts to manage the TAP device; the cloud remotely manages the online TAP device, and when it is determined that the service data of the TAP device needs a corresponding restoration device, the cloud distributes the data of the TAP device to the corresponding restoration device, and in the whole process, the cloud can always manage the TAP device.

Images