A pre-processing system applied between an edge gateway and a computing unit

Abstract

The application relates to a preprocessing system applied between an edge gateway and a computing unit, which comprises an edge gateway chip, a bus control module, a connection module, a network interface module, an edge device module and a data acquisition module; the data acquisition module comprises a plurality of sensors and is used for acquiring required data; the edge gateway chip is used for data prestorage and classification preprocessing of the acquired data; the edge device module comprises a plurality of edge devices and is used for receiving the data after classification preprocessing; the bus control module comprises a plurality of bus controllers and is arranged on a bus of each edge device and is used for controlling access and data transmission of the bus; the connection module is used for connecting the edge devices and transmitting data; and the network interface module is used for providing virtual connection processing and maintenance, nested multi-tenant support, connection pool management and flow control functions.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of edge gateway computing and converged communication technology, and particularly relates to a preprocessing system applied between an edge gateway and a computing unit. BACKGROUND

[0002] Edge computing can bring better computing performance to various devices, but the data transmission between edge devices has become a bottleneck in the industrial chain because of the limitations in fast data transmission and integration.

[0003] In the early design architecture of edge computing, the computing unit needs to undertake the work of Internet of Things connector, data aggregation, and edge computing at the same time. With the increasing number of front-end sensors, the total number of categories, and the data size, these works become more and more heavy. Therefore, in order to avoid network congestion and system lag caused by the exhaustion of computing unit resources, we need a professional edge gateway chip to take over the unified data link and deliver it to the computing unit, design a high-speed data bus to realize data aggregation, ensure that data collection and application are more convenient, and improve the application efficiency of the system. SUMMARY

[0004] In order to solve the problems existing in the prior art, the present application provides a preprocessing system applied between an edge gateway and a computing unit.

[0005] The technical scheme of the present application is as follows:

[0006] On the one hand, the present application provides a preprocessing system applied between an edge gateway and a computing unit, which comprises an edge gateway chip, a bus control module, a connection module, a network interface module, an edge device module, and a data acquisition module. The data acquisition module comprises a plurality of sensors for acquiring required data. The edge gateway chip is used for data pre-storage and classification preprocessing of the acquired data. The edge device module comprises a plurality of edge devices for receiving the data after classification preprocessing. The bus control module comprises a plurality of bus controllers arranged on the bus of each edge device for controlling the access and data transmission of the bus. The connection module is used for connecting each edge device and transmitting data. The network interface module is used for providing virtual connection processing and maintenance, nested multi-tenant support, connection pool management, and flow control functions.

[0007] As a preferred embodiment, the acquired required data comprises industrial video and various types of detection device data.

[0008] As a preferred embodiment, the specific steps of the edge gateway chip for classification preprocessing of the acquired data comprise:

[0009] The collected industrial video is pre-sliced to decompose the industrial video occupying large memory into several industrial videos occupying small memory.

[0010] The same type of detection device data in each type of detection device data is merged, and all the merged same type of detection device data is packaged into the same data packet.

[0011] As a preferred embodiment, all bus controllers of the bus control module can also be connected to the kernel of the general processor to complete the storage and access operations of data.

[0012] As a preferred embodiment, according to the bus controllers on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit each industrial video after classification preprocessing and the data packet after merging of each type of detection device data.

[0013] On the other hand, the application provides a preprocessing method applied between an edge gateway and a computing unit according to any one of claims 1-5, and the specific steps include:

[0014] The required data is collected by each sensor and uploaded to the edge gateway chip for pre-storage;

[0015] The collected data is classified and preprocessed by the edge gateway chip, and the data after classification preprocessing is simultaneously distributed to each edge device through the connection module;

[0016] Each edge device receives the data after classification preprocessing by the bus controller on the bus and intercepts the required data;

[0017] The network interface is arranged on each edge device to establish a virtual connection between each edge device to ensure stable transmission and processing of data.

[0018] As a preferred embodiment, the collected required data includes industrial video and each type of detection device data.

[0019] As a preferred embodiment, the specific steps of classification preprocessing of the collected data by the edge gateway chip include:

[0020] The collected industrial video is pre-sliced to decompose the industrial video occupying large memory into several industrial videos occupying small memory;

[0021] The same type of detection device data in each type of detection device data is merged, and all the merged same type of detection device data is packaged into the same data packet.

[0022] As a preferred implementation, all bus controllers of the bus control module can also be connected to the kernel of the general processor to complete the storage and access operations of data.

[0023] As a preferred implementation, according to the bus controllers on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit the data packets after the industrial videos and the data of various detection devices after classification preprocessing are combined.

[0024] The present application has the following beneficial effects:

[0025] 1. The present application classifies and pre-processes the collected data through the edge gateway chip, reduces the tasks that the edge computing unit needs to undertake, avoids network congestion and system lag caused by the exhaustion of computing unit resources, ensures more convenient data collection and application, and improves the application efficiency of the system.

[0026] 2. In the present application, each edge device is controlled through the bus controller thereon, and fine configuration between the bus controller and the logical channel can be performed according to the application scene.

[0027] 3. The bus controller of the present application can be directly connected to the processor kernel, eliminating the data transmission bottleneck between the general bus and the main memory, and reducing the system delay.

[0028] 4. The network interface of the present application has various functions such as providing virtual connection processing and maintenance, supporting nested multi-tenancy, connection pool management and flow control functions, etc., ensuring stable data transmission and processing functions. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 The present application is a system structure diagram. DETAILED DESCRIPTION

[0030] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0031] It should be understood that the step numbers used herein are only for the convenience of description, and are not limited to the execution sequence of the steps.

[0032] It is to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting thereof. As used in the description of the application and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0033] The terms "including" and "comprising" as used herein specify the presence of stated features, integers, steps, operations, elements, and / or components but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0034] The term "and / or" means any combination of one or more of the associated listed items and all possible combinations thereof.

[0035] Embodiment One:

[0036] Referring to Figure 1 A preprocessing system applied between an edge gateway and a computing unit includes an edge gateway chip, a bus control module, a connection module, a network interface module, an edge device module, and a data acquisition module. The data acquisition module includes a plurality of sensors for acquiring required data. The edge gateway chip is configured to pre-store and classify the acquired data. The edge device module includes a plurality of edge devices for receiving the classified data. The bus control module includes a plurality of bus controllers disposed on buses of the edge devices for controlling access to the buses and data transmission. The connection module is configured to connect the edge devices and transmit data. The network interface module is configured to provide virtual connection processing and maintenance, nested multi-tenant support, connection pool management, and flow control functions.

[0037] In this embodiment, a connection-oriented and highly customizable bus is established between the bus controllers, the physical buses of the connection module, and the network interface, and integrates central routing, broadcast, multicast, point-to-point communication, and end-to-end guaranteeing and other transmission modes to adapt to the needs of various application scenarios. Meanwhile, under the control of the bus controllers, the bus can also include a plurality of logical channels for processing data transmission of different data types.

[0038] The edge gateway chip provides a 20Gbps communication bandwidth for pre-storing data acquired by the sensors, and the 20Gbps communication bandwidth can be maximized for use between the front-end visual perception stream and other sensor data and the computing unit, while also providing high-reliability data transmission and shielding bandwidth fluctuations and data packet loss caused by network congestion through network adaptive technology.

[0039] As a preferred embodiment of the present embodiment, the required data collected includes industrial videos and various types of detection device data.

[0040] As a preferred embodiment of the present embodiment, the specific steps of the edge gateway chip for classifying and preprocessing the collected data include:

[0041] The industrial videos collected are pre-sliced to decompose the industrial videos occupying large memory into several industrial videos occupying small memory.

[0042] The detection device data of the same type in the various types of detection device data are merged, and all the merged detection device data of the same type are packaged into the same data packet.

[0043] In the present embodiment, the edge gateway chip merges the detection device data of the same type into an mqtt message and pushes the edge computing chip through the http protocol. In this case, the backend only needs to analyze one protocol and one bus, reducing the number of mass conversion and connection of front-end sensors.

[0044] The edge gateway chip pre-slices the industrial videos. In actual application, the original single 2M code stream 24 frame video data per second is decomposed into 6-8 dozens of k key frame data.

[0045] As a preferred embodiment of the present embodiment, all the bus controllers of the bus control module can also be connected to the kernel of the general processor to complete the storage and access operations of data.

[0046] In the present embodiment, the bus controller can perform memory mapping to transmit data on the bus, and can also be connected to the kernel of the general processor to complete the storage and access operations of data. The straight-through kernel eliminates the data transmission bottleneck between the general bus and the main memory, thereby reducing the system delay. Through memory mapping for data transmission, the management and debugging of the data transmission process are simplified.

[0047] As a preferred embodiment of the present embodiment, according to the bus controllers on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit the various industrial videos and the data packets of the various types of detection device data after merging.

[0048] In the present embodiment, the slices of the various industrial videos and the data packets of the various types of detection device data after merging are transmitted through different logical channels.

[0049] Embodiment Two:

[0050] A preprocessing method applied between the edge gateway and the computing unit according to any one of claims 1-5, the specific steps including:

[0051] The required data is collected by the sensors and uploaded to the edge gateway chip for pre-storage;

[0052] The collected data is classified and preprocessed by the edge gateway chip, and the data after classification and preprocessing is distributed to each edge device through the connection module;

[0053] Each edge device receives the data after classification and preprocessing through the bus controller on the bus and intercepts the required data;

[0054] The network interface is arranged on each edge device to establish a virtual connection between the edge devices to ensure stable transmission and processing of data.

[0055] As a preferred embodiment of the present embodiment, the collected required data includes industrial video and various types of detection device data.

[0056] As a preferred embodiment of the present embodiment, the specific steps of the edge gateway chip for classifying and preprocessing the collected data include:

[0057] The collected industrial video is pre-sliced to decompose the industrial video occupying large memory into several industrial videos occupying small memory;

[0058] The same type of detection device data in various types of detection device data is merged, and all the merged same type of detection device data is packaged into the same data packet.

[0059] As a preferred embodiment of the present embodiment, all bus controllers of the bus control module can also be connected to the kernel of the general processor to complete the storage and access operation of data.

[0060] As a preferred embodiment of the present embodiment, according to the bus controller on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit each industrial video after classification and preprocessing and the data packet after merging of various types of detection device data.

[0061] The above is only an embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation using the content of the present application specification and drawings, or direct or indirect application in other related technical fields, is also included in the patent protection scope of the present application.

Claims

1. A pre-processing system applied between an edge gateway and a computing unit, characterized in that, It comprises an edge gateway chip, a bus control module, a connection module, a network interface module, an edge device module and a data acquisition module; the data acquisition module comprises a plurality of sensors for acquiring required data; the edge gateway chip is used for data pre-storage and classification preprocessing of the acquired data; the edge device module comprises a plurality of edge devices for receiving the data after classification preprocessing; the bus control module comprises a plurality of bus controllers arranged on the bus of each edge device and used for controlling access and data transmission of the bus; the connection module is used for connecting each edge device and transmitting data; and the network interface module is used for providing virtual connection processing and maintenance, nested multi-tenant support, connection pool management and flow control functions. The specific steps of the edge gateway chip for classification preprocessing of the acquired data comprise: Pre-slicing processing is performed on the acquired industrial video, and the industrial video occupying large memory is decomposed into a plurality of industrial videos occupying small memory; The same type of detection device data in each type of detection device data is merged, and all the merged same type of detection device data is packaged into the same data packet; All the bus controllers of the bus control module can also be connected to the kernel of the general processor to complete data storage and access operations.

2. The pre-processing system for use between an edge gateway and a computing unit according to claim 1, characterized in that, The acquired required data comprises industrial video and each type of detection device data.

3. The pre-processing system for use between an edge gateway and a computing unit according to claim 1, characterized in that, According to the bus controllers on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit each industrial video after classification preprocessing and the data packet after merging of each type of detection device data.

4. A method of pre-processing applied between an edge gateway and a computing unit for a pre-processing system applied between an edge gateway and a computing unit according to any one of claims 1 to 3, characterized in that, The specific steps comprise: Required data is acquired by each sensor and uploaded to the edge gateway chip for pre-storage; The acquired data is classified and preprocessed by the edge gateway chip, and the data after classification preprocessing is simultaneously distributed to each edge device by the connection module; Each edge device receives the data after classification preprocessing by the bus controller on the bus and intercepts required data; The network interface is arranged on each edge device to establish virtual connection between each edge device to ensure stable transmission and processing of data; The specific steps of the edge gateway chip for classification preprocessing of the acquired data comprise: Pre-slicing processing is performed on the acquired industrial video, and the industrial video occupying large memory is decomposed into a plurality of industrial videos occupying small memory; The same type of detection device data in each type of detection device data is merged, and all the merged same type of detection device data is packaged into the same data packet; All the bus controllers of the bus control module can also be connected to the kernel of the general processor to complete data storage and access operations.

5. The pre-processing method for use between an edge gateway and a computing unit according to claim 4, characterized in that, The acquired required data comprises industrial video and each type of detection device data.

6. The pre-processing method for use between an edge gateway and a computing unit according to claim 4, characterized in that, According to the bus controllers on each edge device, a plurality of logical channels are configured on the bus of each edge device to transmit each industrial video after classification preprocessing and the data packet after merging of each type of detection device data.

Images