Lightweight cloud side system data real-time transmission device

By using timed triggering devices and status identifiers in the cloud edge system to record data status on the edge and cloud, the data interruption problem caused by network abnormalities is solved, real-time data recovery and continuous transmission are realized, and the reliability of data transmission is improved. and real-time.

CN119030943APending Publication Date: 2024-11-26RES INST OF ZHEJIANG UNIV TAIZHOU
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411065728.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The prior art cannot guarantee the real-time and continuity of data transmission at the edge and cloud in the cloud in the cloud system, especially when the network is abnormal, data cannot be restored from the breakpoint, resulting in data interruption and recovery process interruption.

Method used

By setting a timing trigger device on the edge, adding status identifiers to the data to be uploaded, and recording status identifiers and data when network abnormalities are found. When network recovery, data transmission is restored based on the latest status identification number of the cloud, and data is reduced by parallelism calculations. Recovery time to ensure data continuity and real-time.

Benefits of technology

It realizes continuous data recovery when the network environment is restored, reduces the data processing burden on the cloud and edge, improves the reliability and real-timeness of data transmission, and ensures data integrity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119030943A_ABST
    Figure CN119030943A_ABST
Patent Text Reader

Abstract

The invention provides a real-time data transmission device for a cloud edge system in a lightweight state. The real-time data transmission device comprises a plurality of edge ends and a cloud end, a timing trigger device is arranged in the edge end, and a state identifier is added into data to be uploaded by the timing trigger device; the edge end stores the added state identifier in a state record, and the cloud end obtains data uploaded by the edge end; if the network is abnormal, the cloud end records the latest received state identifier, and the current edge end stores the data to be uploaded in the data record and stores the state identifier corresponding to the stored data in the state record; if the network is recovered, the current edge end requests the newest state identification number from the cloud end, searches the data position corresponding to the newest state identification number in the data record, and uploads the stored data to the cloud end; according to the invention, continuity of process data of edge end and cloud end data transmission is ensured through state recording, and the problems of data interruption and discontinuous recovery process data caused by abnormal network environment in cloud edge data transmission are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of cloud computers, and in particular to a lightweight cloud-edge system data real-time transmission device. Background Art

[0002] The Industrial Internet of Things is a network of sensors and instruments connected to industrial applications through the Internet. The network uses IoT sensing and communication technologies to collect industrial application data and analyze the data. The purpose is to optimize the production process, improve production efficiency, reduce manufacturing costs, improve product quality, and ultimately achieve a new stage of upgrading traditional industries to intelligence. The Industrial Internet of Things achieves flexible configuration of production materials, on-demand execution of production processes, reasonable optimization of production processes, and rapid adaptation of production environments through network interconnection, data interoperability, and system interoperability of industrial resources, so as to achieve efficient utilization of resources and build a new service-driven industrial ecosystem. Edge computing is an open platform that provides intelligent services at the edge of the network close to the source of objects or data, integrating the core capabilities of network, computing, storage, and applications to meet the key needs of industry digitalization and intelligence. The data transmission of the cloud-edge system is to solve the problem of insufficient edge computing and storage capabilities, and data needs to be transmitted to the cloud for complex data calculation and storage.

[0003] In the process of industrial practice, network anomalies often occur, resulting in a brief interruption in the transmission of edge data to the cloud, and the data transmission can only be continued after the environment is restored. In the prior art, commonly used methods include: processing and storing data at the edge, and uploading the data to the cloud at the same time; or, providing a visual operation method to implement executable programs, so that edge tasks can be automatically processed, which greatly simplifies the complexity of executing tasks at the edge, and adds functions such as device discovery and cloud-edge data transmission to improve the collaboration between the cloud and the edge and the resource management capabilities of edge nodes. However, neither method mentions a solution to ensure the reliability of data during the transmission of data between the edge and the cloud. If the network is interrupted during the transmission process, the real-time and continuity of data transmission cannot be guaranteed. Therefore, it is necessary to propose a device that can ensure the real-time and continuity of data transmission between the edge and the cloud, improve the reliability of data transmission, Summary of the invention

[0004] In order to overcome the shortcomings of the prior art, the present invention provides a lightweight cloud-edge system data real-time transmission device, which ensures the continuity of process data between edge and cloud data transmission by recording the status, solves the problem of data interruption and discontinuity of recovery process data caused by abnormal network environment in cloud-edge data transmission, and can ensure that the network environment can restore the data from the breakpoint to ensure data continuity.

[0005] In order to achieve the above-mentioned object, the present invention provides a lightweight cloud-edge system data real-time transmission device, which includes: a plurality of edge terminals and a cloud;

[0006] A timing trigger device is provided in the edge end, and the timing trigger device adds a status identifier to the data to be uploaded; the edge end stores the added status identifier in the status record, and the cloud obtains the data uploaded by the edge end;

[0007] If the network is abnormal, the cloud records the latest received status identifier, and the current edge stores the data to be uploaded in the data record, and stores the status identifier corresponding to the stored data in the status record;

[0008] If the network is restored, the current edge terminal requests the latest status identification number from the cloud, searches for the data location corresponding to the latest status identification number in the data record, and uploads the stored data to the cloud.

[0009] Preferably, when the edge and the cloud perform data recovery, if the time difference between the real-time transmission device and the mark number stored in the edge is less than the trigger period of the timer trigger device, the edge stops storing data in the data record and uploads the data to be recovered directly to the cloud.

[0010] Preferably, when the network between the edge and the cloud is normal, the cloud filters out the status identification number information uploaded by the edge in the received data, and stores the status identification number in the status record; and processes the received data according to the business process of the cloud system.

[0011] Preferably, the real-time transmission device also includes a plurality of terminal devices, and the terminal devices upload data to the edge end via wireless communication, and the edge end aggregates and caches the data.

[0012] Preferably, when data is restored, the edge terminal predicts the parallelism of uploading data according to the stored data cache time, and the parallelism calculation formula is:

[0013]

[0014] Among them, t2 is the latest time on the cloud, t1 is the current edge system time, t1-t2 is the current edge disconnection time, p is the latest parallelism for starting to upload data, and e is a constant.

[0015] The present invention provides a lightweight cloud-edge system data real-time transmission device, which has the following beneficial effects:

[0016] 1. By using a timing trigger device in the edge end, a status identifier is added to the data to be uploaded. When the data is uploaded to the cloud, the edge end and the cloud end store the status identifier in the corresponding status record respectively; when the network is abnormal, the cloud end stores the latest received status identifier, and the edge end stores the data to be uploaded and the status identifier that has not been uploaded in the local data record and status record; if the network is restored, the edge end uploads the corresponding data according to the latest status identifier received by the cloud end to ensure data continuity.

[0017] 2. During data transmission, the cloud only stores status identifiers instead of data to ensure real-time data recovery, making the cloud lightweight and reducing the burden of cloud data processing.

[0018] 3. During the data upload process on the edge, the data is stored in the record only when the transmission is interrupted. After the set time condition is met, the edge will no longer store the data and resume the normal data upload process, making the local resources on the edge lightweight and reducing the local pressure on the edge.

[0019] 4. The present invention calculates the degree of parallelism by the interruption time, and reduces the time of uploading in the data recovery process by the degree of parallelism, thus providing a guarantee for the real-time performance of data transmission.

[0020] 5. The present invention records the ID of each edge terminal when recording the status identifier, so that when the data of any edge terminal in the entire system is abnormal, rapid recovery can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram of data transmission between a terminal device, an edge terminal and a cloud in a lightweight cloud-edge system data real-time transmission device provided by the present invention;

[0022] Figure 2 A schematic diagram of data transmission when the network between the edge terminal and the cloud is normal in a lightweight cloud-edge system data real-time transmission device provided by the present invention;

[0023] Figure 3 A schematic diagram of data transmission when a network anomaly occurs between an edge terminal and a cloud in a lightweight cloud-edge system data real-time transmission device provided by the present invention;

[0024] Figure 4 A schematic diagram of data transmission when the network between the edge and the cloud is restored in a lightweight cloud-edge system data real-time transmission device provided by the present invention. DETAILED DESCRIPTION

[0025] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0026] like Figures 1 to 4 As shown, the present invention provides a lightweight cloud-edge system data real-time transmission device (hereinafter referred to as the real-time transmission device), which is widely used in industrial Internet of Things and Internet of Vehicles systems, and includes: multiple edge terminals and a cloud. A timing trigger device is provided in the edge terminal, and the timing trigger device adds a status identifier to the data to be uploaded; the edge terminal stores the added status identifier in the status record, and the cloud obtains the data uploaded by the edge terminal; if the network is abnormal, the cloud records the latest received status identifier, and the current edge terminal stores the data to be uploaded in the data record, and stores the status identifier corresponding to the stored data in the status record; if the network is restored, the current edge terminal requests the latest status identification number from the cloud, searches for the data position corresponding to the latest status identification number in the data record, and uploads the stored data to the cloud.

[0027] Specifically, the present invention adopts a timing trigger device in the edge terminal to add a status identifier to the data to be uploaded. When the data is uploaded to the cloud, the edge terminal and the cloud terminal respectively store the status identifier in the corresponding status record; when the network is abnormal, the cloud terminal stores the latest received status identifier, and similarly the edge terminal stores the data to be uploaded and the status identifier that has not been uploaded in the local data record and status record; if the network is restored, the edge terminal uploads the corresponding data according to the latest status identifier received by the cloud terminal to ensure the continuity of the data. During the data transmission process, the cloud terminal only ensures the real-time data recovery by storing the status identifier instead of the data, so that the cloud terminal is lightweight and the burden of cloud data processing is reduced. In addition, during the data upload process of the edge terminal, the data is stored in the record only when the output is interrupted. After the set time condition is met, the edge terminal no longer stores the data and resumes the normal data upload process, so that the local resources of the edge terminal are lightweight and the local pressure of the edge terminal is reduced. Among them, the edge terminal uses Figure 2 The following description will be made using edge end 1 and edge end 2 as examples.

[0028] In this embodiment, when the edge and the cloud perform data recovery, if the time difference between the real-time transmission device and the mark number stored in the edge is less than the trigger period of the timing trigger device, the edge stops storing data in the data record and uploads the data to be recovered directly to the cloud.

[0029] Specifically, after the network is restored, when the edge uploads data, according to the information of the latest status identification number (denoted as X) requested from the cloud, the edge finds the corresponding data in the data records stored therein and quickly uploads it to the cloud. At this time, when the time of the real-time transmission device minus the time of the status identification number stored locally at the edge is less than the departure time of the timing trigger device, it means that all the data stored at the edge has been uploaded to the cloud, and the uploaded data time has been restored to the transmission time and speed under the normal network state. The edge does not need to store data anymore, and can directly upload it to the cloud through wireless communication, so as to achieve the purpose of data recovery, ensure the real-time nature of the data, prevent data loss, and make the local storage of the edge lightweight.

[0030] It should be noted that when the network at the edge is restored, if the above time requirement is not met, the edge will still store the transmitted data; after the above time requirement is met, the edge will no longer store the data, and will delete the uploaded data to prepare for storing data when the network is interrupted next time, thereby improving the reliability of data transmission. The timing trigger device is preferably a timing trigger.

[0031] like Figure 2 As shown, when the network between the edge and the cloud is normal, the cloud filters out the status identification number information uploaded by the edge in the received data, and stores the status identification number in the status record; the received data is processed according to the business process of the cloud system.

[0032] Specifically, when the network is normal, the edge uploads data with status identification to the cloud. When the cloud identifies the data, it filters the status identification information from the data and stores it in the cloud as an identification mark for network recovery. The received data is processed by the business process on the cloud system. Among them, the content recorded in the status record by the edge and the cloud includes: tag ID, recording time, edge ID, cloud ID, whether it is marked, and other information. The edge and the cloud realize data recovery through status identification, making the edge and the cloud lightweight.

[0033] In this embodiment, the real-time transmission device also includes multiple terminal devices, and the terminal devices upload data to the edge end through wireless communication, and the edge end aggregates and caches the data.

[0034] Specifically, the edge is connected to multiple terminal devices, and the terminal devices send corresponding data to the edge through the MQTT protocol. The edge aggregates and caches the received data, and then uploads the cached data to the cloud to process the data using a large-scale computer group, thereby realizing data transmission from the terminal device to the cloud. Among them, the terminal device can also upload data to the cloud through other communication protocols.

[0035] In this embodiment, when data is restored, the edge terminal predicts the parallelism of uploading data according to the stored data cache time. The calculation formula of parallelism is:

[0036]

[0037] Among them, t2 is the latest time on the cloud, t1 is the current edge system time, t1-t2 is the current edge disconnection time, p is the latest parallelism for starting data upload, e is a constant, which is an empirical value and needs to be tested according to the real-time environment. It is the empirical time required for a parallel upload to quickly catch up with the data, and Cm is the number of edge system cores. When setting the parallelism, the number of edge system cores is set to the parallelism.

[0038] Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

Claims

1. A lightweight cloud-edge system data real-time transmission device, characterized in that: include: Multiple edge devices and clouds; A timing trigger device is provided in the edge end, and the timing trigger device adds a status identifier to the data to be uploaded; The edge stores the added status identifier in the status record, and the cloud obtains the data uploaded by the edge; If the network is abnormal, the cloud records the latest received status identifier, and the current edge stores the data to be uploaded in the data record, and stores the status identifier corresponding to the stored data in the status record; If the network is restored, the current edge terminal requests the latest status identification number from the cloud, searches for the data location corresponding to the latest status identification number in the data record, and uploads the stored data to the cloud.

2. According to the lightweight cloud-edge system data real-time transmission device of claim 1, it is characterized in that: When the edge and the cloud perform data recovery, if the time difference between the real-time transmission device and the mark number stored in the edge is less than the trigger period of the timer trigger device, the edge stops storing data in the data record and uploads the data to be recovered directly to the cloud.

3. The lightweight cloud-edge system data real-time transmission device according to claim 2 is characterized in that: When the network between the edge and the cloud is normal, the cloud filters out the status identification number information uploaded by the edge from the received data, and stores the status identification number in the status record; The received data will be processed according to the business process of the cloud system.

4. According to claim 2, the lightweight cloud-edge system data real-time transmission device is characterized in that: The real-time transmission device also includes multiple terminal devices, which upload data to the edge end through wireless communication, and the edge end collects and caches the data.

5. According to claim 2, the lightweight cloud-edge system data real-time transmission device is characterized in that: When the data is restored, the edge predicts the parallelism of the uploaded data according to the stored data cache time. The parallelism calculation formula is: Among them, t2 is the latest time on the cloud, t1 is the current edge system time, t1-t2 is the current edge disconnection time, p is the latest parallelism for starting to upload data, and e is a constant.