Cloud data processing method and system based on cloud server
By deploying a primary and secondary transmission container in a cloud server system, combined with a monitoring loop and security probes, the problems of data loss and inaccuracy during data transmission are solved, achieving highly consistent and accurate data transmission in the cloud.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-01-05
- Publication Date
- 2026-03-20
AI Technical Summary
During the data transmission process from edge devices to the cloud, the original data is easily lost or inaccurate, resulting in inconsistencies in the same time-series data received by the cloud.
At each data collection point, a main transmission container and a secondary transmission container are deployed. Data is transmitted through the main transmission channel and sub-channels. The data status is monitored using a monitoring ring and a security probe. Pre-set trigger conditions are used to virtually connect or disconnect the data, and lost or altered data is promptly replaced.
Ensure the consistency and accuracy of the original data received by the cloud server, reduce data loss and alteration, and achieve time-consistent data transmission.
Smart Images
Figure CN121711348A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of cloud server data transmission, and particularly relates to a cloud data processing method and system based on a cloud server. BACKGROUND
[0002] With the deep integration of cloud computing, the Internet of Things and edge computing, massive data is collected from widely distributed and environmentally diverse terminal collection points to the cloud for centralized storage, analysis and decision-making, which has become the core paradigm of modern information technology architecture. In modern application scenarios (such as intelligent manufacturing, smart energy and Internet of Vehicles) with complex and variable network environments, high data value and strict business continuity requirements, reliable and consistent data transmission from the edge to the cloud is the cornerstone of ensuring the efficiency of the entire business system.
[0003] In the process of processing data transmission from edge devices to the cloud, the raw data collected by multiple collection devices often has the following problems during transmission: if some raw data is lost, it needs to be re-sent, which can easily lead to inconsistency in receiving the same time sequence data at the cloud; meanwhile, it is also easy to cause inaccurate raw data.
[0004] In view of this, the present application provides a cloud data processing method and system based on a cloud server to solve the above problems. SUMMARY
[0005] The purpose of the present application is to provide a cloud data processing method and system based on a cloud server to solve the problems raised in the background.
[0006] In order to achieve the above purpose, the present application provides the following technical solution: a cloud data processing method based on a cloud server, comprising the following steps: determining a plurality of sending ports and a plurality of receiving ports, the sending ports corresponding to collection points, and the receiving ports corresponding to a cloud server; wherein a main transmission container and an auxiliary transmission container are deployed for each collection point; establishing a transmission network architecture between the plurality of sending ports and the plurality of receiving ports, the transmission network architecture comprising a plurality of transmission sub-channels and a transmission main channel; using the main transmission container and the auxiliary transmission container deployed at each collection point to carry raw data, and using the transmission main channel and the transmission sub-channels to respectively transmit the plurality of main transmission containers and auxiliary transmission containers carrying the raw data; presetting a trigger condition, and based on the trigger condition, establishing a virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point until the plurality of main transmission containers and auxiliary transmission containers reach the receiving port; In the transmission process, if the trigger condition is met, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected, and the disconnected main transmission container or auxiliary transmission container is replaced.
[0007] In a preferred embodiment, the plurality of sending ports and the plurality of receiving ports are determined, the sending port corresponds to a collection point, and the receiving port corresponds to a cloud server; wherein the step of deploying a main transmission container and an auxiliary transmission container for each collection point comprises: determining the collection device of the original data, taking the collection device as a collection point, setting a sending port corresponding to the collection point, and setting a receiving port located in the cloud server corresponding to the sending port; wherein the collection point and the sending port are one-to-one corresponding, and the sending port and the receiving port are one-to-one corresponding; a preset collection period, each collection point generates a main transmission container and an auxiliary transmission container according to the collection period; wherein the main transmission container and the auxiliary transmission container are the same.
[0008] In a preferred embodiment, the step of establishing a transmission network architecture between the plurality of sending ports and the plurality of receiving ports, the transmission network architecture comprising a plurality of transmission sub-channels and a transmission main channel, comprises: establishing a transmission sub-channel between each sending port and the corresponding receiving port, and establishing a transmission main channel between all sending ports and all receiving ports, the plurality of transmission sub-channels and the transmission main channel forming a transmission network architecture.
[0009] In a preferred embodiment, the step of using the main transmission container and the auxiliary transmission container deployed by each collection point to carry the original data, and using the transmission main channel and the transmission sub-channel to transmit the plurality of main transmission containers and the auxiliary transmission containers carrying the original data respectively, comprises: a plurality of collection points collect original data based on a collection period, and after collection, use the main transmission container and the auxiliary transmission container corresponding to the collection point to carry the original data; the main transmission container carrying the original data is transmitted through the transmission main channel, and the auxiliary transmission container carrying the original data is transmitted through the transmission sub-channel; wherein all main transmission containers are arranged in the transmission main channel and connected in turn to obtain a transmission container chain.
[0010] In a preferred embodiment, the step of presetting a trigger condition, establishing a virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point based on the trigger condition until the plurality of main transmission containers and auxiliary transmission containers reach the receiving port, comprises: The connection center is used for state monitoring of virtual connection of the main transmission container and the auxiliary transmission container corresponding to the same collection point. The main port is deployed for each main transmission container, and the sub-port is deployed for each auxiliary transmission container, and the main port and the sub-port are virtually connected based on the connection center. The main transmission container and the auxiliary transmission container maintaining the virtual connection are transmitted to the receiving port.
[0011] In a preferred embodiment, the step of virtually connecting the main port and the sub-port based on the connection center comprises: The connection center deploys a center port in the connection center for each main port and sub-port corresponding to each collection point, and converts original data collected by each collection point into an identifier. The center port, the main port and the sub-port corresponding to the same collection point form a virtual communication link, and the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected based on the virtual communication link. The main port, the sub-port and the center port corresponding to the same collection point are respectively taken as independent nodes, a monitoring ring is established in the connection center based on all the independent nodes corresponding to the same collection point, and the identifier corresponding to each independent node is respectively mapped to the corresponding monitoring ring; wherein, each independent node corresponds to a data interval on the monitoring ring, and the identifier is mapped in the corresponding data interval. A plurality of safety probes are deployed corresponding to the monitoring ring, and the monitoring ring is monitored based on the plurality of safety probes to obtain a state monitoring result.
[0012] In a preferred embodiment, the step of deploying a plurality of safety probes corresponding to the monitoring ring, and monitoring the monitoring ring based on the plurality of safety probes to obtain a state monitoring result comprises: A plurality of safety probes are deployed corresponding to each monitoring ring, and the plurality of safety probes are respectively deployed at the interval boundary of the data interval corresponding to the adjacent independent nodes. Each safety probe binds the interval boundary where the safety probe is located, and monitors the actual boundary of the identifiers corresponding to the two independent nodes adjacent to the interval boundary, calculates the absolute value difference of the two, and obtains the state information of the safety probe. The connection center monitors the state information of all the safety probes on the monitoring ring, and takes the state information of all the safety probes on the monitoring ring as the state monitoring result of the corresponding monitoring ring.
[0013] In a preferred embodiment, in the transmission process, if the trigger condition is met, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected, and the step of replacing the disconnected main transmission container or auxiliary transmission container comprises: The preset trigger condition is whether the state information of the safety probe changes or not, if the state information of the safety probe does not change, it is considered that the trigger condition is met, and if the state information of the safety probe changes, it is considered that the trigger condition is not met; If the trigger condition is met, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected; After disconnection, the same collection point corresponding to the central port is used to replace the disconnected main transmission container or auxiliary transmission container, and after the replacement is completed, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected.
[0014] The application also provides a cloud data processing system based on a cloud server, comprising: The first deployment unit is used to determine a plurality of sending ports and a plurality of receiving ports, the sending port corresponds to a collection point, and the receiving port corresponds to a cloud server; wherein one main transmission container and one auxiliary transmission container are deployed for each collection point; The second deployment unit is used to establish a transmission network architecture between the plurality of sending ports and the plurality of receiving ports, the transmission network architecture comprises a plurality of transmission sub-channels and a transmission main channel; The collection unit is used to load the original data by using the main transmission container and the auxiliary transmission container deployed by each collection point, and to transmit the plurality of main transmission containers and auxiliary transmission containers carrying the original data by using the transmission main channel and the transmission sub-channel respectively; The transmission unit is used to preset a trigger condition, and to establish a virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point based on the trigger condition until the plurality of main transmission containers and auxiliary transmission containers reach the receiving port; The monitoring unit is used to virtually connect the main transmission container and the auxiliary transmission container corresponding to the same collection point in the transmission process if the trigger condition is met, and to disconnect the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point if the trigger condition is not met, and to replace the disconnected main transmission container or auxiliary transmission container.
[0015] In the above technical solution, the application provides technical effects and advantages: 1. By setting up a monitoring ring and a security probe, this invention can monitor the original data carried in the main transmission container and the secondary transmission container during transmission, ensuring that the original data collected by the collection point remains consistent during transmission, and promptly replacing any lost or altered original data during transmission. This results in strong consistency and accuracy of the original data received by the receiving port in the cloud server. 2. This invention arranges and connects the main transmission containers in the main transmission channel to obtain a transmission container chain. The transmission container chain facilitates the simultaneous transmission of raw data collected from multiple collection points, thereby facilitating the cloud server to receive raw data at the same time, ensuring that the raw data arrives at the same time, and better maintaining the consistency of the raw data received by the receiving port. Attached Figure Description
[0016] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this invention. For those skilled in the art, other drawings can be obtained based on these drawings.
[0017] Figure 1 This is a flowchart of the method of the present invention.
[0018] Figure 2 This is a schematic diagram showing the connection of the branch port, the central port, and the main port in the method of the present invention.
[0019] Figure 3 This is a system block diagram of the present invention. Detailed Implementation
[0020] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0021] Example 1, please refer to Figure 1 and Figure 2 As shown in this embodiment, a cloud data processing method based on a cloud server includes the following steps: Multiple sending ports and multiple receiving ports are determined, with sending ports corresponding to data collection points and receiving ports corresponding to cloud servers; for each data collection point, a main transmission container and a secondary transmission container are deployed. The transmission network architecture is established between a plurality of sending ports and a plurality of receiving ports, and the transmission network architecture comprises a plurality of transmission sub-channels and a transmission main channel; The original data is carried by the main transmission container and the auxiliary transmission container deployed at each collection point, and the plurality of main transmission containers and auxiliary transmission containers carrying the original data are transmitted by the transmission main channel and the transmission sub-channel respectively; A preset trigger condition is set, and a virtual connection is established between the main transmission container and the auxiliary transmission container corresponding to the same collection point based on the trigger condition until the plurality of main transmission containers and auxiliary transmission containers reach the receiving port; During the transmission process, if the trigger condition is met, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected, and the disconnected main transmission container or auxiliary transmission container is replaced.
[0022] In this embodiment, by monitoring the setting of the monitoring ring and the safety probe, the original data carried in the main transmission container and the auxiliary transmission container can be monitored during the transmission process, the original data collected by the collection point can be kept consistent during transmission, and the original data lost or changed during transmission can be replaced in time, thereby the original data received by the receiving port in the cloud server has strong consistency and accuracy; wherein the main transmission container in the transmission main channel is arranged and connected in sequence to obtain a transmission container chain, the transmission container chain can facilitate simultaneous transmission of the original data collected by a plurality of collection points, thereby facilitating the cloud server to receive the original data at the same time, so that the arrival time of the original data is consistent, and the consistency of the original data received by the receiving port is better maintained; furthermore, the application can solve the inconsistency and inaccuracy of the cloud receiving the same time sequence data caused by the loss of a certain original data when the original data collected by a plurality of collection devices is transmitted.
[0023] In one embodiment, the plurality of sending ports and the plurality of receiving ports are determined, the sending port corresponds to a collection point, and the receiving port corresponds to a cloud server; wherein the step of deploying one main transmission container and one auxiliary transmission container for each collection point comprises: The collection device of the original data is determined, the collection device is used as a collection point, a sending port is set corresponding to the collection point, and a receiving port located in the cloud server is set corresponding to the sending port; wherein the collection point and the sending port are one-to-one corresponding, and the sending port and the receiving port are one-to-one corresponding; A preset collection period is set, and a main transmission container and an auxiliary transmission container are generated for each collection point according to the collection period; wherein the main transmission container and the auxiliary transmission container are the same.
[0024] It should be noted that the collection device is, for example, an IoT sensor (such as a temperature sensor), an edge server, etc.; by taking the collection device as a collection point, and assigning a unique sending port to each collection point on the network independent node where the collection point is located, and configuring a corresponding (dedicated) receiving port for each sending port on the cloud server side; the collection point performs a collection task once every preset collection period (such as every second, every 3 minutes, etc.), and generates two data carrying units with the same configuration at each time of performing the collection task, the data carrying unit is, for example, a virtual machine, etc., one is marked as a main transmission container, and the other is marked as a secondary transmission container, the two data carrying units contain the same raw data, collection point ID, timestamp and other metadata; by taking the collection device as a collection point, and configuring a receiving port in the cloud server corresponding to the sending port of the collection device one by one, it is convenient for subsequent transmission sub-channels and transmission main channels to be established based on the sending port and the receiving port, so as to facilitate redundant carrying of raw data collected by the collection point and reduce the loss of raw data.
[0025] In one embodiment, the step of establishing a transmission network architecture between a plurality of sending ports and a plurality of receiving ports includes: establishing a transmission sub-channel between each sending port and the corresponding receiving port, and establishing a transmission main channel between all sending ports and all receiving ports, the plurality of transmission sub-channels and the transmission main channel forming a transmission network architecture; In one embodiment, the step of carrying raw data by the main transmission container and the secondary transmission container deployed by each collection point, and transmitting the plurality of main transmission containers and secondary transmission containers carrying raw data by the transmission main channel and the transmission sub-channel respectively includes: a plurality of collection points collect raw data based on a collection period, and after collection, the main transmission container and the secondary transmission container corresponding to the collection point are used to carry the raw data; the main transmission container carrying the raw data is transmitted through the transmission main channel, and the secondary transmission container carrying the raw data is transmitted through the transmission sub-channel; wherein, all main transmission containers are arranged and connected in sequence in the transmission main channel to obtain a transmission container chain.
[0026] It should be noted that an independent point-to-point data transmission link is established between the sending port of each collection point and the corresponding receiving port on the cloud server as a transmission sub-channel, and the transmission sub-channel corresponds to the transmission of the secondary transmission container generated by each collection point; a transmission main channel is established between the sending port (sending port aggregation point, such as a regional gateway) corresponding to all collection points and all receiving ports (unified access point of the cloud server); a preset arrangement rule is arranged, which includes arranging and sequentially connecting the main transmission containers located in the transmission main channel according to the distribution of the transmission main containers corresponding to the collection points, obtaining a transmission container chain, which can facilitate the simultaneous transmission of the raw data collected by multiple collection points, thereby facilitating the cloud server to receive raw data at the same time, making the arrival time of the raw data consistent, and facilitating better consistency of the receiving port receiving the raw data.
[0027] In one embodiment, the preset trigger condition, based on the trigger condition, establishes a virtual connection between the main transmission container and the secondary transmission container corresponding to the same collection point until the multiple main transmission containers and secondary transmission containers reach the receiving port, including: A connection center is established corresponding to the transmission network architecture, which is used for state monitoring of the virtual connection between the main transmission container and the secondary transmission container corresponding to the same collection point; A main port is deployed for each main transmission container, and a sub-port is deployed for each secondary transmission container, and the main port and the sub-port are virtually connected based on the connection center; The multiple main transmission containers and the multiple secondary transmission containers maintaining the virtual connection are transmitted to the receiving port; In one embodiment, the step of virtually connecting the main port and the sub-port based on the connection center includes: The connection center deploys a center port inside it corresponding to the main port and the sub-port corresponding to each collection point, and converts the raw data collected by each collection point into an identifier; A virtual communication link is formed between the center port and the main port and the sub-port corresponding to the same collection point, and the main transmission container and the secondary transmission container corresponding to the same collection point are virtually connected based on the virtual communication link; The main port, the sub-port and the center port corresponding to the same collection point are respectively taken as independent nodes, a monitoring ring is established in the connection center based on all independent nodes corresponding to the same collection point, and the identifier corresponding to each independent node is respectively mapped to the corresponding monitoring ring; wherein, each independent node corresponds to a data interval on the monitoring ring, and the identifier is mapped in the corresponding data interval; A plurality of safety probes are deployed corresponding to the monitoring ring, and the monitoring ring is monitored based on the plurality of safety probes to obtain a state monitoring result; In one embodiment, the corresponding monitoring ring deploys a plurality of security probes, and the step of monitoring the monitoring ring based on the plurality of security probes to obtain the state monitoring result comprises: A plurality of security probes are deployed corresponding to each monitoring ring, and the plurality of security probes are respectively deployed at the interval boundaries of the data intervals corresponding to the adjacent independent nodes; Each security probe is bound to the interval boundary where it is located, and the absolute value difference between the actual boundaries of the two independent nodes corresponding to the identifiers adjacent to the interval boundary is calculated to obtain the state information of the security probe; The connection center monitors the state information of all security probes on the monitoring ring, and takes the state information of all security probes on the monitoring ring as the state monitoring result of the corresponding monitoring ring.
[0028] It should be noted that a connection center is established corresponding to the transmission network architecture, and a mapping table of the original data corresponding to the collection point is pre-configured in the connection center. The mapping table is used to convert the original data collected by the collection point into an identifier. Each collection point corresponds to a mapping table, and the mapping tables of different collection points are different. By deploying the center port corresponding to the collection point in the connection center, the center port can establish a triangular virtual communication link with the main port and the sub-port corresponding to the collection point. This virtual communication link is realized based on logical connection. By taking the main port, the sub-port and the center port corresponding to the same collection point as independent nodes (the independent nodes include the main nodes, the sub-nodes and the center nodes corresponding to the main port, the sub-port and the center port respectively), and based on all independent nodes corresponding to the same collection point, a monitoring ring is established in the connection center (the monitoring ring corresponds to the collection point), and the identifiers corresponding to each independent node are mapped on the monitoring ring. The security probes deployed on the monitoring ring monitor the identifiers mapped on the monitoring ring. The security probes monitor the actual boundaries of the identifiers corresponding to the two independent nodes adjacent to the interval boundary (the data range of the identifier mapping), calculate the absolute value difference between the two, and obtain the state information of the security probe. The state information of the security probe is obtained. By monitoring the state information of the security probe through the connection center, the state monitoring result of the monitoring ring can be obtained. Wherein, each independent node corresponds to a data interval on the monitoring ring, and the identifier is mapped in the corresponding data interval (the identifier is mapped in the data range corresponding to the data interval, and the identifier corresponding to each independent node carries the number of the independent node during mapping. In the case of the same identifier, the identifier can be mapped to the data interval corresponding to the independent node by the number of the independent node; for example, there are three independent nodes ABC on the monitoring ring, and the three independent nodes correspond to the data intervals of 0~10, 10~20 and 20~30 respectively. The data interval corresponding to the identifier of the master node A is 0~10, and the actual boundary of the identifier mapping is 3~7. The data interval corresponding to the identifier of the center node B is 10~20, and the actual boundary of the identifier mapping is 13~17. The data interval corresponding to the identifier of the sub-node C is 20~30, and the actual boundary of the identifier mapping is 23~27. A plurality of safety probes are deployed on the monitoring ring, and the plurality of safety probes are respectively deployed at the interval boundaries of the data intervals corresponding to all independent nodes, such as at 10, 20 and 30 (since 0 and 30 coincide on the monitoring ring, only a safety probe is deployed at 30). Each safety probe is bound to the corresponding interval boundary and the difference between the actual boundary of the adjacent identifier mapping, which serves as the state information of the corresponding safety probe; specifically, the data interval division of the monitoring ring is equivalent to a virtual consistency hash with a fixed interval; the safety probe is equivalent to a sentinel node in a distributed system, each safety probe independently runs, is distributed at a key position of the monitoring ring, regularly performs a check, and reports the state information of the safety probe to the connection center. Further, through the setting of the monitoring ring and the safety probe, the original data carried in the master transmission container and the secondary transmission container can be monitored during transmission, the original data collected by the collection point can be kept consistent during transmission, and the original data lost or changed during transmission can be timely replaced, so that the original data received by the receiving port in the cloud server has strong consistency and accuracy.
[0029] In one embodiment, during transmission, if the trigger condition is met, the master transmission container and the secondary transmission container corresponding to the same collection point are virtually connected, if the trigger condition is not met, the virtual connection between the master transmission container and the secondary transmission container corresponding to the same collection point is disconnected, and the step of replacing the disconnected master transmission container or secondary transmission container comprises: A preset trigger condition, wherein the trigger condition is whether the state information of the safety probe changes; if the state information of the safety probe does not change, it is considered that the trigger condition is met, and if the state information of the safety probe changes, it is considered that the trigger condition is not met; If the trigger condition is met, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected. After disconnection, the disconnected main transmission container or auxiliary transmission container is replaced by using the central port corresponding to the same collection point, and after the replacement is completed, the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected.
[0030] It should be noted that the state information of the security probe changes as follows: when a new independent node D is added to the monitoring ring, the identifier of the independent node D is mapped to 7-12, so that the state information of the security probe deployed on 10 changes (the difference between the adjacent identifier mapping actual boundary corresponding to the security probe deployed on 10 is |7-13| before the change, and |12-13| after the change, so it is known that the state information of the security probe changes), and the connection center learns that a new independent node is added to the monitoring ring through the state information of the security probe. The connection center deletes the identifier mapping of the independent node D; when the master node A on the monitoring ring is lost, the connection center finds that the state information of the security probe deployed on 30 changes (the difference between the adjacent identifier mapping actual boundary corresponding to the security probe deployed on 30 is |27-3| before the change, and |27-13| after the change; the difference between the adjacent identifier mapping actual boundary corresponding to the security probe deployed on 10 is |7-13| before the change, and |27-13| after the change, so it is known that the state information of the security probe changes); when the identifier corresponding to the master node A changes, the state information of the security probe deployed on 10 and 30 will change (for example, the actual mapping interval of the identifier of the master node A is 2-8, so the difference between the adjacent identifier mapping actual boundary corresponding to the security probe deployed on 10 is |7-13| before the change, and |8-13| after the change; and the difference between the adjacent identifier mapping actual boundary corresponding to the security probe deployed on 30 is |27-3| before the change, and |27-2| after the change, so it can also be concluded that the identifier of the master node A changes); through the preset trigger condition, and the trigger condition is whether the state information of the security probe changes, the master transmission container and the secondary transmission container can be virtually connected or disconnected based on the trigger condition, and the identifiers of the master transmission container and the secondary transmission container carrying the lost or changed identifiers can be replaced according to whether the security probe meets the trigger condition (the replacement includes replacing the changed original data and supplementing the lost original data). If the identifier corresponding to the master node or the secondary node changes or is lost, the identifier corresponding to the master node or the secondary node is remapped through the identifier corresponding to the center node, the consistency of the identifier is ensured, and the accuracy of the original data is ensured, so that the loss and inaccuracy of the original data of the collection point can be reduced.
[0031] Embodiment 2, please refer to Figure 3 As shown in the figure, the cloud data processing system based on the cloud server comprises: The first deployment unit is configured to determine a plurality of sending ports and a plurality of receiving ports, the sending ports corresponding to the collection points, and the receiving ports corresponding to the cloud servers; wherein one main transmission container and one auxiliary transmission container are deployed for each collection point; The second deployment unit is configured to establish a transmission network architecture between the plurality of sending ports and the plurality of receiving ports, the transmission network architecture including a plurality of transmission sub-channels and one main transmission channel; The collection unit is configured to load the raw data by using the main transmission container and the auxiliary transmission container deployed for each collection point, and to transmit the plurality of main transmission containers and auxiliary transmission containers carrying the raw data by using the main transmission channel and the transmission sub-channels, respectively; The transmission unit is configured to preset a trigger condition, and to establish a virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point based on the trigger condition until the plurality of main transmission containers and auxiliary transmission containers reach the receiving ports; The monitoring unit is configured to, during the transmission process, if the trigger condition is met, then the main transmission container and the auxiliary transmission container corresponding to the same collection point are virtually connected, and if the trigger condition is not met, then the virtual connection between the main transmission container and the auxiliary transmission container corresponding to the same collection point is disconnected, and the disconnected main transmission container or auxiliary transmission container is replaced.
[0032] In this embodiment, by monitoring the ring and the safety probe, the raw data carried in the main transmission container and the auxiliary transmission container can be monitored during the transmission process, the raw data collected by the collection points can be kept consistent during transmission, and the lost and changed raw data during transmission can be replaced in a timely manner, thereby the raw data received by the receiving ports in the cloud server has strong consistency and accuracy; wherein the main transmission containers in the main transmission channel are arranged and connected in sequence to obtain a transmission container chain, the transmission container chain can facilitate simultaneous transmission of the raw data collected by the plurality of collection points, thereby facilitating the cloud server to receive the raw data at the same time, making the arrival time of the raw data consistent, and facilitating better maintenance of the consistency of the raw data received by the receiving ports.
[0033] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A cloud data processing method based on a cloud server, characterized in that, Includes the following steps: Multiple sending ports and multiple receiving ports are determined, with sending ports corresponding to data collection points and receiving ports corresponding to cloud servers; for each data collection point, a main transmission container and a secondary transmission container are deployed. A transmission network architecture is established between multiple transmitting ports and multiple receiving ports. The transmission network architecture includes multiple transmission sub-channels and one transmission main channel. The raw data is carried by the main transmission container and the secondary transmission container deployed at each collection point, and the main transmission channel and the secondary transmission channel are used to transmit the raw data to the multiple main transmission containers and secondary transmission containers respectively. Preset trigger conditions, and establish a virtual connection between the main transmission container and the secondary transmission container corresponding to the same collection point based on the trigger conditions, until multiple main transmission containers and secondary transmission containers reach the receiving port; During transmission, if the triggering condition is met, the main transmission container and the secondary transmission container corresponding to the same acquisition point will be virtually connected. If the triggering condition is not met, the virtual connection between the main transmission container and the secondary transmission container corresponding to the same acquisition point will be disconnected, and a replacement will be made for the disconnected main transmission container or secondary transmission container.
2. The cloud data processing method based on a cloud server according to claim 1, characterized in that, The step of determining multiple sending ports and multiple receiving ports, where the sending ports correspond to data collection points and the receiving ports correspond to cloud servers; and the step of deploying a main transmission container and a secondary transmission container for each data collection point, includes: The original data acquisition device is determined, and the acquisition device is designated as the acquisition point. A sending port is set for the corresponding acquisition point, and a receiving port located in the cloud server is set for the corresponding sending port. There is a one-to-one correspondence between the acquisition point and the sending port, and a one-to-one correspondence between the sending port and the receiving port. A preset acquisition cycle is set, and each acquisition point generates a main transmission container and a secondary transmission container according to the acquisition cycle; the main transmission container and the secondary transmission container are the same.
3. The cloud data processing method based on a cloud server according to claim 1, characterized in that, The step of establishing a transmission network architecture between multiple transmitting ports and multiple receiving ports, wherein the transmission network architecture includes multiple transmission sub-channels and one transmission main channel, includes: A transmission sub-channel is established between each transmitting port and its corresponding receiving port, and a transmission main channel is established between all transmitting ports and all receiving ports. Multiple transmission sub-channels and one transmission main channel form a transmission network architecture.
4. The cloud data processing method based on a cloud server according to claim 1, characterized in that, The steps of using the main and secondary transmission containers deployed at each collection point to carry the raw data, and using the main transmission channel and transmission sub-channels to transmit the raw data through the multiple main and secondary transmission containers, respectively, include: Multiple collection points collect raw data based on a collection cycle, and after collection, the raw data is carried by the main transmission container and the secondary transmission container corresponding to the collection point; The main transmission container carrying the original data is transmitted through the main transmission channel, and the secondary transmission container carrying the original data is transmitted through the secondary transmission channel; all the main transmission containers are arranged and connected in sequence within the main transmission channel to form a transmission container chain.
5. The cloud data processing method based on a cloud server according to claim 1, characterized in that, The preset triggering condition, based on which a virtual connection is established between the main transmission container and the secondary transmission container corresponding to the same acquisition point, until multiple main transmission containers and secondary transmission containers reach the receiving port, includes the following steps: A connection center is established for the corresponding transmission network architecture. The connection center is used to monitor the status of the virtual connection between the main transmission container and the secondary transmission container corresponding to the same collection point. Deploy a main port for each main transport container and a sub-port for each secondary transport container. The main port and sub-port are virtually connected based on the connection center. The multiple primary and secondary transport containers that maintain the virtual connection are transmitted to the receiving port.
6. The cloud data processing method based on a cloud server according to claim 5, characterized in that, The steps for establishing a virtual connection between the main port and the sub-port based on the connection center include: The connection center deploys a central port within each collection point, corresponding to the main port and sub-ports. The connection center converts the raw data collected by each collection point into identifiers. A virtual communication link is formed between the central port, main port, and sub-port corresponding to the same collection point. Based on the virtual communication link, the main transmission container and the secondary transmission container corresponding to the same collection point are virtually connected. The main port, sub-port, and central port corresponding to the same acquisition point are each treated as an independent node. A monitoring ring is established at the connection center based on all independent nodes corresponding to the same acquisition point. The identifier corresponding to each independent node is mapped to the corresponding monitoring ring. Each independent node corresponds to a data range on the monitoring ring, and the identifier is mapped to the corresponding data range. Multiple safety probes are deployed on the corresponding monitoring ring, and the monitoring ring is monitored based on the multiple safety probes to obtain the status monitoring results.
7. The cloud data processing method based on a cloud server according to claim 6, characterized in that, The steps for deploying multiple security probes on the corresponding monitoring ring and obtaining status monitoring results based on the multiple security probes include: Multiple security probes are deployed for each monitoring ring, and the multiple security probes are deployed at the interval boundaries of the corresponding data intervals of adjacent independent nodes; Each security probe is bound to the boundary of its own interval. At the same time, the actual boundary mapped by the identifiers of two independent nodes adjacent to the interval boundary is monitored, and the absolute difference between the two is calculated to obtain the status information of the security probe. The connection center monitors the status information of all safety probes on the monitoring ring and uses the status information of all safety probes on the monitoring ring as the status monitoring result of the corresponding monitoring ring.
8. The cloud data processing method based on a cloud server according to claim 7, characterized in that, During transmission, if a triggering condition is met, the primary and secondary transmission containers corresponding to the same acquisition point are virtually connected; if the triggering condition is not met, the virtual connection between the primary and secondary transmission containers corresponding to the same acquisition point is broken, and a replacement primary or secondary transmission container is provided. A preset trigger condition is set, which is whether the status information of the security probe changes; if the status information of the security probe does not change, the trigger condition is considered to be met; if the status information of the security probe changes, the trigger condition is considered not to be met. If the triggering condition is met, the main transmission container and the secondary transmission container corresponding to the same acquisition point will be virtually connected. If the triggering condition is not met, the virtual connection between the main transmission container and the secondary transmission container corresponding to the same acquisition point will be disconnected. After disconnection, the disconnected main or secondary transmission container is replaced by the central port corresponding to the same acquisition point, and after the replacement is completed, the main and secondary transmission containers corresponding to the same acquisition point are virtually connected.
9. A cloud data processing system based on a cloud server, used to implement the cloud data processing method based on a cloud server as described in any one of claims 1-8, characterized in that, include: The first deployment unit is used to determine multiple sending ports and multiple receiving ports, with the sending ports corresponding to collection points and the receiving ports corresponding to cloud servers; among them, a main transmission container and a secondary transmission container are deployed for each collection point. The second deployment unit is used to establish a transmission network architecture between multiple sending ports and multiple receiving ports. The transmission network architecture includes multiple transmission sub-channels and one transmission main channel. The acquisition unit is used to carry the raw data using the main transmission container and the secondary transmission container deployed at each acquisition point, and to transmit the raw data using the main transmission channel and the secondary transmission channel respectively. The transmission unit is used to preset trigger conditions and establish a virtual connection between the main transmission container and the secondary transmission container corresponding to the same collection point based on the trigger conditions, until multiple main transmission containers and secondary transmission containers reach the receiving port. The monitoring unit is used to establish a virtual connection between the main transmission container and the secondary transmission container corresponding to the same acquisition point during transmission if the triggering condition is met, and to disconnect the virtual connection between the main transmission container and the secondary transmission container corresponding to the same acquisition point if the triggering condition is not met, and to replace the disconnected main transmission container or secondary transmission container.