A Visual Distributed Data Acquisition Method and Platform
By identifying the central and subordinate nodes in the distributed data acquisition system, generating transmission strategies, and constructing a visual topology map, the problems of low data transmission reliability and accuracy are solved, enabling real-time visual monitoring and improving data transmission efficiency and user experience.
Patent Information
- Application Number
- CN202411943922.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-27
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2044-12-27
AI Technical Summary
Existing distributed data acquisition systems suffer from low data transmission reliability, low accuracy and efficiency during large-scale data transmission, as well as high monitoring complexity and large errors.
By acquiring the data collection area, determining the central node and subordinate nodes, selecting subordinate nodes as collection nodes, determining the data transmission volume, type and security level based on node status information, generating transmission strategies, and constructing a visual topology map for data animation display, real-time visual monitoring is achieved.
It improves the data transmission reliability of the distributed data acquisition system, reduces monitoring complexity and errors, and enhances the user experience.
Smart Images

Figure CN119629077B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data acquisition technology, and in particular to a visual distributed data acquisition method and platform. Background Technology
[0002] A distributed data acquisition system typically consists of multiple acquisition nodes and a central node, connected via a distributed network. Each acquisition node can independently acquire and process its corresponding local data, and transmit necessary data or local data processing results to the central node.
[0003] Currently, existing distributed data acquisition systems are more complex than single-machine systems. When large-scale data transmission is required, real-time monitoring of the distributed data acquisition system is necessary. However, there is currently no effective way to visualize and monitor distributed data transmission, resulting in high complexity and large errors in monitoring data transmission of distributed nodes. Furthermore, for large-scale data transmission, the influx of data from numerous distributed nodes can easily cause the central node to crash due to the simultaneous influx of large amounts of data, leading to low reliability, accuracy, and efficiency of data transmission in distributed data acquisition systems. Summary of the Invention
[0004] This invention provides a visual distributed data acquisition method and platform to solve the technical problems of low data transmission reliability, low data transmission accuracy and efficiency, and high complexity and large error in data transmission monitoring in existing distributed data acquisition systems.
[0005] To address the aforementioned technical problems, embodiments of the present invention provide a visual distributed data acquisition method, comprising:
[0006] Obtain the area where data needs to be collected, and determine the central node and its connected subordinate nodes based on the data collection area;
[0007] Based on the status information of the central node, the subordinate nodes connected to it are selected as collection nodes, and based on the status information of the collection nodes, the data transmission volume, data type and data security level of each collection node are determined.
[0008] Based on the data transmission volume, data type, and data security level of each acquisition node, a transmission strategy is generated for the acquisition nodes to transmit data to the central node.
[0009] A visual topology map is constructed based on each acquisition node and the central node, and data animations corresponding to each acquisition node are constructed in the visual topology map according to the data transmission volume, data transmission type and data security level of the acquisition nodes.
[0010] According to the transmission strategy, the corresponding data is transmitted through each acquisition node, and during the data transmission process, the data animation corresponding to each acquisition node is visualized in the visual topology map.
[0011] As a preferred embodiment, the step of acquiring the area where data needs to be collected, and determining the central node and its connected subordinate nodes based on the data collection area, specifically includes:
[0012] In response to the data collection area clicked by the user, obtain all nodes in the data collection area;
[0013] Obtain the working status of all nodes in the data acquisition area, and determine the corresponding central node based on the working status;
[0014] All nodes in the data acquisition area that are not designated as the central node are treated as subordinate nodes, and all subordinate nodes are connected to the central node.
[0015] As a preferred embodiment, the step of acquiring the working status of all nodes in the data acquisition area and determining the corresponding central node based on the working status specifically includes:
[0016] Obtain the working status of all nodes in the data acquisition area; wherein, the working status includes: idle status and busy status;
[0017] All nodes in an idle state are selected as candidate nodes, and the historical data transmission volume, historical data transmission type, and historical data security level of each candidate node are obtained.
[0018] Based on the historical data transmission volume, historical data transmission type, and historical data security level, the central transmission weight of each candidate node is determined, and the candidate node with the largest corresponding central transmission weight is selected as the central node.
[0019] As a preferred embodiment, the step of treating all nodes in the data acquisition area that are not identified as the central node as subordinate nodes, and connecting all subordinate nodes to the central node, specifically includes:
[0020] All currently busy nodes are designated as worker nodes.
[0021] All nodes in the data acquisition area that are not identified as central nodes or working nodes are designated as subordinate nodes, and communication connections are established between all subordinate nodes and the central node.
[0022] Nodes outside the data collection area clicked by the user are selected as substitute nodes; each substitute node corresponds to a working node.
[0023] All the aforementioned working nodes transfer data to their corresponding standby nodes, and the data that the current working node needs to transmit is transmitted through its corresponding standby node;
[0024] After the worker nodes transmit the data they previously transmitted to the substitute nodes, communication connections are established between all worker nodes and the central node simultaneously.
[0025] As a preferred embodiment, the step of generating a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node specifically includes:
[0026] Calculate the first priority weight of each slave node based on the current data type and data security level of each slave node;
[0027] The subordinate nodes are sorted according to the first priority weight, and the subordinate nodes with the same priority weight are sorted and adjusted according to the data transmission volume between the subordinate nodes, so that the subordinate nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the first data transmission order of the subordinate nodes.
[0028] Based on the data type and data security level of each working node, the second priority weight of each working node is calculated, and the working nodes are sorted according to the second priority weight. Taking into account the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted so that the working nodes with the same priority weight are arranged from largest to smallest according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes.
[0029] Each working node in the second data transmission sequence is inserted sequentially from front to back between each subordinate node in the first data transmission sequence to obtain the transmission strategy for the acquisition node to transmit data to the central node; wherein, the transmission strategy is the data transmission sequence of each subordinate node and each working node, and each working node is inserted between each subordinate node in the first data transmission sequence until all working nodes are inserted.
[0030] As a preferred embodiment, the step of constructing a visual topology map based on each acquisition node and the central node, and constructing data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type, and data security level of the acquisition nodes, specifically includes:
[0031] Based on the communication connection relationship between each acquisition node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes, a visual topology map is constructed.
[0032] Based on the data transmission volume, data transmission type, and data security level of the acquisition node, as well as the data transmission volume, data transmission type, and data security level of the prior transmitted data of the working node, the corresponding animation display form, color, and texture are set to construct the data animation corresponding to each acquisition node in the visual topology map.
[0033] As a preferred embodiment, the step of transmitting the corresponding data through each acquisition node according to the transmission strategy, and visually displaying the data animation corresponding to each acquisition node in the visual topology map during the data transmission process, specifically includes:
[0034] According to the transmission strategy, each acquisition node transmits its corresponding data in sequence, so that at each preset time interval, a corresponding acquisition node transmits its corresponding data to the central node. During the transmission process, when each subordinate node transmits data, each working node transmits its own previously transmitted data to the substitute node, which then transmits it until all the data transmitted by the working node has been transmitted.
[0035] The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
[0036] Accordingly, the present invention also provides a visual distributed data acquisition platform, comprising: an acquisition module, a determination module, a strategy module, an animation module, and a transmission module;
[0037] The acquisition module is used to acquire the area where data needs to be collected, and to determine the central node and its connected subordinate nodes based on the data collection area.
[0038] The determining module is used to select subordinate nodes connected to the central node as collection nodes based on the status information of the central node, and to determine the data transmission volume, data type and data security level of each collection node based on the status information of the collection nodes.
[0039] The strategy module is used to generate a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node.
[0040] The animation module is used to construct a visual topology map based on each acquisition node and the central node, and to construct data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type and data security level of the acquisition nodes.
[0041] The transmission module is used to transmit the corresponding data through each acquisition node according to the transmission strategy, and to visualize the data animation corresponding to each acquisition node in the visual topology map during the data transmission process.
[0042] Accordingly, the present invention also provides a terminal device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the visualization distributed data acquisition method as described above.
[0043] Accordingly, the present invention also provides a computer-readable storage medium comprising a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the visualization distributed data acquisition method as described above.
[0044] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0045] The technical solution of this invention obtains the area where data needs to be collected, determines the central node and corresponding subordinate nodes within that area, and then selects the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node. This determines the data transmission volume, data type, and data security level of each collection node, ultimately generating a transmission strategy. Simultaneously, a visual topology map is constructed for each collection node and the central node to generate corresponding data animations. This allows for real-time and synchronous visualization of data transmission in the topology map, in conjunction with the data animations, during data transmission according to the transmission strategy. This achieves real-time and synchronous visual monitoring, avoiding the high complexity and large errors associated with traditional data transmission monitoring, improving the reliability of data transmission in the distributed data acquisition system, and enhancing the user experience. Attached Figure Description
[0046] Figure 1 : A flowchart illustrating the steps of a visual distributed data acquisition method provided in an embodiment of the present invention;
[0047] Figure 2 : This is a structural diagram of a visual distributed data acquisition platform provided in an embodiment of the present invention. Detailed Implementation
[0048] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0049] Example 1
[0050] Please refer to Figure 1 The present invention provides a visual distributed data acquisition method, comprising the following steps S101-S105:
[0051] Step S101: Obtain the area where data needs to be collected, and determine the central node and its connected subordinate nodes based on the data collection area.
[0052] As a preferred embodiment, the step of obtaining the area for data collection and determining the central node and its connected subordinate nodes based on the data collection area specifically includes:
[0053] In response to the data collection area clicked by the user, all nodes in the data collection area are obtained; the working status of all nodes in the data collection area is obtained, and the corresponding central node is determined according to the working status; all nodes in the data collection area that are not determined as central nodes are treated as subordinate nodes, and all subordinate nodes are connected to the central node.
[0054] In this embodiment, the data acquisition area can be defined by the user. This can be done by selecting a preset area on the platform or by using a selection box to define the corresponding nodes. By responding to the user's click on the data acquisition area, all nodes within that area can be acquired. Based on the working status of each node, the corresponding central node is determined. Finally, all nodes in the data acquisition area that are not designated as the central node are treated as subordinate nodes, and all subordinate nodes are connected to the central node.
[0055] In a preferred embodiment, the step of acquiring the working status of all nodes in the data acquisition area and determining the corresponding central node based on the working status specifically includes:
[0056] Obtain the working status of all nodes in the data acquisition area; wherein the working status includes: idle status and busy status; take all nodes in the idle status as candidate nodes, and obtain the historical data transmission volume, historical data transmission type and historical data security level of each candidate node; determine the center transmission weight of each candidate node according to the historical data transmission volume, historical data transmission type and historical data security level, and take the candidate node with the largest center transmission weight as the center node.
[0057] In this embodiment, by acquiring the working status of all nodes in the data acquisition area, it can be determined whether each node is idle or busy. Nodes in an idle state can serve as the central node, undertaking the data acquisition and transmission for all acquisition nodes in the data acquisition area. Furthermore, all idle nodes are considered as candidate nodes, and their historical data transmission volume, historical data transmission type, and historical data security level are acquired. This information is used to calculate the central transmission weight of each candidate node, and finally, the candidate node with the highest central transmission weight is selected as the central node.
[0058] It should be noted that the historical data transmission volume, historical data transmission type, and historical data security level each have corresponding weight coefficients. The historical data transmission volume is the total amount of data transmitted by the candidate node in history, the historical data transmission type is all types of data transmitted by the candidate node, and the historical data security level is all security levels of the historical transmitted data.
[0059] The formula for calculating the center transmission weight of the candidate node is as follows:
[0060]
[0061] in, The central transmission weight is C, where C is the total amount of historical data transmitted by the candidate nodes. The type of data transmitted by the candidate node accounts for the largest proportion. Each type has a corresponding Type value according to its importance. For example, the Type value of text data is 1, the Type value of binary data is 2, the Type value of database is 3, the Type value of compressed data is 4, the Type value of metadata is 5, and the Type value of encrypted data is 6. The security level represents the largest proportion of historical data transmission. Each security level has a corresponding S value based on its importance. For example, the security levels are divided into high, medium, and low levels, with high level being 3, medium level being 2, and low level being 1. a, b, and c are the preset weighting coefficients for historical data transmission volume, historical data transmission type, and historical data security level, respectively.
[0062] As a preferred embodiment, the step of treating all nodes in the data acquisition area that are not determined to be the central node as subordinate nodes and connecting all subordinate nodes to the central node specifically includes:
[0063] All currently busy nodes are designated as working nodes; all nodes in the data acquisition area that are not identified as central or working nodes are designated as subordinate nodes, and all subordinate nodes establish communication connections with the central node; nodes outside the data acquisition area clicked by the user are selected as substitute nodes; each substitute node corresponds to one working node; all working nodes relay data to their corresponding substitute nodes, and the data that the current working node needs to transmit is transmitted through its corresponding substitute node; after the working node transmits its previously transmitted data to the substitute node, all working nodes simultaneously establish communication connections with the central node.
[0064] In this embodiment, all nodes in a busy state are designated as working nodes, and all nodes in the data acquisition area that are not designated as central or working nodes are designated as subordinate nodes. In this way, communication connections are established between all subordinate nodes and the central node to achieve the connection between subordinate nodes and the central node.
[0065] Furthermore, nodes outside the data collection area clicked by the user are selected and used as substitute nodes to establish data connections with their corresponding work nodes. This allows all work nodes to relay data to their corresponding substitute nodes, transmitting the data that the current work node needs to transmit through its substitute node. After the work node transmits its previously transmitted data to the substitute node, a communication connection is simultaneously established between all work nodes and the central node. This enables work nodes to simultaneously transmit previously transmitted data through substitute nodes and send the data from the current data collection task to the central node, thereby achieving efficient data transmission and ensuring data transmission efficiency.
[0066] Step S102: Based on the status information of the central node, select the subordinate nodes connected to it as collection nodes, and determine the data transmission volume, data type and data security level of each collection node based on the status information of the collection nodes.
[0067] In this embodiment, the status information of the central node, including but not limited to node status, resource usage, node information, attributes and address information, is used to filter out the subordinate nodes connected to it as data collection nodes, that is, to filter out the nodes that do not need to be collected. Then, based on the status information of the collection nodes, the data transmission volume, data type and data security level of each collection node are determined, and the data collection and transmission tasks between each collection node are determined.
[0068] Step S103: Generate a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node.
[0069] As a preferred embodiment, the step of generating a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node specifically includes:
[0070] Based on the current data type and data security level of each subordinate node, calculate the first priority weight of each subordinate node; sort the subordinate nodes according to the first priority weight, and then, based on the sorted subordinate nodes and the data transmission volume between them, adjust the order of subordinate nodes with the same priority weight so that they are arranged in descending order of data transmission volume, thus obtaining the first data transmission order of the subordinate nodes; based on the current data type and data security level of each working node, calculate the second priority weight of each working node, and sort the working nodes according to the second priority weight, and then, based on the data transmission volume between them, adjust the order of subordinate nodes with the same priority weight, so that they are arranged in descending order of data transmission volume, thus obtaining the first data transmission order of the subordinate nodes; based on the current data type and data security level of each working node, calculate the second priority weight of each working node, and then sort the working nodes according to the second priority weight, and then, based on the data transmission volume between them, adjust the order of subordinate nodes with the same priority weight, so that they are arranged in descending order of data transmission volume, thus obtaining the first data transmission order of the subordinate nodes; The data transmission volume between worker nodes is adjusted by sorting worker nodes with the same priority weight so that they are arranged from largest to smallest data transmission volume, thus obtaining a second data transmission order for worker nodes. Each worker node in the second data transmission order is then inserted sequentially between each subordinate node in the first data transmission order to obtain the transmission strategy for the acquisition node to transmit data to the central node. The transmission strategy is the data transmission order between each subordinate node and each worker node, with each worker node inserted between each subordinate node in the first data transmission order, until all worker nodes are inserted.
[0071] In this embodiment, the first priority weight of each slave node is calculated based on the data type and data security level of each slave node. That is, the first priority weight of the slave node is calculated based on the data type and data security level that the slave node needs to transmit. At the same time, the slave nodes are sorted by the first priority weight. Then, combined with the data transmission volume between the slave nodes, slave nodes with the same first priority weight are sorted in a secondary order, that is, arranged from largest to smallest according to the data transmission volume, so as to obtain the first data transmission order of the slave nodes.
[0072] Furthermore, the same sorting is performed on the worker nodes. That is, based on the data type and data security level of each worker node, the second priority weight of each worker node is calculated, and the worker nodes are sorted according to the second priority weight. Then, based on the amount of data transmission between each worker node, the worker nodes with the same second priority weight are sorted in a secondary order, that is, arranged from largest to smallest according to the amount of data transmission, so as to obtain the second data transmission order of the worker nodes.
[0073] For example, the first data transmission order is [a,b,c,d,…], where a, b, c, d, etc. are slave nodes, and the second data transmission order is [A,B,C,D,…], where A, B, C, D are worker nodes. Each worker node in the second data transmission order is inserted sequentially from front to back between each slave node in the first data transmission order to obtain the transmission strategy of the acquisition node transmitting data to the central node, that is, the obtained transmission strategy order is [a,A,b,B,c,C,d,…].
[0074] Step S104: Construct a visual topology map based on each acquisition node and the central node, and construct data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type and data security level of the acquisition nodes.
[0075] As a preferred embodiment, the step of constructing a visual topology map based on each acquisition node and the central node, and constructing data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type, and data security level of the acquisition nodes, specifically includes:
[0076] Based on the communication connection relationship between each acquisition node and the central node, and the data transmission relationship of the substitute nodes of the corresponding working nodes, a visual topology map is constructed; based on the data transmission volume, data transmission type and data security level of the acquisition nodes, and the data transmission volume, data transmission type and data security level of the prior transmitted data of the working nodes, the corresponding animation performance, color and texture are set, thereby constructing the data animation corresponding to each acquisition node in the visual topology map.
[0077] In this embodiment, a visual topology map is constructed by establishing communication connections between each acquisition node and the central node, as well as data transmission relationships between working nodes and their corresponding stand-in nodes. Different animation styles, colors, and textures are then set according to the data transmission volume, data transmission type, and data security level of the acquisition nodes, and the data transmission volume, data transmission type, and data security level of the prior data transmitted by the working nodes. This allows for the display of data transmission in the visual topology map, enabling intuitive monitoring of the corresponding data transmission status.
[0078] Step S105: According to the transmission strategy, the corresponding data is transmitted through each acquisition node, and during the data transmission process, the data animation corresponding to each acquisition node is visualized in the visual topology map.
[0079] As a preferred embodiment, the step of transmitting the corresponding data through each acquisition node according to the transmission strategy, and visually displaying the data animation corresponding to each acquisition node in the visual topology map during the data transmission process, specifically includes:
[0080] According to the transmission strategy, each acquisition node transmits its corresponding data sequentially, so that at each preset time interval, a corresponding acquisition node transmits its corresponding data to the central node. During the transmission process, when each subordinate node transmits data, each working node transmits its previously transmitted data to the substitute node, which then transmits it, until all the data previously transmitted by the working node has been transmitted. The data transmission process of each acquisition node is visualized in the visual topology diagram through corresponding data animations.
[0081] In this embodiment, a transmission strategy is used to sequentially transmit the corresponding data from each acquisition node. This strategy involves one acquisition node transmitting its data to the central node at preset time intervals, according to the transmission strategy sequence [a, A, b, B, c, C, d, ...]. Each node has a preset time to transmit, and after the last node finishes transmitting, the cycle returns to the first acquisition node, acquisition node a. During transmission, when each subordinate node transmits data, the working node transmits its previously transmitted data to a substitute node, which then performs the online data transmission. After the subordinate node finishes transmitting its data, the transmission moves to the next node (the working node, following the transmission strategy sequence [a, A, b, B, c, C, d, ...]), where the working node transmits its current data. Other working nodes pause transmission to avoid errors caused by large amounts of data transmission between previously transmitted and current data. This continues until all previously transmitted data by the working nodes has been transmitted.
[0082] Implementing the above embodiments has the following effects:
[0083] The technical solution of this invention obtains the area where data needs to be collected, determines the central node and corresponding subordinate nodes within that area, and then selects the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node. This determines the data transmission volume, data type, and data security level of each collection node, ultimately generating a transmission strategy. Simultaneously, a visual topology map is constructed for each collection node and the central node to generate corresponding data animations. This allows for real-time and synchronous visualization of data transmission in the topology map, in conjunction with the data animations, during data transmission according to the transmission strategy. This achieves real-time and synchronous visual monitoring, avoiding the high complexity and large errors associated with traditional data transmission monitoring, improving the reliability of data transmission in the distributed data acquisition system, and enhancing the user experience.
[0084] Example 2
[0085] Please refer to the figure, which shows a visual distributed data acquisition platform provided by the present invention, including: an acquisition module 201, a determination module 202, a strategy module 203, an animation module 204, and a transmission module 205;
[0086] The acquisition module 201 is used to acquire the area where data needs to be collected, and to determine the central node and its connected subordinate nodes based on the data collection area.
[0087] The determining module 202 is used to select subordinate nodes connected to the central node as collection nodes based on the status information of the central node, and to determine the data transmission volume, data type and data security level of each collection node based on the status information of the collection nodes.
[0088] The strategy module 203 is used to generate a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node.
[0089] The animation module 204 is used to construct a visual topology map based on each acquisition node and the central node, and to construct data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type and data security level of the acquisition nodes.
[0090] The transmission module 205 is used to transmit the corresponding data through each acquisition node according to the transmission strategy, and to visualize the data animation corresponding to each acquisition node in the visual topology map during the data transmission process.
[0091] As a preferred embodiment, the step of acquiring the area where data needs to be collected, and determining the central node and its connected subordinate nodes based on the data collection area, specifically includes:
[0092] In response to the data collection area clicked by the user, obtain all nodes in the data collection area;
[0093] Obtain the working status of all nodes in the data acquisition area, and determine the corresponding central node based on the working status;
[0094] All nodes in the data acquisition area that are not designated as the central node are treated as subordinate nodes, and all subordinate nodes are connected to the central node.
[0095] As a preferred embodiment, the step of acquiring the working status of all nodes in the data acquisition area and determining the corresponding central node based on the working status specifically includes:
[0096] Obtain the working status of all nodes in the data acquisition area; wherein, the working status includes: idle status and busy status;
[0097] All nodes in an idle state are selected as candidate nodes, and the historical data transmission volume, historical data transmission type, and historical data security level of each candidate node are obtained.
[0098] Based on the historical data transmission volume, historical data transmission type, and historical data security level, the central transmission weight of each candidate node is determined, and the candidate node with the largest corresponding central transmission weight is selected as the central node.
[0099] As a preferred embodiment, the step of treating all nodes in the data acquisition area that are not identified as the central node as subordinate nodes, and connecting all subordinate nodes to the central node, specifically includes:
[0100] All currently busy nodes are designated as worker nodes.
[0101] All nodes in the data acquisition area that are not identified as central nodes or working nodes are designated as subordinate nodes, and communication connections are established between all subordinate nodes and the central node.
[0102] Nodes outside the data collection area clicked by the user are selected as substitute nodes; each substitute node corresponds to a working node.
[0103] All the aforementioned working nodes transfer data to their corresponding standby nodes, and the data that the current working node needs to transmit is transmitted through its corresponding standby node;
[0104] After the worker nodes transmit the data they previously transmitted to the substitute nodes, communication connections are established between all worker nodes and the central node simultaneously.
[0105] As a preferred embodiment, the step of generating a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data type, and data security level of each acquisition node specifically includes:
[0106] Calculate the first priority weight of each slave node based on the current data type and data security level of each slave node;
[0107] The subordinate nodes are sorted according to the first priority weight, and the subordinate nodes with the same priority weight are sorted and adjusted according to the data transmission volume between the subordinate nodes, so that the subordinate nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the first data transmission order of the subordinate nodes.
[0108] Based on the data type and data security level of each working node, the second priority weight of each working node is calculated, and the working nodes are sorted according to the second priority weight. Taking into account the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted so that the working nodes with the same priority weight are arranged from largest to smallest according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes.
[0109] Each working node in the second data transmission sequence is inserted sequentially from front to back between each subordinate node in the first data transmission sequence to obtain the transmission strategy for the acquisition node to transmit data to the central node; wherein, the transmission strategy is the data transmission sequence of each subordinate node and each working node, and each working node is inserted between each subordinate node in the first data transmission sequence until all working nodes are inserted.
[0110] As a preferred embodiment, the step of constructing a visual topology map based on each acquisition node and the central node, and constructing data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type, and data security level of the acquisition nodes, specifically includes:
[0111] Based on the communication connection relationship between each acquisition node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes, a visual topology map is constructed.
[0112] Based on the data transmission volume, data transmission type, and data security level of the acquisition node, as well as the data transmission volume, data transmission type, and data security level of the prior transmitted data of the working node, the corresponding animation display form, color, and texture are set to construct the data animation corresponding to each acquisition node in the visual topology map.
[0113] As a preferred embodiment, the step of transmitting the corresponding data through each acquisition node according to the transmission strategy, and visually displaying the data animation corresponding to each acquisition node in the visual topology map during the data transmission process, specifically includes:
[0114] According to the transmission strategy, each acquisition node transmits its corresponding data in sequence, so that at each preset time interval, a corresponding acquisition node transmits its corresponding data to the central node. During the transmission process, when each subordinate node transmits data, each working node transmits its own previously transmitted data to the substitute node, which then transmits it until all the data transmitted by the working node has been transmitted.
[0115] The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
[0116] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the device described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0117] Implementing the above embodiments has the following effects:
[0118] The technical solution of this invention obtains the area where data needs to be collected, determines the central node and corresponding subordinate nodes within that area, and then selects the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node. This determines the data transmission volume, data type, and data security level of each collection node, ultimately generating a transmission strategy. Simultaneously, a visual topology map is constructed for each collection node and the central node to generate corresponding data animations. This allows for real-time and synchronous visualization of data transmission in the topology map, in conjunction with the data animations, during data transmission according to the transmission strategy. This achieves real-time and synchronous visual monitoring, avoiding the high complexity and large errors associated with traditional data transmission monitoring, improving the reliability of data transmission in the distributed data acquisition system, and enhancing the user experience.
[0119] Example 3
[0120] Accordingly, the present invention also provides a terminal device, comprising: a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the visualization distributed data acquisition method as described in any of the above embodiments.
[0121] The terminal device in this embodiment includes a processor, a memory, and a computer program and computer instructions stored in the memory and executable on the processor. When the processor executes the computer program, it implements the various steps described in Embodiment 1 above, for example... Figure 1 The steps S101 to S105 are shown. Alternatively, when the processor executes the computer program, it implements the functions of each module / unit in the above-described device embodiment, such as animation module 204.
[0122] For example, the computer program can be divided into one or more modules / units, which are stored in the memory and executed by the processor to complete the present invention. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program in the terminal device. For example, the animation module 204 is used to construct a visual topology map based on each acquisition node and the central node, and to construct data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type, and data security level of the acquisition nodes.
[0123] The terminal device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The terminal device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that the schematic diagram is merely an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the terminal device may also include input / output devices, network access devices, buses, etc.
[0124] The processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor. The processor is the control center of the terminal device, connecting all parts of the terminal device via various interfaces and lines.
[0125] The memory can be used to store the computer programs and / or modules. The processor implements various functions of the terminal device by running or executing the computer programs and / or modules stored in the memory and by calling data stored in the memory. The memory may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc.; the data storage area may store data created based on the use of the mobile terminal, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, RAM, plug-in hard disk, smart media card (SMC), secure digital card (SD card), flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.
[0126] Wherein, if the modules / units integrated in the terminal device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of the present invention can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, it can implement the steps of the various method embodiments described above. Wherein, the computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.
[0127] Example 4
[0128] Accordingly, the present invention also provides a computer-readable storage medium comprising a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the visualization distributed data acquisition method as described in any of the above embodiments.
[0129] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. In particular, it should be noted that any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention for those skilled in the art.
Claims
1. A visual distributed data acquisition method, characterized in that, include: The process involves: acquiring the area where data needs to be collected, and determining the central node and its connected subordinate nodes based on the data collection area; wherein, by acquiring the working status of all nodes in the data collection area and determining the corresponding central node based on the working status, the process includes: acquiring the working status of all nodes in the data collection area; wherein, the working status includes: idle state and busy state; using all nodes in the idle state as candidate nodes, and acquiring the historical data transmission volume, historical data transmission type, and historical data security level of each candidate node; determining the central transmission weight of each candidate node based on the historical data transmission volume, historical data transmission type, and historical data security level, and selecting the candidate node with the largest corresponding central transmission weight as the central node; Based on the status information of the central node, the subordinate nodes connected to it are selected as collection nodes, and based on the status information of the collection nodes, the data transmission volume, data transmission type and data security level of each collection node are determined. Based on the data transmission volume, data transmission type, and data security level of each acquisition node, a transmission strategy is generated for the acquisition nodes to transmit data to the central node. A visual topology map is constructed based on each acquisition node and the central node, and data animations corresponding to each acquisition node are constructed in the visual topology map according to the data transmission volume, data transmission type and data security level of the acquisition nodes. According to the transmission strategy, the corresponding data is transmitted through each acquisition node, and during the data transmission process, the data animation corresponding to each acquisition node is visualized in the visual topology map.
2. The visual distributed data acquisition method as described in claim 1, characterized in that, The process of acquiring the area where data needs to be collected, and determining the central node and its connected subordinate nodes based on the data collection area, specifically includes: In response to the data collection area clicked by the user, obtain all nodes in the data collection area; Obtain the working status of all nodes in the data acquisition area, and determine the corresponding central node based on the working status; All nodes in the data acquisition area that are not designated as the central node are treated as subordinate nodes, and all subordinate nodes are connected to the central node.
3. The visual distributed data acquisition method as described in claim 2, characterized in that, The step of treating all nodes in the data acquisition area that are not identified as the central node as subordinate nodes, and connecting all subordinate nodes to the central node, specifically includes: All currently busy nodes are designated as worker nodes. All nodes in the data acquisition area that are not identified as central nodes or working nodes are designated as subordinate nodes, and communication connections are established between all subordinate nodes and the central node. Nodes outside the data collection area clicked by the user are selected as substitute nodes; each substitute node corresponds to a working node. All the aforementioned working nodes transfer data to their corresponding standby nodes, and the data that the current working node needs to transmit is transmitted through its corresponding standby node; After the worker nodes transmit the data they previously transmitted to the substitute nodes, communication connections are established between all worker nodes and the central node simultaneously.
4. The visual distributed data acquisition method as described in claim 3, characterized in that, The process of generating a transmission strategy for each data acquisition node to transmit data to the central node based on the data transmission volume, data transmission type, and data security level of each acquisition node specifically includes: Calculate the first priority weight of each slave node based on the current data transmission type and data security level of each slave node; The subordinate nodes are sorted according to the first priority weight, and the subordinate nodes with the same priority weight are sorted and adjusted according to the data transmission volume between the subordinate nodes, so that the subordinate nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the first data transmission order of the subordinate nodes. Based on the data transmission type and data security level of each working node, the second priority weight of each working node is calculated, and the working nodes are sorted according to the second priority weight. Taking into account the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted so that the working nodes with the same priority weight are arranged from largest to smallest according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes. Each working node in the second data transmission sequence is inserted sequentially from front to back between each subordinate node in the first data transmission sequence to obtain the transmission strategy for the acquisition node to transmit data to the central node; wherein, the transmission strategy is the data transmission sequence of each subordinate node and each working node, and each working node is inserted between each subordinate node in the first data transmission sequence until all working nodes are inserted.
5. The visual distributed data acquisition method as described in claim 4, characterized in that, The process of constructing a visual topology map based on each acquisition node and the central node, and then constructing data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type, and data security level of the acquisition nodes, specifically includes: Based on the communication connection relationship between each acquisition node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes, a visual topology map is constructed. Based on the data transmission volume, data transmission type, and data security level of the acquisition node, as well as the data transmission volume, data transmission type, and data security level of the prior transmitted data of the working node, the corresponding animation display form, color, and texture are set to construct the data animation corresponding to each acquisition node in the visual topology map.
6. The visual distributed data acquisition method as described in claim 5, characterized in that, According to the transmission strategy, each acquisition node transmits its corresponding data, and during the data transmission process, the data animation corresponding to each acquisition node is visualized in the visual topology map, specifically including: According to the transmission strategy, each acquisition node transmits its corresponding data in sequence, so that at each preset time interval, a corresponding acquisition node transmits its corresponding data to the central node. During the transmission process, when each subordinate node transmits data, each working node transmits its own previously transmitted data to the substitute node, which then transmits it until all the data transmitted by the working node has been transmitted. The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
7. A visual distributed data acquisition platform, characterized in that, include: The module includes an acquisition module, a determination module, a strategy module, an animation module, and a transmission module. The acquisition module is used to acquire the area where data needs to be collected, and determine the central node and its connected subordinate nodes based on the data collection area. Specifically, the process of acquiring the working status of all nodes in the data collection area and determining the corresponding central node based on the working status includes: acquiring the working status of all nodes in the data collection area; wherein the working status includes: idle state and busy state; using all nodes in the idle state as candidate nodes, and acquiring the historical data transmission volume, historical data transmission type, and historical data security level of each candidate node; determining the central transmission weight of each candidate node based on the historical data transmission volume, historical data transmission type, and historical data security level, and selecting the candidate node with the highest central transmission weight as the central node. The determining module is used to select subordinate nodes connected to the central node as collection nodes based on the status information of the central node, and to determine the data transmission volume, data transmission type and data security level of each collection node based on the status information of the collection nodes. The strategy module is used to generate a transmission strategy for the data acquisition nodes to transmit data to the central node based on the data transmission volume, data transmission type, and data security level of each acquisition node. The animation module is used to construct a visual topology map based on each acquisition node and the central node, and to construct data animations corresponding to each acquisition node in the visual topology map based on the data transmission volume, data transmission type and data security level of the acquisition nodes. The transmission module is used to transmit the corresponding data through each acquisition node according to the transmission strategy, and to visualize the data animation corresponding to each acquisition node in the visual topology map during the data transmission process.
8. A terminal device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor, when executing the computer program, implements the visualization distributed data acquisition method as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program, wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium is located to perform the visual distributed data acquisition method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Cluster resource scheduling method, node, equipment and storage medium
CN110213358A
Cloud security visualization method and system based on topological graph
CN116886544A