Visual distributed data acquisition method and platform
By acquiring and filtering nodes in a distributed data acquisition system, generating transmission strategies, and building a visual topology map for data animation display, the problems of low reliability, accuracy and efficiency of data transmission in the existing technology of distributed data acquisition system are solved, and real-time and synchronous visual monitoring and data transmission efficiency are improved.
Patent Information
- Application Number
- CN202411943922.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-27
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2044-12-27
AI Technical Summary
In the process of large-scale data transmission, existing distributed data acquisition systems are difficult to achieve effective visual monitoring, resulting in low reliability, accuracy and efficiency of data transmission, and high complexity and large errors in data transmission monitoring.
By obtaining the central node and slave nodes in the data acquisition area, filtering the acquisition nodes based on the status information of the central node, determining the data transmission amount, data type and data security level of each acquisition node, generating a transmission strategy, and building a visual topology diagram for data animation display, realizing visual monitoring of data transmission.
Real-time and synchronous visual monitoring of distributed data acquisition systems is realized, which improves the reliability and efficiency of data transmission and reduces monitoring complexity and error.
Smart Images

Figure CN119629077A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data acquisition, and in particular to a visual distributed data acquisition method and platform. Background Art
[0002] Distributed data acquisition systems usually consist of multiple acquisition nodes and a central node, connected through a distributed network. Each acquisition node can independently acquire and process its corresponding local data, and transmit the necessary data or local data processing results to the central node. At present, the existing distributed data acquisition system is more complicated than the stand-alone system. In the process of large-scale data transmission, the distributed data acquisition system needs to be monitored in real time. However, it is currently impossible to effectively perform visual monitoring of distributed data transmission, resulting in high complexity and large errors in data transmission monitoring of distributed nodes. At the same time, for large-scale data, a large number of distributed nodes sending data can easily cause the central node to crash due to the influx of a large amount of data at the same time, resulting in low data transmission reliability, accuracy and efficiency of the distributed data acquisition system. Summary of the invention
[0003] The present invention provides a visual distributed data acquisition method and platform to solve the technical problems of low data transmission reliability, low data transmission accuracy and efficiency, high complexity and large error of data transmission monitoring in the prior art distributed data acquisition system.
[0004] In order to solve the above technical problems, an embodiment of the present invention provides a visual distributed data collection method, including: Acquire the area where data collection is required, and determine the central node and the slave nodes connected thereto according to the data collection area; According to the status information of the central node, the slave nodes connected to the central node are selected as collection nodes, and according to the status information of the collection nodes, the data transmission volume, data type and data security level of each collection node are determined; Generate a transmission strategy for transmitting data from each collection node to the central node based on the data transmission volume, data type and data security level of each collection node; Constructing a visual topology map according to each collection node and the central node, and constructing a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node; According to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visualized in the visual topology diagram.
[0005] As a preferred solution, the step of acquiring the area for data collection and determining the central node and the slave nodes connected thereto according to the data collection area specifically includes: In response to a data collection area clicked by a user, acquiring all nodes in the data collection area; Acquire the working status of all nodes in the data collection area, and determine the corresponding central node according to the working status; All nodes in the data collection area that are not determined as central nodes are used as slave nodes, and all the slave nodes are connected to the central node.
[0006] As a preferred solution, the obtaining of the working statuses corresponding to all nodes in the data collection area and determining the corresponding central node according to the working statuses specifically includes: Obtaining the working status corresponding to all nodes in the data collection area; wherein the working status includes: idle state and busy state; All nodes in an idle state are taken as candidate nodes, and the historical data transmission volume, historical data transmission type and historical data security level of each candidate node are obtained; According to the historical data transmission volume, historical data transmission type and historical data security level, the central transmission weight of each candidate node is determined, and the candidate node with the largest corresponding central transmission weight is used as the central node.
[0007] As a preferred solution, the process of treating all nodes in the data collection area that are not determined as central nodes as slave nodes and connecting all slave nodes to the central node specifically includes: All nodes currently in a busy state are considered working nodes; All nodes in the data collection area that are not determined as central nodes and working nodes are regarded as slave nodes, and all slave nodes are connected to the central node in a communication manner; Nodes outside the data collection area clicked by the user are screened and obtained as substitute nodes; wherein each substitute node corresponds to a working node; Transfer data from all the working nodes to their corresponding stand-in nodes, and transmit the data that the current working node needs to transmit through its corresponding stand-in node; After the working node transmits the previously transmitted data to the substitute node, all the working nodes are synchronously connected to the central node.
[0008] As a preferred solution, the transmission strategy for transmitting data from the collection node to the central node is generated according to the data transmission volume, data type and data security level of each collection node, specifically including: Calculate the first priority weight of each slave node according to the current data type and data security level of each slave node; Sorting the slave nodes according to the first priority weight, and adjusting the order of the slave nodes with the same priority weight according to the sorted slave nodes and the data transmission volume between the slave nodes, so that the slave nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining a first data transmission order of the slave nodes; According to the data type and data security level of each current working node, the second priority weight of each working node is calculated, and each working node is sorted according to the second priority weight. In combination with the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted, so that the working nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes; Insert each working node in the second data transmission sequence from front to back in sequence between each slave node in the first data transmission sequence to obtain a transmission strategy for the acquisition node to transmit data to the central node; wherein the transmission strategy is the data transmission sequence of each slave node and each working node, and each working node is inserted between each slave node in the first data transmission sequence until all working nodes are inserted.
[0009] As a preferred solution, the visual topology map is constructed according to each collection node and the central node, and the data animation corresponding to each collection node is constructed in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node, which specifically includes: Construct a visual topology diagram based on the communication connection relationship between each collection node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes; According to the data transmission volume, data transmission type and data security level of the acquisition node, as well as the data transmission volume, data transmission type and data security level corresponding to the previously transmitted data of the working node, the corresponding animation expression form, color and texture are set, so as to construct the data animation corresponding to each acquisition node in the visual topology diagram.
[0010] As a preferred solution, according to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visually displayed in the visual topology map, specifically including: According to the transmission strategy, each collection node transmits its corresponding data in turn, so that within each preset time interval, there is a corresponding collection node that transmits its corresponding data to the central node, and during the transmission process, when each slave node transmits data, each working node transmits its previously transmitted data to the substitute node, and the substitute node transmits it until the data previously transmitted by the working node has been completely transmitted; The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
[0011] Accordingly, the present invention also provides a visual distributed data acquisition platform, comprising: an acquisition module, a determination module, a strategy module, an animation module and a transmission module; The acquisition module is used to acquire the area where data acquisition is required, and determine the central node and the slave nodes connected thereto according to the data acquisition area; The determination module is used to select the slave nodes connected to the central node as collection nodes according to the status information of the central node, and determine the data transmission volume, data type and data security level of each collection node according to the status information of the collection node; The strategy module is used to generate a transmission strategy for transmitting data from the collection node to the central node according to the data transmission volume, data type and data security level of each collection node; The animation module is used to construct a visual topology map according to each collection node and the central node, and to construct a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node; The transmission module is used to transmit the corresponding data through each collection node according to the transmission strategy, and to visualize the data animation corresponding to each collection node in the visual topology diagram during the data transmission process.
[0012] Correspondingly, the present invention also provides a terminal device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, it implements the visual distributed data acquisition method as described in any one of the above.
[0013] Correspondingly, the present invention also provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the visual distributed data acquisition method as described in any one of the above.
[0014] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: The technical solution of the present invention obtains the area where data collection is required, determines the central node and the corresponding subordinate nodes in the data collection area, and then screens the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node, thereby determining the data transmission volume, data type and data security level of each collection node, and finally generating a transmission strategy. At the same time, a visual topology diagram is constructed for each collection node and the central node to generate corresponding data animations, so that when data is transmitted according to the transmission strategy, it can be simultaneously visualized in the visual topology diagram in combination with the data animation, thereby realizing real-time and synchronous visual monitoring, avoiding the problems of high complexity and large errors in data transmission monitoring, and improving the data transmission reliability of the distributed data acquisition system and the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 : A flowchart of the steps of a visual distributed data acquisition method provided by an embodiment of the present invention; Figure 2 : A structural diagram of a visual distributed data acquisition platform provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0017] Embodiment 1 Please refer to Figure 1 , a visual distributed data collection method provided by an embodiment of the present invention, comprising the following steps S101-S105: Step S101: Acquire an area where data collection is required, and determine a central node and slave nodes connected thereto according to the data collection area.
[0018] As a preferred solution of this embodiment, the step of acquiring the area for data collection and determining the central node and the slave nodes connected thereto according to the data collection area specifically includes: In response to a data collection area clicked by a user, all nodes in the data collection area are obtained; the working statuses corresponding to all nodes in the data collection area are obtained, and the corresponding central node is determined according to the working statuses; all nodes in the data collection area that have not been determined as central nodes are made subordinate nodes, and all subordinate nodes are connected to the central node.
[0019] In this embodiment, the data collection area can be framed by the user, and can be selected by selecting a preset area in the platform, or by selecting a corresponding node as the data collection area by selecting a box. By responding to the data collection area clicked by the user, all nodes in the data collection area can be obtained, and the corresponding central node can be determined according to the working status of each node. Finally, all nodes in the data collection area that have not been determined as central nodes are used as slave nodes, and all slave nodes are connected to the central node.
[0020] As a preferred solution of this embodiment, the obtaining of the working statuses corresponding to all nodes in the data collection area and determining the corresponding central node according to the working statuses specifically includes: Obtain the working status corresponding to all nodes in the data collection area; wherein the working status includes: idle state and busy state; take all nodes in idle state as candidate nodes, and obtain the historical data transmission volume, historical data transmission type and historical data security level of each candidate node; determine the central transmission weight of each candidate node according to the historical data transmission volume, historical data transmission type and historical data security level, and take the candidate node with the largest corresponding central transmission weight as the central node.
[0021] In this embodiment, by obtaining the corresponding working status of all nodes in the data collection area, it is possible to determine whether each node is in an idle state or a busy state. Among them, the node in the idle state can be used as a central node to undertake the data collection and transmission of each collection node in the data collection area. Then, all nodes in the idle state are used as candidate nodes to obtain the historical data transmission volume, historical data transmission type and historical data security level of each candidate node, so as to calculate the central transmission weight of each candidate node, and finally the candidate node with the largest corresponding central transmission weight is used as the central node.
[0022] It should be noted that the historical data transmission volume, historical data transmission type and historical data security level have corresponding weight coefficients respectively, among which the historical data transmission volume is the total data volume of the historical data transmission of the candidate node, the historical data transmission type is all types of data transmitted by the candidate node, and the historical data security level is all security levels of the historical transmission data.
[0023] Among them, the calculation formula of the central transmission weight of the candidate node is:
[0024] in, is the central transmission weight, C is the total amount of historical data transmission of the candidate nodes, The type of data that the candidate node has transmitted accounts for the largest proportion, where each type has a corresponding Type value according to its importance. For example, the Type value of text data is 1, the Type value of binary data is 2, the Type value of database is 3, the Type value of compressed data is 4, the Type value of metadata is 5, and the Type value of encrypted data is 6; It is the security level with the largest proportion of historical transmission data, where each security level has a corresponding S value according to its importance. For example, the security level is divided into high, medium and low levels, with the high level being 3, the medium level being 2, and the low level being 1; a, b and c are the preset weight coefficients of historical data transmission volume, historical data transmission type and historical data security level, respectively.
[0025] As a preferred solution of this embodiment, the nodes in the data collection area that are not determined as the central node are all used as slave nodes, and all the slave nodes are connected to the central node, specifically including: According to all nodes that are currently in a busy state, all of them are used as working nodes; all of the nodes in the data collection area that have not been determined as central nodes and working nodes are used as slave nodes, and communication connections are established between all the slave nodes and the central node; the nodes outside the data collection area clicked by the user are screened and obtained as substitute nodes; wherein each substitute node corresponds to a working node; all of the working nodes transfer data to their corresponding substitute nodes, and the data that the current working node needs to transmit is transmitted through its corresponding substitute node; after the working node transmits its previously transmitted data to the substitute node, communication connections are synchronously established between all the working nodes and the central node.
[0026] In this embodiment, all nodes in a busy state are determined as working nodes, and all nodes in the data collection area that are not determined as central nodes and working nodes are determined as slave nodes, and communication connections are established between all slave nodes and the central node to achieve connection between the slave nodes and the central node.
[0027] Furthermore, the nodes outside the data collection area clicked by the user are filtered out, and the nodes outside the data collection area are used as substitute nodes to establish data connections with their corresponding working nodes, so that all working nodes transfer data to their corresponding substitute nodes, so that the data that the current working node needs to transmit is transmitted through its corresponding substitute node. After the working node transmits its previously transmitted data to the substitute node, all working nodes are synchronously established with the central node. Communication connection, so that the working node can synchronously transfer the original previous data through the substitute node during the data transmission process, and can also send the data in the current data collection task to the central node, thereby realizing efficient data transmission and ensuring the efficiency of data transmission.
[0028] Step S102: According to the status information of the central node, the slave nodes connected to the central node are selected as collection nodes, and according to the status information of the collection nodes, the data transmission volume, data type and data security level of each collection node are determined.
[0029] In this embodiment, the status information of the central node, including but not limited to node status, resource usage, node information and attributes and address information, is used to screen out the slave nodes connected to it as collection nodes, that is, to screen out the nodes that do not need to perform data collection, and then determine the data transmission volume, data type and data security level of each collection node based on the status information of the collection node, and determine the data collection and transmission tasks between each collection node.
[0030] Step S103: generating a transmission strategy for transmitting data from each collection node to the central node according to the data transmission volume, data type and data security level of each collection node.
[0031] As a preferred solution of this embodiment, the transmission strategy for transmitting data from the collection node to the central node is generated according to the data transmission volume, data type and data security level of each collection node, specifically including: According to the current data type and data security level of each slave node, the first priority weight of each slave node is calculated; according to the first priority weight, each slave node is sorted, and according to the sorted slave nodes, combined with the data transmission volume between each slave node, the slave nodes with the same priority weight are sorted and adjusted, so that the slave nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the first data transmission order of the slave nodes; according to the current data type and data security level of each working node, the second priority weight of each working node is calculated, and the working nodes are sorted according to the second priority weight, combined with each The data transmission volume between working nodes is adjusted by sorting working nodes with the same priority weight, so that the working nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining a second data transmission order of the working nodes; each working node in the second data transmission order is inserted from front to back between each slave node in the first data transmission order, thereby obtaining a transmission strategy for the acquisition node to transmit data to the central node; wherein, the transmission strategy is the data transmission order of each slave node and each working node, and each working node is inserted between each slave node in the first data transmission order until all working nodes are inserted.
[0032] In this embodiment, the first priority weight of each slave node is calculated according to the current data type and data security level of each slave node, that is, the first priority weight of the slave node is calculated according to the data type and data security level that the current slave node needs to transmit, and at the same time, each slave node is sorted by the first priority weight, and then combined with the data transmission volume between each slave node, the slave nodes with the same first priority weight are sorted in a secondary order, that is, they are arranged from large to small according to the data transmission volume, so as to obtain the first data transmission order of the slave nodes.
[0033] Furthermore, the working nodes are sorted in the same way, that is, the second priority weight of each working node is calculated according to the data type and data security level of each current working node, and each working node is sorted according to the second priority weight. Then, according to the data transmission volume between each working node, the working nodes with the same second priority weight are sorted in a secondary order, that is, they are arranged from large to small according to the data transmission volume, so as to obtain the second data transmission order of the working nodes.
[0034] For example, the first data transmission order is [a, b, c, d, …], where a, b, c, d, etc. are slave nodes respectively, and the second data transmission order is [A, B, C, D, …], where A, B, C, D are working nodes respectively; each working node in the second data transmission order is inserted from front to back between each slave node in the first data transmission order to obtain a transmission strategy for the collection node to transmit data to the central node, that is, the obtained transmission strategy order is [a, A, b, B, c, C, d, …].
[0035] Step S104: constructing a visual topology map according to each collection node and the central node, and constructing a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node.
[0036] As a preferred solution of this embodiment, the visual topology diagram is constructed according to each collection node and the central node, and the data animation corresponding to each collection node is constructed in the visual topology diagram according to the data transmission volume, data transmission type and data security level of the collection node, specifically including: A visual topology diagram is constructed based on the communication connection relationship between each collection node and the central node, and the data transmission relationship of the substitute node of the corresponding working node; according to the data transmission volume, data transmission type and data security level of the collection node, and the data transmission volume, data transmission type and data security level corresponding to the previous transmission data of the working node, the corresponding animation expression form, color and texture are set, so as to construct the data animation corresponding to each collection node in the visual topology diagram.
[0037] In this embodiment, a visual topology diagram is constructed through the communication connection relationship between each collection node and the central node, and the data transmission relationship between the working node and its corresponding substitute node. Then, different animation expressions, colors and textures are set according to the data transmission volume, data transmission type and data security level of the collection node, and the data transmission volume, data transmission type and data security level corresponding to the previously transmitted data of the working node, so that when the corresponding node performs data transmission, it can be displayed in the visual topology diagram, so that the corresponding data transmission status can be intuitively monitored.
[0038] Step S105: according to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visualized in the visual topology diagram.
[0039] As a preferred solution of this embodiment, according to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visually displayed in the visual topology diagram, specifically including: According to the transmission strategy, each collection node transmits its corresponding data in turn, so that within each preset time interval, there is a corresponding collection node that transmits its corresponding data to the central node, and in the transmission process, when each slave node transmits data, each working node transmits its own previously transmitted data to the substitute node, and the substitute node transmits it until the data previously transmitted by the working node has been completely transmitted; through its corresponding data animation, the data transmission process of each collection node is visualized in the visual topology diagram.
[0040] In this embodiment, the corresponding data of each collection node is transmitted in turn through the transmission strategy, so that in the transmission strategy, that is, at each preset interval, there is a collection node to transmit the corresponding data to the central node, that is, according to the transmission strategy sequence [a, A, b, B, c, C, d, ...], each node has a preset time to transmit, and after the last node completes the transmission, it turns back to the first collection node, that is, the collection node a, to transmit. In the transmission process, when each slave node performs data transmission, the working node transmits its previously transmitted data to the substitute node, that is, the substitute node performs the online data transmission, and after the data transmission of the slave node is completed, it goes to the next node of the slave node (that is, the working node, which can refer to the transmission strategy sequence [a, A, b, B, c, C, d, ...]), and then the working node transmits the current data, and other working nodes also suspend transmission to avoid the problem of transmission errors between the previous data and the current data caused by a large amount of data transmission. Until the data previously transmitted by the working node has been fully transmitted.
[0041] Implementing the above embodiments has the following effects: The technical solution of the present invention obtains the area where data collection is required, determines the central node and the corresponding subordinate nodes in the data collection area, and then screens the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node, thereby determining the data transmission volume, data type and data security level of each collection node, and finally generating a transmission strategy. At the same time, a visual topology diagram is constructed for each collection node and the central node to generate corresponding data animations, so that when data is transmitted according to the transmission strategy, it can be simultaneously visualized in the visual topology diagram in combination with the data animation, thereby realizing real-time and synchronous visual monitoring, avoiding the problems of high complexity and large errors in data transmission monitoring, and improving the data transmission reliability of the distributed data acquisition system and the user experience.
[0042] Embodiment 2 Please refer to the figure, which is a visual distributed data acquisition platform provided by the present invention, including: an acquisition module 201, a determination module 202, a strategy module 203, an animation module 204 and a transmission module 205; The acquisition module 201 is used to acquire an area where data acquisition is required, and determine a central node and slave nodes connected thereto according to the data acquisition area.
[0043] The determination module 202 is used to select the slave nodes connected to the central node as collection nodes according to the status information of the central node, and determine the data transmission volume, data type and data security level of each collection node according to the status information of the collection node.
[0044] The strategy module 203 is used to generate a transmission strategy for the data transmission from the collection node to the central node according to the data transmission volume, data type and data security level of each collection node.
[0045] The animation module 204 is used to construct a visual topology map according to each collection node and the central node, and to construct a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node.
[0046] The transmission module 205 is used to transmit the corresponding data through each collection node according to the transmission strategy, and to visualize the data animation corresponding to each collection node in the visual topology diagram during the data transmission process.
[0047] As a preferred solution, the step of acquiring the area for data collection and determining the central node and the slave nodes connected thereto according to the data collection area specifically includes: In response to a data collection area clicked by a user, acquiring all nodes in the data collection area; Acquire the working status of all nodes in the data collection area, and determine the corresponding central node according to the working status; All nodes in the data collection area that are not determined as central nodes are used as slave nodes, and all the slave nodes are connected to the central node.
[0048] As a preferred solution, the obtaining of the working statuses corresponding to all nodes in the data collection area and determining the corresponding central node according to the working statuses specifically includes: Obtaining the working status corresponding to all nodes in the data collection area; wherein the working status includes: idle state and busy state; All nodes in an idle state are taken as candidate nodes, and the historical data transmission volume, historical data transmission type and historical data security level of each candidate node are obtained; According to the historical data transmission volume, historical data transmission type and historical data security level, the central transmission weight of each candidate node is determined, and the candidate node with the largest corresponding central transmission weight is used as the central node.
[0049] As a preferred solution, the process of treating all nodes in the data collection area that are not determined as central nodes as slave nodes and connecting all slave nodes to the central node specifically includes: All nodes currently in a busy state are considered working nodes; All nodes in the data collection area that are not determined as central nodes and working nodes are regarded as slave nodes, and all slave nodes are connected to the central node in a communication manner; Nodes outside the data collection area clicked by the user are screened and obtained as substitute nodes; wherein each substitute node corresponds to a working node; Transfer data from all the working nodes to their corresponding stand-in nodes, and transmit the data that the current working node needs to transmit through its corresponding stand-in node; After the working node transmits the previously transmitted data to the substitute node, all the working nodes are synchronously connected to the central node.
[0050] As a preferred solution, the transmission strategy for transmitting data from the collection node to the central node is generated according to the data transmission volume, data type and data security level of each collection node, specifically including: Calculate the first priority weight of each slave node according to the current data type and data security level of each slave node; Sorting the slave nodes according to the first priority weight, and adjusting the order of the slave nodes with the same priority weight according to the sorted slave nodes and the data transmission volume between the slave nodes, so that the slave nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining a first data transmission order of the slave nodes; According to the data type and data security level of each current working node, the second priority weight of each working node is calculated, and each working node is sorted according to the second priority weight. In combination with the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted, so that the working nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes; Insert each working node in the second data transmission sequence from front to back in sequence between each slave node in the first data transmission sequence to obtain a transmission strategy for the acquisition node to transmit data to the central node; wherein the transmission strategy is the data transmission sequence of each slave node and each working node, and each working node is inserted between each slave node in the first data transmission sequence until all working nodes are inserted.
[0051] As a preferred solution, the visual topology map is constructed according to each collection node and the central node, and the data animation corresponding to each collection node is constructed in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node, which specifically includes: Construct a visual topology diagram based on the communication connection relationship between each collection node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes; According to the data transmission volume, data transmission type and data security level of the acquisition node, as well as the data transmission volume, data transmission type and data security level corresponding to the previously transmitted data of the working node, the corresponding animation expression form, color and texture are set, so as to construct the data animation corresponding to each acquisition node in the visual topology diagram.
[0052] As a preferred solution, according to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visually displayed in the visual topology map, specifically including: According to the transmission strategy, each collection node transmits its corresponding data in turn, so that within each preset time interval, there is a corresponding collection node that transmits its corresponding data to the central node, and during the transmission process, when each slave node transmits data, each working node transmits its previously transmitted data to the substitute node, and the substitute node transmits it until the data previously transmitted by the working node has been completely transmitted; The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
[0053] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0054] Implementing the above embodiments has the following effects: The technical solution of the present invention obtains the area where data collection is required, determines the central node and the corresponding subordinate nodes in the data collection area, and then screens the subordinate nodes connected to the central node as collection nodes by determining the status information of the central node, thereby determining the data transmission volume, data type and data security level of each collection node, and finally generating a transmission strategy. At the same time, a visual topology diagram is constructed for each collection node and the central node to generate corresponding data animations, so that when data is transmitted according to the transmission strategy, it can be simultaneously visualized in the visual topology diagram in combination with the data animation, thereby realizing real-time and synchronous visual monitoring, avoiding the problems of high complexity and large errors in data transmission monitoring, and improving the data transmission reliability of the distributed data acquisition system and the user experience.
[0055] Embodiment 3 Correspondingly, the present invention also provides a terminal device, comprising: a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein when the processor executes the computer program, the visual distributed data collection method as described in any one of the above embodiments is implemented.
[0056] The terminal device of this embodiment includes: a processor, a memory, and a computer program and a computer instruction stored in the memory and executable on the processor. When the processor executes the computer program, each step in the above-mentioned embodiment 1 is implemented, for example: Figure 1 Alternatively, the processor implements the functions of each module / unit in the above device embodiment, such as the animation module 204, when executing the computer program.
[0057] Exemplarily, the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the memory and executed by the processor to complete the present invention. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the terminal device. For example, the animation module 204 is used to construct a visual topology map based on each collection node and the central node, and to construct a data animation corresponding to each collection node in the visual topology map based on the data transmission volume, data transmission type and data security level of the collection node.
[0058] The terminal device may be a computing device such as a desktop computer, a notebook, a PDA, and a cloud server. The terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that the schematic diagram is merely an example of a terminal device and does not constitute a limitation on the terminal device. The terminal device may include more or fewer components than shown in the diagram, or may combine certain components, or different components. For example, the terminal device may also include an input / output device, a network access device, a bus, etc.
[0059] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the terminal device, and uses various interfaces and lines to connect various parts of the entire terminal device.
[0060] The memory can be used to store the computer program and / or module, and the processor realizes various functions of the terminal device by running or executing the computer program and / or module stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, etc.; the data storage area can store data created according to the use of the mobile terminal, etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0061] Wherein, if the module / unit integrated in the terminal device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.
[0062] Embodiment 4 Correspondingly, the present invention also provides a computer-readable storage medium, which includes a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the visual distributed data acquisition method described in any one of the above embodiments.
[0063] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.
Claims
1. A visual distributed data collection method, characterized in that: include: Acquire the area where data collection is required, and determine the central node and the slave nodes connected thereto according to the data collection area; According to the status information of the central node, the slave nodes connected to the central node are selected as collection nodes, and according to the status information of the collection nodes, the data transmission volume, data type and data security level of each collection node are determined; Generate a transmission strategy for transmitting data from each collection node to the central node based on the data transmission volume, data type and data security level of each collection node; Constructing a visual topology map according to each collection node and the central node, and constructing a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node; According to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visualized in the visual topology diagram.
2. A visual distributed data collection method as claimed in claim 1, characterized in that: The step of acquiring the area for data collection and determining the central node and the slave nodes connected thereto according to the data collection area specifically includes: In response to a data collection area clicked by a user, acquiring all nodes in the data collection area; Acquire the working status of all nodes in the data collection area, and determine the corresponding central node according to the working status; All nodes in the data collection area that are not determined as central nodes are used as slave nodes, and all the slave nodes are connected to the central node.
3. A visual distributed data collection method as claimed in claim 2, characterized in that: The obtaining of the working statuses corresponding to all nodes in the data collection area and determining the corresponding central node according to the working statuses specifically includes: Obtaining the working status corresponding to all nodes in the data collection area; wherein the working status includes: idle state and busy state; All nodes in an idle state are taken as candidate nodes, and the historical data transmission volume, historical data transmission type and historical data security level of each candidate node are obtained; According to the historical data transmission volume, historical data transmission type and historical data security level, the central transmission weight of each candidate node is determined, and the candidate node with the largest corresponding central transmission weight is used as the central node.
4. A visual distributed data collection method as claimed in claim 3, characterized in that: The step of treating all nodes in the data collection area that are not determined as the central node as slave nodes and connecting all the slave nodes to the central node specifically includes: All nodes currently in a busy state are considered working nodes; All nodes in the data collection area that are not determined as central nodes and working nodes are regarded as slave nodes, and all slave nodes are connected to the central node in a communication manner; Nodes outside the data collection area clicked by the user are screened and obtained as substitute nodes; wherein each substitute node corresponds to a working node; Transfer data from all the working nodes to their corresponding stand-in nodes, and transmit the data that the current working node needs to transmit through its corresponding stand-in node; After the working node transmits the previously transmitted data to the substitute node, all the working nodes are synchronously connected to the central node.
5. A visual distributed data collection method as claimed in claim 4, characterized in that: The generating of a transmission strategy for transmitting data from the collection node to the central node according to the data transmission volume, data type and data security level of each collection node specifically includes: Calculate the first priority weight of each slave node according to the current data type and data security level of each slave node; Sorting the slave nodes according to the first priority weight, and adjusting the order of the slave nodes with the same priority weight according to the sorted slave nodes and the data transmission volume between the slave nodes, so that the slave nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining a first data transmission order of the slave nodes; According to the data type and data security level of each current working node, the second priority weight of each working node is calculated, and each working node is sorted according to the second priority weight. In combination with the data transmission volume between each working node, the working nodes with the same priority weight are sorted and adjusted, so that the working nodes with the same priority weight are arranged from large to small according to the data transmission volume, thereby obtaining the second data transmission order of the working nodes; Insert each working node in the second data transmission sequence from front to back in sequence between each slave node in the first data transmission sequence to obtain a transmission strategy for the acquisition node to transmit data to the central node; wherein the transmission strategy is the data transmission sequence of each slave node and each working node, and each working node is inserted between each slave node in the first data transmission sequence until all working nodes are inserted.
6. A visual distributed data collection method as claimed in claim 5, characterized in that: The step of constructing a visual topology map according to each collection node and the central node, and constructing a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node, specifically includes: Construct a visual topology diagram based on the communication connection relationship between each collection node and the central node, and the data transmission relationship between the substitute nodes of the corresponding working nodes; According to the data transmission volume, data transmission type and data security level of the acquisition node, as well as the data transmission volume, data transmission type and data security level corresponding to the previously transmitted data of the working node, the corresponding animation expression form, color and texture are set, so as to construct the data animation corresponding to each acquisition node in the visual topology diagram.
7. A visual distributed data collection method as claimed in claim 6, characterized in that: According to the transmission strategy, the corresponding data is transmitted through each collection node, and during the data transmission process, the data animation corresponding to each collection node is visually displayed in the visual topology diagram, specifically including: According to the transmission strategy, each collection node transmits its corresponding data in turn, so that within each preset time interval, there is a corresponding collection node that transmits its corresponding data to the central node, and during the transmission process, when each slave node transmits data, each working node transmits its previously transmitted data to the substitute node, and the substitute node transmits it until the data previously transmitted by the working node has been completely transmitted; The data transmission process of each acquisition node is visualized in the visual topology diagram through its corresponding data animation.
8. A visual distributed data acquisition platform, characterized in that: include: an acquisition module, a determination module, a strategy module, an animation module, and a transmission module; The acquisition module is used to acquire the area where data acquisition is required, and determine the central node and the slave nodes connected thereto according to the data acquisition area; The determination module is used to select the slave nodes connected to the central node as collection nodes according to the status information of the central node, and determine the data transmission volume, data type and data security level of each collection node according to the status information of the collection node; The strategy module is used to generate a transmission strategy for transmitting data from the collection node to the central node according to the data transmission volume, data type and data security level of each collection node; The animation module is used to construct a visual topology map according to each collection node and the central node, and to construct a data animation corresponding to each collection node in the visual topology map according to the data transmission volume, data transmission type and data security level of the collection node; The transmission module is used to transmit the corresponding data through each collection node according to the transmission strategy, and to visualize the data animation corresponding to each collection node in the visual topology diagram during the data transmission process.
9. A terminal device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein when the processor executes the computer program, the visual distributed data collection method according to any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the visual distributed data acquisition method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Data acquisition method and device
CN107896175A
Cluster resource scheduling method, node, equipment and storage medium
CN110213358A
Network topological graph dynamic generation method and device, and storage medium
CN115883386A
Distributed photovoltaic data acquisition and transmission method and system
CN116436906A
Cloud security visualization method and system based on topological graph
CN116886544A