An Internet data collection system with early warning function

Abstract

The present invention provides an Internet data collection system with an early warning function, which relates to the field of data security technology and includes: a user analysis module, which is used to obtain user information from a user and determine the user's collection authority based on the user information; a node analysis module, which is used to obtain node information of an Internet node and determine the distribution authority of the Internet node based on the node information; a risk assessment module, which is used to obtain the user's data collection request, conduct a risk assessment on the data collection process in combination with the collection authority and distribution authority, and issue an early warning based on the assessment result; mutual verification and assessment are performed from two aspects of users and Internet nodes, and corresponding early warnings are issued to ensure data collection security.

Description

Technical Field

[0001] The present invention relates to the field of data security technology, and in particular to an Internet data acquisition system with an early warning function. Background Art

[0002] Internet data security risks are becoming increasingly prominent. Internet systems inherently feature complex connected services, a wide variety of connected devices, and diverse data formats, exposing all layers of these systems to direct security risks. Furthermore, the data resources collected, stored, and utilized by internet systems are characterized by large volumes, diverse types, strong correlations, uneven value distribution, and significant disparities in data protection across different sectors, all of which pose data security risks. Data is the core of the core of the Industrial Internet, and data security is a core requirement of Industrial Internet platforms.

[0003] To ensure data security, a risk assessment method is provided from the perspective of users and Internet nodes to ensure data security. Summary of the Invention

[0004] The present invention provides an Internet data collection system with an early warning function, which performs risk assessment on users and Internet nodes to ensure data security.

[0005] An Internet data collection system with an early warning function, comprising:

[0006] A user analysis module, configured to obtain user information from a user and determine the collection authority of the user based on the user information;

[0007] A node analysis module, configured to obtain node information of an Internet node and determine the distribution authority of the Internet node based on the node information;

[0008] The risk assessment module is used to obtain the user's data collection request, conduct a risk assessment on the data collection process in combination with the collection authority and distribution authority, and issue an early warning based on the assessment results.

[0009] Preferably, the user analysis module includes:

[0010] an acquisition unit, configured to acquire the user's identity login data on the Internet and user behavior data on the Internet;

[0011] A data analysis unit, configured to analyze the user behavior data and determine a user behavior value;

[0012] The permission determination unit is used to retrieve the corresponding target permission from the permission solution library based on the user behavior value, associate it with the identity login information, and obtain the collection permission of the user.

[0013] Preferably, the data analysis unit includes:

[0014] A behavior analysis unit, configured to obtain a user's behavior record on the service data based on the user behavior data, and determine a behavior feature vector of a behavior feature of each service data in a preset service feature space based on the behavior record;

[0015] The vector processing unit is used to distribute the behavior feature vector to each analysis node of the distributed vector model, and pre-process and fuse the behavior feature vector based on the analysis node to determine the user behavior value of the user.

[0016] Preferably, the node analysis module includes:

[0017] a node evaluation unit, configured to obtain node information of Internet nodes, determine a node distribution structure of the Internet based on the node information, determine connection characteristics and path characteristics between all Internet nodes based on the node distribution structure, perform connection evaluation for the Internet nodes based on the connection characteristics to determine a connection evaluation value, and perform path evaluation for the Internet nodes based on the path characteristics to determine a path evaluation value;

[0018] a determining unit, configured to determine a target data range of the Internet node based on the connection evaluation value and the path evaluation value;

[0019] The permission setting unit is used to set distribution permissions for the Internet node based on the target data range.

[0020] Preferably, the determining unit includes:

[0021] a node analysis unit, configured to determine a node type and a node service of an Internet node based on the node information, and determine a data range of the Internet node based on the node type;

[0022] a threshold determination unit, configured to determine a node association value between the Internet nodes based on the data range, and set a first range threshold for each Internet node based on the connection evaluation value, and set a second range threshold for each Internet node based on the path evaluation value;

[0023] The data selection unit is configured to select a target data range from the data range that satisfies the node association value, the first range threshold, and the second range threshold.

[0024] Preferably, the data selection unit includes:

[0025] a data determination unit, configured to determine whether a difference between the first range threshold and the second range threshold is within a preset range; if so, obtain an initial data range corresponding to the first range threshold from the data range; otherwise, modify the first range threshold based on the second range threshold, and obtain an initial data range corresponding to the modified first range threshold from the data range;

[0026] The data determination unit is further configured to verify the initial data range based on the node association value, and determine whether the association between the initial data ranges of any two Internet nodes meets the requirements of the node association value; if so, determine the initial data range as the target data range; otherwise, select the initial data range corresponding to the Internet node with the larger comprehensive evaluation value of the connection evaluation value and the path evaluation value from the two Internet nodes participating in the judgment, and correct the initial data range corresponding to the Internet node with the smaller comprehensive evaluation value to obtain the target data range.

[0027] Preferably, the risk assessment module includes:

[0028] A relationship establishing unit, configured to determine the collected data and the collection nodes corresponding to the collected data based on the user's data collection request, and to establish a mapping relationship between the collected data and the collection nodes;

[0029] an interval determining unit, configured to establish an acquisition queue based on the mapping relationship, and determine a transmission rate confidence interval of each acquisition path in the acquisition queue;

[0030] The early warning unit is used to perform risk assessment on the acquisition rate during the data acquisition process based on the transmission rate confidence interval, and to issue an early warning according to the assessment result.

[0031] Preferably, the interval determination unit includes:

[0032] a queue establishing unit, configured to establish a collection path based on the mapping relationship, and to establish a collection queue based on the collection path and the mapping relationship;

[0033] A permission determination unit, configured to determine, based on the collection queue, the target collection permission and target distribution permission corresponding to each collection path, and determine a relative collection time point for each collection path;

[0034] An interval estimation unit is used to set a data identifier and a node identifier for the relative acquisition time point based on the target acquisition authority and the target distribution authority, and estimate the transmission rate interval of the acquisition path based on the relative time point, the data identifier and the node identifier to obtain a transmission rate confidence interval of the acquisition path.

[0035] Preferably, the early warning unit includes:

[0036] a rate determination unit, configured to perform data collection according to the collection queue, obtain a transmission rate corresponding to a relative time point of each collection path in the collection queue, and determine whether the transmission rate is within a transmission rate confidence interval;

[0037] If so, the data collection process is determined to be safe and no warning is issued;

[0038] Otherwise, the transmission data and access identifier under the collection path are detected to determine whether they match the data identifier and node identifier;

[0039] If so, determine that the data collection process is safe and issue an early warning of changes in transmission rate;

[0040] Otherwise, the data collection process is determined to be unsafe and a data security warning is issued.

[0041] Preferably, the data identifier is used to identify the characteristics of the collected data, and the node identifier is used to identify the characteristics of an Internet node.

[0042] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purposes and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0043] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0045] Figure 1 This is a structural diagram of an Internet data acquisition system with an early warning function in an embodiment of the present invention;

[0046] Figure 2 This is a structural diagram of a user analysis module in an embodiment of the present invention;

[0047] Figure 3 2 is a structural diagram of a node analysis module in an embodiment of the present invention. DETAILED DESCRIPTION

[0048] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0049] Example 1

[0050] The embodiment of the present invention provides an Internet data collection system with an early warning function, such as Figure 1 As shown, including:

[0051] A user analysis module, configured to obtain user information from a user and determine the collection authority of the user based on the user information;

[0052] A node analysis module, configured to obtain node information of an Internet node and determine the distribution authority of the Internet node based on the node information;

[0053] The risk assessment module is used to obtain the user's data collection request, conduct a risk assessment on the data collection process in combination with the collection authority and distribution authority, and issue an early warning based on the assessment results.

[0054] In this embodiment, the collection authority of the user is determined based on the user's behavioral characteristics, trust level, etc., and the collection authority is used to specify the scope of data collection for the user.

[0055] In this embodiment, the Internet node is used to store data of the service provider.

[0056] In this embodiment, risk assessment of the data collection process specifically involves verifying data collection based on collection permissions and distribution permissions.

[0057] In this embodiment, the Internet node can be a workstation, client, network user or personal computer, or a server, printer or other network-connected device. Each workstation, server, terminal device, network device, or device with its own unique network address is a network node.

[0058] The beneficial effects of the above design scheme are: by pre-analyzing the user information of the Internet data collection and the Internet nodes required for collection, determining the collection and distribution permissions, and conducting a risk assessment of the data collection process of the data collection request based on the collection and distribution permissions, mutual verification and evaluation are carried out from both the user and Internet node aspects, and corresponding early warnings are issued to ensure the security of data collection.

[0059] Example 2

[0060] Based on Example 1, the present invention provides an Internet data acquisition system with an early warning function, such as Figure 2 As shown, the user analysis module includes:

[0061] an acquisition unit, configured to acquire the user's identity login data on the Internet and user behavior data on the Internet;

[0062] A data analysis unit, configured to analyze the user behavior data and determine a user behavior value;

[0063] The permission determination unit is used to retrieve the corresponding target permission from the permission solution library based on the user behavior value, associate it with the identity login information, and obtain the collection permission of the user.

[0064] In this embodiment, the relationship between the permissions and user behavior values ​​in the permission scheme library is determined based on the relationship between historical permissions and historical user behavior values ​​in the user's historical data collection.

[0065] In this embodiment, the user behavior value is used to quantify the user's behavior, which facilitates the determination of permissions.

[0066] The beneficial effects of the above design scheme are: by quantizing the features of user behavior data, it is easy to analyze the characteristics of behavior data, and by matching the corresponding permissions with user behavior values, the security of data collection is guaranteed from the user's perspective.

[0067] Example 3

[0068] Based on Example 2, this embodiment of the present invention provides an Internet data collection system with an early warning function, wherein the data analysis unit includes:

[0069] A behavior analysis unit, configured to obtain a user's behavior record on the service data based on the user behavior data, and determine a behavior feature vector of a behavior feature of each service data in a preset service feature space based on the behavior record;

[0070] The vector processing unit is used to distribute the behavior feature vector to each analysis node of the distributed vector model, and pre-process and fuse the behavior feature vector based on the analysis node to determine the user behavior value of the user.

[0071] In this embodiment, the user behavior data includes data collection, data operation (addition, deletion, modification, etc.), and other data.

[0072] In this embodiment, there are multiple types of business data, and one business corresponds to one type of business data.

[0073] In this embodiment, the preset service feature space is designed based on the features of historical services.

[0074] In this embodiment, the distributed vector model is obtained based on service type classification.

[0075] The beneficial effects of the above design scheme are: by converting user behavior data into behavior feature vectors, the analysis of user behavior is facilitated, and the accuracy of user behavior is guaranteed by pre-setting the business feature space designed according to historical business. The user behavior value of the user is determined by pre-processing and fusing the behavior feature vectors on each analysis node of the distributed vector model and based on the analysis node. Analysis and fusion are performed from the perspective of business type to ensure the accuracy of the user behavior value, providing a basis for determining the collection authority.

[0076] Example 4

[0077] Based on Example 1, the present invention provides an Internet data acquisition system with an early warning function, such as Figure 3 As shown, the node analysis module includes:

[0078] a node evaluation unit, configured to obtain node information of Internet nodes, determine a node distribution structure of the Internet based on the node information, determine connection characteristics and path characteristics between all Internet nodes based on the node distribution structure, perform connection evaluation for the Internet nodes based on the connection characteristics to determine a connection evaluation value, and perform path evaluation for the Internet nodes based on the path characteristics to determine a path evaluation value;

[0079] a determining unit, configured to determine a target data range of the Internet node based on the connection evaluation value and the path evaluation value;

[0080] The permission setting unit is used to set distribution permissions for the Internet node based on the target data range.

[0081] In this embodiment, the more connections the Internet node has with other nodes represented by the connection feature of the Internet node, the greater the corresponding connection evaluation value.

[0082] In this embodiment, the shorter the average path between the Internet node and other nodes represented by the path feature of the Internet node is, the greater the corresponding path evaluation value is.

[0083] In this embodiment, the more identical data there is in the data range between two Internet nodes, the greater the corresponding node association value.

[0084] In this embodiment, the data range is all data required for the node business based on the node type of the Internet node, and the initial data range is all data determined according to the characteristics of the Internet node in the node layout structure, which is the data that the Internet node is allowed to operate.

[0085] In this embodiment, the Internet node can be a workstation, client, network user or personal computer, or a server, printer and other network-connected devices. The corresponding target data range is the data that can be stored at this Internet node and the operation authority for the stored data, which is related to the position and connection of the Internet node in the entire Internet structure.

[0086] In this embodiment, the Internet node communicates node information with other Internet nodes in the Internet, and controls the target data range in the Internet node through the communication results. Therefore, the target data range will change as the Internet structure changes, thereby setting distribution permissions.

[0087] In this embodiment, determining the target data range of the Internet node based on the connection evaluation value and the path evaluation value includes a node analysis unit for determining a node type and a node service of the Internet node based on the node information, and determining the data range of the Internet node based on the node type;

[0088] a threshold determination unit, configured to determine a node association value between the Internet nodes based on the data range, and set a first range threshold for each Internet node based on the connection evaluation value, and set a second range threshold for each Internet node based on the path evaluation value;

[0089] The data selection unit is configured to select a target data range from the data range that satisfies the node association value, the first range threshold, and the second range threshold.

[0090] In this embodiment, the target data range is the data that the Internet node is ultimately authorized to operate.

[0091] The beneficial effects of the above design scheme are: by specifically analyzing the node characteristics of each Internet node based on the node information of the Internet node, including the node distribution structure, node connection characteristics and path characteristics, and matching a reasonable data range for it in combination with the node business, ultimately, ensuring the rationality and accuracy of the determined data distribution authority, and providing an accurate data basis for the evaluation of the data collection process.

[0092] Example 5

[0093] Based on Example 4, this embodiment of the present invention provides an Internet data collection system with an early warning function, wherein the determining unit includes:

[0094] a node analysis unit, configured to determine a node type and a node service of an Internet node based on the node information, and determine a data range of the Internet node based on the node type;

[0095] a threshold determination unit, configured to determine a node association value between the Internet nodes based on the data range, and set a first range threshold for each Internet node based on the connection evaluation value, and set a second range threshold for each Internet node based on the path evaluation value;

[0096] The data selection unit is configured to select a target data range from the data range that satisfies the node association value, the first range threshold, and the second range threshold.

[0097] In this embodiment, the data range is all data required for node services based on the node type of the Internet node, and the initial data range is data that allows the Internet node to operate among all data determined based on the characteristics of the Internet node in the node layout structure.

[0098] In this embodiment, the more identical data there is in the data range between two Internet nodes, the greater the corresponding node association value.

[0099] In this embodiment, selecting a target data range from the data range that satisfies the node association value, the first range threshold, and the second range threshold includes:

[0100] a data determination unit, configured to determine whether a difference between the first range threshold and the second range threshold is within a preset range; if so, obtain an initial data range corresponding to the first range threshold from the data range; otherwise, modify the first range threshold based on the second range threshold, and obtain an initial data range corresponding to the modified first range threshold from the data range;

[0101] The data determination unit is further configured to verify the initial data range based on the node association value, and determine whether the association between the initial data ranges of any two Internet nodes meets the requirements of the node association value; if so, determine the initial data range as the target data range; otherwise, select the initial data range corresponding to the Internet node with the larger comprehensive evaluation value of the connection evaluation value and the path evaluation value from the two Internet nodes participating in the judgment, and correct the initial data range corresponding to the Internet node with the smaller comprehensive evaluation value to obtain the target data range.

[0102] The beneficial effect of the above design scheme is: by matching the corresponding initial data range from the data range according to the connection evaluation value and path evaluation value of the Internet node, and then correcting the initial data range according to the node association value between the Internet nodes, the accuracy of the final target data range is guaranteed, providing a basis for ensuring the safe collection of data.

[0103] Example 6

[0104] Based on Example 5, this embodiment of the present invention provides an Internet data collection system with an early warning function, wherein the data selection unit includes:

[0105] a data determination unit, configured to determine whether a difference between the first range threshold and the second range threshold is within a preset range; if so, obtain an initial data range corresponding to the first range threshold from the data range; otherwise, modify the first range threshold based on the second range threshold, and obtain an initial data range corresponding to the modified first range threshold from the data range;

[0106] The data determination unit is further configured to verify the initial data range based on the node association value, and determine whether the association between the initial data ranges of any two Internet nodes meets the requirements of the node association value; if so, determine the initial data range as the target data range; otherwise, select the initial data range corresponding to the Internet node with the larger comprehensive evaluation value of the connection evaluation value and the path evaluation value from the two Internet nodes participating in the judgment, and correct the initial data range corresponding to the Internet node with the smaller comprehensive evaluation value to obtain the target data range.

[0107] In this embodiment, the data range is all data required for node services based on the node type of the Internet node, and the initial data range is data that allows the Internet node to operate among all data determined based on the characteristics of the Internet node in the node layout structure.

[0108] The beneficial effect of the above design scheme is: by correcting the first range threshold according to the second range threshold, it is ensured that the obtained initial data range not only meets the connection requirements between nodes, but also meets the path requirements. Specifically, a larger initial data range is determined for Internet nodes that have a large number of connections with other Internet nodes and a short connection path, ensuring the efficiency and security of data collection. Then, the initial data range is verified and corrected according to the node association value to ensure the correlation between the target data ranges obtained by the Internet nodes, meet business needs, and ensure the correctness of data collection.

[0109] Example 7

[0110] Based on Example 1, this embodiment of the present invention provides an Internet data collection system with an early warning function, characterized in that the risk assessment module includes:

[0111] A relationship establishing unit, configured to determine the collected data and the collection nodes corresponding to the collected data based on the user's data collection request, and to establish a mapping relationship between the collected data and the collection nodes;

[0112] an interval determining unit, configured to establish an acquisition queue based on the mapping relationship, and determine a transmission rate confidence interval of each acquisition path in the acquisition queue;

[0113] The early warning unit is used to perform risk assessment on the acquisition rate during the data acquisition process based on the transmission rate confidence interval, and to issue an early warning according to the assessment result.

[0114] In this embodiment, the collection node is an Internet node.

[0115] In this embodiment, the mapping relationship is that one group of collected data corresponds to one collection node.

[0116] In this embodiment, the acquisition queue is the data acquisition order for each group of acquired data, and each group of acquired data corresponds to an acquisition path, etc.

[0117] In another modified embodiment, the transmission rate confidence interval is a transmission rate range corresponding to normal data acquisition.

[0118] In this embodiment, the early warning unit includes: a rate judgment unit, configured to collect data according to the collection queue, obtain the transmission rate corresponding to the relative time point of each collection path in the collection queue, and judge whether the transmission rate is within the transmission rate confidence interval;

[0119] If so, the data collection process is determined to be safe and no warning is issued;

[0120] Otherwise, the transmission data and access identifier under the collection path are detected to determine whether they match the data identifier and node identifier;

[0121] If so, determine that the data collection process is safe and issue an early warning of changes in transmission rate;

[0122] Otherwise, the data collection process is determined to be unsafe and a data security warning is issued.

[0123] In this embodiment, the transmission rate range is obtained when the network is normal. When network fluctuations and failures occur, the transmission rate range is adjusted according to the specific fluctuations and failure conditions, so that when network fluctuations and failures occur, the abnormality can be used to judge the safety of the collection process based on the judgment rate.

[0124] The beneficial effects of the above design scheme are: by conducting a risk assessment of the collection rate during the data collection process based on the transmission rate, and issuing early warnings based on the assessment results, the efficiency of data collection process detection is improved, mutual verification and evaluation are carried out from both the user and Internet node aspects, and corresponding early warnings are issued to ensure data collection security.

[0125] Example 8

[0126] Based on Example 7, this embodiment of the present invention provides an Internet data collection system with an early warning function, wherein the interval determination unit includes:

[0127] a queue establishing unit, configured to establish a collection path based on the mapping relationship, and to establish a collection queue based on the collection path and the mapping relationship;

[0128] A permission determination unit, configured to determine, based on the collection queue, the target collection permission and target distribution permission corresponding to each collection path, and determine a relative collection time point for each collection path;

[0129] An interval estimation unit is used to set a data identifier and a node identifier for the relative acquisition time point based on the target acquisition authority and the target distribution authority, and estimate the transmission rate interval of the acquisition path based on the relative time point, the data identifier and the node identifier to obtain a transmission rate confidence interval of the acquisition path.

[0130] In this embodiment, the relative acquisition time points are determined by the acquisition sequence of the corresponding acquired data.

[0131] In this embodiment, the data identifier is used to identify the characteristics of the collected data, and the node identifier is used to identify the characteristics of the Internet node. The rate confidence interval of this data collection and transmission is specifically determined based on the characteristics of the collected data and the characteristics of the Internet node.

[0132] The beneficial effect of the above design scheme is: by specifically determining the rate confidence interval of this data collection and transmission based on the characteristics of the collected data and the characteristics of the Internet nodes, a data basis is provided for the detection of data collection and transmission.

[0133] Example 9

[0134] Based on Example 7, this embodiment of the present invention provides an Internet data collection system with an early warning function, wherein the early warning unit includes:

[0135] a rate determination unit, configured to perform data collection according to the collection queue, obtain a transmission rate corresponding to a relative time point of each collection path in the collection queue, and determine whether the transmission rate is within a transmission rate confidence interval;

[0136] If so, the data collection process is determined to be safe and no warning is issued;

[0137] Otherwise, the transmission data and access identifier under the collection path are detected to determine whether they match the data identifier and node identifier;

[0138] If so, determine that the data collection process is safe and issue an early warning of changes in transmission rate;

[0139] Otherwise, the data collection process is determined to be unsafe and a data security warning is issued.

[0140] In this embodiment, the access identifier is an identifier for the actual transmission data corresponding to the collection path to access the collection path. If the actual transmission data under the collection path is predetermined transmission data, the access identifier should match the data identifier and the node identifier.

[0141] The working principle and beneficial effects of the above design scheme are: first, determine whether to issue an early warning by judging whether the transmission rate is within the transmission rate confidence interval, thereby improving the efficiency of the early warning; then detect the transmission data and access identifier under the collection path, and judge whether there are data transmission errors or illegal intrusions during the data collection and transmission process, and issue an early warning to ensure the accuracy of the early warning, thereby ultimately ensuring the security of data collection.

[0142] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. An Internet data collection system with early warning function, characterized in that: include: A user analysis module, configured to obtain user information from a user and determine the collection authority of the user based on the user information; A node analysis module, configured to obtain node information of an Internet node and determine the distribution authority of the Internet node based on the node information; A risk assessment module is used to obtain the user's data collection request, conduct a risk assessment on the data collection process based on the collection authority and distribution authority, and issue an early warning based on the assessment results; The risk assessment module includes: A relationship establishing unit, configured to determine the collected data and the collection nodes corresponding to the collected data based on the user's data collection request, and to establish a mapping relationship between the collected data and the collection nodes; an interval determining unit, configured to establish an acquisition queue based on the mapping relationship, and determine a transmission rate confidence interval of each acquisition path in the acquisition queue; An early warning unit, configured to perform a risk assessment on the acquisition rate during the data acquisition process based on the transmission rate confidence interval, and issue an early warning based on the assessment result; The interval determination unit includes: a queue establishing unit, configured to establish a collection path based on the mapping relationship, and to establish a collection queue based on the collection path and the mapping relationship; A permission determination unit, configured to determine, based on the collection queue, the target collection permission and target distribution permission corresponding to each collection path, and determine a relative collection time point for each collection path; An interval estimation unit is configured to set a data identifier and a node identifier for the relative acquisition time point based on the target acquisition authority and the target distribution authority, and estimate the transmission rate interval of the acquisition path based on the relative acquisition time point, the data identifier, and the node identifier to obtain a transmission rate confidence interval of the acquisition path.

2. The Internet data acquisition system with early warning function according to claim 1 is characterized in that: The user analysis module includes: an acquisition unit, configured to acquire the user's identity login data on the Internet and user behavior data on the Internet; A data analysis unit, configured to analyze the user behavior data and determine a user behavior value; The permission determination unit is used to retrieve the corresponding target permission from the permission solution library based on the user behavior value, associate it with the identity login data, and obtain the collection permission of the user.

3. The Internet data acquisition system with early warning function according to claim 2 is characterized in that: The data analysis unit comprises: A behavior analysis unit, configured to obtain a user's behavior record on the service data based on the user behavior data, and determine a behavior feature vector of a behavior feature of each service data in a preset service feature space based on the behavior record; The vector processing unit is used to distribute the behavior feature vector to each analysis node of the distributed vector model, and pre-process and fuse the behavior feature vector based on the analysis node to determine the user behavior value of the user.

4. The Internet data acquisition system with early warning function according to claim 1 is characterized in that: The node analysis module includes: a node evaluation unit, configured to obtain node information of Internet nodes, determine a node distribution structure of the Internet based on the node information, determine connection characteristics and path characteristics between all Internet nodes based on the node distribution structure, perform connection evaluation for the Internet nodes based on the connection characteristics to determine a connection evaluation value, and perform path evaluation for the Internet nodes based on the path characteristics to determine a path evaluation value; a determining unit, configured to determine a target data range of the Internet node based on the connection evaluation value and the path evaluation value; The permission setting unit is used to set distribution permissions for the Internet node based on the target data range.

5. The Internet data acquisition system with early warning function according to claim 4 is characterized in that: The determining unit includes: a node analysis unit, configured to determine a node type and a node service of an Internet node based on the node information, and determine a data range of the Internet node based on the node type; a threshold determination unit, configured to determine a node association value between the Internet nodes based on the data range, and set a first range threshold for each Internet node based on the connection evaluation value, and set a second range threshold for each Internet node based on the path evaluation value; The data selection unit is configured to select a target data range from the data range that satisfies the node association value, the first range threshold, and the second range threshold.

6. The Internet data collection system with early warning function according to claim 5, characterized in that: The data selection unit includes: a data determination unit, configured to determine whether a difference between the first range threshold and the second range threshold is within a preset range; if so, obtain an initial data range corresponding to the first range threshold from the data range; otherwise, modify the first range threshold based on the second range threshold, and obtain an initial data range corresponding to the modified first range threshold from the data range; The data determination unit is further configured to verify the initial data range based on the node association value, and determine whether the association between the initial data ranges of any two Internet nodes meets the requirements of the node association value; if so, determine the initial data range as the target data range; otherwise, select the initial data range corresponding to the Internet node with the larger comprehensive evaluation value of the connection evaluation value and the path evaluation value from the two Internet nodes participating in the judgment, and correct the initial data range corresponding to the Internet node with the smaller comprehensive evaluation value to obtain the target data range.

7. The Internet data acquisition system with early warning function according to claim 1 is characterized in that: The early warning unit includes: a rate determination unit, configured to perform data collection according to the collection queue, obtain a transmission rate corresponding to a relative collection time point of each collection path in the collection queue, and determine whether the transmission rate is within a transmission rate confidence interval; If so, the data collection process is determined to be safe and no warning is issued; Otherwise, the transmission data and access identifier under the collection path are detected to determine whether they match the data identifier and node identifier; If so, determine that the data collection process is safe and issue an early warning of changes in transmission rate; Otherwise, the data collection process is determined to be unsafe and a data security warning is issued.

8. The Internet data acquisition system with early warning function according to claim 1 is characterized in that: The data identifier is used to identify the characteristics of the collected data, and the node identifier is used to identify the characteristics of the Internet node.

Images