Feature data sniffing system based on block chain technology
Patent Information
- Application Number
- CN202410912873.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-09
- Publication Date
- 2024-11-01
- Estimated Expiration
- Not applicable · inactive patent
Smart Images

Figure CN118890138A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing and security technology, and in particular to a feature data sniffing system based on blockchain technology. Background Art
[0002] With the rapid development of the Internet and the Internet of Things, a large amount of data is transmitted on the network, including personal communication data, corporate communication data and other private data. The security and privacy of these communication data are receiving more and more attention.
[0003] At present, data sniffing technology is usually used to capture the data transmitted in the network, and the data in the network is analyzed to determine the security of the network. Patent CN117395663A adopts a method for detecting network access security based on data sniffing technology. This detection method tests whether the system is in an anti-interference state through data anti-interference detection, and adjusts it appropriately to make the system in the same state. A cross-analysis is performed on whether it is in an anti-interference state, and suspicious domain names are detected, so that the entire method has a higher detection accuracy rate in the set hidden nodes when the number of hidden nodes is 20 to 100 than the traditional network security analysis and detection system based on the network intrusion detection and defense engine, indicating that the network intrusion detection and defense engine has a stronger modeling ability in high-dimensional feature models, which improves the detection rate of network access security detection.
[0004] Although the above technology can improve the detection rate of network access security detection, the above technology has the problem of low data security and easy data tampering in the process of processing data, which makes the network security unable to be effectively improved. Therefore, how to improve the security of data sniffing has become an urgent problem to be solved. Summary of the invention
[0005] In order to avoid and overcome the technical problems existing in the prior art, the present invention provides a feature data sniffing system based on blockchain technology. The present invention ensures the security of data by storing the data sniffing results on the blockchain and utilizing the decentralized, tamper-proof and traceable characteristics of the blockchain.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A feature data sniffing system based on blockchain technology, including a data sniffing module, a blockchain storage module and a data analysis module;
[0008] The data sniffing module is used to capture data in the network and extract features from the captured data;
[0009] The blockchain storage module is used to store the extracted data features on the blockchain;
[0010] The data analysis module is used to analyze the security of data features stored on the blockchain and optimize the evaluation model based on the analysis results to improve data security.
[0011] As a further solution of the present invention: the data sniffing module includes a network card for acquiring binary data from the network, a sniffer for converting the binary data acquired by the network card into a readable form and performing feature extraction on the data, and a storage medium for storing the data interpreted by the sniffer.
[0012] As a further solution of the present invention: the sniffer converts the binary data obtained by the network card into a readable form, and uses the readable data as the input of the sniffer, identifies and verifies the protocol of the data, and then extracts the characteristics of each protocol; the characteristics include source IP address, destination IP address, source port, destination port and data load.
[0013] As a further solution of the present invention: the blockchain storage module includes a sharder that can divide features into segments, an encryptor that encrypts the sharded data, a hash value generator that assigns a hash value to the encrypted data, and a blockchain that stores the data assigned with the hash value and verifies the newly added data.
[0014] As a further solution of the present invention: the slicing method adopted by the slicer is horizontal slicing, vertical slicing or a slicing method combining the two.
[0015] As a further solution of the present invention: the data analysis module includes a cleaner for cleaning the data stored in the blockchain to remove impurities, an analysis model for performing data security analysis on the cleaned data, and an evaluator for evaluating the security of the data.
[0016] As a further solution of the present invention: the evaluator performs risk assessment based on the security analysis results of the analysis model to determine potential security threats and vulnerabilities. The assessment results include risk levels, impacts corresponding to the risk levels, and mitigation measures to address the risks.
[0017] As a further solution of the present invention: when analyzing the security of the data, the analysis model first extracts security features related to the data security from the cleaned data, the security features including abnormal traffic patterns and abnormal user behaviors;
[0018] Then, the extracted security features are converted into corresponding data formats;
[0019] Then select the corresponding machine learning algorithm according to the characteristics of the data;
[0020] The selected machine learning model is then trained using the extracted and transformed feature data;
[0021] Finally, the performance of the analysis model is evaluated through cross-validation, accuracy, and recall indicators, and the parameters of the analysis model are optimized based on the evaluation results to obtain the optimal analysis model.
[0022] As a further solution of the present invention: the machine learning algorithm is a decision tree, a support vector machine or a neural network.
[0023] As a further solution of the present invention: the system also includes a permission verification module for managing access rights to the data sniffing module, the blockchain storage module and the data analysis module; the permission verification module includes identity authentication, authorization management and access control.
[0024] Compared with the prior art, the present invention has the following beneficial effects:
[0025] 1. The present invention uses deep packet inspection technology to capture data features in the network, and uses the decentralized, tamper-proof and traceable characteristics of blockchain to ensure the security and credibility of data. At the same time, it realizes automated data analysis and alarm functions through smart contracts, thus improving the intelligence level of the system.
[0026] 2. The strong deep packet inspection technology in the present invention can penetrate into the application layer of the data packet, capture and analyze the data characteristics in the network. This helps to understand the network traffic and user behavior more comprehensively, and provides rich information for subsequent data processing and analysis.
[0027] 3. The decentralized, tamper-proof and traceable characteristics of blockchain technology in the present invention ensure that the captured data will not be maliciously tampered with or deleted. This greatly enhances the authenticity and credibility of the data and provides a solid foundation for subsequent data analysis and processing.
[0028] 4. In the present invention, due to the open and transparent nature of blockchain, anyone can verify the authenticity and integrity of the data. This increases the transparency and auditability of the system, helps build trust and prevent fraud.
[0029] 5. The present invention realizes automated data analysis and alarm functions through smart contracts, which greatly improves the intelligence level of the system. Smart contracts can automatically execute preset conditions and logic, and trigger alarms or other automated operations when specific conditions are met, thereby responding to potential security threats in a timely manner.
[0030] 6. The execution of smart contracts in the present invention is automatic and does not require human intervention, which greatly improves the response speed and efficiency of the system. At the same time, since the data is uploaded to the chain in real time, abnormal situations can be discovered and handled in a timely manner to ensure the safe and stable operation of the network. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 It is a schematic diagram of the overall structure of the present invention.
[0032] Figure 2 The flowchart of the data sniffing module in the present invention processing data.
[0033] Figure 3 This is a flow chart of data processing by the blockchain storage module in the present invention.
[0034] Figure 4 The flowchart of the data analysis module in the present invention for processing data. DETAILED DESCRIPTION
[0035] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0036] See also Figure 1 to Figure 4 In an embodiment of the present invention, a characteristic data sniffing system based on blockchain technology includes a data sniffing module, a blockchain storage module and a data analysis module. The data sniffing module is used to capture data in the network and extract the captured data features; the blockchain storage module is used to store the extracted data features on the blockchain; and the data analysis module is used to analyze the data features stored on the blockchain.
[0037] 1. Data sniffing module.
[0038] The core technology used by the data sniffing module is data sniffing technology, which is a technology used to capture data packets flowing in and out of the system. It plays an important role in network security and data analysis. The following are the main functions of data sniffing technology:
[0039] Network monitoring and management: Data sniffing technology can monitor the data flow in the network in real time, helping network administrators understand the network status and data flow, so as to carry out effective network management. This is crucial for timely detection of network bottlenecks, failures or abnormal behaviors.
[0040] Security detection and defense: Through sniffing technology, malicious data packets and potential attack behaviors in the network can be detected. For example, by capturing and analyzing data packets, network attacks such as packet injection and session hijacking can be discovered and prevented, thus improving network security.
[0041] Data collection and analysis: Data sniffing technology can capture raw data packets in the network and provide a rich data source for data analysis. Through in-depth parsing and analysis of these data packets, valuable information such as network user behavior patterns and traffic distribution can be obtained, which helps to optimize network services and improve AI functions.
[0042] Troubleshooting and diagnosis: When a network failure occurs, data sniffing technology can help locate the root cause of the problem. By analyzing the captured data packets, the location and cause of the failure can be determined, thus quickly and effectively solving network problems.
[0043] The data sniffing module uses deep packet inspection technology to deeply analyze the data in the network and extract the characteristic information of the data, including but not limited to the source IP address, destination IP address, source port, destination port, protocol type, etc.
[0044] The data sniffing module processes data in the following steps:
[0045] 1) Data collection:
[0046] The data sniffing module first collects raw binary data from the network cable. To achieve this process, it is usually necessary to set the selected network card to promiscuous mode. In this mode, the network card will capture all network communication traffic on a network segment, not just the data packets sent to the network card. The details are as follows:
[0047] First, you need to choose a suitable packet sniffer, such as Wireshark, tcpdump, etc., to capture the data on the network cable.
[0048] Then set the network card to promiscuous mode: Set the selected network card to promiscuous mode through a packet sniffer. In this mode, the network card will not only capture the packets sent to it, but also capture all network communication traffic on the entire network segment. This is a key step in collecting raw binary data.
[0049] Then capture data: Once the network card is set to promiscuous mode, the packet sniffer will start capturing data on the network cable. This data exists in raw binary format and contains all the information of network communication.
[0050] Finally, save the data: The captured data can be saved to the local file system for subsequent analysis and processing. Packet sniffers usually provide a save function that allows users to save the captured data in a specific format, such as pcap format.
[0051] 2) Data conversion:
[0052] The raw binary data collected is then converted into a readable form. This step is usually supported by an advanced command-line packet sniffer or similar tool, which displays the packets on the network in a basic parsed form for further analysis.
[0053] 3) Data analysis:
[0054] The converted data is then analyzed in depth. Packet sniffers use the captured network data as input, identify and verify their protocols, and then start analyzing the properties specific to each protocol.
[0055] This step may involve detailed interpretation of various fields in the data packet, such as source IP address, destination IP address, port number, data payload, etc., to reveal the communication mode, content and other relevant information.
[0056] 4) Result output or storage:
[0057] After the analysis is completed, the data sniffing module will output the results to the console, file or other specified storage media.
[0058] These results include detailed information on data packets, analysis of communication patterns, detection of anomalous behavior, and more.
[0059] During the entire processing, the data sniffing module relies on the promiscuous mode of the network card to capture as much data as possible for comprehensive network analysis and monitoring.
[0060] 2. Blockchain storage module.
[0061] The blockchain storage module uses distributed ledger technology to store the extracted data features in the form of transactions on the blockchain. Each transaction includes information such as data features, timestamps, and on-chain addresses to ensure the integrity and credibility of the data.
[0062] Blockchain technology is a decentralized distributed database technology that records and stores transaction data in the form of blocks and uses cryptographic algorithms to ensure data security and immutability. The following is a detailed explanation of blockchain technology:
[0063] Block: The blockchain consists of a series of blocks, each of which contains a certain number of transaction records and other related information on the chain. Each block is protected by digital signatures and encryption algorithms to ensure its integrity and authenticity.
[0064] Chain: These blocks are linked together in the order of their generation to form an immutable chain of data. Each block is given a unique identifier and contains the identifier of the previous block, thus forming a continuous chain.
[0065] Consensus mechanism: Nodes in the blockchain network verify and confirm new blocks through a consensus mechanism. The most common consensus mechanisms are "Proof of Work" and "Proof of Stake". These mechanisms ensure the security and decentralization of the network.
[0066] Decentralization: Blockchain technology does not rely on any central authority or server to verify and manage transactions. Instead, it relies on a large number of nodes distributed in the network to jointly maintain and verify data.
[0067] Security: Through advanced cryptography and decentralized features, blockchain technology is able to provide a high level of security. Each block is encrypted and signed to ensure the integrity and authenticity of its data.
[0068] Transparency: All transaction records are public and transparent and can be viewed and verified by anyone. This increases the credibility of the system and reduces the possibility of fraud and manipulation.
[0069] Immutability: Once data is written to the blockchain, it is almost impossible to change or delete it. This ensures the permanence and credibility of the data.
[0070] The process of storing data in the blockchain storage module is as follows:
[0071] 1) Create data shards:
[0072] The data stored in the storage medium is first divided into smaller segments by a sharder, a process called sharding. Sharding is the process of breaking up data into manageable chunks that can be distributed across multiple nodes.
[0073] Data sharding methods include horizontal sharding, vertical sharding, a combination of horizontal and vertical sharding, network sharding, transaction sharding, and state sharding.
[0074] Horizontal Sharding:
[0075] Definition: According to certain conditions, all tuples of a global relation are divided into several complementary and intersecting subsets.
[0076] Features: Each subset is a logical fragment of the global relation, and these subsets are obtained by applying selection operations to the global relation.
[0077] Application scenario: Applicable to situations where data has some correlation or similarity in the horizontal direction (i.e. between records).
[0078] Vertical Sharding:
[0079] Definition: Divide the attributes of a global relation into several subsets, which are obtained by performing projection operations on the global relation.
[0080] Requirement: Each attribute of the global relation is mapped to at least one vertical fragment, and each vertical fragment contains the keyword of the global relation.
[0081] Application scenario: Applicable to situations where data has some correlation in the vertical direction (i.e. between attributes) or needs to be processed separately.
[0082] Combined horizontal and vertical sharding:
[0083] This method is to perform horizontal sharding first, then vertical sharding, or vice versa.
[0084] This combined sharding approach allows for more flexible processing of complex data structures to meet different data storage and query requirements.
[0085] Network sharding: Divide the entire blockchain network into multiple sub-networks (shards), and each shard processes different transactions in the network in parallel to increase processing speed.
[0086] Transaction sharding: involves allocating transactions to different shards according to specific attributes to achieve more efficient processing.
[0087] State Sharding: The key is to separate the entire storage area and let different shards store different parts. Each node is only responsible for hosting its own shard data, reducing redundant storage of the state and improving storage scalability.
[0088] These sharding technologies are applied in blockchain mainly to solve scalability and latency problems and improve the performance and efficiency of blockchain networks.
[0089] 2) Encrypt each shard:
[0090] After the data is sharded, the encryptor encrypts each data shard on the local system.
[0091] Content owners have full control over this encryption process to ensure the security of their data.
[0092] The purpose of encryption is to ensure that no one other than the content owner can view or access the data in the shard, whether it is at rest or in motion.
[0093] 3) Generate a hash for each shard:
[0094] The hash generator generates a unique hash value based on the shard's data or encryption key. The hash is a fixed-length cryptographic output string that is used to verify the integrity of the data. This hash value will be added to the ledger and shard metadata to link the transaction to the shard where it is stored.
[0095] 4) Copy each shard:
[0096] To ensure data availability and performance and prevent data loss, each shard is replicated and stored in a storage medium. By creating enough redundant copies, the system can maintain data availability even when some nodes fail.
[0097] 5) Record the shard information to the blockchain:
[0098] The relevant information of the shard, including the hash value, the location information of the shard, etc., will be recorded on the blockchain. As a decentralized distributed ledger, the blockchain ensures the security and immutability of data records.
[0099] 6) Data verification and synchronization:
[0100] Nodes in the blockchain verify the newly added data shards and their related information. Once verified, this information is added to the blockchain and synchronized to all nodes in the network. This process ensures the secure storage and decentralized verification of data, while also improving the availability and durability of data. Through blockchain technology, the integrity and authenticity of data are strongly guaranteed.
[0101] 3. Data analysis module.
[0102] The data analysis module can perform multi-dimensional analysis on the data features stored on the blockchain, including but not limited to data statistics, data visualization, anomaly detection, etc. Through smart contracts, automated data analysis and alarm functions can be realized.
[0103] The process of data security analysis by the data analysis module is as follows:
[0104] 1) Data cleaning:
[0105] Cleansing of data stored in the blockchain: Data stored in the blockchain will go through a cleansing process to remove duplicate, invalid or erroneous data to ensure the quality and accuracy of the data.
[0106] 2) Establish data analysis model:
[0107] According to the characteristics of the data and the analysis requirements, the data analysis module will select appropriate modeling techniques, such as statistical models, machine learning algorithms, etc. The parameters of the model will be tuned to find the best model configuration and improve the accuracy of the analysis.
[0108] 3) Data security analysis:
[0109] Once the model is built, the data analysis module uses it to analyze the security of the data. This may include detecting abnormal data patterns, such as sudden data volume surges or unusual user behavior, which may be signs of security threats. At the same time, the module also analyzes whether there is leakage of sensitive information in the data, such as personally identifiable information or confidential business data.
[0110] 4) Risk assessment and reporting:
[0111] The data analysis module will conduct risk assessment based on the analysis results to identify potential security threats and vulnerabilities. The assessment results will be presented in the form of a report, including the risk level, possible impact, and recommended mitigation measures.
[0112] 5) Model update and optimization:
[0113] Data analysis is an ongoing process, and as new data is continuously collected and analyzed, the model may need to be updated and optimized. The data analysis module regularly evaluates the performance of the model and makes adjustments as needed to ensure the accuracy and timeliness of the analysis.
[0114] 6) Integration with other security systems:
[0115] The data analysis module is usually integrated with other security systems of the enterprise, such as firewalls, intrusion detection systems, etc. Through integration, the data analysis module can receive and process security event data from these systems in real time, providing more comprehensive security analysis.
[0116] During the entire analysis process, the data analysis module not only focuses on the statistical characteristics of the data, but also focuses on identifying potential security threats and vulnerabilities, thereby helping enterprises take protective measures in a timely manner to ensure data security.
[0117] 4. Permission verification module.
[0118] The permission verification module is used to manage the access rights of the data sniffing module, blockchain storage module and data analysis module. Only authorized users can access the system, which further improves the security of the system.
[0119] The permission verification module is an important part of information system security. It is mainly responsible for managing and verifying the user's access rights to various functions and data in the system. The following is a detailed description of the permission verification module:
[0120] Composition and functions of the permission verification module
[0121] 1) Identity authentication: Verify user identity to ensure that only legitimate users can enter the system. This is usually achieved through username and password, multi-factor authentication (such as dynamic tokens, biometrics, etc.), etc.
[0122] 2) Authorization management: Determine which resources an authenticated user can access and which operations they can perform in the system. This includes functions such as role management and permission allocation.
[0123] 3) Access control: Control the user's access to system resources based on their identity and authorization. For example, only users with specific roles can access certain sensitive data or perform key operations.
[0124] Technical implementation of permission verification module:
[0125] 1) Role-based access control (RBAC): This is a common permission management method in which a user's permissions are associated with their role. System administrators can define roles and assign a set of permissions to each role. Users are assigned to one or more roles and inherit the permissions of these roles.
[0126] 2) Access token: After the user passes the identity authentication, the system will generate an access token (such as JWT token), which contains the user's identity information, authorization information, etc. The user carries this token in subsequent requests so that the server can verify his identity and authority.
[0127] 3) Logging and monitoring: The permission verification module should also include logging and monitoring functions to track and record user access behavior and promptly detect and handle any suspicious activities.
[0128] Security considerations for the permission verification module:
[0129] 1) Prevent privilege escalation: The system should ensure that users cannot elevate their privilege levels by forging requests or other means.
[0130] 2) Prevent session hijacking: The system should take security measures (such as using the HTTPS protocol, setting a secure session timeout, etc.) to prevent session hijacking attacks.
[0131] 3) Input validation and filtering: In order to prevent attacks such as SQL injection, the system should strictly validate and filter user input.
[0132] Performance optimization of permission verification module:
[0133] 1) Cache mechanism: To improve performance, the system can use a cache mechanism to store user identity information and authorization information to reduce the number of accesses to the database or other storage systems.
[0134] 2) Distributed deployment: In large systems, distributed deployment can be used to improve the availability and scalability of the permission verification module. For example, load balancing technology can be used to distribute requests to multiple servers for processing.
[0135] Interaction between the permission verification module and other modules:
[0136] The permission verification module needs to interact with other system modules to ensure the security of the entire system. For example, when a user tries to access a resource, other modules will call the permission verification module to check whether the user has the corresponding access rights. In addition, when the system administrator updates the user's role or permissions, the permission verification module also needs to update its internal authorization information accordingly.
[0137] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.
Claims
1. A feature data sniffing system based on blockchain technology, characterized in that: Including data sniffing module, blockchain storage module and data analysis module; The data sniffing module is used to capture data in the network and extract features from the captured data; The blockchain storage module is used to store the extracted data features on the blockchain; The data analysis module is used to analyze the security of data features stored on the blockchain and optimize the evaluation model based on the analysis results to improve data security.
2. According to the characteristic data sniffing system based on blockchain technology according to claim 1, it is characterized in that: The data sniffing module includes a network card for acquiring binary data from the network, a sniffer for converting the binary data acquired by the network card into a readable form and performing feature extraction on the data, and a storage medium for storing the data interpreted by the sniffer.
3. According to a characteristic data sniffing system based on blockchain technology according to claim 2, it is characterized in that: The sniffer converts the binary data obtained by the network card into a readable form and uses the readable data as the input of the sniffer to identify and verify the protocol of the data and then extract the characteristics of each protocol; Characteristics include source IP address, destination IP address, source port, destination port, and data payload.
4. A feature data sniffing system based on blockchain technology according to claim 1, 2 or 3, characterized in that: The blockchain storage module includes a sharder that can divide features into segments, an encryptor that encrypts the sharded data, a hash value generator that assigns a hash value to the encrypted data, and a blockchain that stores the data assigned with the hash value and verifies the newly added data.
5. According to claim 4, a characteristic data sniffing system based on blockchain technology is characterized in that: The sharding method adopted by the sharder is horizontal sharding, vertical sharding or a combination of the two.
6. According to claim 5, a characteristic data sniffing system based on blockchain technology is characterized in that: The data analysis module includes a cleaner for cleaning the data stored in the blockchain to remove impurities, an analysis model for performing data security analysis on the cleaned data, and an evaluator for evaluating the security of the data.
7. A characteristic data sniffing system based on blockchain technology according to claim 6, characterized in that: The evaluator performs risk assessment based on the security analysis results of the analysis model to identify potential security threats and vulnerabilities. The assessment results include risk level, impact of corresponding risk level, and mitigation measures to address the risk.
8. According to claim 7, a characteristic data sniffing system based on blockchain technology is characterized in that: When analyzing the security of data, the analytical model first extracts security features related to data security from the cleaned data. Security features include abnormal traffic patterns and abnormal user behaviors. Then, the extracted security features are converted into corresponding data formats; Then select the corresponding machine learning algorithm according to the characteristics of the data; The selected machine learning model is then trained using the extracted and transformed feature data; Finally, the performance of the analysis model is evaluated through cross-validation, accuracy, and recall indicators, and the parameters of the analysis model are optimized based on the evaluation results to obtain the optimal analysis model.
9. A characteristic data sniffing system based on blockchain technology according to claim 8, characterized in that: The machine learning algorithms are decision trees, support vector machines, or neural networks.
10. A characteristic data sniffing system based on blockchain technology according to claim 8, characterized in that: The system also includes a permission verification module for managing access rights to the data sniffing module, the blockchain storage module and the data analysis module; the permission verification module includes identity authentication, authorization management and access control.
Citation Information
Patent Citations
Network access security detection method and system, and storage medium
CN117395663A
Partitioning a blockchain network
CN112041870A
Detection method, defense method and detection device for Internet of Things DDoS based on distributed machine learning and block chain, and storage medium
CN113221113A
Financial data storage system based on block chain network
CN118093715A
Apparatus and methods for minting non-fungible tokens (NFTS) from user-specific products and data
US11863676B1
