Data monitoring method and system, medium and computer equipment

Abstract

The invention discloses a data monitoring method and system, a medium and computer equipment. The method comprises the following steps: capturing handshake information generated by a server and a client during handshake negotiation based on a target protocol; analyzing the transmission format of the handshake information, and extracting an encryption suite, a session key and a random number which are used for data transmission encryption; wherein the encryption suite comprises one or more encryption algorithms; dynamically selecting an encryption algorithm from the encryption suite, and processing the session key and the random number by using the encryption algorithm to generate a decryption key; capturing the encrypted data packet transmitted by the server and the client based on the target protocol; and decrypting the encrypted data packet by using the decryption key to generate a data plaintext for security analysis.

Description

Technical Field

[0001] The present application relates to the field of network security technology, and in particular to a data monitoring method, system, medium and computer equipment. Background Art

[0002] As the global digitalization process accelerates, the Internet has become the main platform for information transmission and communication. In this context, information security issues have become increasingly prominent, especially when it comes to the transmission of sensitive data.

[0003] In order to ensure the confidentiality and integrity of information and the identity authentication of both parties in communication, TLS (Transport Layer Security) has been widely used. In particular, the TLS1.3 protocol simplifies the handshake process of the protocol, increases the speed of connection establishment, and adds support for Perfect Forward Secrecy (PFS). This makes TLS1.3 protocol one of the most secure transport layer protocols to date.

[0004] At present, in order to discover abnormal network communication activities, it is necessary to conduct data security monitoring on TLS1.3 protocol communications. The core of data security monitoring lies in the management and use of session keys. The existing technology generally relies on KDF (Key Derivation Function, a key derivation algorithm based on hash functions) to generate session keys, and uses stream ciphers or block ciphers to process ciphertexts during decryption to achieve the supervision of TLS1.3 protocol communications. However, the KDF algorithm is too complex and cannot flexibly adapt to various hardware environments and network conditions, which increases the difficulty of data security monitoring and reduces the supervision efficiency of data security monitoring. Summary of the invention

[0005] In order to solve or partially solve the technical problem that the current existing technology cannot flexibly adapt to various hardware environments and network conditions, resulting in reduced supervision efficiency of data security monitoring, the present invention provides a data monitoring method, system, medium and computer equipment, which ensures that decryption keys can be efficiently derived under different hardware environments and network conditions by optimizing the processing of handshake messages and adopting a dynamic selection mechanism of encryption algorithms, thereby obtaining the best decryption performance and security, effectively improving the efficiency of data security monitoring and enhancing the adaptability of the supervision system.

[0006] In order to solve the above technical problems, the first aspect of the present invention discloses a data monitoring method, the method comprising:

[0007] Capture the handshake information generated by the server and client based on the target protocol handshake negotiation;

[0008] Parsing the transmission format of the handshake information to extract the encryption suite, session key and random number used for data transmission encryption; wherein the encryption suite includes one or more encryption algorithms;

[0009] Dynamically selecting an encryption algorithm from the encryption suite, and processing the session key and the random number using the encryption algorithm to generate a decryption key;

[0010] Capturing the encrypted data packets transmitted by the server and the client based on the target protocol;

[0011] The encrypted data packet is decrypted using the decryption key to generate data plaintext for security analysis.

[0012] Optionally, capturing handshake information generated by the server and the client during handshake negotiation based on the target protocol specifically includes:

[0013] The handshake negotiation process between the server and the client based on the target protocol is monitored in real time, and the handshake information generated during the handshake negotiation process is captured using a handshake capture tool.

[0014] Optionally, parsing the transmission format of the handshake information to extract the encryption suite, session key and random number used for data transmission encryption specifically includes:

[0015] Parsing the transmission format of the handshake information to extract the encryption suite and the shared key;

[0016] With reference to the shared key, the corresponding session key and the random number are obtained.

[0017] Optional,

[0018] The obtaining the corresponding session key and the random number by referring to the shared key specifically includes:

[0019] Based on the shared key, generating a key derivation request for invoking the key derivation function based on the hash message authentication code;

[0020] Based on the key derivation request, checking whether the corresponding session key and the random number exist in a cache;

[0021] If yes, directly call the session key and the random number;

[0022] If not, the key derivation function based on the hash message authentication code is called to derive the shared key to obtain the session key and the random number, and the derived session key and the random number are stored in the cache.

[0023] Optionally, storing the derived session key and the random number into the cache specifically includes:

[0024] Based on the key derivation request, generate an identity identifier for finding the session key and the random number; wherein the identity identifier is used as a cache key;

[0025] The session key and the random number are stored in a cache area corresponding to the cache key.

[0026] Optionally, the capturing of the encrypted data packet transmitted based on the target protocol specifically includes:

[0027] Intercepting a number of fragmented flows from a designated network interface of the server or the client; the fragmented flows carry one or more identity information of a TCP sequence number, an IP address, and a port number;

[0028] The plurality of fragmented flows are assembled into the encrypted data packet according to the identity information respectively carried by the plurality of fragmented flows.

[0029] Optionally, the encryption algorithm includes at least an AES-GCM encryption algorithm and a ChaCha20-Poly1305 encryption algorithm.

[0030] A second aspect of the present invention discloses a data monitoring system, comprising:

[0031] The first capture module is used to capture the handshake information generated by the server and the client during the handshake negotiation based on the target protocol;

[0032] A key parameter derivation module, used to parse the transmission format of the handshake information and extract the encryption suite, session key and random number used for data transmission encryption; wherein the encryption suite includes one or more encryption algorithms;

[0033] A key generation module, used to dynamically select an encryption algorithm from the encryption suite, and use the encryption algorithm to process the session key and the random number to generate a decryption key;

[0034] A second capturing module, used for capturing the encrypted data packets transmitted by the server and the client based on the target protocol;

[0035] The decryption module is used to decrypt the encrypted data packet using the decryption key to generate data plaintext for security analysis.

[0036] According to a third aspect of the present invention, a computer-readable storage medium is disclosed, on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented.

[0037] According to a fourth aspect of the present invention, a computer device is disclosed, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the program.

[0038] Through one or more technical solutions of the present invention, the present invention has the following beneficial effects or advantages:

[0039] The present invention provides a data monitoring method, system, medium and computer equipment, which first capture the handshake information generated by the server and the client during the handshake negotiation based on the target protocol; then parse the transmission format of the handshake information, so as to quickly extract the encryption suite, session key and random number used for data transmission encryption; according to different hardware environments and network conditions, dynamically select encryption algorithms from the encryption suite to flexibly adapt to network requirements, and generate corresponding decryption keys to decrypt data plaintext for security analysis, so as to ensure that the decryption keys can be efficiently derived under different hardware environments and network conditions, and the optimal decryption performance and security can be obtained, so as to effectively improve the efficiency of data security monitoring and enhance the adaptability of the supervision system.

[0040] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0042] Figure 1 A flowchart of a data monitoring method according to an embodiment of the present invention is shown;

[0043] Figure 2 A module schematic diagram of a data monitoring system according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0044] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0045] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0046] First, as Figure 1 As shown, the data monitoring method provided by the embodiment of the present invention at least includes the following steps:

[0047] Step 101: Capture handshake information generated by the server and the client during handshake negotiation based on the target protocol.

[0048] In this embodiment, the target protocol at least includes the TLS 1.3 protocol. The server and the client perform handshake negotiation based on the TLS 1.3 protocol to establish a secure communication channel and generate necessary keys for subsequent encrypted communications.

[0049] Considering that the extraction of handshake messages is the basis of data decryption, in order to conduct security monitoring of the communication between the server and the client, the handshake information generated by the server and the client during the handshake negotiation is first captured. The captured handshake messages include but are not limited to the following messages:

[0050] ClientHello: The first handshake message sent by the client to the server, which contains the encryption algorithms supported by the client, protocol version, random number, and other options.

[0051] ServerHello: The server responds to the client's handshake message, confirming the encryption algorithm used, session information, and the server's random number.

[0052] Cipher suite: Cipher suite is a combination of several groups of encryption algorithms defined in the TLS1.3 protocol to ensure the security of data transmission. The cipher suite contains one or more encryption algorithms. Specifically, the cipher suite mainly includes various algorithms for key exchange, data encryption and message authentication. They are negotiated during the handshake of the TLS1.3 protocol to determine which algorithms the two parties will use. For example, ECDHE (EphemeralElliptic Curve Diffie-Hellman) is negotiated during key exchange.

[0053] Key Exchange message: It is used to negotiate a shared key through an open channel between the two communicating parties without sharing any secret information in advance, which is used for subsequent encrypted communication to ensure data communication security. For example, ECDHE is used to negotiate the shared key between the two communicating parties.

[0054] These handshake messages are transmitted over the TCP connection in a specific order. In the protocol stack, the handshake message is located above the TLS record layer. The start of the message is identified by the handshake message type (0x16), followed by the handshake content.

[0055] During the capture process, the handshake negotiation process between the server and the client based on the target protocol is monitored in real time, and the handshake information generated during the handshake negotiation process is captured using a handshake capture tool. An example of a handshake capture tool is gopacket (a network packet capture tool), which is used to capture handshake messages based on the TLS1.3 protocol. When the client sends a "ClientHello" message, the server responds to a "ServerHello" message, and various encryption algorithms in the encryption suite are captured, they will all be stored for subsequent use.

[0056] Step 102: Parse the transmission format of the handshake information to extract the encryption suite, session key and random number used for data transmission encryption.

[0057] During the parsing process, it is considered that the handshake information is stored in a set transmission format, for example, in a TLV (Type-Length-Value) transmission format. Therefore, the transmission format of the handshake information is parsed to extract the encryption suite and shared key used for data transmission encryption. Specifically, the message type, length and content of the handshake message are parsed, and then the encryption suite and shared key are extracted. Among them, the shared key can be used as the input key material of HKDF (Hash-based Key Derivation Function) to derive the session key and random number used for encryption and decryption. Therefore, the corresponding session key and random number are obtained with reference to the shared key.

[0058] In the specific implementation process, if multiple sessions reuse the same handshake information, or multiple key derivation operations are required in a short period of time, a large number of redundant calculations will be caused. This will increase the computing load and cause decryption delays. Considering that reducing repeated calculations and using caches are important means to improve performance. Therefore, this embodiment introduces a cache mechanism, that is, when the key is derived, the calculated key results are stored so that these cached keys can be directly used under the same input conditions in the future, instead of recalculating the key, so that repeated key derivation operations can be avoided. Especially in the case of high concurrency and multiple sessions, this optimization can significantly reduce the computing load and improve the decryption speed.

[0059] Therefore, the specific operations of this embodiment are as follows:

[0060] Step 1021: Generate a key derivation request for calling the key derivation function based on the hash message authentication code based on the shared key, for example, generate a key derivation request for calling the HKDF-Extract function or the HKDF-Expand function.

[0061] Step 1022: Based on the key derivation request, check whether the corresponding session key and random number exist in the cache. If the session key and random number exist in the cache, execute step 1023.

[0062] Specifically, when the key derivation request triggers the call of the HKDF-Extract function or the HKDF-Expand function, it can trigger a check whether the corresponding cache result already exists in the cache. For example, check whether there is a shared key, a random number, a context, etc. in the cache. If so, execute step 1023. Further, if the key derivation request has a cache key, the cache key can be used to check whether the corresponding session key and random number exist in the cache. If so, execute step 1023.

[0063] Step 1023, directly call the session key and the random number.

[0064] If the session key and the random number are not in the cache, execute step 1024.

[0065] Step 1024: Call the key derivation function HKDF based on the hash message authentication code to derive the shared key to obtain the session key and the random number, and store the derived session key and the random number into the cache.

[0066] The process of deriving the session key and random number using the HKDF function is as follows:

[0067] (1) Create Early Secret: When the handshake starts, extract the Early Secret from the zero value (0x00) and the pre-shared key (PSK) for the initial session key exchange and early data encryption, such as encryption of 0-RTT data. Its execution logic is: early_secret = HKDF-Extract (0, PSK).

[0068] (2) Generate a derived key Derive Secret.

[0069] The execution logic of deriving the key Derive Secret is: derive_secret = Derive-Secret (early_secret,"derived","").

[0070] (3) Generating the Handshake Secret: After the key exchange is completed, the client and server use the Diffie-Hellman algorithm to calculate a shared key, also known as the handshake key, which is used to generate the encryption key and authentication key used in the handshake process.

[0071] The execution logic of the shared key is: handshake_secret = HKDF-Extract (dhe, derive_secret).

[0072] (4) Derive Secret is derived from the shared key:

[0073] derive_secret=Derive-Secret(handshake_secret,"derived","").

[0074] (5) Generate Master Secret: Generate a master secret from the shared key. The master secret is the core key used to generate multiple session keys for decrypting data at different stages. The execution logic of the master secret is: master_secret = HKDF-Extract (0, derive_secret).

[0075] (6) The session key Key and random number IV are calculated using the master key Master Secret.

[0076] First, based on the master key, through a specific derivation function (Derive-Secret), combined with the label "captraffic" and hash messages (hash_messages), an intermediate variable for processing captured traffic is generated, and then the HKDF algorithm is used to derive the session key Key and random number IV based on the intermediate variable.

[0077] captraffic:=Derive-Secret(master_secret,"cap traffic",hash_messages)

[0078] Key=HKDF-Extract(captraffic,`key`,32).

[0079] IV (Initialization Vector, counter) = HKDF-Extrac (captraffic, `iv`, 12). The counter is a component of decrypting encrypted data packets, ensuring that the decryption key used for each encrypted data packet is different to avoid key reuse. Even if these encrypted data packets are in the same session, their corresponding decryption keys can be obtained according to the counter.

[0080] After the key derivation, a cache mechanism can also be introduced. In order to distinguish different key derivation requests, an identity identifier for searching the session key and the random number is generated based on the key derivation request; wherein the identity identifier is used as a cache key; the session key and the random number are stored in the cache area corresponding to the cache key. The identity identifier is a unique identifier of the session key and the random number, and has a mapping relationship with the hash, session ID, random number and other parameters of the handshake message. Therefore, when the same key derivation request arrives, the corresponding cache result can be quickly found according to the cache key.

[0081] In an optional embodiment, in order to prevent the cache from occupying too much memory or storage space, expired keys in the cache are cleaned up regularly, for example, the cache is cleaned up according to policies such as the life cycle of the session and the validity period of the key.

[0082] In this technical solution, a lightweight key derivation algorithm HKDF is introduced to replace the traditional KDF key derivation function, which can significantly reduce the computational complexity while maintaining security.

[0083] Step 103: Dynamically select an encryption algorithm from the encryption suite, and use the encryption algorithm to process the session key and the random number to generate a decryption key.

[0084] In this embodiment, in order to ensure that the best decryption performance and security can be obtained under different hardware environments and network conditions, a dynamic selection mechanism is followed to dynamically select an encryption algorithm from the encryption suite to efficiently decrypt the ciphertext.

[0085] The encryption suite defines the encryption algorithm, key exchange algorithm, and hash algorithm used in the TLS1.3 protocol. The AEAD (Authenticated Encryption with Associated Data) encryption mode is followed during the decryption process. Therefore, this embodiment supports both the AES-GCM encryption algorithm and the ChaCha20-Poly1305 encryption algorithm, and improves the decryption efficiency through a dynamic algorithm selection mechanism to meet the security and performance requirements in specific scenarios.

[0086] In the process of generating the key, the session key and the random number are processed using the selected encryption algorithm (such as the AES-GCM encryption algorithm, the ChaCha20-Poly1305 encryption algorithm) to generate a unique decryption key for the encrypted data packet.

[0087] Step 104: Capture the encrypted data packets transmitted by the server and the client based on the target protocol.

[0088] Specifically, the encrypted data packet is intercepted from a designated network interface of the server or the client, for example, libpcap (a capture tool) is used to capture the encrypted data packet passing through the network interface, but this does not constitute a limitation.

[0089] During the HTTPS request process, the encrypted data packet may be transmitted in fragments and needs to be reassembled. Specifically, a number of fragmented flows are intercepted from the server or the designated network interface of the client; the fragmented flows carry one or more identity information of TCP sequence number, IP address, and port number; and the fragmented flows are assembled into the encrypted data packet according to the identity information carried by each of the fragmented flows.

[0090] Step 105: Decrypt the encrypted data packet using the decryption key to generate data plaintext for security analysis.

[0091] Through the above steps, the present invention realizes data monitoring based on TLS1.3 protocol, can efficiently derive keys from handshake messages, effectively improves the efficiency of data security monitoring and enhances the adaptability of the system.

[0092] The present invention ensures optimal decryption performance and security under different hardware environments and network conditions through intelligent key caching and dynamic algorithm selection mechanism, which not only improves the flexibility of the decryption algorithm but also reduces the consumption of system resources, making it suitable for a wide range of application scenarios from high-performance servers to resource-constrained devices.

[0093] In a second aspect, based on the same inventive concept as the data monitoring method provided in the first aspect embodiment, the present invention also provides a data monitoring system, see Figure 2 ,include:

[0094] The first capturing module 201 is used to capture the handshake information generated by the server and the client during the handshake negotiation based on the target protocol;

[0095] The key parameter derivation module 202 is used to parse the transmission format of the handshake information and extract the encryption suite, session key and random number used for data transmission encryption; wherein the encryption suite includes one or more encryption algorithms;

[0096] A key generation module 203, configured to dynamically select an encryption algorithm from the encryption suite, and use the encryption algorithm to process the session key and the random number to generate a decryption key;

[0097] A second capturing module 204, configured to capture the encrypted data packets transmitted by the server and the client based on the target protocol;

[0098] The decryption module 205 is used to decrypt the encrypted data packet using the decryption key to generate data plaintext for security analysis.

[0099] It should be noted that the data monitoring system provided by the embodiment of the present invention, wherein the specific manner in which each module performs operations has been described in detail in the method embodiment provided in the above-mentioned first aspect. The specific implementation process can refer to the method embodiment provided in the above-mentioned first aspect, and will not be elaborated in detail here.

[0100] In the third aspect, based on the same inventive concept as the data monitoring method provided in the embodiment of the first aspect mentioned above, the embodiment of the present invention also discloses a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the methods described above.

[0101] In the fourth aspect, based on the same inventive concept as the data monitoring method provided in the embodiment of the first aspect mentioned above, the embodiment of the present invention also discloses a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the methods described above when executing the program.

[0102] Through one or more embodiments of the present invention, the present invention has the following beneficial effects or advantages:

[0103] The present invention provides a data monitoring method, system, medium and computer equipment, which first capture the handshake information generated by the server and the client during the handshake negotiation based on the target protocol; then parse the transmission format of the handshake information, so as to quickly extract the encryption suite, session key and random number used for data transmission encryption; according to different hardware environments and network conditions, dynamically select encryption algorithms from the encryption suite to flexibly adapt to network requirements, and generate corresponding decryption keys to decrypt data plaintext for security analysis, so as to ensure that the decryption keys can be efficiently derived under different hardware environments and network conditions, and the optimal decryption performance and security can be obtained, so as to effectively improve the efficiency of data security monitoring and enhance the adaptability of the supervision system.

[0104] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0105] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A data monitoring method, characterized in that: The method comprises: Capture the handshake information generated by the server and client based on the target protocol handshake negotiation; Parsing the transmission format of the handshake information to extract the encryption suite, session key and random number used for data transmission encryption; wherein the encryption suite includes one or more encryption algorithms; Dynamically selecting an encryption algorithm from the encryption suite, and processing the session key and the random number using the encryption algorithm to generate a decryption key; Capturing the encrypted data packets transmitted by the server and the client based on the target protocol; The encrypted data packet is decrypted using the decryption key to generate data plaintext for security analysis.

2. The method according to claim 1, characterized in that The capturing of the handshake information generated by the server and the client during the handshake negotiation based on the target protocol specifically includes: The handshake negotiation process between the server and the client based on the target protocol is monitored in real time, and the handshake information generated during the handshake negotiation process is captured using a handshake capture tool.

3. The method according to claim 1 or 2, characterized in that The transmission format of the handshake information is parsed to extract the encryption suite, session key and random number used for data transmission encryption, specifically including: Parsing the transmission format of the handshake information to extract the encryption suite and the shared key; With reference to the shared key, the corresponding session key and the random number are obtained.

4. The method according to claim 3, characterized in that The obtaining the corresponding session key and the random number by referring to the shared key specifically includes: Based on the shared key, generating a key derivation request for invoking the key derivation function based on the hash message authentication code; Based on the key derivation request, checking whether the corresponding session key and the random number exist in a cache; If yes, directly call the session key and the random number; If not, the key derivation function based on the hash message authentication code is called to derive the shared key to obtain the session key and the random number, and the derived session key and the random number are stored in the cache.

5. The method according to claim 4, characterized in that The step of storing the derived session key and the random number into the cache specifically includes: Based on the key derivation request, generate an identity identifier for finding the session key and the random number; wherein the identity identifier is used as a cache key; The session key and the random number are stored in a cache area corresponding to the cache key.

6. The method according to claim 1, characterized in that The capturing of the encrypted data packet transmitted based on the target protocol specifically includes: Intercepting a number of fragmented flows from a designated network interface of the server or the client; the fragmented flows carry one or more identity information of a TCP sequence number, an IP address, and a port number; The plurality of fragmented flows are assembled into the encrypted data packet according to the identity information respectively carried by the plurality of fragmented flows.

7. The method according to claim 1, characterized in that The encryption algorithm at least includes the AES-GCM encryption algorithm and the ChaCha20-Poly1305 encryption algorithm.

8. A data monitoring system, characterized in that: include: The first capture module is used to capture the handshake information generated by the server and the client during the handshake negotiation based on the target protocol; A key parameter derivation module, used to parse the transmission format of the handshake information and extract the encryption suite, session key and random number used for data transmission encryption; wherein the encryption suite includes one or more encryption algorithms; A key generation module, used to dynamically select an encryption algorithm from the encryption suite, and use the encryption algorithm to process the session key and the random number to generate a decryption key; A second capturing module, used for capturing the encrypted data packets transmitted by the server and the client based on the target protocol; The decryption module is used to decrypt the encrypted data packet using the decryption key to generate data plaintext for security analysis.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 7 are implemented.

Images