Logic data management system based on big data mathematical model
Through a logical data management system based on the big data mathematical model, the problems of low efficiency, insufficient security and poor flexibility in handling large-scale logical data are solved, efficient processing and secure storage are achieved, and the overall performance of data management is improved. .
Patent Information
- Application Number
- CN202411172254.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-11-29
AI Technical Summary
Traditional data management systems are inefficient in processing large amounts of logical data, lack of security, poor flexibility and scalability, especially when processing large amounts of data and increased logic complexity, and are inefficient in decryption and reading.
Using a logical data management system based on a big data mathematical model, the simulation operation, encoding marking, partition storage and encryption processing of logical data is carried out through components such as data acquisition units, node processing units, data repository and encryption construction units, and pre-training is used. Mathematical models perform coding calculations and encrypted analysis to achieve efficient processing and secure storage.
It improves data processing efficiency, enhances data structure and security, optimizes decryption and reading processes, and provides a comprehensive, efficient and secure logical data management solution to meet the needs of the big data era.
Smart Images

Figure CN119046965A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data management, and in particular to a logical data management system based on a big data mathematical model. Background Art
[0002] In today's era of rapid development of information technology, data management systems have become essential for organizing, storing and processing large amounts of data. In particular, the management of logical data, which often involves complex relationships and structures, requires efficient processing methods to ensure data integrity and accessibility. Traditional data management systems may face the following challenges: Data processing efficiency: When the amount of logical data is large, how to efficiently encode, mark and process the data becomes a problem; Data security: For sensitive logical data, how to ensure its security and prevent unauthorized access is the key; Flexibility and scalability: As data volume grows and logic complexity increases, the system needs to be able to adapt flexibly and be easily expanded; Decryption and reading efficiency: For encrypted data, an efficient mechanism is needed to decrypt and quickly read the required information.
[0003] Based on this, the present invention proposes a logical data management system based on a big data mathematical model, which can efficiently organize, store, process and decrypt logical data. Summary of the invention
[0004] The purpose of the present invention is to provide a logical data management system based on a big data mathematical model, which solves the technical problems raised in the background technology.
[0005] The purpose of the present invention can be achieved by the following technical solutions: Logical data management system based on big data mathematical model, including: A data acquisition unit, used to acquire logical data and a plurality of corresponding logical nodes, where the logical nodes represent nodes on which data are running; The node processing unit is used to simulate the operation of the logic data through the pre-trained first mathematical model, and to encode and mark the logic data according to the order in which each logic node is read, and obtain the corresponding digital code; A data repository, used for partitioning and storing sub-data and coding calculation formulas; A storage partition unit, used to divide the data repository into a plurality of storage areas, which include a public file storage area, a plurality of encrypted file storage areas, a public formula storage area and a plurality of encrypted formula storage areas; An encryption construction unit is used to encrypt the corresponding next group of encryption formula storage areas according to the coding calculation formula in the formula storage area corresponding to the corresponding file storage area through a pre-trained second mathematical model; it is also used to construct an encryption analysis formula according to the result value obtained by the digital code and the corresponding coding calculation formula through the pre-trained second mathematical model, and at the same time use the encryption analysis formula as the encryption algorithm for the corresponding next group of encrypted file storage areas.
[0006] As a further solution of the present invention: the processing method of the node processing unit is as follows: SS1, importing the logic data into the pre-trained first mathematical model, the first mathematical model reads the logic data, and performs simulation operation; SS2. During operation, the first mathematical model encodes and marks the logical nodes read in sequence in the logical data, and obtains the corresponding digital code on each logical node according to the encoding and marking result; SS3, sequentially obtain digital codes on each adjacent logical node, and use the pre-trained second mathematical model to construct different coding calculation formulas based on the digital codes on the adjacent logical nodes; SS4. Divide the logical data into several sub-data according to the logical nodes in the logical data, and add the corresponding digital codes to the sub-data; The sub-data and the coding calculation formula are then transmitted to the data storage unit.
[0007] As a further solution of the present invention: wherein, the digital code in the coding mark is obtained based on the coding rules predefined in the first mathematical model.
[0008] As a further solution of the present invention: wherein the rules of digital coding are unified, but the values thereof are different, and the digital coding is a computable number, the values of the result values obtained by the coding calculation formula are different, but the rules thereof are unified.
[0009] As a further solution of the present invention: the public file storage area is used to store the sub-data ranked first according to the reading order of the logical nodes; The multiple public encrypted storage areas are respectively used to store the corresponding sub-data in the latter order according to the reading order of the logical nodes; The public formula storage area is used to store the corresponding coding calculation formula between two adjacent logic nodes ranked first and second according to the reading order of the logic nodes; The plurality of encryption formula storage areas are respectively used to store the encoding calculation formulas corresponding to other adjacent logic nodes in the subsequent order according to the reading order of the logic nodes.
[0010] As a further solution of the present invention: wherein the public file storage area and the plurality of encrypted file storage areas are both prefixed with the digital code corresponding to the sub-data stored therein, and then the digital code corresponding to the sub-data adjacent to the prefix is used as a suffix to name the file storage area; Both the public formula storage area and the encrypted formula storage area are named after the two digital codes corresponding to the coded calculation formulas, and the naming method of the public formula storage area and the encrypted formula storage area is based on the reading order of the logical nodes, with the digital code in the front as the prefix and the digital code in the back as the suffix.
[0011] As a further solution of the present invention: also include: The operation reading unit is used to extract the corresponding sub-data and the encoding calculation formula one by one from the extraction data storage library at runtime, and import them into the pre-trained third data model for decryption reading.
[0012] As a further solution of the present invention: the decryption method of the running reading unit is as follows: AS1, extract corresponding sub-data from the public file storage area for reading; AS2. At the same time, during the operation and reading process, the pre-trained third mathematical model obtains the corresponding coding calculation formula from the public formula storage area, and obtains the corresponding naming from the read public file storage area; AS3, a third mathematical model imports the two digital codes corresponding to the names obtained in step AS2 into the code calculation formula obtained in step AS2, and calculates the corresponding result value; AS4, according to the suffix named corresponding to the public file storage area in step 3 AS3, obtain the encrypted file storage area corresponding to the prefix with the same digital code in all encrypted file storage areas, then import the digital code corresponding to the prefix and the result value obtained by the code calculation formula in step AS3 into the encryption analysis formula, calculate the corresponding result value, and use the result value obtained by the encryption analysis formula as the decryption key of the encrypted file storage area, open the encrypted file storage area, and extract the corresponding sub-data from it for reading; AS5, according to the suffix of the corresponding name of the public file storage area in step AS3, obtain the encryption formula storage area corresponding to the prefix with the same digital code in all encryption formula storage areas, then use the result value obtained by the encoding calculation formula in step AS3 as the decryption key of the encryption formula storage area, open the encryption storage area and extract the corresponding encoding calculation formula from it, then open the read encrypted file storage area in step AS4 to obtain the corresponding name, and then extract the corresponding sub-data from other corresponding encrypted file storage areas and read them according to the method of steps AS3-AS4; This process is repeated in this way until all sub-data in all file storage areas are read.
[0013] As a further solution of the present invention: it also includes a hierarchical analysis unit, which is used to perform hierarchical marking on the logical data before the node processing unit performs coding marking processing on the logical data, and then the node processing unit performs coding marking processing on the contents of each hierarchical mark in the logical data respectively; Among them, the order hierarchy refers to a format used to organize content and express structure in logical data, and the order hierarchy mark refers to distinguishing the importance and order of each part through different levels of title numbers.
[0014] The beneficial effects of the present invention are as follows: Improve processing efficiency: The present invention accelerates data processing by simulating operation and encoding marking of logical data through a pre-trained mathematical model.
[0015] Enhanced structure and hierarchy: The present invention introduces a hierarchical analysis unit to mark the order and parallel order of logical data, which helps to structure and hierarchize the data, making the data clearer and easier to understand.
[0016] Strengthening data security: The present invention strengthens data security by dividing the data repository into public and encrypted areas and using coding calculation formulas and encryption analysis formulas as means of encryption and decryption.
[0017] Optimizing the decryption and reading process: The present invention provides a detailed decryption and reading process to ensure efficient access and use of data even in the case of encryption.
[0018] In general, the present invention provides a comprehensive, efficient and secure logical data management solution by integrating big data processing technology and encryption algorithms, which meets the needs of data processing and management in the current big data era. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The present invention will be further described below in conjunction with the accompanying drawings.
[0020] Figure 1 It is a system block diagram of the logical data management system based on the big data mathematical model of the present invention.
[0021] Figure 2 It is a processing flow diagram of a node processing unit of a logical data management system based on a big data mathematical model of the present invention. DETAILED DESCRIPTION
[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0023] Embodiment 1
[0024] See also Figure 1 and Figure 2 As shown, the present invention is a logical data management system based on a big data mathematical model, comprising: A data acquisition unit, used to acquire logical data and a plurality of corresponding logical nodes, where the logical nodes represent nodes on which data are running; Data repository, used to store logical data; A node processing unit, used for encoding and marking logic data; The method is: SS1, importing the logic data into the pre-trained first mathematical model, the first mathematical model reads the logic data, and performs simulation operation; SS2. During operation, the first mathematical model encodes and marks the logical nodes sequentially read from the logical data, and obtains corresponding digital codes on each logical node according to the encoding and marking results, wherein the digital codes in the encoding and marking are obtained according to the encoding rules predefined in the first mathematical model. In this embodiment, the rules of the digital codes are unified, but the values are different, and the digital codes are computable numbers, such as multiple digital codes are: "1212, 2143, 5435, 2654"; SS3. Obtain the digital codes on each adjacent logical node in sequence, and use the pre-trained second mathematical model to construct different coding calculation formulas based on the digital codes on the adjacent logical nodes; wherein the result values obtained by the coding calculation formulas have different values, but the rules are unified; for example, the result values obtained by the coding calculation formulas for multiple adjacent digital codes are: "26543, 65342, 54326" respectively; The following is an example of the coding calculation formula: For example, the encoding calculation formula corresponding to 1212 and 2143 can be set as: (2*1212-2143)*2143=26543, that is, the result value of the coding calculation formula is 26543; SS4. Divide the logical data into several sub-data according to the logical nodes in the logical data, and add the corresponding digital codes to the sub-data; The sub-data and coding calculation formula are then transferred to the data repository; This embodiment uses a pre-trained mathematical model to simulate and encode logical data, thereby speeding up data processing; The storage partition unit is used to divide the data repository into several storage areas, including a public file storage area, multiple encrypted file storage areas, a public formula storage area and multiple encrypted formula storage areas. The public file storage area is used to store the sub-data ranked first according to the reading order of the logical nodes; The multiple public encrypted storage areas are respectively used to store the corresponding sub-data in the latter order according to the reading order of the logical nodes; The public formula storage area is used to store the corresponding coding calculation formula between two adjacent logic nodes ranked first and second according to the reading order of the logic nodes; The plurality of encryption formula storage areas are respectively used to store the encoding calculation formulas corresponding to other adjacent logic nodes in the subsequent order according to the reading order of the logic nodes; The public file storage area and the multiple encrypted file storage areas are both prefixed with the digital code corresponding to the sub-data stored therein, and the digital code corresponding to the sub-data adjacent to the prefix is used as a suffix to name the file storage area. In this embodiment, the suffix is added with brackets, such as "1212 (2143)". The public formula storage area and the encrypted formula storage area are both named after the two digital codes corresponding to the coded calculation formulas; In this embodiment, the public formula storage area and the encrypted formula storage area are named in the order of reading the logical nodes, with the digital code in the front position as the prefix, the digital code in the back position as the suffix, and then a separator "-" is added between the prefix and the suffix, such as "1212-2143"; An encryption construction unit, used to encrypt the corresponding next set of encryption formula storage areas according to the coded calculation formula in the formula storage area corresponding to the corresponding file storage area through a pre-trained second mathematical model; At the same time, the digital code of the corresponding file storage area is imported into the code calculation formula in the corresponding formula storage area to calculate the corresponding result value, and the result value obtained by the code calculation formula is used as the decryption key of the encryption formula storage area; It is also used to construct an encryption analysis formula based on the result value obtained by the digital code and the corresponding code calculation formula through the pre-trained second mathematical model, and at the same time use the encryption analysis formula as the encryption algorithm of the corresponding next group of encrypted file storage areas through the pre-trained second mathematical model, and import the result value obtained by the digital code and the corresponding code calculation formula into the encryption analysis formula, calculate the corresponding result value, and use the result value obtained by the encryption analysis formula as the decryption key of the encrypted storage area; This embodiment divides the data repository into public and encrypted areas, and divides the data repository into multiple areas, including a public file storage area, an encrypted file storage area, a public formula storage area, and an encrypted formula storage area. This design not only ensures the structure of the data, but also facilitates users to quickly locate and access data according to their needs. The public area allows users to easily obtain non-sensitive information, while the encrypted area uses coded calculation formulas and encrypted analysis formulas to protect data, ensuring the security and privacy of sensitive information. The enhanced security is achieved through advanced encryption technology. The coding calculation formula generates a unique digital code for the relationship between each pair of logical nodes, and the cryptographic analysis formula further converts these codes into encryption keys. This method not only improves the strength of encryption, but also makes the decryption process more complicated, thus effectively preventing unauthorized data access.
[0025] Embodiment 2
[0026] As the second embodiment of the present invention, when the present application is implemented, compared with the first embodiment, the technical solution of the present embodiment is different from that of the first embodiment only in that the present embodiment further includes: An operation reading unit is used to extract corresponding sub-data and encoding calculation formulas from the extracted data storage library one by one during operation, and import them into the pre-trained third data model for decryption reading; Specifically: AS1, extract corresponding sub-data from the public file storage area for reading; AS2. At the same time, during the operation and reading process, the pre-trained third mathematical model obtains the corresponding coding calculation formula from the public formula storage area, and obtains the corresponding naming from the read public file storage area; AS3, a third mathematical model imports the two digital codes corresponding to the names obtained in step AS2 into the code calculation formula obtained in step AS2, and calculates the corresponding result value; AS4, according to the suffix named corresponding to the public file storage area in step 3 AS3, obtain the encrypted file storage area corresponding to the prefix with the same digital code in all encrypted file storage areas, then import the digital code corresponding to the prefix and the result value obtained by the code calculation formula in step AS3 into the encryption analysis formula, calculate the corresponding result value, and use the result value obtained by the encryption analysis formula as the decryption key of the encrypted file storage area, open the encrypted file storage area, and extract the corresponding sub-data from it for reading; AS5, according to the suffix of the corresponding name of the public file storage area in step AS3, obtain the encryption formula storage area corresponding to the prefix with the same digital code in all encryption formula storage areas, then use the result value obtained by the encoding calculation formula in step AS3 as the decryption key of the encryption formula storage area, open the encryption storage area and extract the corresponding encoding calculation formula from it, then open the read encrypted file storage area in step AS4 to obtain the corresponding name, and then extract the corresponding sub-data from other corresponding encrypted file storage areas and read them according to the method of steps AS3-AS4; And so on, until all the sub-data in the file storage area are read; This embodiment provides a detailed decryption and reading process to ensure that data can be efficiently accessed and used even in the encrypted state.
[0027] Embodiment 3
[0028] As the third embodiment of the present invention, when the present application is implemented, compared with the first and second embodiments, the technical solution of this embodiment is to combine the solutions of the first and second embodiments, and the difference between the technical solution of this embodiment and the first and second embodiments is that: this embodiment also includes a hierarchical analysis unit, which is used to perform hierarchical marking on logical data, as follows: SG1. Get all order levels from logical data; The order level refers to a format used to organize content and express structure in logical data. It distinguishes the importance and order of each part through different levels of title numbers. The order level includes the highest level, the second level, the third level, and so on. SG2, mark each level in the order of reading; Marked as follows: The highest level: Use Chinese characters and numerals plus a period, such as "one, two, three" for title numbers; Second level: Use Chinese characters and numbers contained in brackets, such as "(I) (II) (III)" for title numbers; The third level: Use Arabic numerals with a period, such as "1.2.3." Fourth level: Use Arabic numerals in brackets, such as "(1)(2)(3)" for title numbers; Fifth level: Use Arabic numerals surrounded by circles, such as "① ② ③" for title numbers; … Lower level: When further subdivision is required, use lowercase English letters or other symbols; SG3. Mark the logical nodes in each order level in parallel order according to the parallel relationship read, where the parallel relationship is represented by the logical nodes being processed simultaneously; Marked as follows: Taking the highest level as an example, at the highest level, if the corresponding part title numbers "one, two," are in a simultaneous relationship, then other identical symbols are used as the suffix serial number of the level, such as "one (A), two (A),", "(A)" indicates that the title numbers "one, two," are in a simultaneous relationship in the logical data; Among them, if the "three" in the highest level is not numbered simultaneously with other headings, no corresponding suffix number will be added; In this embodiment, the hierarchical analysis unit processes the logical data obtained by the data acquisition unit, and after the hierarchical analysis unit completes the processing, the node processing unit performs coding and marking processing on the contents in different order levels in the logical data; This embodiment introduces a hierarchical analysis unit to mark the logical data in order and order, making the data clearer and easier to understand when processing, analyzing and reading. This embodiment takes into account the comprehensive needs for data processing and management in a big data environment. The integrated big data processing technology can efficiently process massive data sets, while the encryption algorithm ensures the security of data during storage and transmission. The system is designed with good scalability, which means that as the amount of data grows or the complexity of logic increases, the system can still effectively adapt and maintain efficient operation.
[0029] Embodiment 4
[0030] As the fourth embodiment of the present invention, when the present application is specifically implemented, compared with the first, second and third embodiments, the technical solution of this embodiment is to combine and implement the solutions of the above-mentioned first, second and third embodiments.
[0031] This embodiment provides a comprehensive, efficient and secure logical data management solution by integrating big data processing technology and encryption algorithms, which meets the needs of data processing and management in the current big data era. Through intelligent data processing, structured and secure data storage, and efficient and secure encryption and decryption mechanisms, the present invention significantly improves the overall performance of logical data management and provides an innovative model for future data management systems.
[0032] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A logical data management system based on a big data mathematical model, characterized in that: include: A data acquisition unit, used to acquire logical data and a plurality of corresponding logical nodes, where the logical nodes represent nodes on which data are running; The node processing unit is used to simulate the operation of the logic data through the pre-trained first mathematical model, and to encode and mark the logic data according to the order in which each logic node is read, and obtain the corresponding digital code; A data repository, used for partitioning and storing sub-data and coding calculation formulas; A storage partition unit, used to divide the data repository into a plurality of storage areas, which include a public file storage area, a plurality of encrypted file storage areas, a public formula storage area and a plurality of encrypted formula storage areas; An encryption construction unit is used to encrypt the corresponding next group of encryption formula storage areas according to the coding calculation formula in the formula storage area corresponding to the corresponding file storage area through a pre-trained second mathematical model; it is also used to construct an encryption analysis formula according to the result value obtained by the digital code and the corresponding coding calculation formula through the pre-trained second mathematical model, and at the same time use the encryption analysis formula as the encryption algorithm for the corresponding next group of encrypted file storage areas.
2. The logical data management system based on big data mathematical model according to claim 1 is characterized in that: The processing method of the node processing unit is as follows: SS1, importing the logic data into the pre-trained first mathematical model, the first mathematical model reads the logic data, and performs simulation operation; SS2. During operation, the first mathematical model encodes and marks the logical nodes read in sequence in the logical data, and obtains the corresponding digital code on each logical node according to the encoding and marking result; SS3, sequentially obtain digital codes on each adjacent logical node, and use the pre-trained second mathematical model to construct different coding calculation formulas based on the digital codes on the adjacent logical nodes; SS4. Divide the logical data into several sub-data according to the logical nodes in the logical data, and add the corresponding digital codes to the sub-data; The sub-data and the coding calculation formula are then transmitted to the data storage unit.
3. The logical data management system based on big data mathematical model according to claim 2 is characterized in that: in, The digital code in the coding mark is obtained according to the coding rule predefined in the first mathematical model.
4. The logical data management system based on big data mathematical model according to claim 3 is characterized in that: in, The rules of digital coding are unified, but the values are different. Digital coding is a computable number. The values of the result values obtained by the coding calculation formula are different, but the rules are unified.
5. The logical data management system based on big data mathematical model according to claim 1 is characterized in that: The public file storage area is used to store the sub-data ranked first according to the reading order of the logical nodes; The multiple public encrypted storage areas are respectively used to store the corresponding sub-data in the latter order according to the reading order of the logical nodes; The public formula storage area is used to store the corresponding coding calculation formula between two adjacent logic nodes ranked first and second according to the reading order of the logic nodes; The plurality of encryption formula storage areas are respectively used to store the encoding calculation formulas corresponding to other adjacent logic nodes in the subsequent order according to the reading order of the logic nodes.
6. The logical data management system based on big data mathematical model according to claim 5 is characterized in that: in, The public file storage area and multiple encrypted file storage areas are named by using the digital code corresponding to the sub-data stored in them as prefixes, and then using the digital code corresponding to the sub-data adjacent to the prefix as suffixes; Both the public formula storage area and the encrypted formula storage area are named after the two digital codes corresponding to the coded calculation formulas, and the naming method of the public formula storage area and the encrypted formula storage area is based on the reading order of the logical nodes, with the digital code in the front as the prefix and the digital code in the back as the suffix.
7. The logical data management system based on big data mathematical model according to claim 1 is characterized in that: Also includes: The operation reading unit is used to extract the corresponding sub-data and the encoding calculation formula one by one from the extraction data storage library at runtime, and import them into the pre-trained third data model for decryption reading.
8. The logical data management system based on big data mathematical model according to claim 7 is characterized in that: The decryption method of the operation reading unit is as follows: AS1, extract corresponding sub-data from the public file storage area for reading; AS2. At the same time, during the operation and reading process, the pre-trained third mathematical model obtains the corresponding coding calculation formula from the public formula storage area, and obtains the corresponding naming from the read public file storage area; AS3, a third mathematical model imports the two digital codes corresponding to the names obtained in step AS2 into the code calculation formula obtained in step AS2, and calculates the corresponding result value; AS4, according to the suffix named corresponding to the public file storage area in step 3 AS3, obtain the encrypted file storage area corresponding to the prefix with the same digital code in all encrypted file storage areas, then import the digital code corresponding to the prefix and the result value obtained by the code calculation formula in step AS3 into the encryption analysis formula, calculate the corresponding result value, and use the result value obtained by the encryption analysis formula as the decryption key of the encrypted file storage area, open the encrypted file storage area, and extract the corresponding sub-data from it for reading; AS5, according to the suffix of the corresponding name of the public file storage area in step AS3, obtain the encryption formula storage area corresponding to the prefix with the same digital code in all encryption formula storage areas, then use the result value obtained by the encoding calculation formula in step AS3 as the decryption key of the encryption formula storage area, open the encryption storage area and extract the corresponding encoding calculation formula from it, then open the read encrypted file storage area in step AS4 to obtain the corresponding name, and then extract the corresponding sub-data from other corresponding encrypted file storage areas and read them according to the method of steps AS3-AS4; This process is repeated in this way until all sub-data in all file storage areas are read.
9. The logical data management system based on big data mathematical model according to claim 1 is characterized in that: It also includes a hierarchical analysis unit, which is used to perform hierarchical marking on the logical data before the node processing unit performs coding and marking processing on the logical data, and then the node processing unit performs coding and marking processing on the contents of each hierarchical mark in the logical data respectively; Among them, the order hierarchy refers to a format used to organize content and express structure in logical data, and the order hierarchy mark refers to distinguishing the importance and order of each part through different levels of title numbers.
