Safety II-area multi-mode database transformation method and system
Through multi -mode structure analysis and data migration scheme, the existing power monitoring system database was transformed into a multi -mode domestic database, solving the problem of safety hazards and functional limitations of existing databases, and achieved efficient and reliable database migration and system performance improvement. Essence
Patent Information
- Application Number
- CN202411169021.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-23
- Publication Date
- 2025-01-21
AI Technical Summary
The existing power monitoring system database has security risks and functional limitations, which is difficult to meet the needs of complex data processing. How to transform the existing single-mode database into a multi-mode domestic database on the premise of ensuring system stability and data integrity.
Through multi-mode structure analysis, generate a domestic database multi-mode structure framework and data migration plan, build a domestic database system cluster on the security zone II virtualization platform, perform data migration and multi-mode data optimization, and finally complete system switching to realize the transformation of the database .
It achieves efficient and reliable migration from existing databases to domestic databases, improves the overall performance and availability of the system, and ensures data security and integrity.
Smart Images

Figure CN119336725A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of power system data management, and in particular to a method and system for transforming a multi-mode database in a safety II zone. Background Art
[0002] As the country's requirements for network security and autonomous control of information systems are increasing, the power industry, as a key infrastructure, has become a top priority for the localization of its monitoring system database. Traditional power monitoring systems mostly use foreign commercial relational databases, which not only have potential security risks, but also cannot meet the increasingly complex data processing needs.
[0003] At present, the development of multi-mode database technology has provided a new idea for solving this problem. Multi-mode databases can simultaneously support multiple data models such as relational, document, and graphical models, and can better adapt to the complex and diverse data types and processing requirements in power monitoring systems. However, how to transform the existing single-mode database into a multi-mode domestic database while ensuring system stability and data integrity is still a technical problem that needs to be solved urgently. Summary of the invention
[0004] In view of the problems of potential safety hazards and functional limitations in the existing power monitoring system database, the present invention is proposed.
[0005] Therefore, the problem to be solved by the present invention is how to safely and efficiently transform the existing single-mode database into a multi-mode domestic database while ensuring system stability and data integrity.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0007] In the first aspect, an embodiment of the present invention provides a method for transforming a multi-mode database in a security zone II, which includes performing a multi-mode structural analysis on an existing database in the security zone II, and generating a multi-mode structural framework and a data migration plan for a domestic database based on the analysis results; building a domestic database system cluster on a security zone II virtualization platform according to the multi-mode structural framework of the domestic database; transferring the data and structure in the existing database in the security zone II to the domestic database system cluster according to the data migration plan; performing multi-mode data optimization on the domestic database system cluster according to the transferred data and structure; and executing system switching to complete the transformation of the multi-mode database in the security zone II.
[0008] As a preferred solution of the method for transforming the multi-mode database of the safety zone II described in the present invention, the invention comprises the following steps: generating a multi-mode structural framework of a domestic database and a data migration plan based on the analysis results: analyzing the metadata information of the existing database of the safety zone II using a data structure analysis algorithm to identify the data mode type and structural characteristics of the existing database; constructing a multi-dimensional evaluation matrix, using the multi-dimensional evaluation matrix to quantitatively evaluate the structural characteristics of different data mode types in the existing database, and obtaining a multi-dimensional evaluation result; designing an initial multi-mode structural framework of a domestic database, mapping the data mode type in the existing database to the multi-mode structural framework of the domestic database, and generating an initial mode mapping table; adjusting and optimizing the initial multi-mode structural framework of the domestic database based on the multi-dimensional evaluation result and the initial mode mapping table, and obtaining an optimized multi-mode structural framework of the domestic database; formulating a data migration strategy from the existing database to the domestic database, and generating a data migration plan; and outputting the optimized multi-mode structural framework of the domestic database and the data migration plan.
[0009] As a preferred solution of the method for transforming the multi-mode database of the safety zone II described in the present invention, the adjustment and optimization of the initial domestic database multi-mode structural framework includes the following steps: parsing the multi-dimensional evaluation results and extracting the structural feature scores of each data mode type; based on the initial mode mapping table, calculating the mapping matching degree of the existing database mode to the initial domestic database multi-mode structural framework; constructing a structural adaptability evaluation function, which comprehensively considers the structural feature score and the mapping matching degree; and using a heuristic algorithm to iteratively optimize the initial domestic database multi-mode structural framework to maximize the structural adaptability evaluation function.
[0010] As a preferred solution of the multi-mode database transformation method of the safety zone II of the present invention, the specific formula of the structural adaptability evaluation function is as follows:
[0011] S A =ω1*Σ(S i *W i )+ω2*M
[0012] Among them, S A Score for structural adaptability, S i Score the structural features of the i-th data pattern type, W i is the weight of the i-th data pattern type, M is the mapping matching degree, and ω1 and ω2 are weight factors.
[0013] As a preferred solution of the multi-mode database transformation method of the safety zone II of the present invention, the generating of the data migration scheme includes the following steps: based on the metadata information, classifying and counting the data objects in the existing database, generating a data object migration list; designing a preliminary migration processing flow for each type of data object; assigning migration priorities to the data objects according to the multi-dimensional evaluation results, and constructing a migration priority matrix; formulating a heterogeneous data structure conversion rule set based on the optimized domestic database multi-mode structure framework and the updated mode mapping table; designing a batch data migration module, which is used to perform initial large-scale data migration; developing an incremental data synchronization module, which is connected to the second data synchronization mechanism to capture real-time data changes during the migration process; formulating a multi-level data verification mechanism, which includes data integrity verification, structural consistency verification and business logic verification; constructing a migration rollback mechanism to provide a data fallback plan for migration failure; systematically organizing the data migration components to form a data migration framework and formulate a data migration scheme; the data migration components include a data object migration list, a migration processing flow, a heterogeneous data structure conversion rule set, a batch data migration module, an incremental data synchronization module, a data verification mechanism and a migration rollback mechanism.
[0014] As a preferred solution of the multi-mode database transformation method of the safety zone II described in the present invention, wherein: transferring the data and structure in the existing database of the safety zone II to the domestic database system cluster according to the data migration plan includes the following steps: generating a data migration execution plan according to the data migration plan; extracting and converting the data to be migrated from the existing database to obtain a migration data file; using a batch import tool to load the migration data file to the master node of the domestic database system cluster; configuring a second data synchronization mechanism, capturing data changes in the existing database in real time through the second data synchronization mechanism, and applying it to the domestic database system cluster; applying a multi-level data verification mechanism, comparing the data in the existing database with the data in the domestic database system cluster, performing data integrity verification, structural consistency verification and business logic verification; the domestic database system cluster operates in master-slave mode.
[0015] As a preferred solution of the multi-mode database transformation method of the safety zone II described in the present invention, wherein: performing multi-mode data optimization on the domestic database system cluster includes the following steps: analyzing the data migration report to obtain the data structure characteristics and distribution parameters after the transfer; based on the identified data mode type, classifying and marking the multi-mode data in the domestic database system cluster to obtain the data mode classification result; performing performance testing to identify the performance bottleneck of the domestic database system cluster; formulating an optimization strategy based on the data mode classification result and the performance bottleneck; adjusting the index structure of the domestic database system cluster according to the optimization strategy; implementing the data distribution plan based on the master-slave mode, and collecting the performance indicators of the domestic database system cluster under load; adjusting the data distribution plan according to the performance indicators.
[0016] In the second aspect, an embodiment of the present invention provides a multi-mode database transformation system for a safety zone II, which includes a multi-mode structure analysis module for performing multi-mode structure analysis on an existing database in the safety zone II, and generating a multi-mode structure framework and a data migration plan for a domestic database based on the analysis results; a database cluster construction module for building a domestic database system cluster on a safety zone II virtualization platform according to the multi-mode structure framework of the domestic database; a data migration execution module for transferring the data and structure in the existing database in the safety zone II to the domestic database system cluster according to the data migration plan, and performing multi-level data verification during the transfer process; a multi-mode data optimization module for performing multi-mode data optimization on the domestic database system cluster according to the transferred data and structure; a database adaptation layer module for building a database adaptation layer, so that the safety zone II business system can interact with the domestic database system cluster, perform system switching, and complete the transformation of the multi-mode database in the safety zone II.
[0017] In a third aspect, an embodiment of the present invention provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: when the computer program instructions are executed by the processor, the steps of the method for transforming the multi-mode database of the security zone II as described in the first aspect of the present invention are implemented.
[0018] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program instructions are executed by a processor, the steps of the method for transforming the multi-mode database of the security zone II as described in the first aspect of the present invention are implemented.
[0019] The beneficial effects of the present invention are as follows: the present invention realizes efficient and reliable migration from the existing database to the domestic database through multi-dimensional analysis and optimization. First, it ensures the adaptability and efficiency of the new database structure through multi-mode structural analysis and optimization framework design. Secondly, the virtualized cluster deployment in master-slave mode improves the availability and reliability of the system. Thirdly, the multi-level data verification mechanism and real-time synchronization strategy ensure the accuracy and consistency of data migration. Finally, the multi-mode data optimization based on actual data characteristics significantly improves the system performance. Overall, the solution not only realizes safe and controllable domestic database transformation, but also improves the overall performance and availability of the system through a series of optimization measures. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0021] Figure 1 This is a framework flow chart of the multi-mode database transformation method for security zone II.
[0022] Figure 2 This is the multi-mode structure analysis flow chart of the multi-mode database transformation method for safety zone II.
[0023] Figure 3 Computer equipment diagram for the multi-mode database transformation method for Security Zone II. DETAILED DESCRIPTION
[0024] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.
[0025] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0026] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.
[0027] Example 1
[0028] Reference Figure 1 to Figure 3 , which is the first embodiment of the present invention, and provides a method for transforming a multi-mode database in a security zone II, comprising:
[0029] S1: Perform multi-mode structural analysis on the existing database in Security Zone II, and generate a multi-mode structural framework and data migration plan for the domestic database based on the analysis results.
[0030] Specifically, the following steps are included:
[0031] S1.1: Collect metadata information of existing databases in Security Zone II.
[0032] For example, metadata information includes table structure, indexes, stored procedures, triggers, views, and constraints.
[0033] S1.2: Use data structure analysis algorithms to analyze metadata information and identify the data pattern types and structural characteristics of existing databases.
[0034] It should be noted that data model types include relational, document, graph, and key-value.
[0035] S1.3: Construct a multi-dimensional evaluation matrix and use it to quantitatively evaluate the structural characteristics of different data pattern types in the existing database to obtain multi-dimensional evaluation results.
[0036] For example, the evaluation dimensions include query performance, data writing speed, scalability, data consistency, storage efficiency, etc.
[0037] S1.4: Design the initial domestic database multi-mode structural framework, map the data model types in the existing database to the domestic database multi-mode structural framework, and generate the initial model mapping table.
[0038] Preferably, a multi-mode structural template library is constructed, which contains standard structural templates for relational, document, graphic and key-value data models; a matching structural template is selected from the multi-mode structural template library based on the identified data model type and its structural characteristics; a data model relationship diagram is constructed using a graph theory algorithm, and the data model relationship diagram reflects the association relationship between different data models in the existing database; a multi-mode fusion layer is designed according to the data model relationship diagram, and the multi-mode fusion layer is used to coordinate the interaction between different data models; based on the selected structural template and the multi-mode fusion layer, an initial domestic database multi-mode structural framework is generated; a mapping relationship between the existing database model and the optimized domestic database multi-mode structural framework is established to generate an initial model mapping table.
[0039] S1.5: Based on the multi-dimensional evaluation results and the initial mode mapping table, the initial domestic database multi-mode structural framework is adjusted and optimized to obtain the optimized domestic database multi-mode structural framework.
[0040] Specifically, the multi-dimensional evaluation results are analyzed to extract the structural feature scores of each data mode type; based on the initial mode mapping table, the mapping matching degree of the existing database mode to the initial domestic database multi-mode structural framework is calculated; a structural adaptability evaluation function is constructed, which comprehensively considers the structural feature score and mapping matching degree. The specific formula is as follows:
[0041] S A =ω1*Σ(S i *W i )+ω2*M
[0042] Among them, S A Score for structural adaptability, S i Score the structural features of the i-th data pattern type, W i is the weight of the i-th data pattern type, M is the mapping match, and ω1 and ω2 are weight factors (used to balance the importance of structural feature scoring and mapping match).
[0043] Furthermore, a heuristic algorithm is used to iteratively optimize the initial domestic database multi-mode structural framework to maximize the structural adaptability evaluation function; during the optimization process, the multi-mode fusion layer is dynamically adjusted to adapt to structural changes; when the structural adaptability evaluation function reaches a preset threshold or the number of iterations reaches an upper limit, the optimized domestic database multi-mode structural framework is output; and the initial mode mapping table is updated to reflect the latest mapping relationship between the optimized framework and the existing database mode.
[0044] Preferably, by introducing a structural adaptability evaluation function and a heuristic algorithm, both structural characteristics and mapping matching can be considered during the optimization process, achieving more intelligent and precise structural optimization and improving the adaptability and efficiency of the final multi-mode structural framework.
[0045] S1.6: Develop a data migration strategy from the existing database to the domestic database and generate a data migration plan.
[0046] Preferably, based on metadata information, data objects in the existing database are classified and counted to generate a data object migration list; a preliminary migration processing flow is designed for each type of data object; migration priorities are assigned to data objects based on multi-dimensional evaluation results, and a migration priority matrix is constructed; a set of heterogeneous data structure conversion rules is formulated based on the optimized domestic database multi-mode structure framework and the updated mode mapping table; a batch data migration module is designed, and the batch data migration module is used to perform initial large-scale data migration; an incremental data synchronization module is developed, and the incremental data synchronization module is connected to the second data synchronization mechanism to capture real-time data changes during the migration process; a multi-level data verification mechanism is formulated, including data integrity verification, structural consistency verification and business logic verification; a migration rollback mechanism is constructed to provide a data fallback solution for migration failures.
[0047] Furthermore, the data migration components are systematically organized to form a data migration framework and formulate a data migration plan, including the following steps: constructing a data migration component relationship diagram, which is used to represent the dependency relationship and data flow between each data migration component; designing a hierarchical data migration framework structure based on the data migration component relationship diagram, and dividing the data migration components into a data preparation layer, a migration execution layer, and a verification and rollback layer according to their functions; developing a component interface standardization module, which is used to unify the input and output formats of each data migration component to ensure compatibility between components; designing a migration task scheduler, which dynamically allocates computing resources according to the migration priority matrix and coordinates the running order and parallelism of each data migration component; constructing a migration process monitoring module, which is used to collect the running status and performance indicators of each data migration component in real time and generate a migration progress report; integrating data migration components, migration task scheduler, and migration process monitoring module to form a complete data migration framework; based on the data migration framework, formulating a detailed data migration plan including migration preparation, execution, verification, and rollback stages, and allocating corresponding data migration components and resources to each stage.
[0048] It should be noted that the data migration components include a data object migration list, a migration process, a heterogeneous data structure conversion rule set, a batch data migration module, an incremental data synchronization module, a data verification mechanism, and a migration rollback mechanism. The data preparation layer includes a data object migration list and a heterogeneous data structure conversion rule set; the migration execution layer includes a migration process, a batch data migration module, and an incremental data synchronization module, which are responsible for the actual data transfer and synchronization operations; the verification rollback layer includes a data verification mechanism and a migration rollback mechanism, which are used to ensure the accuracy of data migration and provide failure recovery capabilities; the migration priority matrix is an important basis for the formulation of migration strategies, and is used to guide the coordination and scheduling of various components.
[0049] Preferably, the use of a hierarchical data migration framework structure and standardized component interfaces can improve the manageability and flexibility of the migration process. At the same time, through the introduction of a migration task scheduler and a monitoring module, dynamic allocation of resources and real-time monitoring of the migration process can be achieved, thereby improving migration efficiency and reliability.
[0050] S1.7: Output the optimized domestic database multi-mode structure framework and data migration plan.
[0051] S2: Based on the multi-mode structural framework of domestic databases, a domestic database system cluster is built on the security zone II virtualization platform.
[0052] Specifically, the master-slave mode refers to setting up a master node and one or more backup nodes in the database system. The master node is responsible for processing all write operations and most read operations, while the backup node keeps data synchronized with the master node and can share part of the read operation load. When the master node fails, the backup node can quickly take over to ensure high availability of the system.
[0053] Preferably, based on the optimized domestic database multi-mode structural framework, an adapted domestic database software version is selected; a virtual machine cluster is created on the security zone II virtualization platform, and the virtual machine cluster includes a master node virtual machine and a standby node virtual machine; the domestic database software is installed on the master node virtual machine and the standby node virtual machine, and the master-standby mode operating parameters are configured; a database instance is built on the master node virtual machine, and a standby database instance is built on the standby node virtual machine; a first data synchronization mechanism is configured, including full replication and incremental synchronization; a load balancing strategy for the domestic database system cluster is set, and the load balancing strategy distributes read operations to the master node or the standby node according to the query type; performance testing and fault tolerance testing of the domestic database system cluster are performed to verify the stability and reliability of the domestic database system cluster.
[0054] It should be noted that the structures of the master instance and the standby instance are consistent. The first data synchronization mechanism refers to the data synchronization mechanism between the master node and the standby node within the domestic database system cluster, which is used to ensure the consistency and high availability of data within the cluster.
[0055] Preferably, building a domestic database system cluster in active-standby mode based on a virtualization platform can improve the availability and reliability of the system. At the same time, by setting a load balancing strategy, it can optimize resource utilization and improve overall performance. In addition, the execution of performance testing and fault tolerance testing ensures the stability of the system in actual operation.
[0056] S3: According to the data migration plan, the data and structure in the existing database of Security Zone II are transferred to the domestic database system cluster, and a multi-level data verification mechanism is implemented during the transfer process.
[0057] Specifically, the following steps are included:
[0058] S3.1: Generate a data migration execution plan based on the data migration plan.
[0059] It should be noted that the data migration execution plan includes migration sequence, time schedule, and resource allocation.
[0060] S3.2: Extract and convert the data to be migrated from the existing database to obtain a migration data file.
[0061] Specifically, the data to be migrated includes structured data, unstructured data, and metadata information.
[0062] S3.3: Use the batch import tool to load the migration data files into the master node of the domestic database system cluster.
[0063] S3.4: Configure a second data synchronization mechanism to capture data changes in the existing database in real time through the second data synchronization mechanism and apply it to the domestic database system cluster.
[0064] It should be noted that the second data synchronization mechanism refers to a real-time synchronization mechanism used to maintain data consistency between the existing database and the domestic database system cluster during the data migration process.
[0065] S3.5: Apply a multi-level data verification mechanism to compare the data in the existing database with the data in the domestic database system cluster, and perform data integrity verification, structural consistency verification, and business logic verification.
[0066] S3.6: Monitor performance indicators during the migration process and adjust resource allocation or data migration plans based on the monitoring results.
[0067] Among them, performance indicators include monitoring data transmission speed, system resource utilization, etc.
[0068] S3.7: Generate a data migration report to record data conversion statistics, multi-level data verification results and performance indicators during the migration process.
[0069] S3.8: Prepare and test rollback plans.
[0070] Specifically, it includes: formulating a detailed rollback operation process based on the migration rollback mechanism designed in S1.6; simulating various possible failure scenarios in the test environment to verify the effectiveness of the rollback plan; recording the rollback test results and optimizing the rollback plan based on the test results.
[0071] Preferably, by implementing a detailed data migration execution plan, combined with batch import and real-time synchronization mechanisms, the efficiency and consistency of data migration can be ensured. The application of multi-level data verification mechanisms further ensures the integrity and correctness of the migrated data. At the same time, performance monitoring and dynamic resource adjustment strategies help optimize the migration process and improve overall migration efficiency.
[0072] S4: Perform multi-mode data optimization on the domestic database system cluster based on the transferred data and structure.
[0073] Specifically, analyze the data migration report to obtain the data structure characteristics and distribution parameters after the transfer; based on the identified data pattern types, classify and mark the multi-mode data in the domestic database system cluster to obtain the data pattern classification results; perform performance testing to identify the performance bottlenecks of the domestic database system cluster; formulate optimization strategies based on the data pattern classification results and performance bottlenecks, including performance optimization, data consistency optimization and security optimization; adjust the index structure of the domestic database system cluster according to the optimization strategy; based on the master-slave mode, implement the data distribution plan, and collect the performance indicators of the domestic database system cluster under load, including CPU utilization, memory usage, and I / O performance; adjust the data distribution plan according to the performance indicators to balance the load of the master and standby nodes; perform a comprehensive performance evaluation, compare the performance indicators before and after optimization, and adjust the optimization strategy according to the performance evaluation results.
[0074] Preferably, targeted multi-mode data optimization based on the actual data characteristics and distribution after the transfer can give full play to the performance advantages of domestic database systems. Through performance bottleneck analysis, index structure adjustment and data distribution optimization, the query efficiency and overall performance of the system can be significantly improved. At the same time, comprehensive performance evaluation and optimization strategy adjustment ensure the quantification and continuous improvement of optimization effects.
[0075] S5: Execute system switching and complete the transformation of the multi-mode database in Security Zone II.
[0076] Furthermore, the present embodiment also provides a multi-mode database transformation system for a safety zone II, including a multi-mode structure analysis module, which is used to perform multi-mode structure analysis on an existing database in the safety zone II, and generate a multi-mode structure framework and a data migration plan for a domestic database based on the analysis results; a database cluster construction module, which is used to build a domestic database system cluster on a safety zone II virtualization platform according to the multi-mode structure framework of the domestic database; a data migration execution module, which is used to transfer the data and structure in the existing database in the safety zone II to the domestic database system cluster according to the data migration plan, and perform multi-level data verification during the transfer process; a multi-mode data optimization module, which is used to perform multi-mode data optimization on the domestic database system cluster according to the transferred data and structure; a database adaptation layer module, which is used to build a database adaptation layer, so that the safety zone II business system can interact with the domestic database system cluster, perform system switching, and complete the transformation of the multi-mode database in the safety zone II.
[0077] This embodiment also provides a computer device, which is suitable for the situation of the multi-mode database transformation method of the security zone II, including a memory and a processor; the memory is used to store computer executable instructions, and the processor is used to execute computer executable instructions to implement the multi-mode database transformation method of the security zone II proposed in the above embodiment.
[0078] The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.
[0079] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, the method for realizing the transformation of the multi-mode database of the security zone II as proposed in the above embodiment is implemented.
[0080] In summary, the present invention realizes efficient and reliable migration from the existing database to the domestic database through multi-dimensional analysis and optimization. First, the present invention ensures the adaptability and efficiency of the new database structure through multi-mode structural analysis and optimization framework design. Secondly, the virtualized cluster deployment in master-slave mode improves the availability and reliability of the system. Thirdly, the multi-level data verification mechanism and real-time synchronization strategy ensure the accuracy and consistency of data migration. Finally, the multi-mode data optimization based on actual data characteristics significantly improves the system performance. Overall, the present invention not only realizes the safe and controllable domestic transformation of the database, but also improves the overall performance and availability of the system through a series of optimization measures.
[0081] Example 2
[0082] Reference Figure 1 to Figure 3 , which is the second embodiment of the present invention, and this embodiment provides a method for transforming a multi-mode database in a security zone II. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through economic benefit calculation and simulation experiments.
[0083] A large financial institution decided to transform its database system in Security Zone II into a localized one. The existing system contained about 120TB of data, involving more than 1,500 tables, and mainly used Oracle and MySQL databases.
[0084] The first step of the transformation is to conduct a multi-mode structural analysis of the existing database. By collecting metadata information, the team identified that 85% of the data is suitable for relational mode, 10% is suitable for document mode, 4% is suitable for graph mode, and 1% is suitable for key-value mode. Multi-dimensional evaluation shows that the query performance score of relational data is 7.8 / 10, document type is 7.2 / 10, graph type is 8.5 / 10, and key-value type is 9.0 / 10. The team designed the initial domestic database multi-mode structural framework, and through 3 rounds of iterative optimization, the structural adaptability score was increased from the initial 0.68 to 0.82.
[0085] Next, the team built a domestic database system cluster consisting of 1 master node and 2 backup nodes on the virtualization platform. Each node is equipped with a 32-core CPU, 256GB memory and 8TB SSD storage. Through load balancing testing, the throughput of read operations increased by 22%, and the overall system availability reached 99.95%.
[0086] Data migration was then carried out. The team used four high-performance servers for parallel processing and completed 92% of the data batch migration within 96 hours, with an average transmission speed of 320MB / s. The remaining 8% of real-time business data was migrated through an incremental synchronization mechanism, with latency controlled within 800ms. Multi-level data verification showed that data integrity reached 99.998%, structural consistency was 99.99%, and about 0.1% of business logic needed to be adjusted.
[0087] After the data migration was completed, the team optimized the multi-mode data of the domestic database system cluster. By adjusting the index structure and implementing an intelligent data distribution solution, performance of different data modes was improved. The optimization results are shown in Table 1.
[0088] Table 1 Optimization effects of different data modes
[0089] Data Mode Data share (%) Query performance improvement (%) Rating before optimization (10 points) Optimized score (10 points) Relational 85 15 7.8 9.0 Document Type 10 12 7.2 8.1 Graphical 4 18 8.5 9.7 Key-value 1 10 9.0 9.6
[0090] These optimizations have reduced the system's CPU usage to 78% under simulated peak load, stabilized memory usage at 85%, and reduced I / O wait time by 25%. The query performance of various data modes has been significantly improved, especially for relational data, which accounts for a large proportion, and graph data, which has the most significant performance improvement, making an important contribution to improving the overall system performance.
[0091] Finally, the team adopted a grayscale release strategy to switch the system. First, 15% of non-critical businesses were migrated, and after 3 weeks of stable operation, 40% of regular businesses were migrated. After resolving some compatibility issues, the final 45% of core businesses were switched over two weekends. The entire switching process took 6 weeks, during which the business interruption time was controlled within 8 hours, which basically met the requirements of financial supervision.
[0092] After the transformation was completed, the team conducted a comprehensive performance evaluation of the new system. The evaluation results are shown in Table 2.
[0093] Table 2 System performance comparison before and after data migration
[0094] Performance Indicators Before Migration After Migration Average response time (ms) 180 140 Peak processing capacity (TPS) 40000 50000 CPU usage (%) 85 78 Memory usage (%) 90 85 System availability (%) 88 95
[0095] These data show that the new system has significantly improved in many key indicators. The reduction in average response time and the increase in peak processing capacity directly improve the user experience. The optimization of resource utilization and the reduction of operation and maintenance costs have brought substantial economic benefits to the organization. This localization transformation not only improves system performance, but also lays the foundation for subsequent business expansion and technological innovation.
[0096] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.
Claims
1. A method for transforming a multi-mode database in a security zone II, characterized in that: include, Perform multi-mode structural analysis on the existing database in Security Zone II, and generate a multi-mode structural framework and data migration plan for the domestic database based on the analysis results; According to the domestic database multi-mode structure framework, a domestic database system cluster is constructed on the security zone II virtualization platform; According to the data migration plan, the data and structure of the existing database in the security zone II are transferred to the domestic database system cluster; performing multi-mode data optimization on the domestic database system cluster according to the transferred data and structure; Execute system switching and complete the transformation of the multi-mode database in Security Zone II.
2. The method for transforming the multi-mode database of security zone II as claimed in claim 1, characterized in that: The domestic database multi-mode structure framework and data migration plan are generated based on the analysis results: Analyze the metadata information of the existing database in the security zone II by using a data structure analysis algorithm to identify the data pattern type and structural characteristics of the existing database; Constructing a multi-dimensional evaluation matrix, and using the multi-dimensional evaluation matrix to quantitatively evaluate the structural characteristics of different data pattern types in the existing database to obtain a multi-dimensional evaluation result; Design an initial domestic database multi-mode structure framework, map the data model types in the existing database to the domestic database multi-mode structure framework, and generate an initial model mapping table; Based on the multi-dimensional evaluation results and the initial mode mapping table, the initial domestic database multi-mode structural framework is adjusted and optimized to obtain an optimized domestic database multi-mode structural framework; Formulate a data migration strategy from the existing database to the domestic database and generate a data migration plan; Output the optimized domestic database multi-mode structure framework and the data migration plan.
3. The method for transforming the multi-mode database of security zone II as claimed in claim 2, characterized in that: The adjustment and optimization of the initial domestic database multi-mode structure framework includes the following steps: Analyze the multi-dimensional evaluation results and extract the structural feature scores of each data pattern type; Based on the initial mode mapping table, the mapping matching degree of the existing database mode to the initial domestic database multi-mode structure framework is calculated; Constructing a structural adaptability evaluation function, wherein the structural adaptability evaluation function comprehensively considers the structural feature score and the mapping matching degree; The heuristic algorithm is used to iteratively optimize the multi-mode structural framework of the initial domestic database to maximize the structural adaptability evaluation function.
4. The method for transforming the multi-mode database of security zone II as claimed in claim 3, characterized in that: The specific formula of the structural adaptability evaluation function is as follows: S A =ω1*∑(S i *W i )+ω2*M Among them, S A Score for structural adaptability, S i Score the structural features of the i-th data pattern type, W i is the weight of the i-th data pattern type, M is the mapping matching degree, and ω1 and ω2 are weight factors.
5. The method for transforming the multi-mode database of security zone II as claimed in claim 2, characterized in that: The generating data migration plan comprises the following steps: Based on metadata information, classify and count the data objects in the existing database and generate a data object migration list; Design preliminary migration process for each type of data object; According to the multi-dimensional evaluation results, the migration priorities are assigned to the data objects and a migration priority matrix is constructed; Based on the optimized domestic database multi-mode structure framework and updated mode mapping table, a set of heterogeneous data structure conversion rules is formulated; Designing a batch data migration module, wherein the batch data migration module is used to perform initial large-scale data migration; Developing an incremental data synchronization module, which interfaces with the second data synchronization mechanism to capture real-time data changes during the migration process; Formulate a multi-level data verification mechanism, which includes data integrity verification, structural consistency verification, and business logic verification; Build a migration rollback mechanism to provide a data fallback solution in case of migration failure; The data migration components are systematically organized to form a data migration framework and formulate a data migration plan; the data migration components include a data object migration list, a migration processing flow, a heterogeneous data structure conversion rule set, a batch data migration module, an incremental data synchronization module, a data verification mechanism, and a migration rollback mechanism.
6. The method for transforming the multi-mode database of security zone II as claimed in claim 1, characterized in that: The transfer of data and structure from the existing database in the security zone II to the domestic database system cluster according to the data migration plan includes the following steps: Generate a data migration execution plan according to the data migration plan; Extracting and converting the data to be migrated from the existing database to obtain a migration data file; Use a batch import tool to load the migration data file into the master node of the domestic database system cluster; configuring a second data synchronization mechanism, capturing data changes of the existing database in real time through the second data synchronization mechanism, and applying the data changes to the domestic database system cluster; Apply a multi-level data verification mechanism to compare the data in the existing database with the data in the domestic database system cluster, and perform data integrity verification, structure consistency verification and business logic verification; The domestic database system cluster operates in an active-standby mode.
7. The method for transforming the multi-mode database of security zone II as claimed in claim 1, characterized in that: The performing of multi-mode data optimization on the domestic database system cluster comprises the following steps: Analyze the data migration report to obtain the structural characteristics and distribution parameters of the data after the transfer; Based on the identified data pattern types, classify and label the multi-mode data in the domestic database system cluster to obtain data pattern classification results; Perform performance testing to identify the performance bottlenecks of the domestic database system cluster; Formulate an optimization strategy based on the data pattern classification results and the performance bottlenecks; According to the optimization strategy, adjusting the index structure of the domestic database system cluster; Based on the master-slave mode, implement the data distribution plan and collect the performance indicators of the domestic database system cluster under load; The data distribution scheme is adjusted according to the performance indicator.
8. A security zone II multi-mode database transformation system, based on the security zone II multi-mode database transformation method according to any one of claims 1 to 7, characterized in that: Also includes, Multi-mode structural analysis module, used to perform multi-mode structural analysis on the existing database in Security Zone II, and generate a multi-mode structural framework and data migration plan for the domestic database based on the analysis results; A database cluster construction module, used to construct a domestic database system cluster on a security zone II virtualization platform according to the domestic database multi-mode structure framework; A data migration execution module, used to transfer the data and structure in the existing database in the security zone II to the domestic database system cluster according to the data migration plan, and perform multi-level data verification during the transfer process; A multi-mode data optimization module, used for performing multi-mode data optimization on the domestic database system cluster according to the transferred data and structure; The database adaptation layer module is used to build a database adaptation layer, so that the business system of the security zone II can interact with the domestic database system cluster, perform system switching, and complete the transformation of the multi-mode database of the security zone II.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method for transforming the multi-mode database of the security zone II described in any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for transforming the multi-mode database of the security zone II described in any one of claims 1 to 7 are implemented.