73 results about "Tablespace" patented technology

The invention discloses a database performance optimization method based on partition management. The database performance optimization method comprises database storage optimization and key query table efficiency optimization. The database storage optimization comprises the steps of confirming the partition data volume and creating a corresponding partition large file table space; verifying whether the table can be partitioned; creating a temporary table which is the same as the original table, and creating partitions and partition names according to company column values; copying the data to a temporary table; copying the dependent object; partitioning the original table according to a list rule, and emptying data in the original table; synchronizing the data, the trigger and the index information in the temporary table to the partitioned original table; checking whether the partitioned data is consistent or not, verifying whether front-end query is influenced or not, checking index parameters, adopting the database optimization method, dividing the data into a plurality of partitions, mapping key large table data into different partition tables, reducing the data size of a single table, improving the efficiency and availability of the system and ensuring the stability and reliability of the system.

The invention relates to the technical field of database storage optimization, and provides an openGauss database external table space compression backup and recovery method and system.The method comprises the steps that an external table space catalog is recognized, and data files meeting compression conditions in the external table space catalog are screened and marked; performing full-amount or incremental compression backup on the data files meeting the compression conditions according to the compression attributes; and when the compressed data of the external table space needs to be recovered, recovering the file by adopting a corresponding sequence according to the category of the compressed backup data. According to the compression backup and recovery method and system for the external table space of the openGauss database, the full-amount and incremental compression backup function of the external table space data of the openGauss database can be achieved, and the compression backup efficiency and accuracy are improved.

The embodiment of the invention provides a method and device for determining the fragment rate of a distributed database, equipment and a medium. The method comprises the following steps: determining a target query parameter corresponding to a target distributed database instance according to a first interface; and then, according to the target query parameter, sending a spatial distribution query request to a second interface of a distributed database proxy device of the distributed database system, and obtaining spatial distribution information of the target table space returned by the second interface. And finally, according to the spatial distribution information of the target table space, determining the fragment rate of the target table space. Wherein the target query parameter comprises an identifier of at least one target fragment corresponding to the target distributed database instance, query parameters corresponding to different distributed database instances are packaged in the first interface, and a native interface of the distributed database cluster is packaged in the second interface. According to the technical scheme, the efficiency and safety of determining the fragment rate of the target table space are ensured.

The invention provides an SaaS tenant customized service method, and relates to the technical field of software as a service system architecture.The method comprises the steps that an independent database or table space is generated through a tenant identifier, configuration parameters are converted into JSON metadata in combination with a graphical tool and stored, and lightweight customization is achieved; according to the deep customization request, an independent server or container instance is distributed for a tenant, personalized codes are deployed, and the personalized codes and standard codes are separated for running through a dynamic loading mechanism; generating a unique second-level domain name based on the tenant identifier, and routing the request to a corresponding service node through DNS analysis and reverse proxy; and the standard tenants are supported to migrate to the customized tenants, configuration and service data are synchronized to a target instance, domain name resolution and proxy configuration are updated, and seamless switching of service paths is realized.

The invention is suitable for the technical field of shared clusters, and particularly relates to a recycle bin management method, a data space flashback method, a device, equipment and a medium. When deletion operation is carried out on the table space, the database objects belonging to the table space are moved into a database recycle bin, and when deletion marking is carried out on meta-information of data files contained in the table space, the data files are moved into a shared cluster file system recycle bin, and deletion marking is carried out on the meta-information of the table space. And when the table space is flashed back, if the to-be-flashed data file corresponding to the to-be-flashed table space is not cleared, recovering the to-be-flashed data file from the shared cluster file system recycle bin, clearing the deletion mark of the meta information of the to-be-flashed data file, and recovering the to-be-flashed database object corresponding to the to-be-flashed table space from the database recycle bin. And removing the deletion mark of the meta-information of the to-be-flashed-back table space. Through a database recycle bin management mechanism and a shared cluster file system recycle bin management mechanism, the table space recovery efficiency is improved.

The disclosed embodiment discloses a method, device, equipment and product for online large object data migration in a database, including: updating the initial large object segment address in the table dictionary of the table to be operated to the target large object segment address; determining the large object data to be migrated based on the row to be operated and the initial row header information of the table to be operated; the row to be operated needs to perform large object data migration; blocking the large object to be migrated based on the large object unique identifier; the large object to be migrated includes the large object data to be migrated and the initial row header information; based on the initial row header information, copying the large object data to be migrated to the target table space corresponding to the target large object segment address, and updating the initial row header information; submitting the DDL transaction of the large object data migration, and releasing the initial table space. The technical solution provided by this embodiment allows other concurrent transactions to perform concurrent DML operations on the table during the large object migration process, eliminating the performance bottleneck of large object data migration.

The invention relates to a database fault recovery method and device, a storage medium and electronic equipment. The method comprises the steps that when a database normally runs, a WAL log is written into a disk, and meanwhile, a log record is pre-analyzed through a background asynchronous thread to extract core semantic information of the log record; constructing a cache structure sorted according to table space identifiers and data page numbers in the shared memory, and storing the core semantic information in the cache structure in a recovery-oriented compact format; when the check point is executed, the memory dirty page is flashed to a disk, and the cache initial position corresponding to the check point in the cache structure serves as metadata to be written into a control file; and after the database crashes and is restarted, acquiring a cache initial position from the control file, loading all core semantic information entries behind the cache initial position in the cache structure according to the cache initial position, positioning a target data page, and modifying the target data page. The technical problem that an existing database collapse recovery technology is low in recovery speed is solved.

The application is suitable for the technical field of artificial intelligence security, and provides a jailbreaking security evaluation method and system based on dictionary guided sparse logic editing, which comprises the following steps: first, generating a static intensity vector; then, intercepting an original logit vector corresponding to each autoregressive decoding time step of a target large language model, and generating a dynamic gating signal based on the original logit vector; meanwhile, constructing a preliminary sparse intervention vector from the static intensity vector; and then, generating a modified adversarial logit vector based on the preliminary sparse intervention vector, so as to obtain response content for evaluating security. Through the application of extremely sparse local logic editing based on temperature scaling and trust region constraints in the vocabulary space, the high computing power overhead of traditional gradient attacks and the auxiliary model memory overhead of traditional logic intervention methods can be completely eliminated, and efficient, smooth, interpretable and robust large model jailbreaking security evaluation can be realized.

Methods and apparatuses for creating a tablespace, storage media, and electronic devices are disclosed. The method includes: receiving a tablespace creation instruction; determining, in a distributed database based on an identifier of a server carried in the creation instruction, the server corresponding to the identifier as a specified server; based on a capacity for creating a tablespace carried in the creation instruction and a remaining storage space of the specified server, determining a storage space whose total capacity is the capacity; creating a virtual file based on the determined storage space; and creating a tablespace including the virtual file.

The application relates to the technical field of data processing, and discloses a SQL-based column segmentation method, device, equipment and storage medium, which comprises the following steps: obtaining a to-be-divided string, and sorting different text data in the to-be-divided string; saving the sorted string to a first temporary table space of a database, obtaining the number of substrings of the text data of the sorted string in the first temporary table space; dividing the text data according to the number of substrings to obtain divided text data; performing a column-to-row operation on the multiple substrings in the divided text data respectively, so that each column comprises one substring; saving the substrings and the corresponding number of times of the substrings to a second temporary table space of the database, sorting the substrings according to the corresponding number of times of the substrings to obtain a segmentation result. The application can be applied to the data processing of financial technology and medical health, can avoid increasing the complexity of a database management system, and can reduce the configuration and maintenance cost of the database.

The present invention relates to a multi-database environment operation and maintenance method and system. Operation and maintenance scripts are set and classified according to different databases and different operation and maintenance operations. The operation and maintenance scripts to be adopted are automatically matched for database operation and maintenance requests. Authority management is performed according to business system administrators, who can submit relevant operation and maintenance operation requirements, such as table space expansion, database and table construction, parameter optimization, etc. for Oracle, MySQL, and Redis. An automatic operation and maintenance platform for daily database products including general parameters, table spaces, data migration, etc. is provided, so as to save manpower and resource costs, improve operation and maintenance efficiency, provide strong scalability, and facilitate the access of more database products in the future.

The present application relates to the technical field of network chip, and particularly relates to a flow table aging method, device, equipment and program product, the method comprises: obtaining a target flow table to be managed, and representing the activation state of each table entry in the target flow table by a binary bitmap configured by hardware logic; timing polling the binary bitmap to identify and delete the inactivated table entry in the target flow table; when there is a new table entry in the target flow table, according to the table entry occupation of the hash bucket corresponding to the new table entry and the value of the overlay permission control bit carried by the new table entry, it is decided whether to overlay the inactivated table entry with the same hash address as the new table entry in the target flow table. The present application improves the flow table space utilization, and can effectively cope with the table entry management demand under the high-speed network environment.

A system, method, and computer program product are configured to: provide a tablespace comprising an original partition having a lower boundary L, an upper boundary U, a split percentage P, and a split ratio R; and in response to the original partition reaching a fullness of P, automatically split the original partition to a first progeny partition and a second progeny partition, wherein the first progeny partition has a lower boundary L1 that is the same as the lower boundary L of the original partition and an upper boundary U1 that is determined based on whether the insert is a sequential or random insert, and wherein the second progeny partition has an upper boundaries U2 that is the same as the upper boundary U of the original partition and a lower boundary L2 that is determined based on whether the insert is a sequential or random insert.

The invention discloses a database transparent encryption method and device, equipment and a storage medium, and relates to the technical field of information security, and the method comprises the steps: creating a target table space, and generating a table space key corresponding to the target table space; wherein the target table space is an encrypted table space encrypted based on a preset encryption algorithm; migrating the target plaintext table to the target table space, and performing block processing on plaintext data corresponding to the target plaintext table based on a preset block condition to obtain a plurality of plaintext blocks; determining a ciphertext of a file master key corresponding to the plaintext data according to the table space key, and respectively generating a file verification key and a file encryption key based on the file master key; and determining a target ciphertext block corresponding to the plaintext block based on the file encryption key, and calculating a target verification value of the target ciphertext block according to the file verification key so as to determine a target encrypted file corresponding to the plaintext data based on the ciphertext, the target ciphertext block and the target verification value. According to the invention, data transparent encryption with universality can be realized.

This invention discloses an adaptive SFTO attack detection and mitigation method based on flow entry number prediction, belonging to the field of network security. The method includes: real-time monitoring and sliding collection of flow table entry numbers on an SDN switch; predicting the flow entry number using an LRCN model; if the predicted flow entry number for the next two seconds reaches a threshold, collecting flow table information and calculating octal flow table statistical features; determining whether the flow table is under attack based on the attack probability output by the LightGBM classification model; if an attack is detected, adaptively calculating an expulsion ratio based on the attack probability and the predicted flow entry number for the next second; and expelling flow entries sorted by the LightGBM sorting model based on this ratio to free up flow table space and prevent overflow. This method can monitor and predict the flow entry number of an SDN switch in real time, accurately detect SFTO attacks, and execute proactive defense strategies. It has a low false positive and false negative rate and can adaptively expel attacking flow entries to prevent flow table overflow. Therefore, this method can effectively detect and mitigate SFTO attacks.

The invention provides a data processing method and device for a relational memory database. The method comprises the steps of obtaining two groups of check point files and initialization variables corresponding to a memory table space in a relational memory database; obtaining an active file group and a static file group according to the two groups of check point files and the initialization variable; according to the initialization variable, alternately writing dirty pages generated in the operation process of the relational memory database into the active file group and the static file group to obtain an updated active file group and an updated static file group; performing disk mapping processing according to the updated active file group and the updated static file group to obtain target disk data; and performing data recovery according to a data recovery request and the target disk data. According to the method, the security and stability of the system are improved, and the data recovery efficiency and accuracy can be improved when the system crashes.

The present application provides a flow table offloading system, device, and cluster. The system includes: a host, configured to offload a first flow table entry to the flow table space of the offloading hardware and offload first pushing information to the tunnel mirroring space of the offloading hardware, where the first flow table entry includes a first matching item and a first action item, the first action item includes a first index, the first index is associated with the first pushing information, and the first pushing information includes common information of a first tunnel packet header and a first mirror packet header; the offloading hardware is further configured to receive a first original packet, and when the packet header information of the first original packet matches the first matching item in the flow table space, obtain the first pushing information from the tunnel mirroring space according to the first index of the first action item, and add the first tunnel packet header and the first mirror packet header to the first original packet based on the first pushing information to obtain a first tunnel mirror packet.

Tables are selected based on timestamp columns to obtain tables changed during a given time period and the selected tables are split into data blocks based on given partition ranges. Changes to data of the data blocks are incrementally copied into datasets. One or more tablespaces identified using a first structured query language query corresponding to a specified timestamp are unloaded based on output of the incrementally copying changes operation. Data of a source site and a target site are compared based on data blocks having the specified timestamp.

The present application provides a method, apparatus, device and medium for organizing a tablespace of a database, the method comprising: in response to a data table processing operation performed on the database, displaying a first data table and a first tablespace on the graphical user interface; the first data table includes a second data table containing a first fragmented tablespace; according to the first tablespace and a preset organization requirement, determining a third data table from the second data table; predicting that after organizing the third data table, the database includes a second tablespace, and according to the second tablespace and the preset organization requirement, determining a fourth data table from the second data table; when a preset start organization condition is met, organizing the third data table and the fourth data in sequence according to a preset organization method. The present application can help database administrators work more efficiently, reduce labor costs, and improve the efficiency of organizing the database.

The present application relates to a decryption method and apparatus for a data page, a computer device, a readable storage medium, and a program product. The method comprises: upon receiving an access request for accessing an encrypted target table, acquiring a master key, and a target value and a secondary key in a tablespace file corresponding to the target table, wherein the tablespace file comprises different data pages (202); acquiring a page identifier of a target data page among the data pages (204); on the basis of the page identifier and the target value, determining a target mode from among at least two candidate modes (206); and when the secondary key is decrypted using the master key so as to obtain a plaintext secondary key, decrypting the target data page on the basis of the target mode and the plaintext secondary key so as to obtain data corresponding to the target table (208).

The application discloses a table space moving method, device and equipment and a storage medium. The method comprises the following steps: obtaining a table space moving statement input by a user, wherein the table space moving statement is a database statement for moving a target table to a target table space; constructing an intermediate table according to the target table in the target table space, wherein the intermediate table has the same definition as a dependent object of the target table, and the intermediate table has the same structure as the target table; performing data dictionary exchange on the target table and the intermediate table; and migrating data in the intermediate table after the data dictionary exchange to the target table after the data dictionary exchange. Through the technical scheme, the efficiency of table space moving can be improved, and the complexity of table space moving can be reduced.

The invention discloses a method for smoothly migrating mass data based on an asynchronous queue mode. The method comprises the steps that S1, 16 tables are newly built in a main library; s2, establishing and adding a synchronization task monitoring original table database operation binary log; s3, exporting total data of the original table to generate a data file; s4, splitting the program into 16 files; s5, recharging the 16 split files into 16 tables of a backup library node; s6, importing a backup node table space into a tool library node; s7, importing a tool library node table space into a slave library node; s8, using the completed nodes to import the table space into the main library nodes; s9, starting a consumption program in the consumption queue to carry out historical message data consumption; by adopting the migration scheme, the data migration efficiency can be improved; by adopting the migration scheme, if an uncontrollable problem is encountered in the migration process, quick rollback can be carried out without online code modification of a task, so that the stability of an online system is ensured.

The invention provides a method for adjusting a second-level cache, a database system, equipment, a medium and a product, and the method for adjusting the second-level cache comprises the following steps: determining the size change of an effective data page stored in the second-level cache in response to the change of the storage state of a temporary table in the database system by the second-level cache; wherein the storage state comprises a state that the temporary table is written into the second-level cache or a state that the second-level cache releases the temporary table; and adjusting the memory capacity of the second-level cache based on the change of the storage state and the size change of the effective data page. According to the embodiment of the invention, automatic capacity expansion or automatic capacity shrinkage of the second-level cache can be realized, so that the sudden increase requirement of a temporary table space in a relational database system is met, and the waste of memory resources can be avoided, so that the performance of the database system is improved.

The invention relates to the technical field of network chips, in particular to a flow table aging method, device, equipment and program product, and the method comprises the steps: obtaining a to-be-managed target flow table, and representing the activation state of each table item in the target flow table through a binary bitmap configured by hardware logic; periodically polling the binary bitmap to identify and delete the non-activated table items in the target flow table; and when the target flow table has a newly-added table item, determining whether to cover an unactivated table item with the same hash address as the newly-added table item in the target flow table according to the table item occupation condition of the hash bucket corresponding to the newly-added table item and the value of the coverage permission control bit carried by the newly-added table item. According to the method, the flow table space utilization rate is improved, and table item management requirements in a high-speed network environment can be effectively met.

The invention provides a flow table unloading system, equipment and a cluster. The system comprises a host used for unloading a first flow table item to a flow table space of unloading hardware and unloading first press-in information to a tunnel mirror image space of the unloading hardware, the first flow table item comprises a first matching item and a first action item, the first action item comprises a first index, the first index is associated with the first press-in information, and the first matching item is matched with the first press-in information; the first press-in information comprises public information of a first tunnel message header and a first mirror image message header; the hardware unloading module is also used for receiving a first original message, acquiring first press-in information from a tunnel mirror image space according to a first index of a first action item under the condition that message header information of the first original message is matched with a first matching item in a flow table space, and sending the first press-in information to the flow table space; and adding a first tunnel message header and a first mirror image message header to the first original message based on the first press-in information to obtain a first tunnel mirror image message.

The invention relates to the technical field of multi-tenant system architecture, and discloses a multi-tenant resource isolation system and method. Comprising a meta-model driving layer which comprises a plurality of meta-models and a meta-model dynamic analysis engine, and the meta-model dynamic analysis engine is used for generating an SQL table structure and a business logic code according to a target meta-model selected by a tenant; the tenant configuration layer is used for a tenant to configure fields and processes of the target meta-model in the visual sandbox environment, and performing conflict detection and simulation running test when configuration of the target meta-model is updated; the resource isolation layer is used for distributing an independent container and an independent database for each tenant and carrying out dynamic quota management on CPU and memory resources of the containers; and the data storage layer creates an independent table space in the database of each tenant, and rewrites the initial query request based on the tenant ID in combination with the SQL routing middleware. According to the method and the device, data leakage and interference among the tenants can be prevented, and accurate data access in a multi-tenant environment is realized.

The present application discloses a method, device, and electronic device for monitoring tablespace fragmentation. The method comprises: obtaining a data directory under a database, traversing the data directory, and obtaining a target data directory that is not a system library directory; traversing the target data directory, and obtaining a target table data file under the target data directory; obtaining attribute information of the target table data file, and obtaining table information of the target table from a database instance of the database based on the attribute information, and determining whether the target table has tablespace fragmentation based on the table information. The present application no longer directly obtains tablespace fragmentation through a database system table, thus avoiding the problem of a serious performance bottleneck in the database when a large number of tables exist, and improving the efficiency and reliability of the process of monitoring tablespace fragmentation.

The application provides a table space storage capacity estimation method, device, equipment and medium. The method comprises the following steps: creating a temporary table in a target database according to the table structure of a source database table where to-be-loaded data is located, and loading sample data from the source database table to the temporary table; calculating the table space storage capacity occupied by the sample data in the temporary table, and calculating the number of the sample data; determining the attribute value of the sample data as the attribute value of the to-be-loaded data according to the table space storage capacity occupied by the sample data in the temporary table and the number of the sample data; estimating the number of the to-be-loaded data according to the sample data, and obtaining an estimated value of the number of the to-be-loaded data; and calculating an estimated value of the table space storage capacity occupied by the to-be-loaded data in the source database table according to the attribute value of the to-be-loaded data and the estimated value of the number of the to-be-loaded data. Therefore, the application can calculate the estimated value of the table space storage capacity occupied by the to-be-loaded data in the source database table.

The present invention belongs to the field of database optimization, and in particular to a multi-level query optimization method and system for a tree-structured database based on an AI model. The method first obtains tree-structured data, which is generated based on a distributed database and a configured table space directory, and includes multi-level nodes. The multi-level nodes include corresponding index information under each level of the nodes. Secondly, a query instruction is obtained, and the query instruction is parsed to obtain query index information corresponding to each level of the nodes, and the obtained query index information is optimized using a preset index information optimization library. Finally, according to the optimized query index information, data under the index information of each level of the nodes corresponding to the query index information is obtained from the tree-structured data through a configured dynamic query strategy to obtain a corresponding query data set. The present invention can effectively improve query efficiency and reduce query delay.

The invention provides a database fault detection method, device and equipment, a medium and a program product, and relates to the technical field of databases. The method comprises the following steps: under the condition that data is to be written into a target database, determining a table space in which the data is to be written in the target database, and obtaining operation parameters of the target database; the operation parameter comprises the residual capacity of the meter space; and determining whether the target database has a no-response fault risk or not based on the residual capacity. According to the method, risk prompting can be carried out before the non-response fault occurs, namely, the timeliness of non-response fault detection of the database is improved, delay or hysteresis does not exist when risk prompting is carried out in advance, it is ensured that the influence of the non-response fault of the database on a data writing task can be improved in time, and the reliability of data writing is improved. The non-response fault of the database is detected in time, so that the normal operation of the database is effectively maintained.