51 results about "Tablespace" patented technology

The invention discloses a database performance optimization method based on partition management. The database performance optimization method comprises database storage optimization and key query table efficiency optimization. The database storage optimization comprises the steps of confirming the partition data volume and creating a corresponding partition large file table space; verifying whether the table can be partitioned; creating a temporary table which is the same as the original table, and creating partitions and partition names according to company column values; copying the data to a temporary table; copying the dependent object; partitioning the original table according to a list rule, and emptying data in the original table; synchronizing the data, the trigger and the index information in the temporary table to the partitioned original table; checking whether the partitioned data is consistent or not, verifying whether front-end query is influenced or not, checking index parameters, adopting the database optimization method, dividing the data into a plurality of partitions, mapping key large table data into different partition tables, reducing the data size of a single table, improving the efficiency and availability of the system and ensuring the stability and reliability of the system.

The invention relates to the technical field of database storage optimization, and provides an openGauss database external table space compression backup and recovery method and system.The method comprises the steps that an external table space catalog is recognized, and data files meeting compression conditions in the external table space catalog are screened and marked; performing full-amount or incremental compression backup on the data files meeting the compression conditions according to the compression attributes; and when the compressed data of the external table space needs to be recovered, recovering the file by adopting a corresponding sequence according to the category of the compressed backup data. According to the compression backup and recovery method and system for the external table space of the openGauss database, the full-amount and incremental compression backup function of the external table space data of the openGauss database can be achieved, and the compression backup efficiency and accuracy are improved.

The invention provides an SaaS tenant customized service method, and relates to the technical field of software as a service system architecture.The method comprises the steps that an independent database or table space is generated through a tenant identifier, configuration parameters are converted into JSON metadata in combination with a graphical tool and stored, and lightweight customization is achieved; according to the deep customization request, an independent server or container instance is distributed for a tenant, personalized codes are deployed, and the personalized codes and standard codes are separated for running through a dynamic loading mechanism; generating a unique second-level domain name based on the tenant identifier, and routing the request to a corresponding service node through DNS analysis and reverse proxy; and the standard tenants are supported to migrate to the customized tenants, configuration and service data are synchronized to a target instance, domain name resolution and proxy configuration are updated, and seamless switching of service paths is realized.

The disclosed embodiment discloses a method, device, equipment and product for online large object data migration in a database, including: updating the initial large object segment address in the table dictionary of the table to be operated to the target large object segment address; determining the large object data to be migrated based on the row to be operated and the initial row header information of the table to be operated; the row to be operated needs to perform large object data migration; blocking the large object to be migrated based on the large object unique identifier; the large object to be migrated includes the large object data to be migrated and the initial row header information; based on the initial row header information, copying the large object data to be migrated to the target table space corresponding to the target large object segment address, and updating the initial row header information; submitting the DDL transaction of the large object data migration, and releasing the initial table space. The technical solution provided by this embodiment allows other concurrent transactions to perform concurrent DML operations on the table during the large object migration process, eliminating the performance bottleneck of large object data migration.

The invention relates to a database fault recovery method and device, a storage medium and electronic equipment. The method comprises the steps that when a database normally runs, a WAL log is written into a disk, and meanwhile, a log record is pre-analyzed through a background asynchronous thread to extract core semantic information of the log record; constructing a cache structure sorted according to table space identifiers and data page numbers in the shared memory, and storing the core semantic information in the cache structure in a recovery-oriented compact format; when the check point is executed, the memory dirty page is flashed to a disk, and the cache initial position corresponding to the check point in the cache structure serves as metadata to be written into a control file; and after the database crashes and is restarted, acquiring a cache initial position from the control file, loading all core semantic information entries behind the cache initial position in the cache structure according to the cache initial position, positioning a target data page, and modifying the target data page. The technical problem that an existing database collapse recovery technology is low in recovery speed is solved.

The application is suitable for the technical field of artificial intelligence security, and provides a jailbreaking security evaluation method and system based on dictionary guided sparse logic editing, which comprises the following steps: first, generating a static intensity vector; then, intercepting an original logit vector corresponding to each autoregressive decoding time step of a target large language model, and generating a dynamic gating signal based on the original logit vector; meanwhile, constructing a preliminary sparse intervention vector from the static intensity vector; and then, generating a modified adversarial logit vector based on the preliminary sparse intervention vector, so as to obtain response content for evaluating security. Through the application of extremely sparse local logic editing based on temperature scaling and trust region constraints in the vocabulary space, the high computing power overhead of traditional gradient attacks and the auxiliary model memory overhead of traditional logic intervention methods can be completely eliminated, and efficient, smooth, interpretable and robust large model jailbreaking security evaluation can be realized.

Methods and apparatuses for creating a tablespace, storage media, and electronic devices are disclosed. The method includes: receiving a tablespace creation instruction; determining, in a distributed database based on an identifier of a server carried in the creation instruction, the server corresponding to the identifier as a specified server; based on a capacity for creating a tablespace carried in the creation instruction and a remaining storage space of the specified server, determining a storage space whose total capacity is the capacity; creating a virtual file based on the determined storage space; and creating a tablespace including the virtual file.

The application relates to the technical field of data processing, and discloses a SQL-based column segmentation method, device, equipment and storage medium, which comprises the following steps: obtaining a to-be-divided string, and sorting different text data in the to-be-divided string; saving the sorted string to a first temporary table space of a database, obtaining the number of substrings of the text data of the sorted string in the first temporary table space; dividing the text data according to the number of substrings to obtain divided text data; performing a column-to-row operation on the multiple substrings in the divided text data respectively, so that each column comprises one substring; saving the substrings and the corresponding number of times of the substrings to a second temporary table space of the database, sorting the substrings according to the corresponding number of times of the substrings to obtain a segmentation result. The application can be applied to the data processing of financial technology and medical health, can avoid increasing the complexity of a database management system, and can reduce the configuration and maintenance cost of the database.

The present application relates to the technical field of network chip, and particularly relates to a flow table aging method, device, equipment and program product, the method comprises: obtaining a target flow table to be managed, and representing the activation state of each table entry in the target flow table by a binary bitmap configured by hardware logic; timing polling the binary bitmap to identify and delete the inactivated table entry in the target flow table; when there is a new table entry in the target flow table, according to the table entry occupation of the hash bucket corresponding to the new table entry and the value of the overlay permission control bit carried by the new table entry, it is decided whether to overlay the inactivated table entry with the same hash address as the new table entry in the target flow table. The present application improves the flow table space utilization, and can effectively cope with the table entry management demand under the high-speed network environment.

A system, method, and computer program product are configured to: provide a tablespace comprising an original partition having a lower boundary L, an upper boundary U, a split percentage P, and a split ratio R; and in response to the original partition reaching a fullness of P, automatically split the original partition to a first progeny partition and a second progeny partition, wherein the first progeny partition has a lower boundary L1 that is the same as the lower boundary L of the original partition and an upper boundary U1 that is determined based on whether the insert is a sequential or random insert, and wherein the second progeny partition has an upper boundaries U2 that is the same as the upper boundary U of the original partition and a lower boundary L2 that is determined based on whether the insert is a sequential or random insert.

The invention discloses a database transparent encryption method and device, equipment and a storage medium, and relates to the technical field of information security, and the method comprises the steps: creating a target table space, and generating a table space key corresponding to the target table space; wherein the target table space is an encrypted table space encrypted based on a preset encryption algorithm; migrating the target plaintext table to the target table space, and performing block processing on plaintext data corresponding to the target plaintext table based on a preset block condition to obtain a plurality of plaintext blocks; determining a ciphertext of a file master key corresponding to the plaintext data according to the table space key, and respectively generating a file verification key and a file encryption key based on the file master key; and determining a target ciphertext block corresponding to the plaintext block based on the file encryption key, and calculating a target verification value of the target ciphertext block according to the file verification key so as to determine a target encrypted file corresponding to the plaintext data based on the ciphertext, the target ciphertext block and the target verification value. According to the invention, data transparent encryption with universality can be realized.

This invention discloses an adaptive SFTO attack detection and mitigation method based on flow entry number prediction, belonging to the field of network security. The method includes: real-time monitoring and sliding collection of flow table entry numbers on an SDN switch; predicting the flow entry number using an LRCN model; if the predicted flow entry number for the next two seconds reaches a threshold, collecting flow table information and calculating octal flow table statistical features; determining whether the flow table is under attack based on the attack probability output by the LightGBM classification model; if an attack is detected, adaptively calculating an expulsion ratio based on the attack probability and the predicted flow entry number for the next second; and expelling flow entries sorted by the LightGBM sorting model based on this ratio to free up flow table space and prevent overflow. This method can monitor and predict the flow entry number of an SDN switch in real time, accurately detect SFTO attacks, and execute proactive defense strategies. It has a low false positive and false negative rate and can adaptively expel attacking flow entries to prevent flow table overflow. Therefore, this method can effectively detect and mitigate SFTO attacks.

The invention provides a data processing method and device for a relational memory database. The method comprises the steps of obtaining two groups of check point files and initialization variables corresponding to a memory table space in a relational memory database; obtaining an active file group and a static file group according to the two groups of check point files and the initialization variable; according to the initialization variable, alternately writing dirty pages generated in the operation process of the relational memory database into the active file group and the static file group to obtain an updated active file group and an updated static file group; performing disk mapping processing according to the updated active file group and the updated static file group to obtain target disk data; and performing data recovery according to a data recovery request and the target disk data. According to the method, the security and stability of the system are improved, and the data recovery efficiency and accuracy can be improved when the system crashes.

The present application provides a flow table offloading system, device, and cluster. The system includes: a host, configured to offload a first flow table entry to the flow table space of the offloading hardware and offload first pushing information to the tunnel mirroring space of the offloading hardware, where the first flow table entry includes a first matching item and a first action item, the first action item includes a first index, the first index is associated with the first pushing information, and the first pushing information includes common information of a first tunnel packet header and a first mirror packet header; the offloading hardware is further configured to receive a first original packet, and when the packet header information of the first original packet matches the first matching item in the flow table space, obtain the first pushing information from the tunnel mirroring space according to the first index of the first action item, and add the first tunnel packet header and the first mirror packet header to the first original packet based on the first pushing information to obtain a first tunnel mirror packet.

Tables are selected based on timestamp columns to obtain tables changed during a given time period and the selected tables are split into data blocks based on given partition ranges. Changes to data of the data blocks are incrementally copied into datasets. One or more tablespaces identified using a first structured query language query corresponding to a specified timestamp are unloaded based on output of the incrementally copying changes operation. Data of a source site and a target site are compared based on data blocks having the specified timestamp.

The present application provides a method, apparatus, device and medium for organizing a tablespace of a database, the method comprising: in response to a data table processing operation performed on the database, displaying a first data table and a first tablespace on the graphical user interface; the first data table includes a second data table containing a first fragmented tablespace; according to the first tablespace and a preset organization requirement, determining a third data table from the second data table; predicting that after organizing the third data table, the database includes a second tablespace, and according to the second tablespace and the preset organization requirement, determining a fourth data table from the second data table; when a preset start organization condition is met, organizing the third data table and the fourth data in sequence according to a preset organization method. The present application can help database administrators work more efficiently, reduce labor costs, and improve the efficiency of organizing the database.

The present application relates to a decryption method and apparatus for a data page, a computer device, a readable storage medium, and a program product. The method comprises: upon receiving an access request for accessing an encrypted target table, acquiring a master key, and a target value and a secondary key in a tablespace file corresponding to the target table, wherein the tablespace file comprises different data pages (202); acquiring a page identifier of a target data page among the data pages (204); on the basis of the page identifier and the target value, determining a target mode from among at least two candidate modes (206); and when the secondary key is decrypted using the master key so as to obtain a plaintext secondary key, decrypting the target data page on the basis of the target mode and the plaintext secondary key so as to obtain data corresponding to the target table (208).

The application discloses a table space moving method, device and equipment and a storage medium. The method comprises the following steps: obtaining a table space moving statement input by a user, wherein the table space moving statement is a database statement for moving a target table to a target table space; constructing an intermediate table according to the target table in the target table space, wherein the intermediate table has the same definition as a dependent object of the target table, and the intermediate table has the same structure as the target table; performing data dictionary exchange on the target table and the intermediate table; and migrating data in the intermediate table after the data dictionary exchange to the target table after the data dictionary exchange. Through the technical scheme, the efficiency of table space moving can be improved, and the complexity of table space moving can be reduced.

The invention provides a method for adjusting a second-level cache, a database system, equipment, a medium and a product, and the method for adjusting the second-level cache comprises the following steps: determining the size change of an effective data page stored in the second-level cache in response to the change of the storage state of a temporary table in the database system by the second-level cache; wherein the storage state comprises a state that the temporary table is written into the second-level cache or a state that the second-level cache releases the temporary table; and adjusting the memory capacity of the second-level cache based on the change of the storage state and the size change of the effective data page. According to the embodiment of the invention, automatic capacity expansion or automatic capacity shrinkage of the second-level cache can be realized, so that the sudden increase requirement of a temporary table space in a relational database system is met, and the waste of memory resources can be avoided, so that the performance of the database system is improved.

The invention relates to the technical field of network chips, in particular to a flow table aging method, device, equipment and program product, and the method comprises the steps: obtaining a to-be-managed target flow table, and representing the activation state of each table item in the target flow table through a binary bitmap configured by hardware logic; periodically polling the binary bitmap to identify and delete the non-activated table items in the target flow table; and when the target flow table has a newly-added table item, determining whether to cover an unactivated table item with the same hash address as the newly-added table item in the target flow table according to the table item occupation condition of the hash bucket corresponding to the newly-added table item and the value of the coverage permission control bit carried by the newly-added table item. According to the method, the flow table space utilization rate is improved, and table item management requirements in a high-speed network environment can be effectively met.

The invention relates to the technical field of multi-tenant system architecture, and discloses a multi-tenant resource isolation system and method. Comprising a meta-model driving layer which comprises a plurality of meta-models and a meta-model dynamic analysis engine, and the meta-model dynamic analysis engine is used for generating an SQL table structure and a business logic code according to a target meta-model selected by a tenant; the tenant configuration layer is used for a tenant to configure fields and processes of the target meta-model in the visual sandbox environment, and performing conflict detection and simulation running test when configuration of the target meta-model is updated; the resource isolation layer is used for distributing an independent container and an independent database for each tenant and carrying out dynamic quota management on CPU and memory resources of the containers; and the data storage layer creates an independent table space in the database of each tenant, and rewrites the initial query request based on the tenant ID in combination with the SQL routing middleware. According to the method and the device, data leakage and interference among the tenants can be prevented, and accurate data access in a multi-tenant environment is realized.

The present application discloses a method, device, and electronic device for monitoring tablespace fragmentation. The method comprises: obtaining a data directory under a database, traversing the data directory, and obtaining a target data directory that is not a system library directory; traversing the target data directory, and obtaining a target table data file under the target data directory; obtaining attribute information of the target table data file, and obtaining table information of the target table from a database instance of the database based on the attribute information, and determining whether the target table has tablespace fragmentation based on the table information. The present application no longer directly obtains tablespace fragmentation through a database system table, thus avoiding the problem of a serious performance bottleneck in the database when a large number of tables exist, and improving the efficiency and reliability of the process of monitoring tablespace fragmentation.

The application provides a table space storage capacity estimation method, device, equipment and medium. The method comprises the following steps: creating a temporary table in a target database according to the table structure of a source database table where to-be-loaded data is located, and loading sample data from the source database table to the temporary table; calculating the table space storage capacity occupied by the sample data in the temporary table, and calculating the number of the sample data; determining the attribute value of the sample data as the attribute value of the to-be-loaded data according to the table space storage capacity occupied by the sample data in the temporary table and the number of the sample data; estimating the number of the to-be-loaded data according to the sample data, and obtaining an estimated value of the number of the to-be-loaded data; and calculating an estimated value of the table space storage capacity occupied by the to-be-loaded data in the source database table according to the attribute value of the to-be-loaded data and the estimated value of the number of the to-be-loaded data. Therefore, the application can calculate the estimated value of the table space storage capacity occupied by the to-be-loaded data in the source database table.

The invention provides a database fault detection method, device and equipment, a medium and a program product, and relates to the technical field of databases. The method comprises the following steps: under the condition that data is to be written into a target database, determining a table space in which the data is to be written in the target database, and obtaining operation parameters of the target database; the operation parameter comprises the residual capacity of the meter space; and determining whether the target database has a no-response fault risk or not based on the residual capacity. According to the method, risk prompting can be carried out before the non-response fault occurs, namely, the timeliness of non-response fault detection of the database is improved, delay or hysteresis does not exist when risk prompting is carried out in advance, it is ensured that the influence of the non-response fault of the database on a data writing task can be improved in time, and the reliability of data writing is improved. The non-response fault of the database is detected in time, so that the normal operation of the database is effectively maintained.

The invention provides an automatic release method based on a database table space. The method comprises the following steps: maintaining table space information in real time; screening a table space release list based on the voidage of the database; filtering a table space release list based on a deleted data total amount threshold; formulating a table space release strategy based on the load states of the disk, the CPU and the memory and the table space release list; releasing the table space based on a table space release strategy; based on the analysis trend or mutual exclusion, the priority of the table space release task is dynamically adjusted, or the table space release task is dormant. The method has the advantages that table space release is more intelligent, more efficient and more flexible, when the void rate reaches the threshold value, space release is automatically carried out, a proper release strategy is selected according to the current system resource condition, and release operation self-adjustment is carried out according to the actual service condition.

This application discloses a data synchronization method, apparatus, electronic device, and storage medium. The method includes: scanning a linked list of data pages in a cache instance of a master database; determining a set of page numbers corresponding to each tablespace identifier based on the tablespace identifier and page number corresponding to each data page in the linked list; determining the target data record range of the tablespace corresponding to each tablespace identifier in the master data file based on the set of page numbers corresponding to each tablespace identifier; generating cache status information of the master database based on the target data record range of the tablespace corresponding to each tablespace identifier in the master data file; determining the data page to be loaded that matches the cache status information in the slave data file; and loading the data page to be loaded into the cache of the slave database. This application can accurately, quickly, and proactively recover cached data of the master database from the slave database, ensuring a rapid response to user read and write requests after HA occurs and avoiding a decrease in system access performance.

This application provides a method, system, and device for automatic tablespace reclamation in a PostgreSQL database, belonging to the field of database technology. The method includes: obtaining business attribute tags of a target data table and determining a first reclamation trigger threshold based on the business attribute tags; real-time collection of dynamic indicators of the target data table; wherein the dynamic indicators include at least the frequency of insert operations and the frequency of update operations per unit time; determining the space reuse probability value of dead tuples in the target data table based on the dynamic indicators; dynamically adjusting the first reclamation trigger threshold based on a preset piecewise linear adjustment function and the space reuse probability value to determine a corresponding second reclamation trigger threshold; when the space fragmentation rate of the target data table is greater than the second reclamation trigger threshold, matching the corresponding reclamation operation according to the relationship between the space reuse probability value and a preset diversion threshold; wherein the preset diversion threshold is used to distinguish different reclamation operations.

The present disclosure provides a database storage space optimization method, which can be applied to the fields of finance and computer technology. The database storage space optimization method comprises: obtaining storage information of table spaces in a database, wherein the storage information comprises fragmentation space information of the table spaces; determining a first fragmentation rate of the database according to the fragmentation space information of each table space; generating a database sequence in the order of the size of the first fragmentation rate of each database among N databases, wherein N is greater than or equal to 1; determining M target databases from the N databases according to the database sequence, wherein N is greater than or equal to M and M is greater than or equal to 1; and performing space optimization processing on each target database to generate a space optimization report. The present disclosure also provides a database storage space optimization device, equipment, storage medium and program product.

The invention relates to the technical field of databases, and discloses a dblink access construction method under a distributed transactional database, an external table and a table space are created as required when the external table is accessed for the first time, the external table is stored on a coordination node and a storage node of the distributed transactional database, and the external table is directly called to access an external database during subsequent access. By dynamically executing plan selection, predicate push-down optimization and network path optimization, the cross-library query efficiency is effectively improved, the system resource consumption is reduced, the expansibility is enhanced, and the problems of low access efficiency, intermediate table redundancy, system table expansion and the like of the traditional dblink are solved.

The application discloses a kind of distributed database temporary table space full chaos test method and system, belong to computer software test technical field, the method includes the following steps: determine target database and temporary table space;Perform preset consumption script, through cyclic insertion data and interval execution cartesian product etc. Complex query, simulate temporary table space consumption to full load;Real-time monitoring table space usage and generating alarm;According to alarm execution gradient recovery strategy, first attempt to automatically expand space, if invalid, then terminate the session that occupies most space.The application also provides a system for implementing the method.The application fills the chaos test blank for the scenario of database internal temporary table space resource depletion, realizes the precise controllable and monitoring recovery of fault simulation Automatic closed loop, can significantly improve the efficiency and safety of database resilience testing, shorten the test period from several hours to minutes.