22 results about "Data manipulation language" patented technology

The subject technology receives a first query, the first query comprising a first set of statements, the first set of statements including at least a first statement for performing a first Data Manipulation Language (DML) operation on a first table, the first table included in a source file.The subject technology executes the first query, the executing including determining whether to perform a copy-on-write (CoW) process. subject technology performs a CoW fallback process. The subject technology performs the copy-on-write process for the first query based on a result of the CoW fallback process.

In distributed data management traditional databases often struggle to maintain consistency and handle conflicts. Traditional solutions prioritize specific combinations of properties, resulting in trade-offs that impact user experience and application functionality. Present disclosure provides systems and methods that route incoming transaction associated with application to corresponding database server (DBS) by integrating geographical proximity mean value, and sender internet protocol affinity value. The incoming transaction is processed to extract data manipulation language (DML) operation written by the application and replicated to each DBS other than a DBS on which the application is directly applying a data through the incoming transactions. A primary key is generated by allocating an unique identifier if the DML operation is inserted on identified DBS. The primary key of record is updated from the incoming transaction. A conflict associated with parent and child association of the DML operation is dynamically monitored based on integrity Foreign key Constraint.

Disclosed in the embodiments of the present application are an execution plan analysis method and apparatus for structured query language (SQL), which method and apparatus are used for improving SQL execution plan analysis efficiency. The method in the embodiments of the present application comprises: a computing device determining an object function of a target database, wherein the object function comprises structured query language (SQL) statements that have been modified on the basis of restructuring logic, and the restructuring logic is used for identifying, in an execution plan, data manipulation language (DML) statements in the object function; the computing device generating an execution plan on the basis of the object function, wherein the execution plan is used for indicating performance evaluation metrics corresponding to one or more DML statements invoked in the object function; and the computing device displaying a performance analysis result corresponding to the execution plan, wherein the performance analysis result is used for identifying, from among the one or more DML statements, a DML statement the performance evaluation metric of which is lower than a threshold value.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

This invention discloses a real-time data synchronization method based on DAG orchestration and asynchronous zero-copy architecture, comprising: constructing a directed acyclic graph (DAG) based on timestamped data and its data lineage to obtain parallelizable task nodes; sending data using a zero-copy transmission method based on io_uring based on the parallelizable task nodes to obtain zero-copy transmitted data; grouping the received data according to the source IP address and storing it in the corresponding receiving queue to obtain grouped queue data; and sorting and merging the grouped queue data according to the global timestamp using a time window multi-path merge algorithm, and using an event barrier mechanism to handle the order of data definition language instructions and data manipulation language instructions to obtain a globally ordered event stream. This invention achieves dependency-aware parallel scheduling, zero-copy asynchronous transmission, and globally ordered merging of cross-source events.

The invention discloses a data synchronization method, device and equipment and a computer readable storage medium, which are applied to the technical field of data processing, and the method comprises the following steps: converting a data definition language event and a data manipulation language event into a data definition structured statement and a data manipulation structured statement; determining whether the data manipulation structured statement depends on the data definition structured statement or not by utilizing a dependency analysis model; and when the data manipulation structured statement does not depend on the data definition structured statement, determining to synchronously execute the data definition language event and the data manipulation language event. Compared with the condition that one data definition language event blocks all data manipulation language events during current data synchronization, the method and the device have the advantages that the dependency relationship between the data definition language event and the data manipulation language event can be determined through the dependency analysis model; therefore, the data definition language event and the data manipulation language event can be synchronized at the same time in the target library, and the data synchronization efficiency can be improved.

Embodiments of the present application disclose an event processing method, device and equipment, and a storage medium. The method comprises: obtaining a data update event of a target upstream sub-table in an upstream database when data is updated; in response to the target upstream sub-table not being in a preset state and no data update event being executed for a downstream database, determining whether the data update event comprises a data definition language (DDL) event or a data manipulation language (DML) event; in response to the data update event comprising a DML event, executing the data update event for the downstream database; and in response to the data update event comprising a DDL event, determining a compatibility state of a target table structure before data is updated in the target upstream sub-table and table structures of other upstream sub-tables in the upstream database, and processing the data update event based on the compatibility state. The embodiments of the present application can flexibly process data update events corresponding to upstream sub-tables in an upstream database, and have high applicability.

A computer-implemented method for a database constraint relationship check, includes performing a data manipulation language (DML) operation of a first transaction for a target data table in the database. A submission stage is entered. A corresponding current transaction version number is determined for a target data record obtained and each latest related data record visible to the first transaction is read from the target data table or an associated data table of the target data table. A mutual limitation relationship exists between field values corresponding to a target field in the target data record and each related data record. A constraint relationship check is performed on a target field value corresponding to the target field in the target data record based on each related data record. The first transaction is submitted if the constraint relationship check succeeds or the first transaction is rolled back otherwise.

Provided is an event queue to implement an improved approach to coordinate the intake of work items that are received and operated upon by entities to maintain an inverted index. An improved approach is provided to implement maintenance of inverted indexes, where asynchronous maintenance is performed in a very efficient and highly scalable manner. Also disclosed is an improved approach to coordinate DML and DDL operations between maintenance processing entities and user processing entities.

This application relates to the field of computer technology and provides a database access method, apparatus, device, and storage medium. The method acquires a business request and determines whether the business request is a query request. If the business request is a query request, the method acquires the replication delay value between the current master node and the auxiliary node based on the latency acquisition time interval. The method compares the replication delay value with a preset timeout delay threshold. If the replication delay value is not greater than the preset timeout delay threshold, the method acquires the time of the most recent execution of the data manipulation language of the business request. The method determines the routing mode of the business request based on the current time and the time of the most recent execution of the data manipulation language.

Embodiments of the present application disclose a method and device for analyzing an execution plan of a structured query language (SQL), which are used for improving the analysis efficiency of the execution plan of the SQL. The method comprises the following steps: a computing device determines an object function of a target database, the object function comprising a structured query language (SQL) statement modified based on a reorganization logic, the reorganization logic being used for identifying a data manipulation language (DML) statement in the object function in an execution plan; the computing device generates an execution plan based on the object function, the execution plan being used for indicating a performance evaluation index corresponding to one or more DML statements in the object function; and the computing device displays a performance analysis result corresponding to the execution plan, the performance analysis result being used for identifying a DML statement whose performance evaluation index is lower than a threshold value in the one or more DML statements.

The application discloses a data processing method and device based on a PostgreSQL database, equipment and a medium, and relates to the technical field of PG databases. The method comprises the following steps: creating a preset data processing object in a to-be-processed PostgreSQL database to obtain a target database; the preset data processing object is used for collecting, analyzing and recording data definition languages in the database and is used for specifying a specified library that needs to be subjected to data processing; when it is monitored that a data manipulation language exists and is used for operating the target database, incremental change data generated by the operation is published, and a backup tool deployed on a target equipment is used for backing up the incremental change data according to a preset backup strategy to obtain a backup database; and the target database is recovered by a recovery tool deployed on the target equipment based on the backup database to obtain a recovery database. Through the technical scheme, remote data backup of the specified database can be safely and efficiently performed.

To provide a program, a system and an information processing method for enabling a programmer or the like to preliminarily recognize the existence of an error or an anti-pattern to be generated in the execution of a program without executing a program written in an SQL sentence.SOLUTION: By the control unit 12, 52 executing the program, detecting a predetermined data manipulation language set in advance from the received SQL statement and decomposing a statement including the data manipulation language into constituent elements; Which table is being processed is specified from the decomposed components, a field of an innermost table is specified by analyzing a multilayered data manipulation language for the received SQL statement, and at least one of verification of a comparison operation and verification of an assignment operation is performed or an anti-pattern is detected for the specified field of the innermost table based on the acquired definition information.SELECTED DRAWING: Figure 1

Techniques are provided for generating and maintaining pre-computed result tables ("PRTs") used by a database server to improve performance of SPARQL queries targeting RDF graph sets. Each PRT corresponds to a particular pattern, which can be a simple triple, a star, or a chain. The techniques support creating PRTs for chain patterns containing multiple instances of the same property, as well as creating PRTs for star and chain patterns that include inverse properties. Techniques are also described for maintaining such PRTs when data manipulation language (DML) operations make changes to tables belonging to RDF graphs of a RDF graph set associated with a PRT.

Embodiments of the present application disclose a distributed transaction processing method, system and device, which can avoid outdated metadata and transaction processing errors caused by outdated metadata, improve transaction processing efficiency, reduce computing, transmission and storage overhead, and ensure complete fault tolerance and disaster tolerance of the system. The distributed transaction processing method comprises the following steps: firstly, starting a distributed transaction GT and a transaction branch CT of the distributed transaction GT on a computing node by using the computing node according to a command statement, the command statement comprising a data definition language (DDL) statement or a data manipulation language (DML) statement sent by a client, and the local transaction branch CT being completed on the computing node; secondly, obtaining a parsing result by parsing the command statement by using the computing node, the parsing result comprising an internal representation and an execution state of the command statement; and finally, creating or modifying metadata in a local metadata table by using the computing node according to the parsing result, the created or modified metadata being related to the command statement, and the metadata table being stored on the computing node.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

This disclosure relates to the field of computer technology, specifically to a method and apparatus, storage medium, and terminal device for medical data tracing. The medical data tracing method includes: acquiring information from several data tables; constructing a basic directed graph based on the table names and feature fields in the data table information; wherein the data table information corresponds to several data tables to be processed in a target database; performing data manipulation language logic parsing on the target database to determine the logical relationships between different feature fields; connecting different basic directed graphs based on the logical relationships to construct a target directed graph corresponding to the target database, so as to perform data tracing based on the target directed graph. This solution facilitates rapid investigation of data sources, enables automatic tracing of problematic data, and improves data tracing efficiency.

Techniques are provided for creating a "universal search index" that allow full-text search and value range-based search across all columns from multiple database tables, multiple user-defined non-materialized views, and external sources. In one embodiment, the data is indexed in a specially constructed pattern-based JSON format without duplicating the data. The techniques maintain final consistency with normalized sources of factual database tables and do not significantly affect the performance of transactional data manipulation language (DML) operations.

A method is provided for validating transactions in a system that includes indeterministic ordering of change log events by using deterministic indicia. At least some of the change log events include indeterministic values. The system includes a plurality of nodes. Each node in the system includes an instance of a database used by an application, and a change log associated with the instance of the database used by the application. Each node redundantly executes the same transactions to be validated. Each transaction includes one or more data manipulation language (DML) or data definition language (DDL) operations. Results of the DML or DDL, operations are stored in the change log as change log events, wherein the order of the change log events stored in the change log on one node is in a different order than the order of change log events stored in the change log of at least one of the other nodes. For each transaction executing at each node, indeterministic values of the change log events are pre-converted to deterministic values of the change log events. Deterministic subunits of the change log events are defined. Indicia are then computed for each subunit of the change log events. The subunits are ordered by the computed indicia. Deterministic indicia are then computed for the transaction from the ordered subunits. The transaction is then validated with at least one of the other nodes using the deterministic indicia. The validation indicates either a match or a mismatch of the deterministic indicia computed at the plurality of nodes.

In distributed data management traditional databases often struggle to maintain consistency and handle conflicts. Traditional solutions prioritize specific combinations of properties, resulting in trade-offs that impact user experience and application functionality. Present disclosure provides systems and methods that route incoming transaction associated with application to corresponding database server (DBS) by integrating geographical proximity mean value, and sender internet protocol affinity value. The incoming transaction is processed to extract data manipulation language (DML) operation written by the application and replicated to each DBS other than a DBS on which the application is directly applying a data through the incoming transactions. A primary key is generated by allocating an unique identifier if the DML operation is inserted on identified DBS. The primary key of record is updated from the incoming transaction. A conflict associated with parent and child association of the DML operation is dynamically monitored based on integrity Foreign key Constraint.

The application discloses a PostgreSQL database misoperation recovery method and device, equipment and medium, and relates to the technical field of PostgreSQL database. The method comprises the following steps: monitoring operation actions in a PostgreSQL database, and acquiring operation information of the operation actions; wherein the operation actions comprise operation actions on a data manipulation language, operation actions for deleting tables based on a data definition language, and operation actions on system tables of the PostgreSQL database; creating corresponding preset record tables based on the operation information; when there is a misoperation in the PostgreSQL database, filtering and querying the content in the preset record tables to determine data information of the misoperation; and recovering the PostgreSQL database according to the data information. Through the technical scheme of the application, the deficiencies and limitations of recovering data when a PostgreSQL database is misoperated in the prior art can be overcome, and the problem of data loss caused by human misoperation of the PostgreSQL database can be solved without stopping service.