39 results about "Data manipulation language" patented technology

Techniques are described for applying topological graph changes and traversing the modified graph. In an implementation, a set of compile processes schedules the graph changes caused by a DML (Data Manipulation Language) statement. Based on the requested graph operation in a received query for graph, a set of graph operation processes generate extensions to the graph that capture the changes to the graph by the DML. The received graph operation(s) are then performed by traversing both the existing graph and the generated extensions.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

The subject technology receives a first query, the first query comprising a first set of statements, the first set of statements including at least a first statement for performing a first Data Manipulation Language (DML) operation on a first table, the first table included in a source file.The subject technology executes the first query, the executing including determining whether to perform a copy-on-write (CoW) process. subject technology performs a CoW fallback process. The subject technology performs the copy-on-write process for the first query based on a result of the CoW fallback process.

In distributed data management traditional databases often struggle to maintain consistency and handle conflicts. Traditional solutions prioritize specific combinations of properties, resulting in trade-offs that impact user experience and application functionality. Present disclosure provides systems and methods that route incoming transaction associated with application to corresponding database server (DBS) by integrating geographical proximity mean value, and sender internet protocol affinity value. The incoming transaction is processed to extract data manipulation language (DML) operation written by the application and replicated to each DBS other than a DBS on which the application is directly applying a data through the incoming transactions. A primary key is generated by allocating an unique identifier if the DML operation is inserted on identified DBS. The primary key of record is updated from the incoming transaction. A conflict associated with parent and child association of the DML operation is dynamically monitored based on integrity Foreign key Constraint.

Disclosed in the embodiments of the present application are an execution plan analysis method and apparatus for structured query language (SQL), which method and apparatus are used for improving SQL execution plan analysis efficiency. The method in the embodiments of the present application comprises: a computing device determining an object function of a target database, wherein the object function comprises structured query language (SQL) statements that have been modified on the basis of restructuring logic, and the restructuring logic is used for identifying, in an execution plan, data manipulation language (DML) statements in the object function; the computing device generating an execution plan on the basis of the object function, wherein the execution plan is used for indicating performance evaluation metrics corresponding to one or more DML statements invoked in the object function; and the computing device displaying a performance analysis result corresponding to the execution plan, wherein the performance analysis result is used for identifying, from among the one or more DML statements, a DML statement the performance evaluation metric of which is lower than a threshold value.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

This invention discloses a real-time data synchronization method based on DAG orchestration and asynchronous zero-copy architecture, comprising: constructing a directed acyclic graph (DAG) based on timestamped data and its data lineage to obtain parallelizable task nodes; sending data using a zero-copy transmission method based on io_uring based on the parallelizable task nodes to obtain zero-copy transmitted data; grouping the received data according to the source IP address and storing it in the corresponding receiving queue to obtain grouped queue data; and sorting and merging the grouped queue data according to the global timestamp using a time window multi-path merge algorithm, and using an event barrier mechanism to handle the order of data definition language instructions and data manipulation language instructions to obtain a globally ordered event stream. This invention achieves dependency-aware parallel scheduling, zero-copy asynchronous transmission, and globally ordered merging of cross-source events.

The invention discloses a data synchronization method, device and equipment and a computer readable storage medium, which are applied to the technical field of data processing, and the method comprises the following steps: converting a data definition language event and a data manipulation language event into a data definition structured statement and a data manipulation structured statement; determining whether the data manipulation structured statement depends on the data definition structured statement or not by utilizing a dependency analysis model; and when the data manipulation structured statement does not depend on the data definition structured statement, determining to synchronously execute the data definition language event and the data manipulation language event. Compared with the condition that one data definition language event blocks all data manipulation language events during current data synchronization, the method and the device have the advantages that the dependency relationship between the data definition language event and the data manipulation language event can be determined through the dependency analysis model; therefore, the data definition language event and the data manipulation language event can be synchronized at the same time in the target library, and the data synchronization efficiency can be improved.

Techniques are provided for generating and maintaining Precomputed Result Tables ("PRTs") that are used by a database server to improve performance of SPARQL queries that target an RDF graph set. Each PRT corresponds to a particular pattern, which may be simple-triple, star, or chain. The techniques support the creation of PRTs for chain patterns that contain multiple instances of the same property, and PRTs for star and chain patterns that include reverse properties. Techniques are also described for maintaining such PRTs as Data Manipulation Language (DML) operations make changes to the RDF graph tables that belong to the RDF graph set associated with the PRTs.

The present invention provides a data loading method, device, electronic device and storage medium, which can be applied to the field of electronic digital data processing. The method includes: based on the space occupied by the data block parameter, using a reading thread to read the data file and generate an initial data block; processing the initial data block to generate a target data block, the target data block represents a data block marked with a parsing termination position, and the target data block is stored in a blocking data block queue; based on the parsing termination position, using a parsing thread to parse the target data block and generate at least one initial row data, the parsing thread is parallel to the reading thread, the initial row data represents data marked with a column position, and at least one initial row data is stored in a blocking data row queue; based on the column position, performing column data assignment processing on at least one initial row data in the blocking data row queue to obtain the target row data; using a data operation language to batch load the target row data into a target database.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

Embodiments of the present application disclose an event processing method, device and equipment, and a storage medium. The method comprises: obtaining a data update event of a target upstream sub-table in an upstream database when data is updated; in response to the target upstream sub-table not being in a preset state and no data update event being executed for a downstream database, determining whether the data update event comprises a data definition language (DDL) event or a data manipulation language (DML) event; in response to the data update event comprising a DML event, executing the data update event for the downstream database; and in response to the data update event comprising a DDL event, determining a compatibility state of a target table structure before data is updated in the target upstream sub-table and table structures of other upstream sub-tables in the upstream database, and processing the data update event based on the compatibility state. The embodiments of the present application can flexibly process data update events corresponding to upstream sub-tables in an upstream database, and have high applicability.

A computer-implemented method for a database constraint relationship check, includes performing a data manipulation language (DML) operation of a first transaction for a target data table in the database. A submission stage is entered. A corresponding current transaction version number is determined for a target data record obtained and each latest related data record visible to the first transaction is read from the target data table or an associated data table of the target data table. A mutual limitation relationship exists between field values corresponding to a target field in the target data record and each related data record. A constraint relationship check is performed on a target field value corresponding to the target field in the target data record based on each related data record. The first transaction is submitted if the constraint relationship check succeeds or the first transaction is rolled back otherwise.

Aspects of the present disclosure relate to merging data lake openness with scalable metadata of a management table in a cloud database platform, this allows for atomicity, consistency, isolation and persistence (ACID) transactions, high performance data manipulation language (DML), higher throughput flow ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automated storage optimization. Table data is stored in cloud storage in various open source file formats, while physical metadata of the table data is stored in an extensible metadata storage system.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

Provided is an event queue to implement an improved approach to coordinate the intake of work items that are received and operated upon by entities to maintain an inverted index. An improved approach is provided to implement maintenance of inverted indexes, where asynchronous maintenance is performed in a very efficient and highly scalable manner. Also disclosed is an improved approach to coordinate DML and DDL operations between maintenance processing entities and user processing entities.

Techniques are described for applying topological graph changes and traversing the modified graph. In an implementation, a set of compile processes schedules the graph changes caused by a DML (Data Manipulation Language) statement. Based on the requested graph operation in a received query for graph, a set of graph operation processes generate extensions to the graph that capture the changes to the graph by the DML. The received graph operation(s) are then performed by traversing both the existing graph and the generated extensions.

This application relates to the field of computer technology and provides a database access method, apparatus, device, and storage medium. The method acquires a business request and determines whether the business request is a query request. If the business request is a query request, the method acquires the replication delay value between the current master node and the auxiliary node based on the latency acquisition time interval. The method compares the replication delay value with a preset timeout delay threshold. If the replication delay value is not greater than the preset timeout delay threshold, the method acquires the time of the most recent execution of the data manipulation language of the business request. The method determines the routing mode of the business request based on the current time and the time of the most recent execution of the data manipulation language.

Techniques are provided for generating and maintaining Precomputed Result Tables ("PRTs") that are used by a database server to improve performance of SPARQL queries that target an RDF graph set. Each PRT corresponds to a particular pattern, which may be simple-triple, star, or chain. The techniques support the creation of PRTs for chain patterns that contain multiple instances of the same property, and PRTs for star and chain patterns that include reverse properties. Techniques are also described for maintaining such PRTs as Data Manipulation Language (DML) operations make changes to the RDF graph tables that belong to the RDF graph set associated with the PRTs.

Embodiments of the present application disclose a method and device for analyzing an execution plan of a structured query language (SQL), which are used for improving the analysis efficiency of the execution plan of the SQL. The method comprises the following steps: a computing device determines an object function of a target database, the object function comprising a structured query language (SQL) statement modified based on a reorganization logic, the reorganization logic being used for identifying a data manipulation language (DML) statement in the object function in an execution plan; the computing device generates an execution plan based on the object function, the execution plan being used for indicating a performance evaluation index corresponding to one or more DML statements in the object function; and the computing device displays a performance analysis result corresponding to the execution plan, the performance analysis result being used for identifying a DML statement whose performance evaluation index is lower than a threshold value in the one or more DML statements.

The application discloses a data processing method and device based on a PostgreSQL database, equipment and a medium, and relates to the technical field of PG databases. The method comprises the following steps: creating a preset data processing object in a to-be-processed PostgreSQL database to obtain a target database; the preset data processing object is used for collecting, analyzing and recording data definition languages in the database and is used for specifying a specified library that needs to be subjected to data processing; when it is monitored that a data manipulation language exists and is used for operating the target database, incremental change data generated by the operation is published, and a backup tool deployed on a target equipment is used for backing up the incremental change data according to a preset backup strategy to obtain a backup database; and the target database is recovered by a recovery tool deployed on the target equipment based on the backup database to obtain a recovery database. Through the technical scheme, remote data backup of the specified database can be safely and efficiently performed.

The invention provides a structured statement execution method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining a structured statement, and checking the grammar correctness of the structured statement, the language type of the structured statement being one of the following: a data definition language, a data manipulation language, a data control language and a data query language; under the condition that the grammar of the structured statement is correct, analyzing the structured statement by adopting SQL Parser to obtain a hierarchical abstract syntax tree; determining the language type of the structured statement according to the hierarchical abstract syntax tree; and processing the structured statement according to the language type of the structured statement to obtain a target statement, and executing the target statement to perform corresponding operation on the ES cluster. According to the method, the SQL instruction is accurately converted into the domain specific language adapting to the ES internal working principle, the cost that an SQL user is familiar with ES native API and grammar is reduced, and deep integration of the SQL protocol and the ES is achieved.

To provide a program, a system and an information processing method for enabling a programmer or the like to preliminarily recognize the existence of an error or an anti-pattern to be generated in the execution of a program without executing a program written in an SQL sentence.SOLUTION: By the control unit 12, 52 executing the program, detecting a predetermined data manipulation language set in advance from the received SQL statement and decomposing a statement including the data manipulation language into constituent elements; Which table is being processed is specified from the decomposed components, a field of an innermost table is specified by analyzing a multilayered data manipulation language for the received SQL statement, and at least one of verification of a comparison operation and verification of an assignment operation is performed or an anti-pattern is detected for the specified field of the innermost table based on the acquired definition information.SELECTED DRAWING: Figure 1

Techniques are provided for generating and maintaining pre-computed result tables ("PRTs") used by a database server to improve performance of SPARQL queries targeting RDF graph sets. Each PRT corresponds to a particular pattern, which can be a simple triple, a star, or a chain. The techniques support creating PRTs for chain patterns containing multiple instances of the same property, as well as creating PRTs for star and chain patterns that include inverse properties. Techniques are also described for maintaining such PRTs when data manipulation language (DML) operations make changes to tables belonging to RDF graphs of a RDF graph set associated with a PRT.

An embodiment of the present application provides a method, device, electronic device, and computer-readable storage medium for migrating a tablespace, relating to the field of databases. The method includes: creating a target table with the same table structure as the source table in the target tablespace, then generating a DDL row log of the source table through the data definition language (DDL) row log function of the source table, where the DDL row log is used to record data manipulation language (DML) operations on the source table, and further storing first table data in the source table into the target table based on a snapshot of the source table, and storing second table data in the source table into the target table based on the DDL row log, and determining the table name of the target table based on the source table. The embodiment of the present application realizes online tablespace migration in a database, which not only ensures the consistency and integrity of the migrated table data, but also does not affect the normal use of the application program.

Embodiments of the present application disclose a distributed transaction processing method, system and device, which can avoid outdated metadata and transaction processing errors caused by outdated metadata, improve transaction processing efficiency, reduce computing, transmission and storage overhead, and ensure complete fault tolerance and disaster tolerance of the system. The distributed transaction processing method comprises the following steps: firstly, starting a distributed transaction GT and a transaction branch CT of the distributed transaction GT on a computing node by using the computing node according to a command statement, the command statement comprising a data definition language (DDL) statement or a data manipulation language (DML) statement sent by a client, and the local transaction branch CT being completed on the computing node; secondly, obtaining a parsing result by parsing the command statement by using the computing node, the parsing result comprising an internal representation and an execution state of the command statement; and finally, creating or modifying metadata in a local metadata table by using the computing node according to the parsing result, the created or modified metadata being related to the command statement, and the metadata table being stored on the computing node.

Aspects of the disclosure are directed to merging data lake openness with scalable metadata for managed tables in a cloud database platform, allowing for atomicity, consistency, isolation, and durability (ACID) transactions, performant data manipulation language (DML), higher throughput stream ingestion, data consistency, schema evolution, time travel, clustering, fine-grained security, and / or automatic storage optimization. Table data is stored in various open-source file formats in cloud storage while physical metadata of the table data is stored in a scalable metadata storage system.

The invention discloses a data processing method and device based on real-time change perception. The method comprises the steps that under the condition that a change event in a target database is detected, a structured query language (SQL) statement corresponding to the change event is obtained, and the change event comprises a data definition language event and a data operation language event; determining a dependency relationship among a plurality of fields in the SQL statement; according to the dependency relationship, a structure related to the change event in an original knowledge graph is updated, and multiple entities in the target database and the dependency relationship among the multiple entities are stored in the original knowledge graph; and optimizing an original task according to an updating result of the updated original knowledge graph, the original task being a data processing task to which the entity of the executed change event belongs. According to the method and the device, the technical problem of long dependency updating delay time caused by the fact that the change of the data dependency in the data processing task cannot be captured in real time in related technologies is solved.

This disclosure relates to the field of computer technology, specifically to a method and apparatus, storage medium, and terminal device for medical data tracing. The medical data tracing method includes: acquiring information from several data tables; constructing a basic directed graph based on the table names and feature fields in the data table information; wherein the data table information corresponds to several data tables to be processed in a target database; performing data manipulation language logic parsing on the target database to determine the logical relationships between different feature fields; connecting different basic directed graphs based on the logical relationships to construct a target directed graph corresponding to the target database, so as to perform data tracing based on the target directed graph. This solution facilitates rapid investigation of data sources, enables automatic tracing of problematic data, and improves data tracing efficiency.