54 results about "Data manipulation language" patented technology

A database querying system to facilitate the retrieval of desired data from a database including information categories, the system including a plurality of object data items categorized in one information category and a plurality of object data items categorized in another information category. A processor assembly responsive to a user query is also provided and is structured to identify the desired data from the user query. A relationship category defined by relationships between the object data items of the information categories is further provided, the user query including a relationship identifier corresponding the relationship category so as to simplify syntax of the user query. Interpretation of relational-database query and data manipulation languages against non-relational schemas, including conceptual, semantic, object-relational, or object-oriented database schemas, by regarding the schemas as representing virtual relational databases with every class replaced by a virtual table comprised of all the attributes reachable from the class by a chain of relations. The interpretation allows concise and simple querying of non-relational and relational databases in a languages originally intended only for relational databases. The system further provides for wrapping of a relational database into a semantic conceptual schema so as to allow formulation of queries in SQL against the wrapping schema, reducing the size of SQL queries.

A system and method avoids anomalies in presence of data manipulation language (DML) plans maintaining dependent objects and snapshot isolation. An anomaly due to using a snapshot isolation level within the transaction is detected within a database transaction and the transaction is aborted based upon that detection. Involved in making the anomaly detection is determining whether a view of particular data accessed during the transaction under a snapshot isolation view to ensure read consistency differs from a view of the data under another isolation level, such as the read committed isolation level. Then a detection is made that an anomaly may occur if it is determined that the view of the data accessed during the transaction under the snapshot isolation differs from the view of the data under the other isolation level. Such anomaly avoidance prevents an indexed view being maintained nor a referential integrity constraint validated based on incorrect data.

The invention provides a method and a device for managing database changes, and aims to solve the problems of manual management. The method comprises the following steps of: snapshotting raw data in a database to obtain snapshot data; snapshotting the changed data of the database to obtain the latest snapshot data; comparing the latest snapshot data with the snapshot data obtained last time to obtain a comparison result, and if the comparison result shows that the latest snapshot data are inconsistent with the snapshot data obtained last time, storing the latest snapshot data instead of the snapshot data obtained last time; and automatically generating a database statement according to the comparison result. Data description language (DDL) and data manipulation language (DML) statements of the database can be generated automatically, efficiently and accurately, the omissions of the database changes in research and development processes in the last publishing link are avoided, and the efficiency and quality of a publishing process are effectively improved.

Methods, systems, and computer program products for accessing data where the data store provider is abstracted from both the data manipulation language used to access the data and the schema that describes the data. A received request structured in accordance with the data manipulation language is represented in an intermediate form. From the intermediate representation, a native request for any of one or more data store providers may be produced. Before being returned to the requester, a native response from data store provider may be formatted so that it is structured in accordance with the data manipulation language used for the request. A given request received by one computer system may cause a procedure to be generated for accessing the data store provider. When a later request is received by second computer system, the previously generated stored procedure may be reused if applicable.

In accordance with an embodiment, described herein is a system and method for dynamically converting data manipulation language (DML) code embedded in a mainframe application rehosted in a mainframe rehosting platform. The DML code can include SQL scripts with SQL statements, and standalone SQL statements for accessing a source database in a mainframe computer. The DML code can be converted programmatically and immediately before the DML code is to be executed during the execution of the rehosted mainframe application. A database access script converter in an application runtime of the mainframe rehosting platform can load a database schema of a target database and a set of conversion rules, parse the rehosted mainframe application to identify the DML code, and convert each SQL statement based on one or more conversion rules and the database schema, for execution against the target database.

The invention discloses a mixed storage system and a mixed storage method for supporting Hive DML (data manipulation language) enhancement. The storage system is established on the basis of a Dual Table and comprises a Dual Table establishing module and a Dual Table actuating module, wherein the Dual Table establishing module is used for establishing the Dual Table which comprises a main table and a secondary table, maintains unique ID (identification) of each row of data and provides a specific operation set for the external on the basis of a cost model; and the Dual Table actuating module is used for reading and querying data in the Dual Table on the basis of the main table and the secondary table of the Dual Table, changing data in the Dual Table on the basis of the secondary table of the Dual Table, implementing the operation set provided by the Dual Table on the basis of the cost model, and combining the main table and the secondary table when data are read on the basis of the unique ID of each row of ordered data.

Methods, systems, and computer program products for accessing data where the data store provider is abstracted from both the data manipulation language used to access the data and the schema that describes the data. A received request structured in accordance with the data manipulation language is represented in an intermediate form. From the intermediate representation, a native request for any of one or more data store providers may be produced. Before being returned to the requestor, a native response from data store provider may be formatted so that it is structured in accordance with the data manipulation language used for the request. A given request received by one computer system may cause a procedure to be generated for accessing the data store provider. When a later request is received by second computer system, the previously generated stored procedure may be reused if applicable.

The invention discloses a packing method based on a line storage database engine, which comprises a line storage database, and following operations are carried out based on the line database: creating a compress table, specifying a corresponding compressing level, and importing data files with CSV (Comma Separated Value) format into the created compress table. The method is characterized in that: the compress table is a common data table showed externally for supporting general DML / DDL (Data Manipulation Language / Data Definition Language) operation; the compress table comprises a master HOT data segment and a slave LOB large object segment realized internally, wherein the master HOT segment is used for storing internally defined attribute lines, and the slave LOB segment is used for storing a compression method control structure and compressed data content; the compress table is used for supporting various query languages, and when in query, even though all fields in the line need to be read into memory, the related line data only needs to be decompressed and queried; the compress table is used for supporting update operation, and only decompressing updated lines when in update; and the compress table is used for supporting speedy deletion, only delete mark is made, and when no record is in a slave line, a master line is automatically deleted; and the compress table is deleted. According to the invention, through a line storage database technology, without changing a storage engine physical result, the technology of compression and storage according to line is realized, and the effect of high compression ratio of the line storage database is achieved.

A method and system are provided for dynamically relating tables in a federated database based upon a data manipulation language in a query transaction. After the start of a transaction has been detected, a data manipulation language from the transaction is extracted and evaluated to determine the table(s) and column(s) referenced by the transaction language. The data relation output unit determines the relationship(s) between the extracted table(s) and column(s) in real-time and conveys this information through a visual display.

Techniques are disclosed relating to create a configuration for a database system. In some embodiments, program instructions of a change set for an application are received from a source code management (SCM) repository. In response to the receiving, a build process is performed that includes causing compilation of the received program instructions to produce program instructions executable to run the application. The build process also includes provisioning the configuration with a schema by retrieving a first set of metadata defining the schema and issuing corresponding data definition language (DDL) instructions to create the schema in the configuration. The build process includes provisioning the configuration with data by retrieving a second set of metadata defining the data and issuing corresponding data manipulation language (DML) instructions to insert the data into the configuration and storing the provisioned configuration in a repository as one of multiple configurations associated with multiple received change sets.

The invention provides a method and equipment for processing metadata. The method comprises the following steps that: the equipment for processing the metadata acquires an extraction-transformation-loading (ETL) execution log and acquires a first data definition language (DDL) command, wherein the first DDL command is used for performing node definition on a data object included by the ETL execution log; the equipment for processing the metadata analyzes the acquired ETL execution log to acquire a second DDL command and a data manipulation language (DML) command, wherein the second DDL command is used for performing node definition on a temporary object included by the ETL execution log, and the DML command is used for recording the conversion operation of the data object and / or the temporary object in an ETL execution process; and the equipment for processing the metadata acquires the metadata which is used for representing the data flow direction of the data object and / or the temporary object by analyzing the first DDL command, the second DDL command and the DML command. By the method and the equipment for processing the metadata, the metadata which reflects the real data flow direction can be acquired.

The invention provides a persistent layer device and a database operation method. The method comprises the following steps: establishing at least one group of preset tables in advance, wherein each group of preset tables comprises at least one database table; establishing a management table, and managing the preset table; carrying out a DML (Data Manipulation Language) operation on the management table; mapping the management table and a persistent object PO (Persistent Object) class through a configuration file; and finally, packaging a one-to-one correspondence relationship obtained by mapping into one object operation; and providing the packaged object operation for outside to be called through a uniform external operation interface. In the process, the double-layer table structure design of the management table and the preset table converts a complex database DDL (Data Definition Language) operation into a simple database DML operation, a defect that a static configuration file restricts certain DDL operations on the database by an application system in a traditional persistent layer structure can be solved, and the flexible operation of the database is realized.

The invention discloses a database access method, which is applied to a database proxy node. A proxy service is provided for a plurality of database servers at a back end through the database proxy node. The method comprises the following steps: specific to any database server at the back end, if the database proxy node receives a database access request directing to the database server within a high-load time interval of the database server, determining a type of an SQL (Structured Query Language) sentence carried by the database access request firstly, and directly acquiring and transmitting business data directed by the SQL sentence to a source user terminal of the database access request if the carried SQL sentence is a DQL (Data Query Language) sentence; and if the carried SQL sentence is a DML (Data Manipulation Language) sentence, sending the database access request to the database server to execute the database access request when the high-load time interval of the database server is exceeded. The invention also discloses a database proxy node. Through adoption of the database access method and the database proxy node, the working stability of the database servers can be improved.

The invention provides a data processing method and system based on a networked relational dimension. An aggregation on the attributes of the entities having networked relations and / or the attributes of the relations between the entities is described; a transitive rule of relations between the entities having networked relations is described as a restriction; the aggregation and the restriction are translated into the queries in a database manipulating language. According to the invention, a networked relational dimension can be described by using concise description, and the description can be effectively converted into standard data manipulation language.

This application belongs to the field of database application technologies, and discloses a data scrubbing method and apparatus. In the method, a server adds a share update exclusive lock to a target table, to prevent a system from performing a data definition language (DDL) operation on the target table. The server then creates a temporary table and a temporary index, copies data from the target table to the temporary table, and generates index information according to the data in the temporary table. Next, the server adds an access exclusive lock to the target table to prevent the system from performing a data manipulation language (DML) operation on the target table. Then data in the target table and the temporary table as well as corresponding index information is exchanged, thereby completing cleaning and reclaiming of disk space.

The present invention provides a method, system, and program product for grouping statements against database objects. Specifically, under the present invention, a set of statements against a database object are preceded by a start command, and then followed with an end command so that the set of statements will be treated as a single, distributed unit of work. Specifically, the start of this work against the database object would allow for a Data Manipulation Language (DML) command to signal to the target table that a distributed unit of work was starting. After the completion of the (e.g., insert, update and delete) statements another DML command would be issued that would signal the end of the logical unit of work.

The invention belongs to the technical field of databases and provides an incremental data synchronization method. The incremental data synchronization method is characterized by comprising the steps that firstly, the data manipulation language of a source database is obtained; secondly, the data manipulation language is derived and serves as a data package; thirdly, the data package is synchronized to a target database; fourthly, a time quantum is set through a time module, and data of the target database is updated; fifthly, the data package is analyzed into the query language and change data; sixthly, the query language and the change data are synchronized to the target database; finally, in the target database, tables needing data changes and tables on which the data changes are conduced are generated and stored. The incremental data synchronization method effectively resolves the problems that logic repetition exists, the data are not consistent, the data are difficult to process and synchronize, and the data are obliterated easily.

The embodiment of the invention discloses a data access method and device, a server and a storage medium, and the method comprises the steps: obtaining a current data access request which comprises adatabase object and a transaction number; the database object and the transaction number are blocked; and executing data access corresponding to the blocked data access request. According to the embodiment of the invention, the blocking number in the data access corresponding to the data manipulation language is reduced, and the blocking number in the data access corresponding to the data definition language is increased; due to the fact that the number of times of execution of the data manipulation language in the database is very large and far higher than the frequency of execution of the data definition language, control and management of concurrent operation of the database through different locks are achieved, violent competition of system lock resources is greatly reduced, blocking conflicts are reduced, and the concurrent performance of the database is improved.

The embodiment of the invention provides a data restoration method and apparatus. The method comprises the following steps: obtaining a restoration time point input by a lessee; determining at least one second timestamp between the restoration time point and a current time point in at least one first timestamp in a first buffer area, wherein each first timestamp in the at least one first timestamp corresponds to a first reverse data manipulation language DML operation, and the first reverse DML operation is a reverse DML operation after at least one second reverse DML operation is merged; and executing the at least one first reverse DML operation in one to one correspondence with the at least one second timestamp reversely and sequentially according to a time sequence. According to the data restoration method and apparatus provided by the embodiment of the invention, the timestamp corresponding to the simplified reverse DML operation that needs to be executed for data restoration according to the restoration time of the lessee, and the simplified reverse DML operation corresponding to the timestamp is executed to improve the data restoration efficiency in a multi-lessee data table sharing scene.

The embodiment of the invention discloses a backup method and device for an MongoDB database, a recovery method and device for the MongoDB database, electronic equipment and a storage medium. The backup method comprises the following steps: acquiring a first timestamp; sequentially pulling a plurality of database operation logs from the MongoDB database by taking the first timestamp as starting time; classifying the plurality of pulled database operation logs to obtain a data definition language operation log and a data manipulation language operation log; wherein the data definition languageoperation log is used for recording changes of a data structure corresponding to the MongoDB database, and the data manipulation language operation log is used for recording changes of data corresponding to the MongoDB database; and sequentially writing the data definition language operation log into the first temporary file to generate a first file, and sequentially writing the data manipulationlanguage operation log and the data definition language operation log into the second temporary file to generate a second file. According to the embodiment of the invention, the incremental data backup of the MongoDB database can be quickly written into the file, so that the storage space required by data backup is reduced.

The invention discloses a data synchronization method and device. The method comprises the following steps: configuring a database middleware and enabling a table broadcasting mechanism of the database middleware; enabling the database middleware to receive the database statement of the data manipulation language; judging whether the database statement needs to execute the global table logic according to the configuration; when the database statement needs to execute the global table logic, using the table broadcast mechanism to broadcast the database statement table to all the database nodes;when the database statement does not need to execute global table logic, sending the database statement to all database nodes and executing the database statement. The data synchronization method andthe device provided by the invention can synchronize data for different database nodes or different types of database nodes, and maintain the data consistency of the global tables in the database.

Disclosed herein are a data consistency verification method and a system therefor, which are capable of efficiently verifying consistency of a large amount of data while minimizing a load of a source database by collecting and analyzing patterns of data changes in the source database, classifying the patterns of data changes into a time value or a numerical value range of a data change column, and grouping and comparing the classified patterns of data changes. The data consistency verification system includes a change data extraction part configured to extract packets between a client and an operating server which operates a source database, or extract change data from a transaction log or trigger information, a pattern analyzer configured to analyze a pattern of the change data extracted by the change data extraction part to generate data manipulation language (DML) change pattern bit set data storing change information, a rule engine module configured to determine a rule from the DML change pattern bit set data to generate a consistency profile, and a consistency execution module configured to perform consistency verification according to the consistency profile of the rule engine module. In accordance with the present invention, there is an effect of being capable of efficiently verifying consistency of a large amount of data while minimizing a load of a source database by tracking patterns of data changes in the source database and grouping and comparing regions in which a change largely occurs. Further, in accordance with the present invention, even when a task is being performed in a target database, data consistency is identically maintained as in the source database, there is an advantage of being capable of rapidly accurately processing a task.

The invention relates to the technical field of computer processing, in particular to a data recovery method, a data recovery device, a storage medium and electronic equipment. The data recovery method comprises the steps that when it is detected that a transaction is started, a data manipulation language of the transaction is analyzed to obtain an analysis result; generating a manipulation rollback statement of the data manipulation language according to the analysis result to obtain rollback information of the transaction; and in response to a data recovery instruction of the transaction, acquiring the rollback information to traverse and execute the operation rollback statement. According to the data recovery method provided by the invention, the data recovery applicability is high, and management and maintenance are convenient.

The embodiment of the invention discloses a database operation method and device, equipment and a computer readable storage medium. The method comprises the steps that a to-be-tested data table in a database is determined; feature parameters of the to-be-tested table and a data manipulation language are imported into an xml file; content in the xml file is converted into sql statements according to preset conversion rules; and the sql statements are run through a preset function to realize corresponding operation on the database. Through the database operation method and device, the equipmentand the computer readable storage medium, relevant operation in the database can be more visual, and maintenance of the database is easier.

The invention discloses a DML processing method and device. The method includes the steps that input data manipulation language (DML) is received, preset programs are used for detecting and analyzing the DML, structured query language (SQL) meeting the preset condition in the DML is analyzed, at least one preset optimizing mode is adopted to optimize the SQL, the optimization results of all the optimizing modes are recorded, the target optimizing mode is determined according to the optimization results, and the SQL meeting the preset condition and the target optimizing mode are sent to a developer. By means of the technical scheme, performance of the distributed MySQL mass DML can be analyzed in real time and ensured, how to optimize the SQL can be analyzed automatically to give an optimized suggestion finally, and the developer can optimize the programs according to the suggestion to improve service stability.

The invention provides a database compatible device for use in computer equipment. The computer device stores a database, a general storage function library and a corresponding relationship between the database type and the general storage function library deployment mode. The device comprises: a receiving module for receiving a database to be compatible, a determining module for determining the type of the database to be compatible, an acquisition module for acquiring a deployment mode and a general storage function library corresponding to the database type and a deploying module for deploying the general storage function library into the database to be compatible with the deployment mode corresponding to the database type. According to the invention, the technical problems in the prior art that multiple sets of data manipulation languages need to be developed according to different storage functions of different databases can be solved, and the development efficiency and compatibility of the application program are improved.

The invention discloses a data synchronization method, device and equipment and a storage medium, the method is applied to a server side located on the inner side of a one-way isolation gatekeeper, and the method comprises the steps that incremental log information of a first database located on the inner side of the one-way isolation gatekeeper is monitored and published through preset middleware; subscribing the incremental log message published through the preset middleware, and analyzing the incremental log message to obtain a data manipulation language in the incremental log message; the data manipulation language is sent to a client located on the outer side of a one-way isolation gatekeeper, so that the client forwards the data manipulation language to a second database located on the outer side of the one-way isolation gatekeeper, and the data manipulation language is executed through the second database, therefore, data synchronization based on the inner side and the outer side of the one-way isolation gatekeeper is realized. Through the technical scheme of the invention, real-time synchronization of data on the inner side and the outer side of the one-way isolation gatekeeper can be realized under the condition of ensuring network security.