2768 results about "Target database" patented technology

The invention relates to the technical field of data processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a database migration method, device, equipment and medium. And deploying a double-write control module of the application program layer to write the source database and the target database in parallel, and completing consistency verification through a data verification comparison task. And controlling a target database write-in channel according to a difference analysis result, closing a source database write-in channel in combination with a service takeover state, and completing a migration process from the source database to the target database. According to the method, full migration, application layer double writing, differential data verification and dynamic write-in channel control are combined, data consistency of the source database and the target database in the migration process is guaranteed, the source database and the target database are safely switched to after the service takeover capacity is verified, and the migration safety and continuity are improved.

The invention discloses a method and a system for realizing data synchronization between heterogeneous databases based on logs. The method comprises the following steps: acquiring connection information of a source database and a target database; querying a table structure of the source end database and generating an SQL statement to establish a data mapping rule; matching a corresponding rule model from a mapping rule model library; if the matching is not successful, the system abnormally quits and prompts the user to create a new mapping model and add the new mapping model to the mapping rule model base; converting a table structure of the source end database into a JSON character string based on a standard field type; an SQL statement required by the target database is output through the data mapping engine module; the message monitoring program reads the data in the temporary storage area and converts the data into data meeting the requirements of the target database; formatting the converted data into SQL statements supported by a target database; and sending the generated SQL statement to a target database to complete data migration. Accurate and controllable synchronization of the data and the model in a heterogeneous environment is realized.

The invention provides a method for generating an SQL (Structured Query Language) by a natural language based on bidirectional mapping and semantic parsing, which relates to the technical field of database query and comprises the following steps of: extracting natural language query elements and packaging the natural language query elements into structured data, and establishing a mapping relationship from a query field to a service attribute and a physical data table by adopting a bidirectional Hash index technology; and automatically identifying multi-table association keys, performing semantic extension and compliance verification, generating an abstract syntax tree, performing processing according to user permission, and finally converting the abstract syntax tree into an SQL statement conforming to a target database syntax specification. According to the method, the accuracy and the efficiency of converting the natural language into the SQL are improved, and the flexibility and the safety of the system are enhanced.

The invention provides an SQL (Structured Query Language) statement generation method and system based on a large language model. Target database metadata are collected, a structured dictionary is constructed, cue words adaptive to the large language model are generated in combination with a user query strategy, and accurate SQL generation is realized through a closed-loop execution optimization mechanism after model reasoning and SQL analysis. Through a large language model intelligent analysis technology, a multi-source heterogeneous database metadata dynamic adaptation technology and a closed-loop optimization mechanism for SQL statement generation, execution and feedback, the efficient and accurate SQL statement automatic generation function is achieved through the characteristics of cross-database grammar automatic adaptation, complex service requirement accurate analysis, intelligent error correction and the like. The system not only improves the working efficiency of developers, but also reduces the resource occupation and operation and maintenance cost of the system, and improves the accuracy and safety of data query and processing.

The embodiment of the invention discloses a database multi-source heterogeneous data synchronization method and device.The method comprises the steps that a data change event is monitored through an RPA robot deployed in a server where a source database is located, and when change operation of structured data or unstructured data is detected, an initial data set is generated; performing fragmentation processing on the initial data set to generate a plurality of data fragmentation tasks, and allocating the data fragmentation tasks to distributed computing nodes to execute parallel format conversion operation so as to generate a target data set; detecting a task execution state of the distributed computing node, and when a generation completion event of a target data set is detected, activating a data synchronization channel and transmitting the target data set to a target database; and performing conflict detection and identification based on an RPA conflict processing strategy configured in the target database, when a primary key conflict or a uniqueness constraint conflict is identified, updating the target database based on preset conflict merging indication information, and generating a data synchronization log.

The invention discloses a report chart automatic generation method based on natural language analysis and data query, which comprises the following steps: acquiring a natural language text, and constructing a slot set and an initial semantic fragment; executing consistency verification and ambiguity identification, and constructing a semantic framework; executing field standardization and mode alignment, generating a data query statement and establishing a traceability chain identifier; querying a target database to obtain an original data set, completing data quality self-correction, and generating a cleaned data set; calling an improved Mamba model to construct a constraint judgment matrix and outputting a target chart subset; generating a chart description grammar and an image annotation template, and executing image rendering, feature point recognition and image sidebar construction; and performing layout optimization and double compilation, and outputting a structured report file. According to the method, the chart generation automation level and the report compiling efficiency are improved, and the accuracy, traceability and specialty of the output content are ensured.

The invention relates to the technical field of intelligent agricultural equipment, and discloses an automatic agaricus bisporus picking method, device and equipment based on artificial intelligence and a medium. The method comprises the steps that RGB images and three-dimensional point cloud data of the agaricus bisporus growth environment are collected in real time through a binocular vision camera and a depth sensor which are installed at the tail end of a picking robot, and environment illumination parameters and cultivation bed coordinate information are obtained; inputting the RGB image into a pre-trained lightweight convolutional neural network, identifying a pileus contour, a stipe position and a maturity level of the agaricus bisporus, calculating a space coordinate, a height and a growth inclination angle of the agaricus bisporus based on the three-dimensional point cloud data, and constructing an agaricus bisporus target database; a mechanical arm picking path is generated based on the agaricus bisporus target database, and path weight parameters are optimized online through a preset reinforcement learning model; according to the maturity grade and morphological characteristics of the agaricus bisporus, the clamping force and the rotating angle of the end effector are dynamically adjusted, and automatic picking of the agaricus bisporus is completed.

The invention discloses an on-satellite full-autonomous task planning system for an agile remote sensing satellite. Comprising an imaging target database module, a high-precision orbit prediction and orbit calculation module, a target visible arc section calculation module, an imaging task preprocessing module, a subsystem constraint model module, an imaging task planning module, a data transmission task planning module, a solid memory autonomous erasing module, an instruction data block generation module and a satellite state real-time monitoring module. By carrying out constraint modeling on subsystems or single machines such as load, data transmission, control and the like, an on-satellite full-autonomous operation process from receiving of subsystem or single machine instruction blocks from user requirements is established, satellite control is effectively simplified, and remote control uploading efficiency and on-satellite autonomous operation capacity are improved. And through a satellite state real-time monitoring module, the execution condition of tasks on the satellite, satellite state changes and the like are monitored in real time, task execution stopping, whole satellite sun-facing or re-planning are further triggered, task requirements and environment changes are quickly responded, task plans are formulated and adjusted in real time, and the task execution efficiency is improved.

The invention provides a database adaptive migration method and system based on a credential environment, and relates to the technical field of data processing.The method comprises the steps that an intelligent migration model is used for analyzing the structure, including a table structure, index configuration, constraint conditions and data types, of a source database, data size distribution is calculated, and a source database structure feature result is generated; according to a source database structure feature result, automatically selecting and configuring a target database type, adjusting environment parameters of a target database, and generating target database configuration information; according to the structure of a source database and configuration information of a target database, a data mapping rule is automatically established by utilizing an intelligent migration model, and the data mapping rule comprises automatic correspondence of table names and field names, automatic conversion of data types, and an automatic migration scheme of indexes and constraints. According to the method, automatic and intelligent migration from the source database to the target database is realized through the intelligent migration model, the performance is automatically optimized, the migration report is generated, and the migration efficiency and quality are improved.

The invention relates to the technical field of natural language processing, and discloses a structure prompt-based reasoning collaborative SQL generation method. According to the method, a small model carries out structured analysis on natural language query and a target database mode, SQL substructures and combination sequence prompts are generated, a large model constructs a multi-path inference tree based on the prompts, and path nodes sequentially generate SQL substructure fragments. Top-k paths are screened through path node scores and path cumulative scores, comprehensive sorting is performed by applying a heuristic scoring function, and candidate SQL with the highest score is selected. And verifying and correcting the candidate SQL according to execution feedback, and outputting a final SQL result after ensuring that semantics and structures are correct. According to the method, the problems of insufficient reasoning ability of a small model, poor reasoning stability and illusion of a large model and the problems of Tree-of-Though reasoning path redundancy and frequent focus switching are solved, the reasoning reasonability and execution efficiency in a Text2SQL task are improved, and the method is suitable for an application scene from a complex natural language to structured query.

The invention discloses a database test case extension method and device based on a large language model and a readable medium. The method comprises the following steps: constructing a feature knowledge base corresponding to each database management system; identifying an original dialect feature in an original query SQL statement of the initial database management system through an error recovery mechanism, and performing dialect mapping on the original dialect feature in a feature knowledge base corresponding to the target database management system to obtain a target dialect feature and a description and an example corresponding to the target dialect feature; inputting an original SQL (Structured Query Language) statement of the initial database management system into the conversion model, constructing a first cue word, and guiding the conversion model to generate an original SQL statement of the target database management system through the first cue word; and inputting the original query SQL statement of the target database management system into the fine-tuned variation model corresponding to the selected variation strategy, and generating the variation query SQL statement of the corresponding target database management system, thereby effectively improving the universality and reliability.

The invention provides a structured processing method and device for a contract text, equipment and a storage medium, and the method comprises the steps: carrying out the preprocessing of the contract text, generating a standardized word sequence, and enabling the standardized word sequence to comprise a plurality of word sequences and part-of-speech tagging information of each word sequence; the standardized word sequence is input into a named entity recognition model to recognize key entities in the contract text, key terms in the contract text are extracted based on a machine learning algorithm, the key entities include both parties of the contract, the amount of the contract and the name of a product, and the key terms include payment terms, delivery terms, default responsibility terms and force majeure terms; through dependency syntactic analysis and a semantic role labeling model, analyzing to obtain a semantic relationship between the key entities and the key terms; and storing the extracted key entities, key terms and semantic relationships in a target database in a structured form, and establishing a target index to support quick query. According to the invention, the error rate of manual processing is reduced.

The invention discloses a query statement conversion method and device based on a large model, equipment and a medium, and relates to the field of computer science, and the method comprises the steps: obtaining a natural language query statement sent by a user side, comparing the natural language query statement with a high-frequency problem in a target knowledge base, and obtaining a query statement conversion result; whether a high-frequency problem with the similarity with the natural language query statement exceeding a preset similarity threshold value exists in the target knowledge base or not is judged; if the high-frequency problem that the similarity with the natural language query statement exceeds a preset similarity threshold does not exist, determining a target database table corresponding to the natural language query statement based on the target knowledge graph, and extracting a creation statement corresponding to the target database table, so as to determine target information corresponding to the target database table according to the creation statement; and analyzing the target information by using a preset large model to generate an SQL statement corresponding to the natural language query statement. According to the method and the device, the natural language query statement can be efficiently and accurately converted into the structured SQL statement.

The invention provides a cross-database unified management and operation method and system, and relates to the technical field of databases, and the method comprises the following steps: establishing a connection by obtaining database connection information; extracting a database structure by using a dialect strategy processor and mapping the database structure into a unified description; converting the operation instruction into a standard intermediate statement; converting the intermediate statement into a target database execution statement by using a grammar analysis module and a conversion rule; and executing and monitoring in a transaction unit mode. Unified management and operation of different types of databases are realized, the consistency and reliability of database operation are improved, and the development difficulty of cross-database operation is reduced.

The invention relates to the technical field of databases, can be applied to the field of science and technology finance / digital medical treatment, and discloses a database migration method and device, electronic equipment and a storage medium. The method comprises the steps that database structured query language identifiers are defined, strategy classes corresponding to all databases are packaged, and a strategy context management container is created; receiving a target database type, dynamically loading a strategy type instance according to the type, and generating an executable query strategy chain according to the strategy type instance; when a database query request is received, matching a corresponding strategy type instance, and processing an original database query statement to generate a target database executable instruction; controlling a query strategy chain to execute a single-path or double-write-path mode through a common switch, and transmitting the instruction to a strategy type instance for execution; and analyzing a return result of the target database, performing conversion adaptation through the strategy type instance, and returning a conversion adaptation result. The method realizes automatic migration, reduces cost and risk, and improves system performance.

The invention belongs to the field of SQL generation, and particularly discloses an SQL generation method and system based on a large language model, a terminal and a medium, a natural language query statement and a target database mode are transmitted into the large language model, and N candidate tables most relevant to user query are selected and fed back by the large language model according to a first prompt word; selecting and feeding back a plurality of candidate data columns most relevant to the user query from each candidate table by the large language model according to the second cue word; retrieving an example question and answer pair similar to the user query from the vector database, wherein the example question and answer pair comprises an example question and an example SQL statement; generating a plurality of candidate SQL statements by the large language model according to the third cue word; and carrying out confidence coefficient filtering on the plurality of generated candidate SQL statements, and selecting a final SQL statement. According to the method, the natural language query statement is converted into the SQL statement through the large language model, the SQL statement generation efficiency and accuracy are improved, and then the usability and accuracy of database query are improved.

The embodiment of the invention provides a processing method and device based on database query, equipment and a medium. The method comprises the steps that a user query problem is obtained; according to the user query question, screening out candidate database modes from a plurality of database modes in a preset database, and extracting key content information from the user query question; converting the key content information into a content identifier which can be identified by a database, and screening out a target database mode from the candidate database modes; function structure information of the user query problem is determined, and a query statement skeleton of the user query problem is determined according to the function structure information; and filling the content identifier and the target database mode in a query statement skeleton to obtain a database query statement, and executing a query operation in a database through the database query statement. The database query statement is automatically generated according to the user query problem, the query operation is executed, and the query efficiency and accuracy are remarkably improved.

The invention discloses a webpage generation method and device, electronic equipment and a storage medium, and relates to the technical field of computer software or other related fields, the method comprises the following steps: receiving demand information of a user for an expected webpage, and inputting the demand information into a target language model to obtain N pieces of component information in the expected webpage, N being a positive integer; retrieving a target database based on the N pieces of component information to obtain a retrieval result; inputting fusion demand information of the retrieval result and the demand information into the target language model to obtain a configuration code which is used for describing the page layout, the component attribute and the application logic of the expected webpage; and analyzing the configuration code to obtain a corresponding source code, and rendering the page based on the source code to obtain a target webpage corresponding to the expected webpage. According to the method and the device, the technical problem that the generated webpage does not accord with the intention of the user due to understanding limitation of a low-code platform fused with a large language model in related technologies is solved.

The invention discloses an intelligent question answering method and device, equipment, a storage medium and a program product, and relates to the technical field of business intelligence, and the intelligent question answering method comprises the steps: receiving a question input by a user; according to the problem, prompt words are generated through a preset multi-scene knowledge base, and the multi-scene knowledge base is generated based on a preset knowledge configuration file; inputting the cue word into a preset large language model to obtain a query code output by the large language model; and according to the query code, performing data query on a target database to obtain an answer of the question. According to the method, intelligent question answering of the configurable multi-scene knowledge base is realized, the problem that the existing intelligent question answering cannot effectively adapt to different scenes is solved, and the adaptive capacity of the intelligent question answering to different scenes is improved.

The invention provides a credential platform data migration verification method and system, and relates to the technical field of computers.The method comprises the steps that all to-be-migrated source data in a credential platform database are read, basic information of the source data is obtained, and a data label is set for each piece of data; reading fields and contents in the migration data, and constructing a data similarity verification model; selecting a migration path and a target database according to the migration demand, and dynamically evaluating the similarity between the source data and the target data through a data similarity verification model; verifying the migrated source data based on the target database, and performing incremental verification on data of different fields in the table; the data table of the to-be-migrated source data is verified in real time among different migration nodes, data changes on each node are verified step by step through an increment verification mechanism, if data missing or verification inconsistency occurs in the verification process, an alarm mechanism is triggered, and the problem of data missing or inconsistency can be automatically recognized and corrected.

The invention discloses a method for realizing SQL (Structured Query Language) grammar conversion of different databases based on middleware and the middleware, belongs to the technical field of databases, and aims to solve the technical problem of how to realize SQL grammar conversion of different databases through the middleware. The following operations are executed through the middleware to realize the grammar conversion of the SQL between the source database and the target data constructing an abstract syntax tree AST by taking various SQL elements as nodes; operating nodes in the AST on the basis of requirements of a target database; based on the data type in the target database, performing data type mapping by applying a data type conversion rule, and generating an SQL statement adapted to the target database; performing security check on the generated SQL statement; caching the query result and the generated SQL statement based on a caching mechanism; and recording the conversion process and query processing of the SQL statement.

The invention provides a Text2SQL generation method and system driven by a large language model, and the method comprises the steps: recognizing key entities and relationships in a natural language question through the large language model, and carrying out the construction to obtain a query graph; constructing a hierarchical graph representation model based on the database mode of the target database; searching candidate sub-image sets which have the same structure as the query graph and are in semantic association with the query graph from the constructed graph representation model; and constructing a structured Prompt template based on the candidate sub-image set and the user question, generating an initial SQL statement, and outputting a final query result after grammar and semantic detection correction. According to the method, a traditional database is converted into the graph knowledge base, so that the SQL generation accuracy and performance are improved; guiding the large model to generate an SQL (Structured Query Language) meeting business requirements through knowledge graph storage and retrieval table and column information; and the accuracy of the SQL is continuously optimized by utilizing a self-adaptive feedback mechanism, so that the method is particularly suitable for a large-scale complex query scene, and self-improvement and customization of the model are realized.

The invention provides an SQL statement generation method and system based on long and short term memory of a large language model, and relates to the field of man-machine interaction, the SQL statement generation method comprises the following steps: obtaining a preset large language model, and extracting mode design information of a target database of the large language model through a database administrator; analyzing and complementing the pattern design information, and generating long-term memory to introduce a large language model; extracting query elements through multiple rounds of conversations between a user and the model, and generating short-term memory to introduce a large language model; and obtaining an SQL generation task, and generating an SQL statement according to the large language model after the long-term memory and the short-term memory are introduced, so as to extract information from the target database. According to the method, the long and short term memory ability is introduced into the large language model, the flexible interaction ability of the large language model is fully utilized on the basis of a prompt word project of context learning, the user is gradually prompted and recommended to improve the query request, and the accuracy and availability of the generated SQL can be improved.

The invention relates to the field of natural language processing, in particular to a data query method, device and system based on a large model and a medium. Inputting the natural language question into a large language model, and matching a target database table corresponding to the natural language question from a plurality of database tables according to the natural language question through the large language model; matching a target field matched with the natural language question from a plurality of fields of a target database table according to the natural language question through a large language model; generating a query statement through a large language model according to the target field and database table information of the target database table; determining whether the natural language question contains an unviewable field or not according to the user permission; and if the natural language question does not contain the non-viewable field, querying from a database according to the query statement to obtain a query result. According to the method, the data security can be ensured while the query convenience is kept.

The invention relates to the technical field of database migration verification, in particular to a cross-data-platform database migration verification method and system applied to autonomous controllable transformation. The method comprises the following steps: configuring a source database and a target database in a data source management module; newly establishing a comparison task in the task management module; a comparison database is connected through a dynamic data source assembly, different databases are connected through JDBC, and comparison verification is executed after database connection parameters are configured; database comparison is carried out in the task management module, wherein the database comparison comprises data volume verification and data consistency verification; a comparison report is generated and stored in a built-in mode. The problem of data integrity in the cross-platform data migration process is solved, the system fully considers the difference between the MySQL database and the local database in character set, function and technical characteristics, data verification and comparison work after migration of the MySQL database source and various local target databases is supported, consistency verification before and after data migration is achieved, and the verification efficiency is improved. And the risk of data loss caused by data migration is avoided.

A system for migrating master data to a target system, comprising: at least one data processor; and at least one memory result in operations comprising: extracting the master data from a source database; validating the extracted master data at a database layer; mapping the validated master data to the target database specific datasets, and inserting the mapped master data into a target database, wherein the extraction, validation, mapping, and insertion are performed at the database layer.

The invention relates to the technical field of data processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a database data verification method which comprises the following steps: configuring source database connection parameters and target database connection parameters, setting comparison task parameters, and associating the comparison task parameters with corresponding database connection parameters; determining a source table and a target table corresponding to the source table identifier and the target table identifier, executing table structure comparison to generate a structure difference record, determining a data range according to a comparison mode parameter, executing data volume comparison to generate a quantity difference value, determining a data sampling strategy, and performing content comparison to generate a feature identifier comparison result; and finally, integrating the structure difference record, the quantity difference value and the feature identification comparison result to generate a verification report. According to the method, the data range and the sampling strategy are driven by comparing the mode parameters, so that the integrated processing of structure comparison, quantity comparison and content comparison is realized, and the accuracy and efficiency of data synchronization verification are improved in a heterogeneous database environment.

The embodiment of the invention discloses a data query method and device, electronic equipment, a medium and a program product. The method comprises the following steps: receiving a target data query request sent by a user side; the target data query request carries a target natural language query statement input by a user of the user side; performing intention recognition on the target natural language query statement to obtain a target intention recognition result; the target natural language query statement and the target intention recognition result are input into a target large model, a target database query statement is output, and the target large model is obtained through training on the basis of multiple known database query statements and natural language query statements of the intention recognition result; verifying whether the target database query statement meets a preset database query condition or not; and if yes, in response to the target data query request, executing the target database query statement to obtain a target data query result.

The invention discloses an incremental synchronization method, device and equipment of a database table structure and a storage medium, and is applied to the field of big data, and the method comprises the following steps: obtaining a DDL statement which causes the structure change of a source database through a trigger, and adding metadata of the DDL statement into a DDL operation record table; generating a pre-write log according to an addition operation of the DDL operation record table, and writing the pre-write log into the logic copy slot; and when a log reading request sent by the client through log monitoring is received, sending the pre-written log to the client, so that the client restores the DDL statement according to the pre-written log and sends the DDL statement to the target database, and the target database and the source database keep table structure increment synchronization. According to the method, the pre-write log which can be recognized and processed by the logic replication slot is generated through the trigger, the pre-write log is monitored for the logic replication slot through the client, and the DDL statement is analyzed and restored, so that corresponding DDL operation is executed in the target database, and increment synchronization of the table structure is realized.

The invention discloses a multi-database compatible query processing method and device and a medium, and relates to the technical field of data query processing. The method comprises the steps that according to configuration information of all compatible databases, dialect types of all the compatible databases are dynamically recognized, and corresponding dialect configuration rule sets are loaded; when an original SQL statement of the database operation is received, intercepting the original SQL statement before the database operation is executed through a preset interceptor mechanism; according to a dialect configuration rule set of the target database to be operated corresponding to the original SQL statement, reflecting and modifying the original SQL statement in the BoundSql object to obtain a standard SQL statement; and submitting the standard SQL statement to the to-be-operated target database for execution, and returning an execution result.