3292 results about "SQL" patented technology

The invention discloses an interactive question intelligent agent system based on a large language model, and relates to the technical field of dialogue interaction systems. Aiming at the technical defects of the traditional BI tool, the technical scheme is as follows: a heterogeneous data management engine realizes unified access and secure access of cross-source data; the NLP semantic recognition engine converts a natural language into structured semantics through multiple steps, drives the hybrid SQL generation engine and provides visual parameters; the generation engine realizes precise generation from semantics to SQL through a two-stage architecture based on metadata and authority rules; and the visual management console is combined with multi-party configuration and parameters to visually build a number-asking agent. The method is used for realizing intelligent conversion from a natural language to a structured query language (SQL) and a data service interface, and automatically generating an interactive data visualization result.

The invention discloses a Text2SQL (Structured Query Language) implementation method and system, and relates to the field of data processing, and the method comprises the following steps: firstly, receiving a natural language query, and analyzing a query intention, field classification and a key entity through a planner; the searcher obtains domain knowledge, entity information, a database table structure and a historical query mode in a multi-path parallel mode based on the planning result; the generator constructs an SQL framework according to the retrieval result and generates an initial statement; the verifier carries out grammar, table field, authority and logic multi-dimensional verification on the SQL, and if the verification fails, iteration adjustment is carried out to generate logic; when the SQL is executed, the result is formatted and a natural language explanation containing query logic, a data source and a calculation method is generated if the SQL is executed successfully, and a diagnosis and error correction mechanism is started for correction and then rechecking is performed if the SQL is executed unsuccessfully. According to the method, through deep fusion of domain knowledge, whole-process verification error correction and interpretability enhancement, the accuracy, robustness and user interaction experience of SQL conversion in a professional scene are improved.

A user provides a question to be answered from detailed, dense or otherwise complex documents to a processing system that converts the question to a structured query language query and generates an embedding from the question, augmented by temporal data, synopses, themes, or other relevant information or data. The embedding is compared to embeddings generated from documents of a knowledge base to identify documents that are relevant to the question, and to rank such documents for their relevance. Highly ranking documents are combined with the query and provided to a language model that returns an answer to the question. A source for the answer is identified in at least one of the documents. The answer and the identified documents are presented to the user.

The invention discloses an NL2SQL optimization method and device based on a large model, equipment and a medium, and relates to the technical field of artificial intelligence, the method comprises the following steps: constructing a target metadata knowledge base, and obtaining an initial natural language query request; determining each target entity corresponding to the initial natural language query request, and determining missing target SQL elements in the initial natural language query request based on each target entity; generating a first cue word based on the initial natural language query request, the target SQL element and the target metadata knowledge base, and complementing the target SQL element based on the first cue word by utilizing the target large model to obtain a target natural language query request; and generating a plurality of candidate SQL statements corresponding to the target natural language query request by using the target large model, verifying each candidate SQL statement, and determining a target SQL statement from each candidate SQL statement based on a verification result. According to the method, the accuracy of the NL2SQL can be improved by utilizing a large model.

A database system generates a prompt for an LLM or other machine learning (ML) model to narrow the search space to highly relevant information about a database. A distinct instance of a classifier, a clustering algorithm, or a topic modeling model can be trained based on information from ML automation within the database system, respectively for each column or table in the database. Model instances can then be used during generative LLM inferencing to identify relevant sources of data to answer the user's question. Thus, the prompt generation combines ML automation and other ML models or an LLM for topic modeling and schema description.

The invention provides an intelligent SQL generation method and system for business query, and belongs to the technical field of artificial intelligence. Related data of query statements are acquired, and a corresponding query intention knowledge graph is constructed by semantic clustering; the method comprises the following steps: analyzing a historical SQL statement structure, extracting a natural language template and an SQL template, and expanding through a large language model to generate a feed-shot example set; and constructing a composite cue word template by combining task setting guidance, a feed-shot example and CoT chain thinking reasoning guidance. An intention completion module is arranged in a large language model, a natural language query statement of a user is combined with a composite cue word template context, a structured query statement is generated through entity recognition, semantic completion, parameter filling and fuzzy intention training, and the structured query statement is converted into a standard SQL statement through a knowledge graph and a template. According to the method, the use threshold of business personnel is remarkably reduced, and efficient conversion from natural language questions to SQL statements is realized.

The invention discloses an RAG enhanced Text-to-SQL (Structured Query Language) query method and system for a large-scale database environment. The method comprises the following steps: constructing a vector database; based on the original query of the user, generating query enhancement description aiming at Schema recall and query enhancement description aiming at SQL (Structured Query Language) by utilizing LLM (Logistics Language Model); carrying out Schema recall and historical question and answer pair recall operations in a double-way parallel manner by utilizing an RAG technology and relying on the constructed vector database; based on query enhancement description, recalled Schema and historical question and answer pairs, generating an SQL query statement by using LLM in combination with RAG, and realizing Text-to-SQL conversion; the generated SQL query statement is subjected to post-processing optimization through a database interface, the post-processing optimization comprises grammar verification, performance optimization and error correction, the SQL query statement is combined for execution and feedback, efficient, accurate and reliable natural language query is achieved, and continuous optimization can be conducted through user feedback.

The invention relates to the technical field of automatic report generation, and provides a test analysis and report generation method and system based on large model retrieval enhancement, and the method comprises the steps: firstly carrying out the semantic task decomposition of user query, and meanwhile, achieving the multi-dimensional information extraction through the butt joint of a knowledge vector library and a structured image-text knowledge system established by a private knowledge base module. And three strategies of RAG, Self-RAG and Graph-RAG are combined to enhance the generation capability of the large model so as to accurately obtain background knowledge. And constructing a standard SQL statement according to a structured query requirement, and performing data filling according to template prompt by an output result fusion module in combination with a query background and an SQL execution result to form a test report. By optimizing a retrieval enhancement generation method, professional knowledge supplement related to query is realized, and the reasoning ability of a large model in a professional scene is effectively enhanced, so that the accuracy and the intelligent level of data analysis are improved.

The invention discloses a low-code platform based on a component library and a form engine, and relates to the field of data processing. The platform comprises a design system, an application system and a service system. The design system is provided with a form designer and a template manager, the form designer can configure a form component to generate a description file, and the template manager supports separate storage of a page template; the application system comprises a form analysis engine, a UI rendering engine and a reusable resource management component, the analysis engine analyzes configuration generation logic, the rendering engine loads a resource rendering page, and the reusable resource management component stores resources and generates configuration; the service system comprises a metadata analysis engine and an SQL assembler, the metadata analysis engine analyzes business rules to generate SQL and filtering strategies, and the SQL assembler generates operation statements adaptive to multiple data sources. Through the modular architecture design and the dynamic analysis mechanism, the problem that a low-code platform is insufficient in flexibility and usability is solved.

The invention discloses a structured query language generation method and device based on a large model, equipment and a medium, and relates to the technical field of artificial intelligence. The method comprises the steps of performing unified index definition and dimension definition for different business scenes, and combining indexes and dimensions in the business scenes according to the index definition and the dimension definition to obtain different structured query language templates; obtaining a natural language query statement input by a user in the current service scene, and performing semantic analysis on the natural language query statement by using a preset large model to obtain a semantic analysis result; and determining a target structured query language template matched with the natural language query statement from the structured query language templates according to the semantic analysis result, and filling the target structured query language template to generate a structured query language statement result. According to the technical scheme, the natural language query of the user can be efficiently and accurately converted into the structured query language statement.

The invention relates to the technical field of natural language processing, and provides an LLM-based complex language question SQL query generation method and system, and the method comprises the steps: responding to a target language question request; splitting a requested target language question sentence into one or more core clauses through a language model LLM, converting the core clauses into semantic vectors, calculating a matching score of each core clause and a question normal vector of each table in the schema knowledge document, performing sorting and screening according to the score size and a score threshold, and returning a recall result of the core clauses; combining and sorting the recall results of all the core clauses, and screening to generate a recall result of the target language question; and generating a Prompt through a Prompt script, and calling an LLM (Language Model) to automatically generate an SQL (Structured Query Language) query statement. The method does not depend on field fine tuning, does not need to reconstruct a wide table, and effectively solves the problem that a target table is difficult to position when a large language model processes coded value mapping, multiple tables and complex business logic by constructing a virtual table and splitting a question sentence into clauses containing complete semantics and matching the clauses.

Systems and methods for translating natural language to SQL on a custom enterprise data warehouse powered by Generative AI. With an embodiment of the present invention, a natural language question may be converted to a meaningful and accurate database query, e.g., SQL query, relevant to tables existing in an enterprise data warehouse. An embodiment of the present invention is directed to a comprehensive approach of transforming a natural language query to a focused SQL query using domain specific data models across firmwide metadata systems and data systems. In response to a user query, an embodiment of the present invention performs metadata analysis, targeted data retrieval and then SQL generation. An embodiment of the present invention may apply data warehousing standards and guidelines followed in the enterprise and provide a plug-and-play type architecture and solution that is scalable to large warehousing and other systems.

The invention provides a method for generating an SQL (Structured Query Language) by a natural language based on bidirectional mapping and semantic parsing, which relates to the technical field of database query and comprises the following steps of: extracting natural language query elements and packaging the natural language query elements into structured data, and establishing a mapping relationship from a query field to a service attribute and a physical data table by adopting a bidirectional Hash index technology; and automatically identifying multi-table association keys, performing semantic extension and compliance verification, generating an abstract syntax tree, performing processing according to user permission, and finally converting the abstract syntax tree into an SQL statement conforming to a target database syntax specification. According to the method, the accuracy and the efficiency of converting the natural language into the SQL are improved, and the flexibility and the safety of the system are enhanced.

The invention provides an SQL (Structured Query Language) statement generation method and system based on a large language model. Target database metadata are collected, a structured dictionary is constructed, cue words adaptive to the large language model are generated in combination with a user query strategy, and accurate SQL generation is realized through a closed-loop execution optimization mechanism after model reasoning and SQL analysis. Through a large language model intelligent analysis technology, a multi-source heterogeneous database metadata dynamic adaptation technology and a closed-loop optimization mechanism for SQL statement generation, execution and feedback, the efficient and accurate SQL statement automatic generation function is achieved through the characteristics of cross-database grammar automatic adaptation, complex service requirement accurate analysis, intelligent error correction and the like. The system not only improves the working efficiency of developers, but also reduces the resource occupation and operation and maintenance cost of the system, and improves the accuracy and safety of data query and processing.

The invention relates to the cross technical field of business intelligence and natural language processing, in particular to an interactive AI report generation method and system based on intelligent semantic driving, and the method comprises the steps: (1) a large language model analyzes user question semantics, calculates the matching degree with a report subject, and dynamically selects a question correction or report generation process; (2) the fuzzy query is converted into a deterministic request based on the domain knowledge base, and semantic ambiguity is eliminated; (3) analyzing field association in combination with database metadata, and generating an executable SQL (Structured Query Language); (4) dynamically rewriting SQL (Structured Query Language) according to user roles, adding permission filtering conditions, executing query and desensitizing sensitive data; (5) analyzing result features, automatically matching a visual form and generating natural language interpretation; and (6) collecting user feedback, and optimizing a semantic model and a query strategy. According to the scheme, the accuracy of natural language query and the adaptive capacity of the system can be remarkably improved, and the security of data access is guaranteed.

The invention provides a low-code dynamic configuration method based on a natural language, and relates to the technical field of natural language processing, and the method comprises the steps: carrying out semantic analysis on a natural language description input by a user through an intelligent agent, extracting a page type, a field attribute, a verification rule and interaction logic, and generating structured configuration data; dynamically generating JSON metadata for describing page layout, field components, verification rules and interaction logic according to a preset template on the basis of the structured configuration data; according to page function requirements, interface metadata matched with the JSON metadata is generated, and the interface metadata comprises a request address, a parameter list and corresponding SQL (Structured Query Language) operation logic; and analyzing the JSON metadata by utilizing a low-code configuration rendering engine, dynamically generating an interactive management function page, and modifying the JSON metadata in real time and re-rendering the page through natural language interaction between a user and an intelligent agent.

The invention relates to the technical field of artificial intelligence, and particularly provides an intelligent question asking method and device, based on a large model and semantic modeling, the method comprises the following steps: S1, a user interaction module receives a natural language question input by a user; s2, the semantic modeling module collects and integrates related data sources; s3, an analysis rule is built in the rule analysis module; s4, the large model processing module understands and answers the natural language question input by the user; s5, the SQL conversion module generates a universal logic SQL for the natural language problem input by the user through rules and natural language analysis; s6, the data processing and indexing module establishes a data indexing system; s7, establishing a dynamic feedback and learning mechanism; and S8, establishing a security and privacy protection mechanism. Compared with the prior art, the accuracy and timeliness of intelligent question answering of the user questions can be improved, and accurate answering of specific big data scene tasks is achieved.

The invention relates to the technical field of database operation and maintenance, in particular to a database operation and maintenance decision-making method and device based on a large language model.The method comprises the steps that real-time operation indexes and historical log data of a database are collected, and multi-dimensional time sequence features are extracted; and analyzing the characteristics by using a large language model, judging whether a performance bottleneck or an abnormal risk exists or not, and determining the relevance between the performance bottleneck or the abnormal risk and a database performance problem. If the risk exists, acquiring a system load sudden change trend and a resource request rate, quantifying a system pressure degree, and inputting a performance optimization model to generate an adaptive tuning strategy; calculating statement complexity through an SQL audit log, and selecting an index adjustment strategy in combination with an index optimization model; evaluating the influence of the tuning strategy and the index strategy on the throughput, the response delay and the resource utilization rate, and determining a target high-performance strategy; according to the scheme, accurate optimization and efficient operation and maintenance of database performance are realized through intelligent analysis and dynamic adjustment and optimization.

The invention relates to the technical field of data optimization, and discloses a financial data warehouse intelligent SQL (Structured Query Language) optimization method based on a large model, which comprises the following steps: S1, SQL statement analysis and preprocessing: carrying out word segmentation, grammatical analysis and logic structure analysis on an SQL statement submitted by a user, and identifying keywords, table structures and query conditions in query; s2, large model semantic understanding and optimization suggestion: performing semantic understanding and logical reasoning on the analyzed SQL statements by using a large model, and automatically generating optimization suggestions, the optimization suggestions including index recommendation, query rewriting and execution plan optimization; and S3, generating and selecting a dynamic execution plan. According to the method, the advantages of a large model in the aspects of natural language processing and intelligent decision making are fully utilized and combined with the specific requirements of the financial data warehouse, and the execution efficiency of SQL query and the overall performance of the system are remarkably improved; the query response time of the financial data warehouse can be effectively shortened, and the resource utilization rate is improved.

The invention provides an interactive data query and display method and system based on a large language model. The method comprises the steps that a user query request and a service database used for query are obtained; based on the user query request, obtaining a query intention classification result of the user query request and a key entity in the user query request; generating a structured query parameter based on the obtained query intention classification result and the key entity; based on the generated structured query parameters, through interactive processing, rewriting a user query request to conform to a standard query grammar; constructing a query cue word based on the rewritten user query, and generating an SQL statement through a pre-trained large language model based on the constructed query cue word; obtaining a data query result from a business database for query based on the generated SQL statement; based on the query result, a chart is automatically generated to display the query result, and the chart type is determined according to the chart display type of the historical query result of the user.

The invention provides an SQL (structured query language) statement generation method based on large-model multi-stage iteration, which is used for database structure understanding and natural language SQL query generation, constructing multi-level semantic embedding of a database structure through advanced semantic modeling, and deeply analyzing a natural language query request of a user by utilizing an intention recognition model; a query intention frame is extracted in combination with a pre-trained large model, the query intention frame and database semantics are embedded and fused by adopting a calibration correction model and in combination with a multi-stage feedback mechanism, and a query intention and model parameters are optimized step by step; an optimal practice SQL statement is generated through deep optimization and a retrieval strategy model, model parameters and retrieval strategies are continuously optimized through self-adaptive evolution and user preference feedback, and a knowledge base is updated. According to the method, the problems of much manual intervention, inaccurate intention understanding, insufficient structure understanding and lack of a feedback mechanism are effectively solved, and efficient and accurate SQL query generation is realized.

The invention provides an intelligent data query method based on a natural language, and relates to the technical field of intelligent data processing and natural language interaction.The intelligent data query method comprises the steps that firstly, enterprise original data is subjected to standard treatment, and a standardized theme database and a data directory and index definition document are constructed; key semantics are extracted based on unstructured knowledge, and a domain knowledge vector library is fused and constructed by combining document text fragments and vector representation of a mapping relation between historical questions of a user and an SQL (Structured Query Language). And after receiving a natural language question of a user, calling a large language model to identify a task type, and distinguishing knowledge questions and answers, data query and complex analysis. Executing corresponding operations according to different types: directly retrieving a vector library by knowledge questions and answers to generate answers; extracting keywords in data query and generating a query request in combination with context; and in the complex analysis, predefined workflow is judged and executed or intelligent agent processing is called, and query or analysis requirements are output.

The invention discloses a multi-table combined natural language query SQL (structured query language) generation method, which comprises the following steps of: 1, constructing a database meta-knowledge graph, and establishing a triple storage comprising a table structure, a primary and foreign key relationship and business description for each data table; 2, receiving a natural language query request, and calculating the topic relevancy between query semantics and each database table through a pre-trained topic matching model; 3, dynamically constructing a view, and logically associating the database tables of which the theme relevancy exceeds a threshold value to form a temporary view; 4, generating a context enhancement prompt, and combining the temporary view structure, the field semantic description of the view and the view content sample to form a structured prompt; 5, inputting the natural language query and the structured prompt into the large language model to generate candidate SQL statements; and step 6, executing verification and iterative optimization on the candidate SQL statements, verifying logic correctness through SQL execution plan analysis and result sampling, and triggering and prompting a reconstruction mechanism when detection is abnormal.

The invention relates to the technical field of database optimization, in particular to a slow SQL (Structured Query Language) statement optimization method and system, electronic equipment and a storage medium, the slow SQL statement optimization method comprises the following steps: preprocessing a collected target slow SQL statement to obtain multi-modal data of the target slow SQL statement; inputting the multi-modal data of the target slow SQL statement into the multi-modal large model, and performing feature extraction and fusion to generate comprehensive semantic representation; generating an optimization suggestion of the target slow SQL statement according to the comprehensive semantic representation; the optimization suggestions are verified, and then the optimization suggestions which are verified to be qualified are executed in a database. Through multi-dimensional data acquisition, large-model deep analysis and automatic strategy execution, full-life-cycle quality detection and optimization of the slow SQL statement are realized.

According to the artificial intelligence-based data analysis system and method provided by the invention, a set of novel data analysis system architecture is designed, and key technical components such as natural language processing, a large language model, database query optimization, multi-modal visualization and a semantic knowledge graph are fused; data transmission between modules is realized through unified intermediate data objects such as a structured query intention, an analytic tree and a structured query language template object, and asynchronous collaboration is realized through event driving and a message queue mechanism, so that a non-professional user can input an analysis request through a natural language; semantic analysis, structured query language query statement generation, data query and result visualization presentation are automatically completed, the method can be widely applied to data analysis scenes in the industries of government affairs, traffic, finance, education and the like, the data use efficiency is improved, the technical threshold is reduced, and the digital decision-making ability is enhanced.

The invention discloses an automatic NL2SQL data set construction method and system based on a large language model. The method comprises the steps that service-oriented SQL query data collection is carried out; the method comprises the following steps of: collecting SQL query statements related to business through a channel, and cleaning and standardizing an obtained SQL sample by adopting a data preprocessing technology; generating NL2SQL data based on a large language model; a mapping pair between the natural language and the SQL is generated by using a large language model, corresponding natural language description is generated through reverse derivation according to a specific business problem and a table connection mode, and the conversion process from the SQL to the natural language is realized; optimizing the quality of the NL2SQL data set; and dynamically updating a data set for private deployment. According to the method, an automatic SQL sample generation mechanism and a multi-dimensional quality control process are introduced, so that manual intervention is remarkably reduced, and the diversity and accuracy of a data set are improved.

The invention relates to a method for generating steel field TEXT2SQL based on LLM enhanced by RAG, which comprises the following steps: firstly, establishing connection with a steel database, and defining user semantic information and a database mode; then, obtaining user input and carrying out natural language processing; thirdly, guiding a large language model to generate a more accurate SQL query by utilizing the generated group of guiding words prompt; then, natural language query is converted into SQL query in combination with a large language model and an RAG technology; when a new user query is received, searching a historical query most similar to the new user query and a corresponding SQL query from the vector database; and finally, performing grammar correctness and logic rationality verification on the generated SQL statement, and outputting the SQL statement. According to the method, the problem that table names and field names are difficult to obtain when a large language model generates accurate SQL statements according to user description is solved. According to the method, the high-quality SQL query statement can be effectively generated, and the accuracy and the use efficiency of steel database query are improved.

The invention relates to the technical field of natural language processing, in particular to an enterprise number asking system and method based on combination of a large language model and an NL2SQL, and the method comprises the following steps: filling a prompt project template with a natural language query request and a structured metadata context, and generating a standard prompt; the standard prompt is input into the large language model, deep semantic analysis is carried out, and an SQL query draft is generated; self-evaluation is carried out on the questions, and when the questions are recognized, clarified questions are generated and returned to the user; receiving feedback of a user, and iteratively optimizing the SQL query draft based on the feedback; performing grammar verification and security verification on the final SQL query draft to generate an executable SQL statement; sending the executable SQL statement to a target enterprise database for execution; and the information is visually displayed to a user. The problem that the SQL generated in the prior art deviates from the real intention of a user and cannot meet the requirements of enterprise-level applications for accuracy and reliability can be solved.

The invention discloses a method and a device for adaptively generating a structural query statement by using a natural language. The method comprises the following steps: acquiring a natural language query statement input by a user; vectorizing the natural language query statement to obtain a first query statement and a data table and an SQL statement corresponding to the first query statement; rewriting the natural language query statement to obtain a second query statement; recalling a candidate data table and a candidate table field based on the second query statement and a preset to-be-queried data table; the first input data and the first sample data are input into the preset large language model, the query statement and the reasoning chain are structured, the natural language query statement input by the user is corrected, the difference between the natural language query statement and the database table structure is reduced, and the accuracy of data table recall is improved; by recalling the candidate data table, the reasoning difficulty is reduced, so that the accuracy of generating the structured query statement according to the natural language query statement is improved.

The invention provides a method and a device for converting a natural language statement into an SQL (Structured Query Language) and a storage medium, relates to the technical field of data processing, and is used for improving the accuracy of converting the natural language statement into the SQL statement. The method comprises the steps that semantic analysis is conducted on a data query text, a target entity and at least one query field are obtained through extraction, and the target entity indicates a query intention corresponding to the data query text; determining a comprehensive similarity between each query field and each first candidate node according to a semantic similarity and a structural similarity between each query field in the at least one query field and each first candidate node in a pre-stored knowledge graph; determining a target node corresponding to each query field according to the comprehensive similarity between each query field and each first candidate node; according to the information, the data query text can be converted into the structured query statement.