66 results about "Natural language question answering" patented technology

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

An automated data extraction pipeline for large language model (LLM) training may include extracting a set of code segments from a set of natural language question-answer (Q&A) combinations that each include a provided input, a provided output, and a provided code segment formatted to transform the provided input into the provided output. The data extraction pipeline may then generate a predicted output from a question portion of a first natural language Q&A combination using a first LLM. A first extracted code segment from the extracted set of code segments may then be executed to generate a first actual output of the first extracted code segment. One or more data samples may then be generated for training a second LLM based on a comparison of the first actual output to the predicted output. The second LLM may then be trained using the one or more data samples.

This disclosure describes a natural language question (NLQ) query service within a service provider network that provides row level security (RLS) for autocomplete during entry of NLQs and fuzzy matching in NLQ answering. The rules take the form of per-user predicates such as Tim can only see rows with region=US. In configurations a complex extraction and preprocessing pipeline to extract distinct combinations of values against RLS predicate “rule keys” is used. Those distinct values are indexed along with grouped rule keys to enable pushing down predicates at auto-complete time. This enables pushing part of RLS rule handling to ingestion time of a dataset rather than handling all RLS rule handling at query time, enabling meeting of latency goals. In configurations, a single logical document of unique cell values is split into multiple documents with a subset of rule keys to handle scalability limits.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

Provided herein are systems, methods, and computer-readable media for generating one or more database queries based on a natural language input data. An example method comprises configuring, using a conversational artificial intelligence (AI) editing module, information for a task. Moreover, the method may further comprise parsing the configured information based on a database schema to obtain a parsed database schema. Further, the method may further comprise generating, using a natural language question-answering system, one or more database queries based on the parsed database schema and natural language input data.

The invention discloses an equipment fault natural language question and answer method and system based on cue word optimization. The method comprises the steps of obtaining an equipment fault problem which is input by a user and described by a natural language; performing natural language understanding and semantic representation on the question, and identifying core words and dimensions; generating an optimal query prompt word based on the core word and the dimension; combining the optimal cue word with a pre-constructed equipment fault knowledge base, and constructing query and retrieving related knowledge; generating a natural language reply based on the retrieval knowledge and presenting the natural language reply to the user; obtaining user feedback information; and based on the feedback information, optimizing the cue word generation strategy and updating the knowledge base to form a closed-loop learning process. The system further comprises innovation modules such as cross-modal fusion and understanding, intelligent labeling and knowledge extension. According to the method, innovative mechanisms such as cue word optimization generation, knowledge base closed-loop optimization, multi-source heterogeneous data fusion utilization and low-cost knowledge extension are provided, and highly-intelligent fault diagnosis and guidance are realized.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

The invention discloses a natural language question and answer method, system and device, a medium and a product, and relates to the technical field of semantic recognition. The method comprises the steps that a user question is recognized based on a named entity recognition model, and a key entity is determined; the key entity comprises a place name, a distance and an orientation in the question; performing text classification on the user question based on a user intention recognition model, and determining the intention of the user; determining a structured query statement based on a preset language model according to the key entity and the intention; obtaining multi-dimensional geographic space data in the Internet map; converting the multi-dimensional geographic space data into a triple, and constructing a structured knowledge graph; and according to the structured query statement and the structured knowledge graph, determining an answer to the user question. According to the method, the intention of the question of the user is accurately and intelligently understood, and the accurate answer is returned.

The invention discloses a knowledge base knowledge association fusion method based on a knowledge graph, and the method comprises the steps: integrating structured, semi-structured and non-structured data through a cross-modal alignment technology, and constructing a multi-source heterogeneous data association network of a unified semantic space; newly added external data are fused to a multi-source heterogeneous data association network in real time by using a dynamic attention mechanism, and entity conflicts are eliminated by combining rule reasoning and a machine learning model; hidden association among entities in the multi-source heterogeneous data association network is mined based on the graph neural network, and a knowledge graph logic chain is complemented; based on the knowledge graph, intelligent question and answer and risk assessment decision scenes are supported through a hybrid retrieval architecture and an inference engine; and automatically updating and associating the knowledge base of the network extension knowledge graph by adopting an incremental learning technology. Natural language questions and answers are supported, accurate answers are generated through knowledge reasoning, and user experience is remarkably enhanced.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

The invention relates to the technical field of large language models, in particular to a natural language question and answer framework, method and device based on self-reflection, and can solve the problem that large language models LLMs (Language Models) such as ChatGPT and PaLM in the prior art show excellent performance in various language understanding and generation tasks to a certain extent, and the problem that the Language Models are difficult to understand and generate can be solved to a certain extent. However, the ability of the method in the aspects of complex reasoning and complex knowledge utilization is still lower than the human level. The framework comprises: a thinking chain module for receiving an input question, outputting a model thinking process according to the input question, and obtaining and outputting an answer at the end; the persuaser module firstly evaluates the correctness of the answer and the reasoning step, and outputs a corrected reasoning path to the responder module if an error exists in the reasoning step; and the answerer module is used for providing answers according to the corrected reasoning path and self-prompted question type information, and optimizing the output accuracy of the large model through repeated iteration.

The invention discloses a question and answer method based on medical institution internal knowledge base retrieval enhancement generation, electronic equipment and a storage medium. The method comprises the following steps: S100, constructing a medical institution internal knowledge base; s110, collecting an original document, preprocessing the original document, dividing the original document into text blocks, and storing the text blocks into a database; s120, establishing vectorization and indexing based on abstracts for the text blocks; s200, based on the questions of the user, performing retrieval to generate answers; s210, rewriting and expanding the original query to obtain an expanded query; s220, performing multi-path mixed retrieval, namely performing preliminary retrieval on the original query and the extended query to obtain N candidate text blocks; s230, rearrangement and careful selection are carried out, and M most relevant text blocks are selected by adopting a rearrangement model; and S240, answer generation and source tracing: integrating the original query, the M text blocks and the instruction large language model to generate a section of natural language question and answer to obtain an answer result. Accurate, efficient and traceable natural language question and answer service is provided for medical care and management personnel, and standardization, accuracy and efficiency of medical work are improved.

The invention discloses a business database natural language question and answer processing method fused with a large model technology. The method comprises the following steps: S1, receiving an emergency query request input by a user in a natural language form; and S2, carrying out analysis and intention recognition on the emergency query request based on a large language model, and generating a group of candidate query intentions arranged in a descending order according to matching degree scores and corresponding key entity information. According to the method, a core link can be optimized by introducing a large language model technology: in an intention recognition stage, intention recognition accuracy is improved through a formula of fusing semantic similarity and entity type matching degree; a priority-based asynchronous execution strategy is adopted to improve the response efficiency; the response reliability is guaranteed through real-time and conflict verification; meanwhile, the system performance is continuously improved in combination with an offline model optimization link, the defects of an existing processing method are finally overcome, and an accurate, efficient and reliable solution is provided for business database natural language question answering in an enterprise emergency scene.

A method of using a computing device to improve an answer generated by a natural language question and answer system includes receiving, by a computing device, multiple questions in a natural language question and answer system. The computing device further generates multiple answers to the multiple questions. The computing device still further constructs a new training set with the generated multiple answers, where each answer is compared with a corresponding question of the multiple questions. The computing device additionally augments the new training set with one or more tokens delimiting a span of one or more of the generated multiple answers. The computing device further trains a new natural language question and answer system with the augmented new training set.

The invention provides a dialogue method, device and equipment based on a large language model, and relates to the technical field of natural language processing, and the method comprises the steps: obtaining a natural language query statement input by a user and historical dialogue information of the user; generating an enhanced query vector corresponding to the natural language query statement according to the natural language query statement and the historical dialogue information; according to the enhanced query vector, determining a related target FAQ fragment from a preset common question and answer FAQ knowledge graph; the target FAQ fragment comprises a question and an answer; and according to the target FAQ fragment, adopting a preset large language model to generate a natural language dialogue text corresponding to the natural language query statement. By adopting the method, the accuracy and response speed of natural language question answering can be improved.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions with respect to network-based services or computing domains. A natural language question answering service may receive a natural language question from a client computing device. An aggregator of a natural language question answer service may retrieve paragraphs from a search system and generate prompts based on questions. A Large Language Model (LLM) of a natural language question answer service may receive cues and provide answers. The answer may be verified by a verifier of the natural language question answering service. Attributes may be applied to answers and retrieved paragraphs to generate references, embedded references, and similar questions. A watermarking module of the natural language question answering service can watermark the answer under the condition that the answer is verified.

Some embodiments relate to a method for generating one or more database queries based on natural language input data, the method comprising: using a dialog stream editor to configure or define information required to complete a task-oriented dialog; parsing the configured information based on a database schema to obtain a parsed database schema; and, using a natural language question answering system, using the parsed database schema and the natural language input data to generate the one or more database queries.

Systems and methods are provided for a natural language question answering service to provide answers to natural language questions regarding network-based services or computing domains. The natural language question answering service may receive the natural language question from a customer computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service may receive the prompt and provide an answer. The answer may be verified by a verifier of the natural language question answering service. Attribution may be applied to the answers and retrieved passages to produce references, inline citations, and similar questions. A watermarking module of the natural language question answering service may watermark the answer if it is verified.

Techniques for finetuning a large language model (LLM) are described. The finetuned LLM is generated by sequentially tuning a trained LLM using: (i) pairs of questions and corresponding context received from at least one source different from the trained LLM; and (ii) the questions without the context. The finetuned LLM may be used to generate an answer to a question, and user feedback and context may be used to update a trained machine learning (ML) configured to determine context for input to the finetuned LLM at inference. The updated trained ML model may thereafter process a question to determine context usable to answer the question; the question and the context may be processed by the finetuned LLM to determine an answer to the question; and the question, context, and answer may be used to further finetune the LLM.

This disclosure describes techniques and architecture for enriching dataset metadata of datasets arranged in tabular form comprising rows and columns, wherein each column has a name. The dataset metadata is enriched with business semantics for natural language question answering. The techniques include one or more of generating one or more synonyms for each name; ranking the names with respect to a likelihood that a column includes possible data to be returned to a user in response to a received NLQ from the user; predicting a date granularity for each column; and predicting a semantic type to describe values in the columns.

The present invention discloses a method for evaluating the significance of knowledge graph triples based on natural language question answering. The steps are as follows: First, for a given knowledge graph triple, extract the relationship it contains; then, according to the question generation templates corresponding to different pre-set relationship types, convert the triple into the form of a natural language question; based on the generated question sequence, the original task of evaluating the significance of knowledge graph triples can be transformed into a natural language question answering task, and then the existing large-scale pre-trained language model is further fine-tuned through the method proposed by the present invention, and finally the evaluation result of the significance of knowledge graph triples is output. This method significantly improves the accuracy of evaluating the significance of knowledge graph triples without relying on any external knowledge base and graph representation learning.

The invention discloses a method for identifying focus words in a natural language question for an intelligent question answering system, and relates to the technical field of natural language question answering. The invention provides a method for identifying focus words in natural language questions, so that a question answering system can more accurately understand concern points of a user; a prefix tree structure dominated by decision items is provided, an algorithm for mining strong focus association rules to identify focus words is further introduced based on the prefix tree, and the algorithm is more efficient than a classical association rule mining algorithm Apriori; an inverted index for a strong focus association rule is provided, and an algorithm for identifying focus words is further introduced based on the inverted index and is more efficient than sequential search; and a focus item set, a frequent focus item set, a focus association rule and a strong focus association rule are defined so as to better express information related to focus words.

The application provides a kind of operation and maintenance scene visualization report generation method and system based on natural language question and answer, belongs to intelligent operation and maintenance technical field, method includes: receiving the natural language query input by user;Through the pre-training of large language model and the preset operation and maintenance terminology dictionary, the natural language query is parsed and entity is extracted, and the entity-field association table containing demand type is generated;According to demand type and semantic feature, the query type is judged to be data query or visual query;Based on the judgment result, generate structured query language sentence or visual instruction;Query is executed to the interface business database to obtain raw data;Raw data is processed and analyzed to obtain analysis result data;Call data feature adaptation algorithm to match chart type, generate and output visual report.The application realizes the full-link automation from natural language input to visual report output, reduces the operation and maintenance data interaction threshold, improves the operation and maintenance data processing efficiency and accuracy.

A method for improving responses generated by a natural language question answering system using a computing device, including receiving, by the computing device, a plurality of questions in the natural language question answering system. The computing device also generates a plurality of responses to the plurality of questions. The computing device further utilizes the generated plurality of responses to construct a new training set, wherein each response is compared with the corresponding question among the plurality of questions. The computing device additionally augments the new training set with one or more markers that delimit one or more spans of the generated plurality of responses. The computing device also trains a new natural language question answering system with the augmented new training set.

A current set of context features for a database query that is associated with a string is identified. The database query includes a sequence of tokens of a database syntax, and the current set of context features includes words from the string and tokens from the database query. An inference record is selected from an inference store based on a comparison of the current set of context features to context features of inference records in the inference store. The database query is modified using a resolution of the inference record to obtain an inferred database query. The resolution includes one or more tokens of the database syntax. A search of a database is invoked using a query based on the inferred database query to obtain search results.

Embodiments described herein provide a pipelined natural language question answering system that improves a BERT-based system. Specifically, the natural language question answering system uses a pipeline of neural networks each trained to perform a particular task. The context selection network identifies premium context from context for the question. The question type network identifies the natural language question as a yes, no, or span question and a yes or no answer to the natural language question when the question is a yes or no question. The span extraction model determines an answer span to the natural language question when the question is a span question.

Systems and procedures are provided for a natural language question answering service to deliver answers to natural language questions about network-based services or computer domains. The natural language question answering service can receive the natural language question from a client computing device. An aggregator of the natural language question answering service can retrieve passages from search systems based on the question and generate a prompt. A large language model (LLM) of the natural language question answering service can receive the prompt and provide an answer. The answer can be verified by a verifier of the natural language question answering service. Attribution can be applied to the answers and the retrieved passages to generate references, embedded quotes, and similar questions.A watermarking module of the natural language question answering service can watermark the answer when it is verified.

This invention discloses a method and system for power operation safety monitoring and question answering based on a multimodal large model. The method includes the following steps: a data acquisition step, acquiring visual data and safety regulation text data from the power operation site; a multimodal semantic fusion step, generating a unified fused semantic vector through feature extraction and cross-modal alignment fusion technology; a knowledge reasoning step, matching the fused semantic vector with a pre-constructed power safety knowledge graph and performing compliance reasoning based on a graph neural network; and an intelligent question answering generation step, inputting the fused semantic vector and the reasoning results into a large language model to generate natural language question answering information. This invention, through the synergistic innovation of multimodal semantic fusion, knowledge graph reasoning, and a large language model, solves the technical problems of insufficient semantic understanding, disconnect between the question answering system and the field, and unstructured knowledge representation in existing technologies, achieving fully automated and interpretable intelligent safety supervision from perception to cognition.