75 results about "Machine reading" patented technology

The present invention relates to the technical field of wireless network optimization operations and maintenance, and provides a two-stage optimized wireless network optimization field long entity recognition method and system. The method comprises: using a pretrained long entity recognition model to process acquired text content to be recognized to obtain a long entity recognition result; by means of a first-stage predecessor task, acquiring a pretrained model TelBert having domain knowledge; and in a second stage, introducing semantic information related to an entity to obtain a machine reading comprehension framework-based long entity recognition model, and decoding the entity by means of a dual-pointer network. According to the present invention, knowledge in a specific field is learned by adding an entity type prediction task, the text representation learning capability of a base model is enhanced, and the difficulty of model tuning in a few-shot scenario is alleviated; the entity recognition model is improved to obtain an MRC-LER model suitable for document-level long entity recognition; and a semantic similarity-based evaluation index is proposed, and the effective extraction rate of entity key information is reasonably evaluated.

An autonomous agent receives a user query comprising the complex question. The agent can obtain, from a corpus of unstructured texts, an answer candidate text corresponding to the user query and comprising text from which the answer is subsequently identified. The agent may generate first linguistic data corresponding to the user query and second linguistic data corresponding to the answer candidate text. Each instance of linguistic data may comprise a combination of respective syntactic data, semantic data, and discourse data generated from the user query and / or answer candidate text. Both instances of linguistic data may be provided to a machine-learning model that has been previously trained to output an answer identified from an instance of unstructured text (e.g., the answer candidate text). The model may output the answer identified from the answer candidate text, which in turn may be provided in response to the user query.

The invention discloses an equipment defect grade classification method and system based on a knowledge graph, and belongs to the field of equipment defect classification. Structured information is extracted through a two-stage pipeline extraction algorithm; a few-sample named entity recognition task is realized by a prompt-based machine reading understanding named entity recognition method; judging the relationship between the paired entities based on a prompted relationship extraction method; according to the template-based structured data triple extraction method, original structured data is analyzed into a knowledge triple; deep structure information in the knowledge graph is learned by expanding first-order to second-order proximity; realizing candidate entity generation and candidate path extraction based on a dual-channel recall strategy; and performing fine-grained semantic matching and sorting on the input defect text and the candidate path based on a single-tower structure to position the most similar defect type. According to the method, the knowledge graph construction technology is utilized to solve the problems of integration, processing and efficient utilization of multi-source heterogeneous data, and the efficiency and accuracy of defect classification are improved.

The invention relates to the technical field of multi-label text classification, and discloses a small-sample multi-label text classification method based on machine reading understanding, which comprises the following steps of: firstly, preprocessing a multi-label text data set, unifying formats and labeling labels; secondly, designing an auxiliary problem based on the label, and combining the auxiliary problem with the text instance to form input data; a RoBERTa model is used as a joint encoder trunk, semantic correlation between texts and questions is learned, and a label graph representing a label relation is constructed. Through feature fusion, the model is trained to minimize a loss function, and a verification set is used to carry out hyper-parameter tuning. And finally, evaluating the model performance on the test set, and verifying the advantages and component contribution compared with the traditional method. By converting multi-label text classification into a machine reading understanding task, the semantic correlation between the text and the labels can be better captured, and the accuracy of multi-label text classification is remarkably improved.

The present invention relates to a text analysis method, system, device and medium based on text structure, which comprises the following steps: parsing the acquired text to be analyzed to obtain its text structure; respectively performing machine reading on each text structure of the text to be analyzed to obtain the embedding vectors corresponding to the respective text structures; fusing the obtained embedding vectors to obtain a fused article embedding vector; and obtaining a text analysis result based on the fused article embedding vector. The present invention takes into account the important significance of the article structure for machine understanding, and parses according to the structure of abstract - paragraph {paragraph title - paragraph content}, enabling the model to have the ability of reading by sub - structure. Therefore, the present invention can be widely applied to the field of text analysis.

A dialogue processing apparatus includes one or more computers each including a memory and a processor configured to receive a question Qi as a word string representing a current question in an interactive machine reading comprehension task, a question history {Q1, . . . , Qi−1} as a set of word strings representing previous questions, and an answer history {A1, . . . , Ai−1} as a set of word strings representing previous answers to the previous questions, and use a pre-learned first model parameter, to generate an encoded context vector reflecting an attribute or an importance degree of each of the previous questions and the previous answers; and receive a document P to be used to generate an answer Ai to the question Qi and the encoded context vector, and use a pre-learned second model parameter, to perform matching between the document and the previous questions and previous answers, to generate the answer.

Implementation method and device for machine reading comprehension assisted by a generative model. A reading comprehension model is constructed for multiple-choice questions, including two workflows: 1) the generation workflow, where the question is input into an encoder to obtain a question encoding representation, and then input into a decoder to obtain an answer decoding representation. During training, a teacher-forcing loss is calculated based on the correct option; 2) the reading comprehension workflow, where the question encoding representation is separately used by the decoder to generate a vector representation of the question extension using a greedy strategy. At the same time, the question is concatenated with each option and input into the encoder, and the corresponding output question-option representation is interactively fused with the extended vector representation. The logit corresponding to each option is obtained from the resulting fusion result. During training, the cross-entropy loss is calculated between these logits and the correct option, and the reading comprehension model is trained and optimized by combining the teacher-forcing loss and the cross-entropy loss. The present invention uses a single dataset for training, improving the reading comprehension accuracy for multiple-choice questions.

The present invention discloses a machine reading comprehension method based on iterative screening and pre-training enhancement, including: constructing an iterative screening network: training the initial screening network with the question and document pairs of the HotpotQA data set; finding the most relevant document from the original data containing the interference documents; iterative screening process, based on the documents obtained by the initial network and the original questions, screening out the supporting documents most relevant to the initial screening network and documents from the current document set, and obtaining two-step supporting documents related to the questions. Constructing a reader network: fine-tuning the SQuAD data with a pre-trained model to obtain a single-step reading comprehension model; performing two joint trainings on a multi-step reading comprehension data set to obtain answers and supporting facts about the questions and documents. The present invention can achieve better multi-step machine reading comprehension effects without constructing a complex graph neural network and decomposing multi-step problems.

An electronic device is provided. The electronic device includes a display and a processor, and the processor is configured to control the electronic device to: obtain text corresponding to an input based on a machine reading comprehension (MRC) model, obtain a plurality of operation information by dividing the text into operation units of the electronic device, obtain sequence information of the plurality of operation information based on the plurality of operation information and the obtained text, and control the display to provide a guidance user interface (UI) so as to sequentially execute the plurality of operations based on the sequence information.

The present invention discloses a question-answer processing method and an intelligent device, which relates to the technical field of natural language processing, wherein the method comprises using sample data to pre-train a question-answer generation model and a machine reading comprehension model in linkage; inputting the text data to be tested into the question-answer generation model to generate a target question and a benchmark answer; inputting the text data to be tested and the target question into the machine reading comprehension model to obtain a predicted answer; verifying the predicted answer, and if the predicted answer is successfully verified, storing a matching pair of the target question and the predicted answer. The scheme of the present invention can improve the accuracy of question-answer interaction of intelligent devices.

The present invention discloses a corpus positioning method, an intention recognition method, and a model training method, device, equipment, and medium thereof. The training method of the corpus positioning method includes: obtaining multiple groups of training samples, inputting the query text in the training samples and the query text into a pre-training model for feature extraction, and obtaining feature extraction results; performing secondary feature extraction on the overall features of the training samples, the character features of each character contained in the query text, and the overall features of the query text to obtain word features; inputting the feature extraction results and the word features into a machine reading comprehension model; calculating the first calculation error of the machine reading comprehension model based on the annotated positioning information and predicted positioning information of the query text in the corpus, and adjusting the parameters of the machine reading comprehension model based on the first calculation error until the convergence condition is met, and obtaining a trained corpus positioning model. Inputting the feature extraction results and the word features into the machine reading comprehension model, the output is more accurate.

The present application relates to a kind of machine reading comprehension method based on repeated span prediction, belong to natural language processing machine reading comprehension field.The method includes: for the reading comprehension task of span prediction form, increase the task of predicting repeated span.The task first finds all repeated spans in text paragraph based on greedy algorithm, then the short span contained in long span is filtered, after obtaining repeated span set, for each group of repeated span, randomly select one as answer span, and other spans in group are replaced by mask.Processed text is input into pre-training model, and representation vector is obtained, and based on softmax, which span in paragraph should the mask position point to be predicted.In the task, the obtained model is further fine-tuned on target task.The method considers the problem of lack of span knowledge of pre-training model, and constructs data in unsupervised manner, so that the model can better learn span representation, and improve the performance of model in span prediction.

Systems, devices, and methods discussed herein are directed to generating an answer to an input query using machine reading comprehension techniques and a lattice of supported decision trees. A supported decision tree can be generated from the various decision chains (e.g., a sequence of elements comprising a premise and a decision connected by rhetorical relationships), where the nodes of the decision tree are identified from the plurality of decision chains and ordered based on a set of predefined priority rules. A lattice may include nodes that individually correspond to a respective supported decision tree. Nodes of the lattice may be identified for an input query. The passages corresponding to those nodes may be obtained and an answer for the query may be generated from the obtained passages using machine reading comprehension techniques. The generated answer may be provided in response to the query.

A moving image comprising: at least one genuine machine-readable image (e.g. barcode 22) capable of actuating a function in a machine reading system 101,104; at least one non-readable image (fake) tha

A machine reading comprehension method includes obtaining a question text and an article text associated with the question text, generating a first knowledge text corresponding to the question text and a second knowledge text corresponding to the article text based on a knowledge set, encoding the question text and the article text to generate an original target text encoding, encoding the first knowledge text and the second knowledge text to generate a knowledge text encoding, performing a fusion operation on the original target text encoding and the knowledge text encoding, importing part of the knowledge in the knowledge set into the original target text encoding to generate a reinforced target text encoding, and obtaining an answer corresponding to the question text based on the reinforced target text encoding, and outputting the answer.

Information extraction and image restructuring includes generating semantic vectors to encode portions of text extracted from a document. For each semantic vector a semantic similarity between a schema key and other text encoded therein is determined based on their respective positions within the document. An enhanced NLP model is created using the semantic vectors, each labeled according to the semantic similarity. The text, including schema key, are re-encoded as a key and candidate vectors. Key-value pairs are generated by matching the key vector with a predetermined number of candidate vectors. The enhanced NLP model, using prompt learning, is repurposed to perform a next-sentence prediction that predicts which of the candidate vectors is logically related to the schema key. Based on the next-sentence prediction, the discrete portion of text identified as the schema key and portion of text determined to be logically related thereto are output.

The invention relates to a traffic network security event extraction method based on machine reading understanding, which performs joint training and optimization on a trigger word prediction module and an argument extraction module by sharing a coding layer of a pre-training language model, so that two tasks promote each other in a shared semantic space. Accurate context constraints are provided for argument role judgment through trigger word recognition, disambiguation of trigger word types is facilitated through argument information, and the deep interactive optimization mechanism enables the model to learn collaborative representation sensitive to the whole event structure. Therefore, the overall accuracy of event extraction and the generalization ability of the model are remarkably improved, and the inherent error propagation problem in a traditional assembly line method is solved.

The utility model relates to the technical field of cooling liquid label scanning and storage, and discloses a cooling liquid label scanning and machine reading storage device which comprises a bottom plate and a cleaning brush, a placing seat is arranged on the front side of the top of the bottom plate, a vertical plate is fixedly connected to the back side of the top of the bottom plate, and an adjusting box is fixedly connected to the back side of the vertical plate. The top of the adjusting box is fixedly connected with a servo motor, the output end of the servo motor is fixedly connected with a screw rod, the surface of the screw rod is in threaded connection with a thread sleeve, the front surface of the thread sleeve is fixedly connected with a connecting rod, and the front side of the connecting rod is fixedly connected with a scanner body. According to the machine-readable storage device for the coolant label scanner, the output end of the servo motor drives the screw rod to rotate, the screw rod drives the screw sleeve to move up and down under the action of threads, the screw sleeve drives the scanner body to move up and down through the connecting rod, and the scanning height of the scanner body can be adjusted under different heights or special conditions.

Systems, devices, and methods discussed herein are directed to generating an answer to an input query using machine reading comprehension techniques and a lattice of supported decision trees. A supported decision tree can be generated from the various decision chains (e.g., a sequence of elements comprising a premise and a decision connected by rhetorical relationships), where the nodes of the decision tree are identified from the plurality of decision chains and ordered based on a set of predefined priority rules. A lattice may include nodes that individually correspond to a respective supported decision tree. Nodes of the lattice may be identified for an input query. The passages corresponding to those nodes may be obtained and an answer for the query may be generated from the obtained passages using machine reading comprehension techniques. The generated answer may be provided in response to the query.

A machine reading comprehension system (MRCS) can analyze a larger-sized document that includes multiple pages to predict an answer to a query. For example, the document can have two, five, tens, or hundreds of pages. The MRCS divides the document into multiple sections with each section including a portion of the document. Each section is processed separately by one or more processing circuitries to determine a score for that section. The score indicates how related the section is to the query and / or a probability that the section provides a possible answer to the query. Once all of the sections have been analyzed, the sections are ranked by their scores and a subset of the ranked sections are processed again to determine a predicted answer to the query.

This invention proposes a method for extracting entity relations from power technology standards based on multi-turn automatic question answering, comprising: Step 1. Constructing a corpus of power technology standards; Step 2. Constructing information extraction element templates for different types of power technology standards corpus; Step 3. Constructing a question-and-answer corpus of power technology standards based on the information extraction element templates; Step 4. Constructing a text classification module for the power technology standards corpus described in Step 1; Step 5. Automatically constructing a multi-turn question-and-answer and question module by matching the text classification results with the information extraction element templates in Step 4. This module breaks down complex questions into simpler ones and provides step-by-step reasoning answers; Step 6. Constructing a machine reading comprehension module for the power technology standards question-and-answer corpus, which provides step-by-step reasoning answers to the questions automatically constructed in Step 5, thus completing the extraction method of this invention. This invention can effectively alleviate the phenomena of overlapping relations and cross-sentence dependencies in complex texts.

The present invention relates to an automatic extraction method of evidence sentences based on meta-erasure, and belongs to the technical field of machine reading comprehension in natural language processing. This method does not require manual annotation. By erasing at the sentence level, the evidence sentences are selected according to the contribution of each sentence to the answer, and the automatic selection of evidence sentences is realized. The selection of evidence sentences can be evaluated according to the magnitude of the improvement effect, so that the multiple-choice reading comprehension data set can explain the model behavior based on the evidence sentences. Compared with the existing technology, this method can save a lot of time and manpower in the extraction and annotation of evidence sentences, and obtain good results.

The application discloses a machine reading comprehension event extraction method and device based on template bridging, and medium, the method steps comprise: step S01. Input text and trigger word question template are obtained and combined to form an input instance with a trigger word question prompt template; step S02. Syntax analysis is performed on the input instance to form an adjacency graph, the input text and the trigger word question prompt template are connected according to the adjacency graph to obtain a link graph, and global features are extracted according to the link graph; the global features and semantic features are fused to identify the trigger word and the trigger word type; step S03. A argument question prompt template is generated, the prompt template is combined with the input text to form an input instance with a question prompt template; step S04. Argument extraction is performed to obtain argument and argument type output. The application has the advantages of simple implementation method, high event extraction efficiency and precision, good portability and the like.

The application discloses a machine reading comprehension model training method based on contrast learning long-distance supervision. The method comprises the following steps: 1) for each given <question, answer> pair, first, a text paragraph containing the <question, answer> pair is retrieved from a text corpus, and an answer string is found and positioned in the text paragraph as an annotation of an answer position, thereby obtaining a training instance bag for the <question, answer> pair; and a text paragraph not containing the answer in the <question, answer> pair is taken as a negative example text paragraph; 2) inputting the question and the text paragraph in the training instance into a machine reading comprehension model, obtaining an answer position of the training instance according to a predicted output, and updating a confidence of the training instance according to a probability distribution of an answer start and end position; and 3) training the machine reading comprehension model based on the training instance after the confidence is updated. The application can avoid the prediction shortcut and semantic drift problems caused by the wrong annotated instance.

Improving the efficiency of human or machine reading and recognizing graphics, images, text, symbols, spaces, or objects is a very important issue. For example, fast reading can help people get information quickly. The invention achieves one or more of the following objectives by means of graphics, images, text, symbols, spaces or objects arranged in different arrangements: reducing the speed, frequency, amplitude, distance of eye movement, improving the efficiency of visual recognition, achieving rapid reading, improving the utilization rate of paper and display device, reducing the use of paper, reducing the felling of trees, and protecting the environment.

This invention relates to the field of bridge text information retrieval technology, specifically to a few-sample machine reading comprehension method for bridge detection text. In this method, even with a limited amount of sample data, each sample can be fully utilized. Simulated prediction data can be constructed using a question classification model and an answer prediction model, while actual training data can be obtained through manual annotation. Compared to existing technologies, this method fully develops and utilizes the collected text data. By using simulated training data and text data to be annotated, the answer extraction model undergoes two training sessions after pre-training (Pre-Training) and fine-tuning (Pre-Tuning). Compared to existing training methods that use pre-training + fine-tuning, this method significantly improves the training effect of the answer extraction model even when only identical text data is available.

The application discloses a kind of based on machine reading comprehension's chapter-level event extraction method, device and equipment and storage medium.It is given input chapter and corresponding fill-in-the-blank template, model generates fill-in-the-blank according to the corresponding argument slot in template on the basis of chapter content, realizes the extraction of event argument.The application is aimed at chapter-level event extraction and few-sample event extraction problem, realizes using machine reading comprehension mechanism to traditional event extraction task, provides a kind of fill-in-the-blank template level event extraction mode information fusion method and machine reading comprehension method based on pre-training language model.The application further discloses an end-to-end encoder-decoder model, by using the natural language understanding ability of pre-training language model, excavates the potential knowledge of pre-training language model, can improve the generalization performance of model in few-sample situation, improve the adaptive ability of model on extraction task in different fields.

The present invention relates to a method and system for machine reading comprehension of opinion based on dual matching. The system includes: a data preprocessing module preprocesses text data, performs operations such as word segmentation and position information calculation on the data, and maps words to semantic space to obtain text representation; a dual matching module calculates the interactive representation of documents and questions using two matching mechanisms, dynamic and multi-dimensional; a multi-way attention module captures global opinion information from different angles through different attention mechanisms, and obtains multi-way attention representation of documents and questions after splicing; a fusion module uses a gated selection mechanism to summarize the global opinion information and context information of documents and questions to obtain a unified opinion evidence representation; a prediction module uses the opinion evidence representation to predict the answer to the question, and selects the option with the highest probability of being correct as the answer to the question. The present invention can better answer questions based on the text content combined with opinion information.

The application relates to a machine reading comprehension method for electric power professional knowledge, wherein an original question is input into an answer retrieval module for preliminary retrieval to obtain a plurality of first answers and a prediction probability of each first answer; a mother, the original question and the first answer are input into an evidence extraction module to extract an evidence label corresponding to the first answer from text content of the mother; wherein the mother comprises original text, text content in a drawing and text content in a picture; the original question, the first answer and the corresponding evidence label are input into an answer verification module to determine a formal answer with the maximum probability from the plurality of first answers. The application is especially suitable for machine reading comprehension of multiple documents and has good accuracy.

This invention relates to the field of multi-label text classification technology and discloses a few-sample multi-label text classification method based on machine reading comprehension, comprising the following steps: First, the multi-label text dataset is preprocessed, its format is standardized, and labels are added. Next, auxiliary questions are designed based on the labels and combined with text instances to form input data. A RoBERTa model is used as the backbone of the joint encoder to learn the semantic relevance between the text and the questions, and a label graph representing the label relationships is constructed. Through feature fusion, the model is trained to minimize the loss function, and hyperparameters are tuned using a validation set. Finally, the model performance is evaluated on a test set and compared with traditional methods to verify its advantages and component contributions. By transforming multi-label text classification into a machine reading comprehension task, it helps to better capture the semantic relevance between text and labels, significantly improving the accuracy of multi-label text classification.