1919 results about "Text processing" patented technology

The invention provides a medical text big data intelligent labeling and knowledge graph construction method and system, and relates to the technical field of medical text processing, and the method comprises the steps: recognizing entities in a medical text through a pre-trained deep bidirectional coding model and a multi-level entity recognition network, and carrying out the normalization processing in combination with a medical knowledge base, according to the method, the semantic association degree between entities is calculated, a relation extraction result is optimized based on comparative learning, comprehensive relation representation is obtained through fusion of multi-granularity coding and a gating mechanism, the entity relation is determined in combination with an inference rule network, a medical knowledge graph is constructed based on an initial knowledge graph, and the accuracy of medical text entities and relation labeling can be effectively improved. And a more perfect medical knowledge graph is constructed, which is helpful for assisting medical diagnosis and decision making.

The invention discloses a multi-modal large model federated training platform and a heterogeneous data alignment algorithm. The algorithm comprises a time sequence data processing module, a text processing module, an embedded generation module, a local federated learning module, a comparative learning alignment module, a global model aggregation module and a privacy protection verification module. The time sequence data processing module generates a time-frequency matrix signal; the text processing module outputs a text feature signal; the embedding generation module generates a time sequence embedding vector and a text embedding vector; the local federal learning module forms a local encryption signal; comparing the learning alignment module and generating a gradient signal; the global model aggregation module processes the gradient signal through a federated average algorithm and forms a parameter update quantity; and the privacy protection verification module generates confusion gradient signals and transmits the confusion gradient signals back to each module for data alignment. According to the multi-modal large model federation training platform and the heterogeneous data alignment algorithm, the problem that effective alignment and fusion of a logging curve and a geological report are difficult due to modal difference and semantic gaps can be solved.

A real-time system for the multimodal generation of virtual reality scenes based on artificial intelligence for the creation of immersive three-dimensional environments from natural language narratives, consisting of: a speech capture module configured to continuously record a user's spoken narrative via one or more directional microphones, preprocesses the captured signal by noise reduction and temporal alignment, and outputs a digital speech stream; A speech-to-text processing unit that is operationally coupled to the speech capture module and configured for real-time speech recognition using a continuous neural transformer model. The unit is trained to transcribe natural language utterances into structured text data while maintaining contextual continuity throughout the evolving narrative. a semantic interpretation processing unit that is communicatively linked to the speech recognition unit and configured to perform natural language understanding techniques to extract contextual entities, spatial references, temporal relationships, and object attributes from the transcribed narrative; the engine includes a large language model that is fine-tuned for spatial reasoning tasks; a scene graph generation module configured to transform the interpreted semantic data into a structured, hierarchical representation that defines nodes for identified entities and edges for corresponding relationships, with each node associated with metadata describing geometry, position, orientation, texture, and linking attributes between objects; a multimodal image-language model processor coupled with the scene graph generation module, wherein the processor is configured to retrieve, adapt, or synthesize appropriate three-dimensional elements from a pre-trained visual-lexical embedding space and align these elements with their semantic and spatial definitions derived from the scene graph; a scene assembly and rendering controller configured to create a cohesive virtual scene from the aligned assets, perform real-time rendering using a GPU-accelerated ray tracing pipeline, and produce a stereoscopic visual output that corresponds to the evolving narrative; A head-mounted virtual reality visualization device connected to the rendering engine and configured to display the generated immersive environment to the user in real time. The device features motion sensors and inside-out tracking cameras to detect head and body movements, dynamically updating viewing angles and perspective within the rendered scene; and a bidirectional feedback module integrated into the head-mounted device and connected to the semantic interpretation processing unit; the module is configured to interpret corrective commands, gestures, or supplementary comments from the user to refine or modify specific scene elements without interrupting the real-time visualization; The system continuously updates the virtual scene as the narrative develops, ensuring temporal synchronization between speech input and rendered output below a defined latency threshold, thus enabling a natural, dialogic construction of complex three-dimensional virtual environments.

A text detail map-based method for supervising end-to-end text detection and recognition, pertaining to the field of text processing. The method comprises the following steps: given an input image containing text in any shape, processing the input image by means of two separate processing branches; designing a text attention head (TAH), and designing a feature pyramid enhancement fusion module (FPEFM); the FPEFM performing feature self-enhancement at different sizes, fusing text image local features and global text position information extracted by a TAH module, and fusing features extracted by the TAH from feature maps of different sizes; stacking a plurality of FPEFMs to continuously enhance the feature representation capability of a model and the depth of the model; and sampling the feature maps to a unified size to obtain a final enhanced feature map.

A computer program comprising instructions which, when executed by a computer, cause the computer to perform the following operations: Receiving an input document (104), wherein the input document (104) contains content elements including at least one text element; Performing a lossless hierarchical text processing process (106) in which the input document (104) is reproduced as a hierarchical representation (108) in which all text elements from the input document (104) are preserved verbatim and organized according to a structure of the input document (104), the lossless hierarchical text processing process (106) comprising: Prompting a generative language model to generate the hierarchical representation (108), wherein the prompt instructs the generative language model to generate the hierarchical representation (108) without summarizing or omitting any of the text elements; and Performing a retrieval unit generation process (110) in which retrieval units (112) are generated based on the hierarchical representation (108) and stored in a memory accessible by a generative client language model for retrieval-enhanced generation.

The invention discloses a speech recognition and natural language processing integration method and system, and the method comprises the steps: carrying out the multi-modal data fusion according to a speech signal of a user, context text information and environment sensor data, and obtaining a fused multi-modal feature vector; inputting the multi-modal feature vector into a speech recognition model based on an adaptive deep neural network, and performing speech-to-text processing to obtain text output; inputting the text output into a semantic analysis model based on a graph neural network, and performing context semantic analysis and user intention recognition to obtain semantic representation of the user intention and a confidence score of the semantic representation; and according to the semantic representation and the confidence score thereof, dynamically adjusting parameters of the speech recognition model and the semantic analysis model by using a feedback optimization technology based on reinforcement learning, and generating a model optimization strategy. According to the embodiment of the invention, the accuracy of speech recognition and the semantic comprehension capability of natural language processing can be improved.

The invention belongs to the technical field of text processing, and particularly relates to an intelligent legal text analysis method based on a legal concept pedigree, which comprises the following steps of: preprocessing an input legal text, identifying key legal concepts in preprocessed text data by using a natural language processing technology, constructing a legal concept pedigree knowledge graph, and analyzing the legal concept pedigree. And carrying out deep analysis on the preprocessed text data, identifying a logic relationship in the legal text, and providing legal provision matching and case retrieval services for a user through an intelligent algorithm. By integrating an advanced data processing technology and a natural language processing technology, a legal concept pedigree knowledge graph is constructed, and efficient and accurate analysis of legal texts is realized. The method not only improves the accuracy of legal concept recognition, but also can deeply mine the logical relationship between legal provisions by constructing the knowledge graph of the legal concept pedigree, thereby providing powerful support for legal reasoning.

The invention discloses a text keyword desensitization method, system and equipment based on a large model and a medium, belongs to the technical field of large model and natural language processing, and aims to solve the technical problem of how to automatically identify and desensitize sensitive information, improve the accuracy of sensitive information identification and further improve the text processing efficiency. According to the technical scheme, the method comprises the steps of data collection; preprocessing the data; marking sensitive information; segmenting the data; selecting a basic model; finely adjusting the model; training the fine-tuned large language model, and obtaining and storing the trained fine-tuned large language model; preprocessing the to-be-processed text data; detecting sensitive information, formulating a desensitization strategy and implementing desensitization processing, performing desensitization verification on the text after desensitization processing, and optimizing and improving the fine-tuned large language model according to a verification result; and packaging the optimized and improved fine-tuned large language model into an API (Application Program Interface) service for an application program to call.

The invention relates to the artificial intelligence technology, can be applied to service system platforms such as medical health and financial science and technology, and discloses a data processing method, device, equipment and medium based on a hybrid expert model.The method comprises the steps that to-be-processed data is input into the hybrid expert model, routing probability distribution is obtained, the Tsallis entropy of the routing probability distribution is calculated, and the Tsallis entropy of the routing probability distribution is calculated; generating a prediction result according to the Tsallis entropy; evaluating loss based on an auxiliary entropy loss function, constructing a subspace, and adjusting pre-training parameters in the subspace to obtain an optimized hybrid expert model; and obtaining a target prediction result according to the optimized hybrid expert model. According to the dynamic routing mechanism, experts are flexibly selected, an entropy loss function is assisted to optimize a routing decision, uncertainty is reduced, and model convergence is accelerated; and interference of new tasks on old tasks is eliminated through re-parameterization and subspace design, so that the model achieves good balance between stability and plasticity, and generalization and adaptability of model data processing are improved.

The embodiment of the invention provides a directional training method and device for an enterprise project text processing model, and the method and device achieve the screening of high-quality training samples through the construction of a project text scoring model and the multi-dimensional evaluation of the text coverage degree, the technical correlation degree and the structural integrity. And analyzing a text structure relationship based on the knowledge graph and the graph convolutional network, and constructing a differentiated text template library. The system performs directional training on a pre-training large model in combination with an enterprise portrait vector, and continuously optimizes model parameters and a knowledge base by adopting an incremental learning strategy. According to the method, the defects of a traditional technology in the aspects of training sample screening, knowledge structure analysis and model personalized customization are effectively overcome, and the practicability and adaptability of a project text processing model are remarkably improved.

The embodiment of the invention discloses a community governance decision generation method and device based on a knowledge graph. The method comprises the following steps: collecting community governance data; performing information extraction and text processing on the community governance data by adopting a data extraction model to generate structured data; constructing a causal analysis atlas, a decision treatment atlas and a space-time correlation atlas by using the structured data; fusing the causal analysis graph, the decision governance graph and the space-time association graph to obtain a community governance knowledge graph, wherein the community governance knowledge graph supports semantic-based query and reasoning; acquiring resident appeal information, and performing risk reasoning based on a preset reasoning rule to obtain a risk reasoning result; and based on a risk reasoning result, in combination with spatio-temporal information defined by a spatio-temporal association graph, querying in the community governance knowledge graph, and generating a community governance scheme according to a query result. According to the invention, the dynamism, the accuracy and the intelligent level of community management can be improved.

A computerized-method for comprehensive text-summarization quality-assessment with rank-based normalization and weighted-hierarchical-ranking strategy. The computerized-method includes: (i) receiving an original-text and a summary-text that has been generated by a (GPT)-based LLM that has been provided the original-text and a text-prompt; (ii) operating a text-processing NLP module on the original-text and the summary-text to yield a processed-text of both; (iii) measuring the summary-text to assess text-summarization-quality thereof by operating a plurality of metrics to yield a metric-score; (iv) operating ranked-based normalization on each metric-score to yield a normalized-score; and (v) operating an aggregation based on weighted-hierarchical-ranking strategy of the normalized scores to yield an interpreted final-quality score. The interpreted final-quality score indicates a comprehensive text summarization quality assessment of the summary-text, and the plurality of metrics includes: (i) grammatically; (ii) Flesch-Kincaid (FK) readability; (iii) topic coverage; (iv) compression ratio; (v) cosine similarity; (vi) NER accuracy; (vii) BLEU; and (viii) ROUGE.

The invention relates to the technical field of text processing, and provides an engineering management report generation method and system based on natural language processing, which are used for realizing deep analysis of construction logs and providing a comprehensive and accurate decision basis for engineering management. The method comprises the steps that a construction log text set generated in the engineering construction process is acquired, natural language processing is conducted on the construction log text set, key entities and progress events in each construction stage description unit are extracted, and a construction feature set containing entity identification information and event time sequence information is obtained; performing semantic alignment processing on the construction feature set and a preset engineering specification knowledge base to generate specification association information between the construction stage description unit and an engineering specification requirement; and performing structured integration processing on the standard associated information based on a hierarchical template matching algorithm to generate a structured report text meeting the engineering management requirements.

The present application provides a training method for a text processing model, a training apparatus for a text processing model, an electronic device, a program product, and a storage medium. The method comprises: acquiring a sample text set; splicing at least two independent sample texts among a plurality of independent samples texts to obtain a plurality of spliced sample texts; on the basis of the plurality of spliced sample texts, calling an initialized text processing model to perform feature extraction processing to obtain a plurality of spliced sample features; on the basis of each spliced sample feature, calling a masked attention mechanism to perform prediction processing to obtain a predicted text, wherein the masked attention mechanism comprises: masking each independent sample in the spliced sample features; on the basis of the difference between the predicted text and a sample label, determining a loss function; and on the basis of the loss function, performing parameter update processing on the text processing model to obtain a trained text processing model.

Presented herein are interactive graphical user interfaces (GUIs) for providing automated, real-time interactive assistance to a human user creating electronic documents. In certain embodiments, the GUI includes an alphanumeric text processing region, an AI-generated text region, and a reference list region. The AI-generated text region contains one or more alternative blocks of text responsive to a user query and based on specific references (e.g., articles, books, or other written works). The references are listed in the reference list region of the GUI.

The invention relates to the technical field of language data processing, in particular to a language data processing method and system, terminal equipment and a storage medium. The method comprises the following steps: acquiring current round dialogue data of a user; performing dialogue language text processing according to the current round dialogue data of the user to obtain current round dialogue language feature data; carrying out anonym detection on the current round dialogue language feature data, and carrying out dynamic historical anchor point screening to obtain cross-round screening anchor point list data; performing multi-round dialogue intention evolution reasoning according to cross-round screening anchor point list data to obtain an interaction adjustment intention representation strategy; and according to the interaction adjustment intention representation strategy, carrying out current round dialogue language key referring word determination so as to realize cross-round dialogue type language referring word identification. According to the method, the cross-round dialogue type language anonyms are accurately recognized through multi-round dialogue situation and multi-modal clue language data processing.

The invention relates to the technical field of natural language processing, and discloses a knowledge base question and answer platform construction method based on a large language model, which comprises a knowledge acquisition module, a data preprocessing module, a text processing module, a vectorization module, a question understanding module, a mixed retrieval module, a prompt generation module, an answer generation module and an answer quality analysis module. A secondary inquiry processing module and a feedback learning module; according to the method, a semantic segmentation algorithm is combined with semantic retrieval and keyword retrieval, so that the flexibility is high; normalized prompts are constructed, input is performed according to correlation sorting, and the accuracy of answers is improved; multi-dimensional confidence evaluation is introduced, strict multi-layer security and compliance filtering is set, and the reliability of the system is ensured; the relevance of multiple rounds of dialogues is judged and complemented, so that interaction is more natural and efficient; knowledge is collected and updated in real time, a knowledge base and a retrieval strategy are continuously optimized, and a closed loop of data-application-feedback-tracing-optimization is formed.

The invention belongs to the technical field of document analysis, and particularly relates to a multi-algorithm collaborative PDF document intelligent analysis system which comprises a preprocessing module used for recognizing the type of a PDF document, performing layout correction on a scanning document PDF and uniformly adjusting the scanning document PDF into a vertical storage format; the layout analysis module is used for identifying page element categories based on a target detection algorithm, and processing element superposition and separation problems through a merging de-duplication or priority discarding strategy; and the text processing module is used for analyzing all places with characters in the PDF based on the OCR, outputting the characters and corresponding textbox coordinates, and dividing the contents of the text blocks in combination with layout analysis. The system can extract characters of the PDF of the scanned copy, distinguish element types such as titles, texts, tables and formulas, solve the problem of confusion of cross-page tables, column texts and characters with similar shapes, and can completely reserve the content structure of the document.

The invention belongs to the technical field of text processing, and particularly relates to a method and system for retrieving DOCX document content based on keywords, which comprises the following steps: analyzing an Office Open XML structure of a DOCX document, combining with multi-dimensional features such as style names, and utilizing a title classification score model to accurately distinguish a title and a text, so that a semantic hierarchical structure of the document is effectively reserved; and secondly, a multi-level semantic extension mechanism is introduced, and a Sension-BERT, a HowNet knowledge base and a Word2Vec model are fused, so that intelligent extension of synonyms and synonyms of keywords is realized, and the recall rate and semantic understanding ability of retrieval are remarkably improved. And in addition, a BM25 model is combined with paragraph length normalization and structure position weight to calculate a correlation score, so that retrieval results are sorted more accurately and reasonably. The construction of the reverse index is combined with the position coding and compression optimization strategy, and the retrieval efficiency and the storage performance are both considered.

The invention provides an article generation method and device, equipment and a storage medium, and relates to the technical field of artificial intelligence, in particular to the technical field of large models, agents and text processing. According to the specific implementation scheme, the method comprises the steps of obtaining a writing request, and identifying the writing request to obtain a writing requirement; respectively generating a draft outline and available materials according to the writing requirements; adopting the available materials to rewrite the draft outline to obtain a target article outline; and generating a target article according to the target article outline. Through the technical scheme, the article generation quality can be improved.

The invention discloses a method for improving long text processing efficiency and accuracy, and relates to the technical field of natural language processing and large language models.According to the method, text word segmentation embedding, sliding block preprocessing, YaRN position code injection, dynamic sparse attention calculation, multi-level attention fusion, graded KV cache management and output generation are sequentially executed; position drift is inhibited through logarithmic scaling, and key contexts are adaptively screened according to the attention activeness, so that the attention calculation complexity is close to linearity; in million-level Token reasoning, the video memory occupation of the method is reduced, the remote dependency recall rate is improved, and the method is suitable for scenes such as document analysis, code auditing and multi-mode streaming understanding.

The invention discloses a vertical field large model-oriented high-quality data set construction method and system, and relates to the technical field of text processing, and the method comprises the steps: selecting seed text data, carrying out long text processing, segmenting the seed text data into a plurality of text segments, processing the text segments by using a large model tool to generate seed question and answer pairs, and constructing a seed question and answer pair; auditing and optimizing are carried out according to a preset auditing standard; making an instruction generation data set for the cue word, the text fragment and the seed question and answer pair according to a preset organization rule, performing fine adjustment on a pre-selected base model by using the instruction generation data set, and performing iterative optimization on the large model by testing the performance of the large model after fine adjustment and adjusting and optimizing parameters, thereby obtaining an intelligent extraction large model IELM; and based on the intelligent extraction big model, processing the text data by utilizing a preset script code, automatically generating knowledge question and answer pair data corresponding to the text data, and performing format conversion processing to obtain an instruction data set which is used for a training data set of the vertical domain knowledge big model.

The invention relates to the technical field of design examination architecture, in particular to a general design examination architecture method for comprehensively scheduling small models based on AI large models. Comprising the following steps: constructing an intelligent scheduling system which takes a general AI large model as a core and comprises a visual analysis model, a text understanding and segmentation conversion model and a rule generation model, enabling a user to submit a design review task through a dialogue interface or a file uploading mode, receiving a task request through a large language model, and carrying out preliminary analysis; through multi-module cooperation and intelligent scheduling, the automation degree of design drawing review is greatly improved, the overall review efficiency is improved, visual analysis, text processing and rule generation technologies are fused, compared with a rule-based drawing review system, wider review content can be covered, and the design drawing review efficiency is improved. The versatility of the architecture enables the architecture to rapidly adapt to new rules and standards, and enables the iteration updating of the drawing checking system to be faster.

The invention relates to a Chinese language and literature computer networking query reading system. According to the system, a query request processing module carries out mixed feature analysis processing according to a query request of a user, and a mixed query vector fusing radicals and semantics is generated; a distributed retrieval module performs distributed retrieval in a preset space-time fragment index structure based on the mixed query vector to obtain a candidate literature data set; the preliminary retrieval optimization module is used for carrying out self-adaptive conversion processing on abnormal characters and traditional and simple characters in the candidate literature data set according to a Chinese character evolution rule and a context to obtain standardized text data; and the visual query output module performs knowledge graph enhancement processing on the standardized text data to generate a visual query result. According to the system, efficient query and visual display of Chinese language and literature works are achieved through multi-modal processing, multi-dimensional indexing and knowledge graph technologies, and the problems that a traditional query mode is single in input, limited in retrieval dimension, insufficient in text processing and the like are effectively solved.

The invention belongs to the technical field of text processing, and particularly relates to a text processing method and system based on a large model, a terminal and a storage medium, and the method comprises the steps: preprocessing an input text, inputting the preprocessed text into a pre-established first large model, and outputting an error list or an error-free prompt; when the first large model outputs an error list, the output error list is detected, and the preprocessed text is corrected according to the detected error list; and inputting the corrected text or the text corresponding to the error-free prompt into a pre-established second large language model, and outputting a sensitive word prompt or a sensitive word-free prompt. According to the method, the sensitive word problem possibly introduced or triggered by the error correction operation is actively recognized and processed through the serial flow of error correction and sensitive word analysis. And the second model performs sensitive word analysis on the basis of the error-corrected text, so that the real-time accuracy and safety of sensitive word recognition are remarkably improved.

The invention discloses a text auxiliary auditing and proofreading method and system based on a large language model. The system comprises a text processing unit which is used for performing text auditing and proofreading learning based on a large language model, performing uploading, partitioning and auditing and proofreading on a text needing to be audited and proofreading, and outputting a text auditing and proofreading result; the data acquisition unit is used for acquiring various data required by the system; the core processing unit is used for receiving the text checking and proofreading result and the various data, analyzing and processing the text checking and proofreading result and the various data, and generating a text checking and proofreading report according to an analysis and processing result; and the display reminding unit is used for receiving the text checking and proofreading report generated by the core processing unit, performing hierarchical display according to related contents of the received report, and performing warning reminding based on a preset threshold value. According to the scheme, the text checking and proofreading efficiency is improved.

The invention provides a cue word attack detection method and system of a large language model and electronic equipment, and relates to the technical field of text process.The method comprises the steps that a to-be-processed text block in an original text is determined; performing heuristic semantic analysis on the text block to obtain a first suspicious text block and a first risk score thereof; performing semantic analysis on the first suspicious text block and the context information thereof through a first language model to obtain a second suspicious text block and a second risk score thereof; performing structured verification of the attack intention on the second suspicious text block according to a preset meta prompt word through a second language model to obtain an attack intention verification result; the attack intention verification result comprises a third suspicious text block and a third risk score thereof; and executing a target response action on the original text based on the first risk score, the second risk score and the third risk score. According to the method, the efficient processing requirement of the long text can be considered, and the detection accuracy of complex attacks can be improved.

The invention relates to the field of text processing, in particular to a bidding document information extraction method. Comprising the following steps: segmenting a bidding and tendering file into pages, and identifying the pages to obtain corresponding texts; generating complementary text description for images and tables in the page and adding the complementary text description to the tail of a text corresponding to the page to form an enhanced text block sequence; matching a label from the text block sequence according to a pre-constructed hierarchical label system, and generating a corresponding cue word template according to the label and a pre-constructed cue word template library; inputting the cue word template, the enhanced text block sequence and the context text abstract as a combination into a large language model to obtain a structured extraction result with a hierarchical relationship; and matching the extracted entity content with a local dictionary, carrying out aggregation arrangement on a result after the matching is passed, and outputting a structured data file. On the premise that the model does not need to be retrained, the illusion risk of the generated content is reduced.

The invention discloses a text processing model training method and device and a storage medium, and relates to the field of artificial intelligence, and the method comprises the steps: obtaining a sample generation model which is used for generating training sample data containing a thinking path; adopting a sample generation model to generate training sample data containing a thinking path; and training the initial text processing model based on the training sample data to obtain a target text processing model. Through the method and the device, the problem that the accuracy of reply information output by the obtained model is relatively low due to the fact that the initial text processing model is trained by adopting a manually labeled training sample in the related technology is solved.

The invention provides a language model training method and device, a text processing method and device, equipment and a medium, and relates to the technical field of natural language processing, and the method comprises the steps: predicting a first probability matrix corresponding to each data unit in a sample text based on a teacher model; the first probability matrix comprises a probability value of each data unit belonging to each lexical element in the first word list; according to the numerical value of each probability value in the first probability matrix, compressing the first probability matrix to obtain a second probability matrix corresponding to each data unit; performing alignment operation on the second word list according to lexical elements corresponding to probability values in the second probability matrix to obtain a third word list; and according to the third word list and the second probability matrix, carrying out distillation training on the student model to obtain a target language model, thereby reducing the storage cost, improving the distillation training efficiency, and enabling the target language model trained according to the method to better adapt to different model architectures and text processing scenes while keeping high performance.