1285 results about "Text categorization" patented technology

The invention relates to the technical field of data processing, and discloses a cross-border e-commerce commodity recommendation system and method based on multi-source data fusion. The system comprises an acquisition module for performing data acquisition to obtain a cross-border unified data warehouse and federal learning cooperation data; the classification module performs text classification processing to obtain a user preference analysis result and an interpretable attention mark; a quantization module carries out quantization processing to obtain a cross-border selection feature matrix; the fusion module carries out weighted fusion processing to obtain a basic comprehensive score and a weight convergence detection result; the evaluation module performs risk evaluation processing to obtain risk probability distribution and cross-border compliance evaluation results; and the sorting module carries out real-time processing through lightweight preprocessing and a flow-type calculation pipeline to obtain a comprehensive score sorting list of cross-border selected products. The problem that a traditional cross-border e-commerce product selection method cannot effectively integrate multi-source heterogeneous data and cannot analyze user feedback text semantic information is solved.

The invention discloses a person and post matching method, system and equipment based on Transform and a medium, belongs to the technical field of cross application of natural language processing and human resource management, and aims to solve the technical problem of how to reduce subjective errors in a person and post matching process, improve matching accuracy, fairness and objectivity and improve manual matching efficiency at the same time. According to the technical scheme, the method comprises the following steps: data collection: collecting post information data and job seeker resume data from a plurality of data sources, and cleaning and sorting the collected data to obtain a post description text and a resume text; text preprocessing: preprocessing the acquired and sorted post description text and resume text to obtain the preprocessed post description text and resume text; the method comprises the following steps of: fusing a Transform model and a BERT model; constructing an encoder-decoder structure based on the Transform model; optimizing the model; multi-label text classification: constructing a multi-label classification system; and outputting and evaluating a matching result.

The invention relates to the technical field of model review, in particular to a BIM model review method based on text classification and named entity recognition, and provides the following scheme: building a building specification knowledge graph, obtaining BIM review data through a review data extraction strategy, obtaining a matching rule set by utilizing knowledge graph matching, and adjusting the priority for review. Outputting the report; the knowledge graph construction adopts an ontology model and a knowledge extraction network, component attributes, spatial relationships and time dimensions are considered in the examination data extraction, the matching process is combined with multi-dimensional semantic matching and reasoning, and the examination accuracy and efficiency are ensured.

The invention discloses an operation and maintenance question-answering system and method based on a large language model workflow, and mainly relates to the technical field of information security. Comprising a question semantic classification module used for performing semantic analysis and classification on questions through a text classification large language model when the questions are input, and identifying categories of the questions; the process selection and execution module is used for selecting and executing a corresponding process according to the semantic category of the question to generate a preliminary answer; and the answer generation and formatting module is used for processing the preliminary answers through a text generation large language model and formatting the preliminary answers into final answers which can be understood by the user. The method has the beneficial effects that the accuracy of operation and maintenance knowledge retrieval can be improved, problems can be converted into operation and maintenance instructions to execute related operations, meanwhile, the method has the capability of analyzing and deciding operation and maintenance problems, and the response quality and the capability of processing complex problems are remarkably improved.

The invention relates to the technical field of text classification, and provides a text classification method based on a large model and a rule engine, and the method comprises the steps: S1, storing multi-level rule classification labels, and constructing a classification rule template library; s2, receiving text data from various data sources, and preprocessing the text data; s3, performing rule matching on the text data based on the classification rule through a rule engine, and outputting a rule classification result; and S4, when any one of the following conditions is met, large language model classification is triggered: a, a classification rule is not matched; b, matching a classification rule, wherein the rule confidence is smaller than a rule confidence threshold; c, the text data length exceeds the preset text data length; d, matching a specific business scene label; outputting a model classification result; and S5, when the rule engine classification in the S3 and the large language model classification in the S4 are parallel, executing the strategy. The output reliability and the service continuity are guaranteed, and the method is suitable for scenes with high accuracy requirements such as financial compliance examination and the like.

The invention belongs to the field of artificial intelligence and finance, and relates to a text classification method, which comprises the following steps: preprocessing an original text data set, labeling classification labels to obtain a labeled text data set, inputting a training set into a large language model for keyword extraction to obtain a candidate keyword set, cleaning the candidate keyword set to obtain a classification keyword set, constructing an instruction template based on the classification keyword set, and inputting the training set and the instruction template into a large language model to obtain a prediction classification result; and based on a prediction classification result and a loss function between the classification labels, performing fine tuning on the large language model to obtain a fine tuning model, evaluating that the fine tuning model is qualified to obtain a text classification model, and inputting the to-be-classified text into the text classification model for classification. The invention further provides a text classification device, computer equipment and a storage medium. In addition, the invention also relates to a block chain technology, and the tagged text data set can be stored in a block chain. According to the method, the text classification accuracy and stability can be improved.

The invention discloses a text classification method, device and system based on a large language model, a storage medium and a product, and relates to the technical field of text classification, the method comprises the following steps: receiving a to-be-classified text and a classification label input or selected by a user through a user interaction interface of the text classification system; and according to the to-be-classified text and the classification label, constructing prompt words, and calling a pre-trained large language model to perform different-level classification on the to-be-classified text to generate a classification result. According to the technical scheme, the low-cost and low-use-threshold text classification method is provided based on the large language model, classification of different levels can be achieved, in addition, due to the fact that the text classification result is in a light-weight and convenient-to-analyze JSON format, the system can visually display the classification result to a user and can also provide an interface for a third-party application to call, and the user experience is improved. And the application scene of text classification is expanded.

The invention discloses a science and technology public text intelligent classification and service method and device based on deep learning. The method comprises the steps that multi-source science and technology public text data are acquired and preprocessed; extracting keywords by adopting a keyword extraction algorithm, and splicing the keywords with the public text title to form enhanced text features; constructing a multi-dimensional public text classification system and performing data annotation; performing feature extraction and fine adjustment by adopting a BERT pre-training model to obtain a classification model; automatically classifying the newly-added public texts and visually presenting the newly-added public texts; and generating a personalized recommendation result based on the user portrait and the public text feature index. The invention further relates to a technical scheme of multi-objective quality diversity optimization, heterogeneous resource allocation and fusion of the LPLC2 neural network and the BERT. The technical problems that a traditional method is limited in complex semantic understanding ability, single in classification dimension and lack of an integrated solution are solved, and the accuracy of science and technology public text classification and the intelligent level of service are improved.

According to the OpenCSG large model intelligent data annotation system provided by the invention, by virtue of an automatic annotation technology driven by a large model, the requirement of manual annotation is greatly reduced, and the data annotation efficiency is remarkably improved. The system can generate a high-precision labeling result by using the intelligent labeling module and the automatic quality control module, and ensures the consistency and accuracy of the labeling result through an automatic auditing process. No matter sentiment analysis, entity recognition or complex text classification, the system can efficiently adapt to various types of labeling tasks, and different data processing requirements are met. Through modular design, the system supports flexible expansion, and can meet various data labeling requirements from small-scale test projects to large-scale commercial projects. According to the overall architecture, all the function modules are closely coordinated in the system, so that efficient operation and high-quality output are always kept in a large-scale data annotation project.

The invention relates to a Han-Cross industry text classification method and system based on prompt learning and adaptive loss weighting, and belongs to the technical field of natural language processing. The method comprises the following steps: designing and constructing a universal prompt template; the method comprises the following steps: recombining a Han-Cross cross-border industry text classification data set, namely converting an original single sample into paired samples; in a few-sample and multi-language scene, related vocabularies are adopted as external knowledge resources, and vocabularies most related to the mapping labels are retrieved from the related vocabularies; expanding the vocabulary mapper by introducing synonyms and associated vocabularies; adopting a dynamic mixed loss function and applying the dynamic mixed loss function to a pre-training language model to optimize a few-sample classification task; and classifying Chinese and Vietnamese cross-border industry texts by using the optimized pre-training language model. The method shows a remarkable effect in Chinese and Vietnamese industry text classification tasks, and is particularly suitable for a few-sample learning scene with data scarcity and language imbalance.

The invention relates to a zero sample text classification method and device based on cross-modal information completion. According to the method, cross-modal information complemented image construction is realized by designing a new image label mapping mechanism and based on context text generation, finally, a multi-modal collaborative reasoning framework is designed in a reasoning stage, text semantic perception capability is enhanced by prompting project optimization text input, and zero sample reasoning capability of a CLIP model is effectively improved. Aiming at the semantic deviation problem of automatic label generation, a cross-modal information complemented image is constructed based on context text generation so as to optimize the text semantic representation integrity, and meanwhile, a prompt design is introduced in a reasoning stage to enhance the text semantic perception capability; according to the two-stage keyword automatic selection mechanism, firstly, a keyword candidate set is generated through a large model, secondly, through multi-modal matching and selection, the optimal keyword phrases are selected to serve as text information complemented by cross-modal information, and semantic accuracy and field adaptability are effectively improved.

The disclosure relates to systems and methods of automatically generating unique content including natural language text based on a corpus of previously generated response documents and discrete requirements defined in a requirements specification. The system may use generative stitching that includes multi-layer processes that execute to influence the generation of unique content including natural language text through an artificial intelligence (AI) language transformer model trained to output the content based on previously written material that is semantically relevant to the discrete requirements and is weighted against labeled attributes. The labeled attributes may determine the influence asserted against the language transformer, thereby generating unique on-target content that may be combined to create a computer-generated response document.

The invention discloses a BERT model-based resume screening method and system, and belongs to the technical field of deep learning and text classification. The method comprises the following steps of: obtaining post demand text data and job seeker resume text data, and preprocessing the post demand text data and the job seeker resume text data; based on a TFIDF-LDA model, subject term extraction and category feature expansion are carried out on the preprocessed text vector; performing word extraction vocabulary filtering on the subject word vector after category feature expansion based on N-gram of information entropy; a deep learning matching degree calculation module is combined to calculate the comprehensive matching degree of the posts and the job seekers, and the resumes of the job seekers are preliminarily screened in combination with a set threshold value; and carrying out resume text classification based on the FE-BERT model to obtain a resume screening result. According to the method, the problems that the ability of candidates is difficult to accurately evaluate and different post requirements cannot be adapted or the talent screening accuracy is low due to the reasons of inaccurate keyword matching, incapability of understanding contexts and the like in the existing resume screening method can be solved.

The invention provides a semantic search method for identifying user intention based on AI and a storage medium, and the method comprises the steps: receiving a query text input by a user, and carrying out the preprocessing to extract key information; the method comprises the following steps: pre-training a Transform model, and inputting a query text to obtain an embedded vector; predicting a user intention based on the embedded vector by using a classifier; the key information and the user intention are combined, the query text is expanded through the knowledge graph, and the expanded query text is generated; matching the extended text with entities and relationships in the knowledge graph to obtain a related set; calculating a similarity score of the set and the document; and constructing a user portrait, and generating a document list based on the portrait and the similarity score. According to the method, the query text is deeply understood through the Transform model, the intention is predicted by the classifier, and the user demand is accurately grasped. And furthermore, the query content is enriched through domain dictionary construction, synonym replacement and phrase expansion, and the search accuracy is improved.

The invention discloses a text classification method based on multi-expert fusion gating graph neural network comparative learning, which comprises the following steps: preprocessing an original text, generating a standardized corpus, and extracting words, part-of-speech and entity features; constructing a first heterogeneous graph based on word features, constructing a second heterogeneous graph based on part-of-speech features, and constructing a third heterogeneous graph based on entity similarity; dynamically weighting and fusing the first heterogeneous graph, the second heterogeneous graph and the third heterogeneous graph through an expert gating fusion module to generate a fused graph structure; performing graph convolution coding on the fused graph structure to generate a node representation vector; executing double-layer comparative learning based on the node representation vector: optimizing single sample representation consistency by implementing instance-level comparative learning, and synchronously implementing cluster-level comparative learning to optimize intra-class center aggregation; and inputting the representation vector subjected to comparative learning optimization into a classifier, and outputting a text category label. According to the method, the comprehensive performance of the short text classification model in the aspects of semantic expression, structural modeling and cross-sample discrimination can be effectively improved.

The invention relates to the technical field of natural language processing and deep learning matching recommendation, and discloses a supply and demand matching method for digital science and technology personalized services, which comprises the following steps: carrying out semantic understanding and analysis on a submitted technical long text by adopting a natural language large model, effectively extracting a core text of technical contents, and carrying out semantic analysis on the core text; and based on the text classification model, accurately delimiting industry field labels, thereby solving matching obstacles caused by cross-industry term differences. Precise extraction of clear numerical parameters and performance indexes in technical texts is realized by using a natural language large model, a refined demand text set is established, and deep semantic vectorization representation is performed through a word embedding model; through cosine similarity calculation and a screening rule based on industry labels, the matching accuracy and reliability of cross-industry technical services are greatly improved; based on an association weight mechanism of performance indexes, semantic similarity and performance index association degree are comprehensively considered, and the accuracy of matching recommendation results is optimized.

The invention discloses a natural language question and answer method, system and device, a medium and a product, and relates to the technical field of semantic recognition. The method comprises the steps that a user question is recognized based on a named entity recognition model, and a key entity is determined; the key entity comprises a place name, a distance and an orientation in the question; performing text classification on the user question based on a user intention recognition model, and determining the intention of the user; determining a structured query statement based on a preset language model according to the key entity and the intention; obtaining multi-dimensional geographic space data in the Internet map; converting the multi-dimensional geographic space data into a triple, and constructing a structured knowledge graph; and according to the structured query statement and the structured knowledge graph, determining an answer to the user question. According to the method, the intention of the question of the user is accurately and intelligently understood, and the accurate answer is returned.

The invention relates to a large model text classification method and system based on an alignment strategy. The method comprises the following steps: constructing a language prompt based on a to-be-classified text; based on the pre-training language model and the language prompt, obtaining an output vector; according to the output vector, determining a probability distribution matrix of all candidate words of the pre-training language model; the probability distribution matrix comprises prediction classification labels; and performing label propagation based on a pre-constructed text semantic graph and the aligned and enhanced probability distribution matrix to obtain a text classification result of the to-be-classified text. According to the method and the device, the language prompt is constructed based on the to-be-classified text, the text classification task is converted into a task-oriented text completion problem in the natural language prompt, label propagation is carried out by utilizing the text semantic graph, and the predicted text classification result of the pre-trained language model is aligned and enhanced; the accuracy of model classification can be improved when samples are scarce.

The invention discloses an event detection and extraction method and system based on entity and trigger word fusion recognition. The method comprises the steps that trigger words in event text data are extracted; mapping the event text to a vector space based on a word embedding model, and constructing an event text classifier to perform similarity measurement on all words of which the part-of-speech is a verb and the trigger word in the event text; constructing an event detection model to obtain an event category in the event text data; identifying a key element entity of the event; constructing a dependency syntax tree to represent a syntactic dependency relationship of the sentences; obtaining the score of the dependency syntax tree; and inputting the preprocessed word vector and the part-of-speech vector representation obtained through supervised learning into a role tagging model for fusion to obtain a vector representation with part-of-speech features, and after training, carrying out conditional random field processing to obtain a final semantic role tag of the word. Accurate event detection based on entities is realized, and high-quality extraction of events is towed.

Methods and systems for Few-Shot Class-Incremental Learning (FSCIL) that utilizes a combination of Session Specific Prompts (SSP) and hyperbolic distance metrics to enhance session-wise learning and representation of image-text pairings across differing classes. The methods and systems include a base training session where both text and image features are projected into hyperbolic space for accurate class pairing using a cross-entropy loss function. Subsequent incremental sessions incorporate previously learned SSPs to retain and augment the separability of classes while minimizing the trainable parameters. This enhances performance in image-text classification tasks by leveraging a minimalistic approach, achieving higher accuracy with fewer trainable parameters compared to traditional models.

The invention provides a text classification method based on quantum transfer learning, and belongs to the field of fusion of quantum computing and artificial intelligence. In consideration of complex feature space and nonlinear characteristics in text classification, quantum circuit design, a self-attention mechanism and a quantum transfer learning process are optimized, so that the learning efficiency and classification accuracy of the model are improved. The high-dimensional feature representation and a complex nonlinear decision process are converted into a quantum self-attention network structure, an optimal strategy of text classification is obtained by utilizing a complex quantum kernel self-attention network (CQKSAN) model, and a quantum superposition and entanglement mechanism is introduced to enhance the expression ability of the model. A simulation result shows that compared with a traditional deep learning algorithm and other mixed quantum-classical algorithms, the algorithm provided by the invention has higher classification precision and learning efficiency. The method not only shows the potential of a mixed quantum-classical method, but also provides a basis for further research of a future full-quantum learning system.

Systems and methods for processing calls to determine if the call is potentially fraudulent or unwanted. The system extracts a speech signal from an audio signal associated with a call. The system identifies audio characteristics based on analysis of the audio signal. The system generates textual transcript of the audio signal based on automatic speech recognition of the speech signal, which is used to assign text categories for the call based on an automated multi-label textual classification of the textual transcript. The system assigns audio categories for the call based on automated multi-label acoustic classification of the speech signal. The system generates an output label for the call based on a combined analysis of the text categories, the audio categories, and the audio characteristics. The language spoken during the call may be detected and used to generate the textual transcript and to assign the text categories and the audio categories.

The invention provides a text classification model training method and device, electronic equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: clustering an initialized text to obtain a plurality of clusters, and screening out a seed text of each cluster; constructing a first prompt word corresponding to the seed sample of each cluster, and labeling the seed text of each cluster based on the first prompt word to obtain a label of the seed text of each cluster; taking a label of the seed text as a pseudo label of the initialized text; and training a text classification model based on the initialized text carrying the pseudo tag. By means of the text classification method and device, high dependence on manpower and professional knowledge can be relieved in the training process of the text classification model, then the training cost is reduced, and the to-be-classified text can be quickly and accurately classified through the trained text classification model.

The invention relates to the technical field of voice recognition, and discloses a voice instruction recognition method based on a BERT pre-training language model, and the method comprises the steps: receiving a to-be-recognized voice, and converting the to-be-recognized voice into a text sequence through an automatic voice recognition model; fine-tuning the BERT pre-training language model, and performing text classification on the text sequence by using the fine-tuned BERT pre-training language model to obtain an instruction category corresponding to the to-be-recognized voice; performing model compression on the fine-tuned BERT pre-training language model by utilizing knowledge distillation to obtain a sequence classification model; according to the method, the situation that the audio data is more difficult to obtain than the text data is considered, the BERT is selected to pre-train the language model, the classification accuracy is improved, the knowledge distillation is utilized to perform model compression, the instruction category label of the to-be-recognized voice is recognized, and the voice recognition accuracy is improved. And data support is provided for man-machine interaction.

The invention discloses a Chinese text classification method based on metaphor association and label constraint comparative learning, and belongs to the technical field of natural language processing and artificial intelligence. A classification model construction method comprises the steps that an ambiguity recognition module is constructed to quantify voice and syntactic ambiguity of characters, and high ambiguity expression is recognized; a cue word management module is constructed, metaphor interpretation and label definition description are generated through a large language model, and the text semantic understanding depth is enhanced; designing a context attention mechanism and a metaphor attention mechanism, dynamically adjusting a feature weight and realizing label definition alignment; and constructing a loss function based on triple contrast learning, enhancing relevance between metaphor content and tags, and inhibiting irrelevant literal features at the same time. The Chinese text classification method is remarkably superior to a traditional model method in tasks such as metaphor sentiment classification and poetry theme classification, and the accuracy and robustness of Chinese text classification are effectively improved.

The invention provides an SQL generation method and system combining GraphRAG and a large model in the technical field of natural language processing and artificial intelligence crossing, and the method comprises the steps: S1, obtaining an input natural language query statement, and recognizing the user intention of the natural language query statement through a TextCNN text classification model; s2, on the basis of the user intention, matching similar indexes of the natural language query statement through a text sliding block similarity algorithm; s3, querying associated table fields from a preset data knowledge vector library on the basis of the similar indexes through a GraphRAG technology, and filtering each table field; s4, through a preset cue word template, generating a query cue word based on the natural language query statement and the filtered table field; and S5, inputting the query prompt word into a large model to obtain an SQL statement corresponding to the natural language query statement. The method has the advantage that the SQL generation accuracy and efficiency are greatly improved.

Disclosed herein, is a method and system for selecting a LLM for response generation to user queries. The method includes receiving a user query from a user device. The method includes determining, for the user query, a query type from a set of query types through a fine-tuned text classification model. The method includes retrieving a plurality of document embeddings based on the user query and the query type from a vector database through a semantic search technique. The method includes preparing a prompt using the user query and the plurality of document embeddings. The method includes inputting the prompt to an LLM selected from a set of LLMs based on the query type. The method includes generating, via the selected LLM, a response to the user query based on the prompt.

The invention discloses an enhanced contrast learning method and device for highly unbalanced text classification, and the method comprises the steps: carrying out the preprocessing of text data in a training data set and a test data set, and obtaining corresponding original training texts and test texts; respectively inputting the original training text and the test text into the RoBERTa model to obtain corresponding text embedding representations; constructing a text classification model based on data enhancement and comparative learning, wherein the text classification model comprises a text enhancement module, a text representation module, a comparative learning module and a text classification module; and applying the trained and tested text classification model to classification processing of to-be-processed text data, and outputting a classification result. The invention provides a new self-constrained stacked data enhancement method and a new double-weighted contrast loss function, the characterization problem caused by data imbalance and data lack can be solved, and a better text classification effect is achieved.

Herein from tabular data in a text document, a machine learning text classification pipeline infers natural language syntax and semantics to prepare the tabular data for graph analytics. In an embodiment, a computer infers a respective classification of each column in a table in a text document that contains natural language. Based on the classifications of the columns in the table, the vertices of the knowledge graph are automatically generated. Based on those column classifications and automatic analysis of a particular document portion that does not contain the table, the edges of the knowledge graph are automatically generated. The knowledge graph may be generated and operated as a property graph. Pipeline subsystems herein include column classification, edge type identification, and subject / object detection that provide sufficient semantic enrichment and context sensitivity to faster generate a more accurate knowledge graph than the state of the art.

To efficiently and effectively classify a large amount of document and text data by an LLM.SOLUTION: The present invention relates to a text classification system 1 which classifies documents accumulated in a document DB 14 by categories, and the text classification system has a classification processing part 12 which lets an LLM 2 proposes one or more categories based upon a classification policy specified by a user, a search processing part 13 which searches the document DB 14 for documents belonging to the respective proposed categories, and a UI processing part 11 which presents the respective categories and the numbers of documents belonging to the respective categories to the user.SELECTED DRAWING: Figure 1