39 results about "Deep knowledge" patented technology

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of medical health, financial science and technology, culture research and the like, and discloses a content generation and optimization method based on a knowledge graph, which comprises the following steps: constructing a multi-source knowledge database, extracting core concepts and knowledge contents, and constructing the knowledge graph. Performing semantic analysis to generate semantic vector representation and a keyword list; retrieving the associated text fragment based on the semantic vector and the keyword list, and inputting the associated text fragment into a generation model to generate initial answer content; and utilizing the knowledge graph to match the domain entity and the knowledge graph node, generating a logical reasoning path, optimizing the initial answer content, and generating the final answer content. According to the method, content generation of accurate retrieval, deep knowledge association and logical reasoning enhancement is realized by fusing a multi-source knowledge database, knowledge graph reasoning and generation optimization; semantic vector matching and keyword retrieval are combined, so that the accuracy of knowledge acquisition is improved; and through knowledge graph reasoning path construction, the answer logic is coherent.

The invention relates to the field of natural language processing. The invention discloses a cross-modal knowledge optimization system for improving localization adaptability of a large language model, and the system comprises a modal data collection module which collects cross-modal localization data of characters, audios and videos; the data preprocessing module is connected with the data acquisition module and preprocesses acquired data; the cross-modal knowledge fusion module is connected with the preprocessing module, fuses data and large language model general knowledge, and performs mining association by means of a cross-modal learning algorithm to form a localized cross-modal knowledge graph; the model fine-tuning module is connected with the fusion module and uses the map to finely tune the large language model; the evaluation feedback module is connected with the fine tuning module and evaluates the localization performance of the model. Through multi-modal data integration, dynamic preprocessing, deep knowledge fusion, efficient fine adjustment and intelligent feedback, various problems in the large language model localization process are systematically solved, and the expression of the model in dialect understanding, cultural questions and answers and cross-modal tasks is remarkably improved.

The invention discloses an intelligent question bank retrieval and recommendation system based on an artificial intelligence knowledge graph, and relates to the technical field of artificial intelligence education. Comprising a knowledge graph construction module which is used for processing original education data and constructing a neighborhood knowledge graph comprising a hard preposition relation and a soft incidence relation; the user knowledge state graph construction module is used for constructing a user personal knowledge state graph isomorphic to the domain knowledge graph, and dynamically calculating a mastery index of each knowledge node through a deep knowledge tracking model based on user historical answer data; according to the method, by constructing the domain knowledge graph containing the hard preposition relation and the soft incidence relation, discrete knowledge points are organized into the structured network conforming to the cognitive law, so that the system can understand and follow the internal logic between knowledge, and a learning path which is clear in organization, efficient and coherent is generated.

The invention relates to the technical field of power dispatching, and discloses a knowledge distillation-based low-resource power big language big model training method, system and device and a medium, and the method comprises the steps: obtaining accident case data of the power industry, carrying out the problem construction and task setting, introducing a quality evaluation mechanism, carrying out the refusal sampling through a language model, and carrying out the training of a low-resource power big language big model. Generating a distillation data set for model distillation; introducing a LoRA module into the student model for fine tuning, constructing multi-source heterogeneous fine tuning data, and setting a training strategy to optimize the performance of the model; and performing training by adopting reinforcement learning, introducing language consistency rewards until the reinforcement learning achieves convergence on the reasoning task, and generating a final language large model. According to the method, through knowledge distillation and reinforcement learning, the deep knowledge and the reasoning ability of the super-large model are successfully migrated to the small model, so that the parameter quantity of the finally deployed model is greatly reduced, and the computing power resource required by reasoning is sharply reduced.

The invention discloses a learning path recommendation method fusing a hierarchical knowledge graph and deep knowledge tracking, and belongs to the technical field of data analysis, and the method comprises the following steps: constructing a KGDKT model, and constructing a deep knowledge tracking model capable of considering a logic relationship between knowledge points; searching a learning path, and generating all paths pointing from the starting point knowledge point to the target knowledge point based on the hierarchical course knowledge graph and the KGDKT; and optimal path selection: predicting the mastering degrees of the target knowledge points of the learner on different paths through KGDKT, and selecting one path with the best learning effect to be recommended to the learner. The path generated by the method accords with the logical relationship between the knowledge points, can adapt to the dynamically changing knowledge level of the learner, and improves the learning effect of the learner on the target knowledge point.

The invention discloses a sample screening prompt generation method based on knowledge point graph guidance, and belongs to the field of computer natural language processing. The method is divided into two stages: in the first stage, knowledge points are extracted and a knowledge point graph is constructed by analyzing book contents of Common Course Standard Invention, and data are aligned to the graph; in the second stage, input query is mapped to corresponding knowledge points through knowledge point association, samples with the knowledge point overlapping degree being 0 are removed through a sample initial screening model, deep knowledge semantic features are extracted through a self-attention neural network, an optimal sample is screened out from a training set in combination with a knowledge point similarity and diversity comprehensive selection model, and the deep knowledge semantic features are extracted; and inputting a large language model to generate an answer after combining with the query. According to the method, the context learning performance of a large language model is remarkably improved, the problem that sample selection is interfered by surface language characteristics is solved, the knowledge point dimension information is introduced, so that the understanding of the model on tasks is more accurate, the generation illusion is reduced, and experimental verification is achieved.

The invention relates to the technical field of intelligent recommendation, in particular to a teaching content recommendation method and system driven by online education platform data. The invention discloses a teaching content recommendation system driven by online education platform data. The teaching content recommendation system comprises a knowledge point mastering feature data construction module, a mastering degree analysis module, a gap knowledge point determination module and an education content recommendation module. The knowledge point mastering degree of the user is determined by analyzing the evaluation data of the user, the education content knowledge graph is analyzed through the mastering degree analysis model, the dependency relationship between the knowledge points is researched, the deeper knowledge point mastering degree is analyzed, and then more accurate knowledge point mastering degree judgment is obtained. And then determining notched knowledge points with low knowledge point mastering degree of the user based on the knowledge point deep mastering feature data, and determining an educational content learning path needing to be recommended through the notched knowledge points, so that educational content recommendation for checking and repairing the missing of the user can be realized.

The invention provides an intelligent retrieval and reasoning generation method and system based on a knowledge graph and geoscience, and the method comprises the steps: firstly constructing a geoscience knowledge graph according to the information of a geoscience data set; secondly, identifying a key intention of the geographical question sentence; then, knowledge graph embedding work is carried out based on the entity relation structure of the knowledge graph, cross-entity potential relation and global information are captured, and reasoning from geoscience explicit data to deep knowledge is achieved; and finally, fusing a map result and a character result to carry out multi-domain retrieval so as to obtain an answer. Compared with an existing question answering system, the brand-new knowledge graph intelligent question answering system is constructed, the recall of answers can be improved, the knowledge reasoning ability is achieved, implicit internal association can be mined through explicit geoscience data, and geoscience experts can be helped to quickly and accurately find a target data set.

The invention provides an academic knowledge base construction method and system based on distributed crawlers and GraphRAG, and belongs to the technical field of computer information processing and knowledge management. The method comprises the following steps: constructing a distributed crawler architecture based on Selenium + Scrapy, completing character recognition and document logic structure reconstruction, storing a document as a Markdown format file, uploading the Markdown format file to a Dify knowledge base, segmenting the Markdown format file into knowledge blocks, and generating vector representation; extracting a semantic relationship between the entities, and constructing a knowledge graph according to the determined reasoning relationship; synchronously integrating the constructed knowledge graph and the segmented knowledge blocks into an intelligent agent, and constructing an intelligent agent process; by inputting a natural language question, an intelligent agent is triggered to execute semantic analysis, vector representation recall and knowledge graph reasoning, and an interpretable answer is returned. The problems that the data collection coverage rate is insufficient, text semantic conversion is distorted, deep knowledge association is missing, and knowledge base deployment is complex are solved.

The invention discloses a deep knowledge tracking method, system and equipment based on student characteristics, and relates to the technical field of data processing, and the method comprises the steps: obtaining the capability characteristics of each student, obtaining a student warning coefficient, and obtaining the warning coefficient of each student for each exercise; taking the ability characteristics, the warning coefficient and the student question-doing sequence original data as input data of a knowledge tracking model; calculating a knowledge state matrix to obtain a knowledge mastering state of the student for the corresponding exercise content at a certain moment; and splicing the feature vector of the knowledge mastering state with the capability feature and the attitude feature to obtain a composite feature of each student, and outputting the probability that the students correctly answer questions after the composite features pass through a full connection layer. According to the invention, factors such as student ability, learning attitude and exercise quality are integrated, so that knowledge states and learning behaviors of students can be better reflected, and the problem that a traditional DKVMN ignores behavior attitude and learning ability difference is solved.

The invention relates to the technical field of intelligent interaction, in particular to an intelligent interaction method and system based on AIGC. According to the intelligent interaction method and system based on AIGC, an input text interacted for the first time is split into interaction vocabularies, then term description depth levels of the interaction vocabularies are analyzed, and contribution differences between the interaction vocabularies and effective interaction vocabularies are analyzed; the interaction depth of the interaction vocabularies is obtained, then an initial sampling weight is set, pertinent activation of expert parameters is carried out, and an output text of first interaction is obtained; and then according to the input text of the secondary interaction, the change tendency and change degree of the interaction demand of the user are analyzed to obtain the adjustment sampling weight of the secondary interaction, the activated expert parameters are subjected to targeted suppression, and the deformed text of the secondary interaction is output. According to the method, the matching degree of the output deep knowledge and the actual interaction stage of the user can be effectively improved, and the response duration of interaction is optimized under the condition of ensuring that the AIGC interaction content is more professional, so that the immersion feeling is maintained.

The invention relates to a neural machine translation selective knowledge distillation method based on dependency constraint self-attention, and belongs to the technical field of machine translation. An existing knowledge distillation method has the problems that only vocabulary-level probability distribution is transmitted, syntactic structure constraints are ignored, and the capacity of a student model is reduced, so that the complex syntactic modeling capacity is insufficient. Therefore, according to the method, a syntactic matrix converted through a source language dependency syntactic tree is provided, linear combination is adopted to dynamically correct self-attention weight distribution of an encoder, and explicit syntactic constraints are synchronously injected into a teacher-student model. Through a selective distillation strategy of syntax perception, deep knowledge effective for training in a teacher model is screened, a cross-language syntax corresponding relation is obtained in combination with structure alignment distillation, and model compression and translation performance enhancement is realized through attention optimization and a selective knowledge transmission mechanism guided by a dependency syntax.

The invention belongs to the field of artificial intelligence, and provides a deduction method and system based on a affair atlas and a large model, which can expand the range of a data set by constructing event libraries containing real events and virtual events and establishing the affair atlas based on the event libraries, so that the data set is not limited by actual data, and the deduction efficiency is improved. Therefore, not only is the diversity of data enriched, but also the possibility of innovation is provided for the recommendation system, so that the recommendation result is richer and more diversified; an instruction data set for large model training is constructed by using a affair graph, and a complex relationship and a dynamic process between events can be better described, so that more accurate and in-depth knowledge support can be provided during construction of the instruction data set; the controllability and predictability of the output of the large model are improved through instruction tuning, namely, the output of an instruction constraint large model in an instruction data set; the large model has strong deduction capability and breaks through the scale limitation of the affair atlas database, and the deduction result may have certain innovativeness.

This invention discloses a zero-shot stance detection device and method based on multi-level knowledge selection, including a multi-level knowledge selection module and a zero-shot stance detection module. The multi-level knowledge selection module contains a knowledge selection model, which consists of an input layer, an encoding layer, a context layer, an attention layer, and an output layer. The knowledge selection model is used to match deep and shallow semantic information to obtain the deep knowledge required for zero-shot stance detection by extracting the interaction relationships between sentences and the interaction relationships between words in a single sentence. Knowledge, objectives, and arguments are input into the zero-shot stance detection module to complete the zero-shot stance detection, and the obtained deep knowledge is used as auxiliary information for zero-shot stance detection.

The present invention discloses an online fault diagnosis method for industrial streaming data based on a deep knowledge distillation network, comprising the following steps: (1) collecting raw vibration signals of mechanical equipment under multiple different operating conditions, dividing them into a source domain and multiple target domains, and intercepting data of the same length to form training and test samples; (2) designing and constructing a network structure, wherein the overall network framework includes: a feature extractor and a fault classifier; (3) using labeled source domain samples to perform supervised training on the model to obtain an initial source model; (4) combining a knowledge distillation algorithm based on probability confidence and a maximum information entropy algorithm to train the model; (5) inputting the test samples into the trained model to obtain the fault classification results of the model in each domain (each task). The present invention can achieve effective diagnosis of incremental faults in industrial streaming data while protecting data privacy, and has high industrial application value.

The invention discloses a deep knowledge tracking method based on a forgetting behavior in a multi-knowledge-point question, and the method comprises the steps: obtaining answer data, cutting an answer sequence into a preset length, and constructing a training set; setting an input module, a state updating module and a prediction module, and constructing a knowledge tracking model; inputting the training set into a knowledge tracking model, training, and updating model parameters to obtain an optimal knowledge tracking model; and performing answer prediction based on the optimal knowledge model. According to the method and the device, the situation of multiple knowledge points is considered, the forgetting features are calculated according to the multiple knowledge points contained in the question, and the accuracy of answer prediction of the knowledge tracking model is improved. The method can be widely applied to the field of data mining.

The embodiment of the invention provides a relational graph construction method and system based on semantic analysis of knowledge in the electric power field, and belongs to the technical field of electric power. The relation graph construction method comprises the following steps: acquiring multi-source data about the power field; cleaning and de-noising the multi-source data to obtain corresponding power data; sending the electric power data into a BERT model to complete entity identification of the electric power data; according to the relation between the identified entities, completing extraction of the relation between the entities; and according to the obtained relationship between the entities, constructing a relationship graph about the entities. According to the relation graph construction method, key entity elements can be automatically extracted and the incidence relation of the key entity elements can be intelligently constructed based on the deep knowledge background in the electric power field.

This invention provides a method and system for vertical domain adaptation based on entity knowledge distribution alignment, relating to the fields of natural language processing and artificial intelligence. First, by constructing entity knowledge representations from multi-perspective features of the same entity knowledge, this invention achieves a comprehensive and systematic characterization of the identity, structure, and semantic information of entity knowledge. Second, through a cross-perspective knowledge distribution alignment mechanism based on contrastive learning, it ensures semantic consistency of knowledge from different sources before fusion. Finally, by using a compression module based on learnable query tokens and precisely injecting the compressed knowledge tokens into the self-attention calculation of a specified layer in the encoder of a pre-trained language model, it achieves low-intrusive deep knowledge injection, enabling the pre-trained language model to adaptively coordinate internal and external knowledge without modifying the main parameters, significantly reducing the cost of vertical domain adaptation.

The invention discloses a recommendation question generation method and recommendation question generation equipment, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a user question; the user questions are converted into vectors, the vectors are matched with vectors in a preset recommendation question vector library, target vectors are obtained, and the recommendation question vector library comprises vectors obtained by converting the first candidate recommendation questions; each first candidate recommendation question is generated by a preset first intelligent agent based on a preset first prompt word and each knowledge text block in a preset knowledge text block set, and the first prompt word is used for prompting the first intelligent agent to generate a question to be recommended to the user according to the knowledge text block; and determining a recommendation question for output according to the candidate recommendation question corresponding to the target vector. According to the method, the professional degree and the accuracy of the generated recommendation problem are improved, so that the user is effectively guided to carry out deep knowledge exploration.

The invention provides an EPC field-oriented knowledge sharing platform construction method, which is characterized in that a knowledge graph is used as a basis, a deep learning algorithm and an LLM large language model are used as technical supports, and a knowledge extraction model which takes each professional knowledge in the EPC field as a core target is optimized on the basis of the existing knowledge extraction technology and knowledge query technology, so that the knowledge sharing platform construction efficiency is improved. A knowledge fusion module taking an entity alignment technology as a core is added, a knowledge automatic reasoning and complementing module is added, and a sensitive information processing module is added. A professional knowledge question-answering system is constructed through a general large language model and a knowledge graph, and a promote project is used for processing, so that the knowledge reasoning ability is improved, and deep knowledge mining is realized. According to the method, internal knowledge assets in the EPC engineering field can be better shared and utilized, manpower and material resource investment caused by knowledge management is reduced, and cost reduction and benefit increase are achieved.

The present disclosure provides a student and teacher interaction method, device, medium and electronic equipment. The present disclosure logically reviews the question information sent by the student terminal, obtains at least one pair of suspicious knowledge point information, that is, the information in which the understanding of the knowledge point in the question information is wrong and the concept is unclear, and then obtains the matched first answer information from the teaching asset records of the teaching assets in the asset layer through the at least one pair of suspicious knowledge point information. A large number of similar questions are answered in an automatic reply manner, the answering efficiency is improved, and the answering teacher and the student can explore deeper knowledge.

The invention discloses an archive editing and research automation system based on machine learning and natural language processing, and relates to the technical field of archive management and information processing, and the system comprises an archive editing and research system which automatically collects, arranges, analyzes, studies and compiles archive information to form various archive editing and research results, and a data collection and processing module which is used for collecting and processing the archive information. The method is used for collecting archive information from various channels. According to the archive editing and research automation system based on machine learning and natural language processing, through the data collecting and processing module and the natural language processing module, information can be automatically extracted, the time cost and the error rate of traditional manual retrieval are greatly reduced, the efficiency and the accuracy of processing a large amount of diversified and unstructured archive data are improved, and the archive editing and research automation system is suitable for popularization and application. Through the machine learning module, the efficiency and systematicness of data management are improved by utilizing the classification and arrangement functions of machine learning, and deep knowledge is conveniently extracted from archive data through the application of the NLP technology of the archive editing and research generation module.

The present disclosure relates to the technical field of artificial intelligence education, and discloses a lightweight knowledge tracking method and system, which comprises the following steps: obtaining learning data input by a user, and performing natural language understanding and processing on the learning data through an LLM distillation module to determine learning resources for the learning data; wherein the learning data comprises text data and structured data; obtaining historical learning data of the user, and performing deep learning algorithm analysis on the historical learning data through a DKT module to predict the mastery of knowledge points by the user; and determining a learning task based on the learning resources and the mastery. By combining the large language model distillation technology (LLM distillation module) and the deep knowledge tracking technology (DKT module), the present disclosure can accurately track the mastery of knowledge points by students while reducing the computational complexity, and can realize personalized learning task recommendation, thereby effectively improving the learning effect.

The present invention relates to the field of intelligent recommendation technology, and particularly relates to a method and system for recommending teaching content driven by data on an online education platform. An online education platform data-driven teaching content recommendation system includes: a knowledge point mastery feature data construction module, a mastery degree analysis module, a gap knowledge point determination module, and an educational content recommendation module. The present invention determines the user's knowledge point mastery degree by analyzing the user's assessment data, and analyzes the educational content knowledge graph through a mastery degree analysis model, studies the dependency relationship between knowledge points, analyzes the deeper knowledge point mastery degree, and then obtains a more accurate judgment of the knowledge point mastery degree. Based on the deep mastery feature data of knowledge points, the gap knowledge points with low user knowledge point mastery degree are determined, and the learning path of educational content to be recommended is determined through the gap knowledge points, so as to realize the recommendation of educational content for users to check for deficiencies and make up for them.

The application discloses a cognitive state-based knowledge point-by-knowledge point differentiated decoding parameter injection method and system, belongs to the technical field of education, and is suitable for an adaptive personalized content generation scene. The method outputs a learner's mastery probability vector of each knowledge point through a deep knowledge tracking model, calculates a recent development area score in combination with a knowledge graph preposition dependency relationship and a knowledge point hierarchical depth; generates a local decoding parameter tuple for each knowledge point through a cognitive parameter mapping function, including a decoding temperature, a generation granularity and a scaffold insertion probability; and dynamically switches decoding parameters according to the mastery degree of the current knowledge point in the text generation process, realizes fine-grained step-by-step deduction in a low-mastery-degree area and summarization rapid passing in a high-mastery-degree area in the same text. The method realizes single-text knowledge point-by-knowledge point partition differentiated generation for the first time, introduces a cognitive transition section mechanism to process the mastery degree jump, effectively reduces the reasoning power consumption of an online education platform and improves the learning effect.

The application discloses a kind of fusion cognitive theory's deep knowledge tracking method and system, the method includes the following steps: obtaining answer record set, obtains recent attempt time interval and past attempt times, obtains forgetting behavior embedding by embedding layer and is spliced, obtains problem embedding vector by splicing problem index embedding, knowledge concept index embedding and forgetting behavior embedding, obtains problem-response embedding vector by splicing problem embedding vector and corresponding answer response, generates problem embedding vector, problem-response embedding vector and knowledge mastery state based on question encoder, knowledge encoder and knowledge retriever respectively, generates student ability value, question discrimination, exercise difficulty based on embedding layer respectively, and calculates answer guess rate, constructs question response theory model based on deep knowledge tracking and carries out iterative training, and makes answer performance prediction based on optimized deep knowledge tracking model.The application can make accurate evaluation to the knowledge mastery state of student.

The invention relates to the technical field of artificial intelligence education, and discloses a lightweight knowledge tracking method and system, and the method comprises the steps: obtaining learning data inputted by a user, carrying out the natural language understanding and processing through an LLM distillation module, and determining learning resources for the learning data; wherein the learning data comprises text data and structured data; historical learning data of the user is obtained, deep learning algorithm analysis is carried out through a DKT module, and the mastering condition of the user on knowledge points is predicted; and determining a learning task based on the learning resources and the mastering condition. According to the method and the device, by combining a large language model distillation technology (LLM distillation module) and a deep knowledge tracking technology (DKT module), the mastering condition of knowledge points of students can be accurately tracked while the calculation complexity is reduced, and personalized learning task recommendation is realized, so that the learning effect is effectively improved.

A system and method for using retrieval-augmented generation (RAG), in a large language model (LLM) having additional content to enhance relevance of LLM generated content. In operation, a user asks a question and the LLM determines whether additional content needs to be retrieved from a data management system to answer the question. If so, the LLM is provided with the user question and said additional content and asked to score its ability to confidently answer the question with the provided content. If the score is below a predefined threshold, the LLM is instructed to generate an alternate response using the retrieved additional content. Additionally, the system generates follow-up suggestions to assist the user in gaining more in-depth knowledge on the subject at hand. If the score is below a predefined threshold for a selected suggestion, the system will record this to assist to fill gaps in available content.

The present invention discloses a concept recommendation method based on large language model structure learning and knowledge representation, which belongs to the field of concept recommendation. The method of the present invention first obtains the learning data and concept knowledge graph of the student account in the learning process and performs preprocessing; uses the pre-trained language model to encode the enhanced text generated by the large language model to obtain the final hidden vector of each concept, and then constructs the enhanced concept knowledge graph, pre-trains the GraphGPS concept encoder based on the enhanced concept knowledge graph and the dual-view cross-graph comparison learning method; synthesizes educational data by the TabDDPM model to pre-train the deep knowledge tracking model; splices the concept representation of question embedding, answer embedding, structure perception and student knowledge state representation to form the final representation, and then obtains the coding sequence, pre-trains the sequence coding model and fine-tunes the concept recommendation matrix, and finally forms a concept recommendation model for concept recommendation.

This invention discloses a deep knowledge tracking method based on graph neural networks, belonging to the field of smart education. Specifically, the method involves: first, cleaning the real dataset and storing the binary relationship between questions and skills in each interaction data point in a dictionary. Then, for the same student, all their questions are sequenced in ascending time steps, and corresponding exercise sequence graphs and interaction sequence graphs are generated based on the binary relationships. Next, a corresponding graph neural network is constructed to obtain the representation of each graph in the exercise sequence graph and interaction sequence graph. The exercise graph representation at time step t+1 is concatenated with the interaction graph representation at time step t, and the student's learning result at time step t+1 is predicted using a fully connected neural network. Finally, the graph neural network is embedded into an existing Transformer model, and parameters are updated through backpropagation. This invention achieves dynamic graph representation of questions and interaction sequences and utilizes an attention mechanism to update the knowledge state, improving the model's performance and interpretability.