Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

522 results about "Inference" patented technology

Inferences are steps in reasoning, moving from premises to logical consequences; etymologically, the word infer means to "carry forward". Inference is theoretically traditionally divided into deduction and induction, a distinction that in Europe dates at least to Aristotle (300s BCE). Deduction is inference deriving logical conclusions from premises known or assumed to be true, with the laws of valid inference being studied in logic. Induction is inference from particular premises to a universal conclusion. A third type of inference is sometimes distinguished, notably by Charles Sanders Peirce, distinguishing abduction from induction, where abduction is inference to the best explanation.

Multi-modal knowledge graph rule reasoning method and device based on large model

The invention discloses a multi-modal knowledge graph rule reasoning method and device based on a large model, and the method comprises the steps: carrying out the feature extraction and cross-modal alignment of input text data and image data, and generating a multi-modal feature vector of a unified semantic space; performing knowledge graph storage on the emotion entities and the relationships by adopting an attribute graph model to complete construction of an emotion knowledge graph; generating an interpretable inference rule from the emotion knowledge graph by using a large language model, and eliminating a conflict rule in combination with logic verification; calculating the confidence coefficient of a reasoning path based on an attention mechanism, and carrying out quantitative evaluation on a rule reasoning result; the knowledge graph and the rule base are updated online according to user feedback, and the real-time performance and accuracy of the inference system are optimized through weight adjustment and a forgetting mechanism. According to the method, through innovative technologies such as multi-modal data integration, dynamic knowledge evolution and interpretability reasoning, the limitation of a traditional sentiment analysis method in the aspects of evidence dimension, adaptive capacity, interpretability and the like is broken through.
Owner:GUANGZHOU UNIVERSITY

Dynamic retrieval decision scheme determination method and system based on Monte Carlo tree search

The invention belongs to the field of artificial intelligence and natural language processing, and provides a method and a system for determining a dynamic retrieval decision scheme based on Monte Carlo tree search in order to solve the problems of redundant retrieval and incapability of multi-step reasoning and dynamic planning of a traditional retrieval enhancement generation method. The dynamic retrieval decision scheme determination method based on Monte Carlo tree search comprises the following steps: receiving an initial query problem and taking the initial query problem as a starting point of a reasoning process to trigger and call a large language model operation; calling a large language model to execute sub-query generation and action selection operation, searching, iteratively and exploring inference actions of sub-query problems based on a Monte Carlo tree, and dynamically screening inference paths by considering self-confident degree scores and honesty degree scores of the large language model to obtain a complete inference track set; and on the basis of the complete reasoning track set, a preference pair is constructed for each sub-query problem, and a reasoning retrieval strategy is optimized, so that the optimal retrieval opportunity of the large language model is autonomously judged. According to the method, invalid retrieval and multi-step reasoning dynamic planning can be reduced.
Owner:INSPUR GENERSOFT CO LTD

Training data synthesis method and device based on error extrapolation and inference chain analysis, medium and program product

The invention provides a training data synthesis method and device based on error extrapolation and inference chain analysis, a medium and a program product. The method comprises the steps of obtaining an initial sample set; performing multiple sampling reasoning on the problem of each task sample by using a small language model to generate a plurality of reasoning chains; calculating an overall error score of each reasoning chain based on a preset error evaluation rule, and determining a to-be-corrected reasoning chain; the inference chain to be corrected and the corresponding question are input into the large language model together, and a corrected answer is generated; forming a new task sample by the question and the corrected answer, and finely adjusting partial parameters of the small language model; repeatedly executing the process until the performance index change rate of the model on the task evaluation set is lower than a preset threshold value, and outputting a final task sample; and forming a training sample set by a plurality of final task samples, and performing all-parameter fine tuning on the small language model. According to the method, the training data self-optimization path is constructed by taking the model error as guidance, so that the semantic consistency and the data validity are improved.
Owner:SHANGHAI COOPERS TECHNOLOGY CO LTD

Inference acceleration method and device, electronic equipment and storage medium

The invention relates to the technical field of computers, in particular to a reasoning acceleration method and device, electronic equipment and a storage medium, and is used for improving the reasoning speed when a model executes a task. The method comprises the steps that when a target model is adopted to execute a to-be-reasoned task, a matched reasoning mode is activated according to hardware state information of computing resources occupied by the target model; when the reasoning mode is an instruction acceleration mode, at least one round of reasoning operation is executed, and each round of reasoning operation comprises the steps that storage continuity check is conducted in computing resources for reasoning dependency data related to the input sequence of the round; the reasoning dependency data is generated and stored through the reasoning operation of the previous round; when the storage position of the reasoning dependency data is in a non-continuous state in the computing resources, the storage position is adjusted to be in a continuous state by rearranging the reasoning dependency data; and calling a specified hardware acceleration instruction to load the adjusted reasoning dependency data, and determining the reasoning result of the round based on the loading result.
Owner:TENCENT TECH (BEIJING) CO LTD

Multi-modal big language model reasoning optimization method and device, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to the fields of financial science and technology and medical health, and discloses a reasoning optimization method, device, equipment and medium for a multi-modal large language model.The method comprises the steps that an input long context sequence is obtained, and key value projection is conducted on the long context sequence to generate an initial key value cache; for each attention layer of the multi-modal large language model, calculating an attention matrix of the attention layer according to the vector dimension of the long context sequence and the initial key value cache; calculating a cross-modal attention entropy according to the attention matrix, and determining a cache size of an attention layer according to the cross-modal attention entropy; optimizing the initial key value cache based on a cumulative attention scoring mechanism and a window strategy to obtain a target key value cache; and reasoning the long context sequence according to the cache size and the target key value cache to generate a long context reasoning result. And the reasoning efficiency and the reasoning accuracy are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Intelligent dialogue method, system and device based on big language model illusion relief and medium

The invention relates to the technical field of artificial intelligence, and provides an intelligent dialogue method, system and device based on big language model illusion alleviation and a medium, and the method comprises the steps: outputting multiple rounds of heuristic answer results, stimulation thinking results and self-reflection results based on an input question through a big language model; generating a reasoning chain based on the heuristic answer result, the stimulation thinking result and the self-reflection result of the same round; performing logic semantic relationship detection on each reasoning chain through a small language model to obtain a target reasoning chain with a correct relationship; and extracting and outputting a target answer of the input question from the target reasoning chain. According to the intelligent dialogue method based on big language model illusion relief, the big language model is used for forming an inference chain, the small language model is used for analyzing the output of the big language model, inaccurate information can be accurately recognized and filtered out, staged cooperation between the two models is achieved, the limitation that the big language model conducts illusion detection in a self-reflection mode is overcome, and the intelligent dialogue efficiency is improved. And a result can be accurately output.
Owner:BEIJING NORMAL UNIVERSITY

Deep exploration AI reasoning method and system

The invention provides a deep exploration AI reasoning method and system, and the method comprises the steps: generating a dynamic calculation graph based on a to-be-reasoned task, carrying out the risk assessment of the dynamic calculation graph, generating a risk prediction result, and carrying out the risk prediction of the to-be-reasoned task. The risk assessment at least comprises complexity assessment, memory occupancy assessment and data transmission quantity assessment; based on a risk prediction result, performing optimization processing on the dynamic calculation graph to generate an optimized calculation graph, the optimized calculation graph being used for constraining an inference calculation depth and an inference resource allocation range, the method converting natural language input into a semantic weighted dynamic calculation graph, and identifying a resource risk through node-level complexity assessment; performing self-adaptive pruning in combination with the permission level and reinforcement learning to generate an optimal calculation graph; elastic resource scheduling is implemented based on a multi-target model and real-time monitoring, so that the problem of low collaboration of reasoning depth and resource efficiency is solved.
Owner:SHANGHAI ANBOTONG COMPUTING POWER TECHNOLOGY CO LTD

Scene application operation maintenance platform based on artificial intelligence model

The invention relates to the technical field of artificial intelligence, in particular to a scene application operation maintenance platform based on an artificial intelligence model, which comprises a reasoning state sensing module, a load balancing scheduling module, an intelligent resource allocation module, a deployment configuration adjustment module and a scene feedback integration module. According to the method, by sensing and reasoning process resource consumption and response time migration trend, abnormal tasks caused by resource fluctuation can be accurately recognized, the state monitoring sensitivity is improved, task allocation records are analyzed to construct conflict structures, the resource conflict recognition and visualization capability is enhanced, the model operation level and the GPU vacancy rate are combined, a task migration path is optimized, and the task migration efficiency is improved. Node resource balance is realized, storage frequency, memory margin and network delay are fused during deployment, migration stability is guaranteed, drift tasks are identified through response logs and call records, an operation and maintenance list is generated, operation and maintenance accuracy and multi-scene matching capability are improved, and reasoning task stability and resource scheduling intelligent level are enhanced.
Owner:SHENZHEN YUNHENG INTELLIGENT CO LTD

Inference acceleration optimization method and system applied to intelligent dialogue large model

The invention provides a reasoning acceleration optimization method and system applied to an intelligent dialogue large model, and belongs to the technical field of large models.Firstly, a to-be-reasoned dialogue sequence and reasoning environment configuration information are obtained, and the to-be-reasoned dialogue sequence comprises a user real-time input text and a historical interaction statement chain; the reasoning environment configuration information covers an operation node load state and cache resource occupation information, then joint process deconstruction processing is carried out on the operation node load state and the cache resource occupation information to obtain a reasoning node dependence graph and a resource elasticity demand list, reasoning link optimization processing is carried out based on the result, and a reasoning acceleration execution scheme is generated; the method comprises the steps of reasoning a node parallel scheduling rule and a resource pre-allocation strategy, regulating and controlling a reasoning operation process according to a reasoning acceleration execution scheme, generating a dialogue response sequence after acceleration processing, and finally pushing the dialogue response sequence after acceleration processing to a user interaction terminal to complete intelligent dialogue output. Therefore, the reasoning speed of the intelligent dialogue large model is effectively improved, and the dialogue interaction experience is optimized.
Owner:XINGFAN XINGQI (CHENGDU) TECH CO LTD

Large model intelligent reasoning method combining reinforcement learning and retrieval enhancement generation

The invention provides a large model intelligent reasoning method combining reinforcement learning and retrieval enhancement generation, and belongs to the technical field of artificial intelligence. Comprising the following steps: data input: data preprocessing; constructing a reinforcement learning environment; an RAG mechanism is integrated; training the model; and evaluating and iteratively optimizing. A reinforcement learning framework based on rules is introduced to guide a model to develop advanced reasoning skills such as reflection, verification and summarization. And in combination with a retrieval enhancement generation mechanism, the model can access and utilize a wide background knowledge base before answering questions. The synergistic effect between information retrieval and text generation is optimized. According to the method, the deficiency of knowledge of the model can be made up by introducing the external knowledge base, and the synergistic effect between information retrieval and text generation can be optimized in the reinforcement learning process, so that the capability of the model for processing complex reasoning tasks is remarkably improved, and formation of a more generalization reasoning strategy is promoted.
Owner:GUANGDONG UNIV OF TECH

Legal text information extraction enhancement method and system based on artificial intelligence

The invention discloses a legal text information extraction and enhancement method and system based on artificial intelligence. The method comprises the steps of data acquisition and processing, semantic segmentation and reconstruction, text logic perception, dynamic knowledge fusion and information extraction and enhancement. The invention relates to the technical field of text information extraction, in particular to a legal text information extraction enhancement method and system based on artificial intelligence, which adopts a joint frame of semantic segmentation reconstruction, text logic perception and dynamic knowledge fusion to realize more accurate recognition of the structural level of a legal text. Understanding of logic association of legal clauses is enhanced, and meanwhile, knowledge among different legal documents is dynamically fused, so that cross reference and intelligent application among different laws and regulations are facilitated; semantic segmentation reconstruction is carried out by adopting a conditional random field bidirectional long-short-term memory model improved by combining hierarchical label reasoning; and carrying out text logic perception by adopting a causal graph convolutional reasoning neural network enhanced by combining a dual-channel logic unit.
Owner:湖南工商大学

Question and answer model training method and device, electronic equipment, storage medium and program product

The invention provides a question and answer model training method and device, electronic equipment, a storage medium and a program product. The method comprises the steps that multiple candidate reasoning paths are determined based on a first question sample carrying an answer label, and the candidate reasoning paths are used for indicating reasoning steps needing to be executed for solving a question corresponding to the first question sample; classifying the plurality of candidate reasoning paths to obtain a first reasoning path belonging to a first category and a second reasoning path belonging to a second category, the reasoning accuracy of the first reasoning path being greater than the reasoning accuracy of the second reasoning path; determining a first loss value of the question and answer model based on the first reasoning path and the answer label, and determining a second loss value of the question and answer model based on the first reasoning path and the second reasoning path; and training the question and answer model based on the first loss value and the second loss value to obtain a target question and answer model. Through the method, the question solving performance of the question and answer model can be effectively improved.
Owner:TENCENT TECH (BEIJING) CO LTD

Method and device for training reasoning model and method and device for processing reasoning problem

The invention provides a training method and device of an inference model and a processing method and device of an inference problem, and relates to the field of artificial intelligence, in particular to the technical field of natural language processing, large models and deep learning. Obtaining a training sample set, wherein training samples in the training sample set at least comprise sample reasoning questions, reference reasoning chains corresponding to the sample reasoning questions and reference answers; on the basis of a first training sample in the training sample set, performing supervised fine tuning SFT on a pre-training model to obtain a first inference model after fine tuning; and performing reinforcement learning RL training on the first reasoning model based on the second training sample in the training sample set to obtain a second reasoning model, thereby improving the accuracy and stability of the second reasoning model in the reasoning process.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Resource pre-allocation method and device for computing device cluster and electronic device

Embodiments of the invention provide a resource pre-allocation method and apparatus for a computing device cluster, and an electronic device. The method comprises the steps of obtaining task information of a reasoning task expected to be submitted to a reasoning model for reasoning; dividing the reasoning tasks into a plurality of types according to the input token number and the output token number of the reasoning tasks, and determining an expected concurrency number of each type of reasoning tasks; for each type of reasoning task, determining a first target model in the equipment models of the computing equipment included in the computing equipment cluster according to the number of input tokens and the number of output tokens of the type of reasoning task; and for each type of reasoning task, according to the expected concurrence number, the input token number and the output token number of the type of reasoning task, reserving a first reasoning instance in a computing device of a first target model determined for the type of reasoning task. By applying the embodiment of the invention, the overall reasoning efficiency of the reasoning model can be improved.
Owner:BEIJING QIYI CENTURY SCI & TECH CO LTD

Model training and information replying method and device, storage medium and program product

The invention provides a model training and information replying method and device, a storage medium and a program product, and relates to the technical field of computers. The method comprises the steps of performing continuous pre-training on a base model based on a first training sample to obtain a basic model; performing cold start supervision fine tuning training on the basic model based on the second training sample to obtain a first supervision fine tuning model; performing multiple reasoning based on the third training sample, the target information and the to-be-trained model to obtain a reasoning result; in the Mth reasoning process, the target information comprises information obtained after a target tool determined by previous M-1 reasoning is called; optimizing the to-be-trained model based on the reasoning result to obtain a first reinforcement learning model; and based on the general recognition data and reasoning data output by the first reinforcement learning model, carrying out general recognition alignment training to obtain a target model. According to the method, the target tool can be called to obtain the required target information, so that the information output by the large model is more comprehensive.
Owner:RAJAX NETWORK &TECHNOLOGY (SHANGHAI) CO LTD

Project file risk analysis method and system

The invention relates to the technical field of artificial intelligence, and particularly provides a project file risk analysis method and system, and the method comprises the steps: obtaining a project file, and recognizing a semantic vector of the project file through a large language model; screening out a difference semantic vector inconsistent with the standard semantic vector; performing logical reasoning on the semantic vector of the project file based on the user problem by utilizing a thinking chain reasoning model to obtain an abnormal semantic vector; sequentially inputting the difference semantic vector and the abnormal semantic vector into a dialogue pre-training model to obtain a corresponding risk analysis text and a modification suggestion text; and converting the difference semantic vector and the abnormal semantic vector into statements, and writing the statements and the corresponding risk analysis text and modification suggestion text into a preset report template to obtain a risk analysis report. According to the method, accurate and accurate identification of project file semantics, comprehensive analysis of risk points and accurate generation and supplement of modification suggestions are realized.
Owner:BEIJING BIG DATA CENT

Task execution method and device based on prompt information, equipment and medium

The invention relates to the technical field of artificial intelligence, in particular to a task execution method and device based on prompt information, equipment and a medium, and aims to improve the flexibility of a task model prompt project and the accuracy of task processing. The method comprises the following steps: extracting each piece of key information related to a task target from task description information of a task to be reasoned; determining a task scale of the to-be-reasoned task according to the task description information, and selecting a topology type matched with the task scale; based on each piece of key information and the topology type, constructing a reasoning topology structure; reasoning nodes and edges in the topological structure, wherein the nodes and the edges respectively represent the reasoning steps of the task to be reasoned and the dependency relationship of the reasoning steps; generating prompt information of each node based on the reasoning topological structure, wherein the prompt information comprises an execution mode of a reasoning step represented by the corresponding node; and based on each piece of prompt information, guiding the task model to gradually execute each reasoning step according to each node and the dependency relationship thereof to obtain a task execution result.
Owner:TENCENT TECH (BEIJING) CO LTD

Layered exploration thinking-driven large-model complex graph question and answer processing method and device

The invention provides a hierarchical exploration thinking-driven large-model complex graph question and answer processing method and device, relates to the technical field of artificial intelligence, and aims to solve the technical problem that an existing complex graph question and answer method is insufficient in the aspects of reasoning depth, path search strategies and cross-layer information fusion ability. The method comprises the steps of obtaining a to-be-processed complex graph question and answer task; inputting the complex graph question and answer task into a pre-constructed large model, adding an induction mark for a node set by using a first-layer structure, and generating an induction graph; extracting a core entity feature and a trunk logic structure feature in the problem description by using a second-layer structure, and generating a context prompt; according to the induction graph and context prompts, reasoning and exploring are conducted through the third-layer structure, a preliminary question and answer result is generated, and the semantic relation and the logic relation of the preliminary question and answer result are verified; and in response to verification failure, iteratively updating the induction graph and regenerating a question and answer result until verification is passed, and outputting a target question and answer result.
Owner:AEROSPACE INFORMATION RES INST CAS

Model training method and device, computer equipment, readable storage medium and program product

The invention relates to a model training method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: reasoning a sample problem through a reasoning model to obtain a reasoning result; determining a corresponding reasoning length control hyper-parameter according to the difficulty level category of the sample problem; constructing a reasoning length reward function according to the reasoning length control hyper-parameter and the reasoning length of the reasoning result, and constructing a reasoning accuracy reward function according to the reasoning result; and performing model training based on reinforcement learning on the reasoning model according to the reasoning length reward function and the reasoning accuracy reward function. The reasoning model trained by the method can give consideration to reasoning efficiency and accuracy, and a more efficient and accurate reasoning process can be realized.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Large model inference chain compression method and system based on confidence guidance

The invention provides a large model inference chain compression method and system based on confidence guidance, and belongs to the technical field of large models. The method comprises the following steps: constructing a confidence phrase pool for improving the internal confidence coefficient of large model reasoning; obtaining a standard problem set, and generating a corresponding complete reasoning chain for each problem in the standard problem set by using the large model so as to construct an efficient reasoning data set; wherein in the inference chain generation process, confidence injection is carried out on the reflection step in the inference chain by utilizing a confidence phrase pool, and the confidence degree of the current inference chain updated each time is calculated so as to optimize the inference process; and then training the large model by using the efficient reasoning data set, wherein the trained large model is used for automatically generating a reasoning chain which is subjected to effective compression and aims at the input problem. According to the method, redundant steps can be compressed to the greatest extent on the premise of ensuring reasoning integrity and accuracy, and efficient and stable compression of the reasoning chain output by the large model is effectively realized.
Owner:TSINGHUA UNIVERSITY +1

Method for realizing expansion and contraction of inference service instance, electronic equipment and storage medium

The invention provides an inference service instance expansion and contraction method, electronic equipment and a storage medium, and belongs to the technical field of artificial intelligence, and the method comprises the steps: predicting a future business load based on historical operation data of a target inference service to generate an active expansion and contraction instance decision; evaluating the current operation state based on the real-time operation data of the target inference service to generate a passive scaling instance decision; and performing collaborative decision-making on the active expansion and contraction instance decision and the passive expansion and contraction instance decision to determine a final expansion and contraction instance instruction, and adjusting the instance number of the target inference service according to the final expansion and contraction instance instruction. According to the method, a double-engine cooperation mechanism combining active prediction and passive response is established, while prospective capacity expansion and contraction are realized by using historical data to reduce time delay, bottom correction is carried out by using real-time data to cope with burst load, the problem of response lag or resource waste of a single capacity expansion and contraction mode is effectively solved, and the method is suitable for large-scale popularization and application. And the resource utilization rate and the service quality stability of the inference service are obviously improved.
Owner:IFLYTEK CO LTD

Model cluster driven hybrid enhanced question-answering system, method and equipment and medium

The invention provides a model cluster driven hybrid enhanced question answering system, method and device and a medium, and relates to the field of artificial intelligence. The system comprises a knowledge enhancement module used for screening out a plurality of target question and answer models matched with a to-be-reasoned question from a question and answer model cluster according to a feature vector of the to-be-reasoned question; the decision alignment module is used for obtaining a main reasoning chain generated by a main target question and answer model in the plurality of target question and answer models for the to-be-reasoned question, and verifying the main reasoning chain by utilizing a plurality of other target question and answer models except the main target question and answer model in the plurality of target question and answer models; and after the main reasoning chain passes verification of a plurality of other target question and answer models, reasoning according to the main reasoning chain to obtain an answer to the question to be reasoned. According to the invention, the limitation of the traditional question-answering system on reasoning ability can be solved, and the accuracy and confidence of the question-answering reasoning result are improved.
Owner:TSINGHUA UNIVERSITY

Efficient and accurate regional explanation technique for NLP models

Herein are techniques for topic modeling and content perturbation that provide machine learning (ML) explainability (MLX) for natural language processing (NLP). A computer hosts an ML model that infers an original inference for each of many text documents that contain many distinct terms. To each text document (TD) is assigned, based on terms in the TD, a topic that contains a subset of the distinct terms. In a perturbed copy of each TD, a perturbed subset of the distinct terms is replaced. For the perturbed copy of each TD, the ML model infers a perturbed inference. For TDs of a topic, the computer detects that a difference between original inferences of the TDs of the topic and perturbed inferences of the TDs of the topic exceeds a threshold. Based on terms in the TDs of the topic, the topic is replaced with multiple, finer-grained new topics. After sufficient topic modeling, a regional explanation of the ML model is generated.
Owner:ORACLE INT CORP

Network security situation awareness method based on artificial intelligence

The invention discloses a network security situation awareness method based on artificial intelligence, and the method comprises the following steps: collecting multi-source heterogeneous data, and generating a standardized data set; spatial-temporal feature decoupling is carried out, and spatial-temporal dimension features are separated; fusing the time-space cross attention, and outputting a fused time-space feature vector; constructing a causal inference engine, and outputting a dynamic causal graph and an anti-fact inference result set; constructing a dynamic risk propagation model, and outputting a whole asset risk value matrix and a risk propagation path diagram; generating a situation quantization matrix, constructing an adversarial training decision network, and outputting a defense strategy set verified by adversarial training; automatically generating a strategy; and a man-machine cooperative verification closed loop is realized. According to the method, dynamic reconstruction of a threat propagation path is realized through spatial-temporal feature decoupling and a causal reasoning engine, and a risk positioning error is reduced; and the adversarial training decision network is combined, so that the misjudgment rate of the defense strategy in the simulation APT attack test is reduced.
Owner:BEIJING BEILONG YUNHAI NETWORK DATA TECH CO LTD

Refractory case question and answer sample acquisition method, model training method and related equipment

The invention provides a difficult case question and answer sample acquisition method, a model training method and related equipment. The difficult case question and answer sample obtaining method comprises the steps that a to-be-corrected question and answer sample is obtained, the to-be-corrected question and answer sample comprises a preset question, an annotated answer and a first reasoning link comprising a reasoning answer, and the reasoning answer included in the first reasoning link does not conform to the annotated answer; the to-be-corrected question and answer sample is input into a second language model, so that the second language model outputs first reflection content, and the first reflection content comprises an error point in the first reasoning link and a correction thought for the error point; inputting the preset question, the first reasoning link and the first reflection content into a second language model, so that the second language model outputs a second reasoning link including the reasoning answer; and if the inference answer included in the second inference link is consistent with the labeled answer, generating a difficult case question and answer sample based on the preset question, the labeled answer, the first inference link, the first reflection content and the second inference link.
Owner:ANT BLOCKCHAIN TECHNOLOGY (SHANGHAI) CO LTD

Inference method and related device

The present application relates to the field of artificial intelligence, and in particular to an inference method and a related device. The method comprises: a first computing device acquiring an inference request statement of a user, and splitting the inference request statement so as to obtain a plurality of tokens; on the basis of a mapping table of parts of speech and devices, dividing the plurality of tokens into K groups of tokens, and determining the correspondence between the K groups of tokens and K second computing devices, wherein in the mapping table of parts of speech and devices, the parts of speech corresponding each of the K second computing devices comprise parts of speech of tokens in a token group corresponding to said second computing device; the first computing device respectively sending the K groups of tokens to the K second computing devices, such that each second computing device processes the received tokens on the basis of deployed experts, so as to obtain an inference response statement for responding to the inference request statement; and the first computing device receiving K inference response statements respectively sent by the K second computing devices. The use of the solution of the present application facilitates reduction of communication overhead.
Owner:HUAWEI TECH CO LTD

Multi-modal inference method and inference system based on error attribution

The invention belongs to the technical field of thinking chain reasoning, and particularly relates to a multi-modal reasoning method and system based on error attribution. The reasoning method comprises the following steps: on the basis of a current modal fusion weight, performing modal fusion on each piece of initial information in an initial information set, and then generating a thinking chain; after a reasoning dependency graph is constructed based on the thinking chain, check points are selected in the reasoning dependency graph; based on consistency, factuality and logicality, performing error possibility scoring on each check point, and if the error possibility scores of all check points in the current thinking chain are below a set threshold, outputting the current thinking chain; otherwise, marking the check points of which the error possibility scores exceed a set threshold value as error nodes; calculating relative contribution strength of different modes to error nodes; and on the basis of the relative contribution strength, updating the modal fusion weight, and regenerating the thinking chain. According to the invention, the accuracy of the reasoning result and the stability of the accuracy can be improved.
Owner:DATA SPACE RES INST

Large language model safety protection defense method and device based on dynamic regulation and control

The invention provides a large language model safety protection defense method and device based on dynamic regulation and control, and belongs to the field of artificial intelligence safety protection. The large language model security protection defense method comprises the following steps: constructing a non-security data set and a security data set jail break prompt data set, calculating a gradient average value of parameters of each layer of a large language model during back propagation of various data sets, calculating cosine similarity among gradients, determining a non-security layer, namely a layer most sensitive to non-security content, and performing security protection defense on the non-security layer. Therefore, the subsequent regulation and control are more accurate and effective; in the aspect of dynamic regulation and control of a specified non-security layer, a joint loss function is established to optimize and train a security offset vector, and the security offset vector is applied to a hidden state of the non-security layer in a big language model reasoning process to carry out intervention, so that output of a big language model is dynamically regulated and controlled; therefore, the robustness of the large language model is improved.
Owner:ZHEJIANG UNIV

Model evaluation method, electronic equipment and computer readable storage medium

The invention discloses a model evaluation method, electronic equipment and a computer readable storage medium, and relates to the technical field of data processing and large models. The method comprises the steps that a reasoning data set is obtained, the reasoning data set comprises a plurality of different types of logical reasoning tasks, the reasoning process of the logical reasoning tasks comprises a plurality of atomic steps, and the atomic steps are obtained after an intermediate reasoning step of the logical reasoning tasks is decomposed; based on the reasoning data set, reasoning ability evaluation is conducted on a target language model, an evaluation result is obtained, and the evaluation result is used for determining the deep reasoning ability of the target language model. The technical problems that the reasoning ability of the large model is evaluated through the accuracy of the final answer in the related technology, so that the evaluation of the reasoning ability of the large model is limited, and the credibility of the evaluation result is low are solved.
Owner:ALIBABA DAMO (HANGZHOU) TECH CO LTD

Mathematical application question solving method and system based on few-sample thinking chain prompt

The invention provides a mathematical application question solving method and system based on a few-sample thinking chain prompt, and the method comprises the steps: coding a question sample and an inference chain thereof into feature vectors based on a pre-training encoder; classifying the feature vectors, selecting the first N feature vectors of each class, constructing cue words, and guiding a large language model to construct examples for each class of problems; an example most similar to the to-be-solved problem is extracted from the example set, and an initial prompt word is constructed based on the example and the to-be-solved problem; adjusting and optimizing the initial cue word based on a programmable declarative cue word optimization framework; and using the optimized cue word to guide the large language model to solve the problem to be solved. An optimal example similar to a to-be-solved problem is constructed by processing the problem in training data and a reasoning chain, so that the illusion risk of a large language model due to inconsistent example types is reduced; by utilizing a programmable cue word template optimization method, the generalization ability of the cue word template is improved, the large language model is effectively guided to solve, and the problem solving accuracy is improved.
Owner:UNIV OF JINAN