387 results about "Inference system" patented technology

The invention provides an operation and maintenance alarm processing method and system based on a knowledge graph enhanced large model, and relates to the technical field of knowledge graphs, and the method comprises the steps: collecting multi-source operation and maintenance alarm historical data, carrying out the adaptive hierarchical structured processing of the data, and constructing a space-time semantic multi-dimensional feature matrix; constructing a multi-dimensional alarm association network based on a dynamic weight fusion algorithm and forming a hierarchical knowledge graph; constructing a root cause inference rule base in combination with time sequence evolution, topology propagation and business dependence characteristics of the alarm; and when a real-time alarm is received, a diagnostic reasoning system is started to analyze a propagation link, a root cause is identified, and a processing suggestion is generated. The method can accurately identify the alarm root cause, improves the operation and maintenance efficiency, and reduces the false alarm rate.

The invention discloses a multi-modal knowledge graph rule reasoning method and device based on a large model, and the method comprises the steps: carrying out the feature extraction and cross-modal alignment of input text data and image data, and generating a multi-modal feature vector of a unified semantic space; performing knowledge graph storage on the emotion entities and the relationships by adopting an attribute graph model to complete construction of an emotion knowledge graph; generating an interpretable inference rule from the emotion knowledge graph by using a large language model, and eliminating a conflict rule in combination with logic verification; calculating the confidence coefficient of a reasoning path based on an attention mechanism, and carrying out quantitative evaluation on a rule reasoning result; the knowledge graph and the rule base are updated online according to user feedback, and the real-time performance and accuracy of the inference system are optimized through weight adjustment and a forgetting mechanism. According to the method, through innovative technologies such as multi-modal data integration, dynamic knowledge evolution and interpretability reasoning, the limitation of a traditional sentiment analysis method in the aspects of evidence dimension, adaptive capacity, interpretability and the like is broken through.

The invention belongs to the field of data processing, and particularly relates to a dynamic cooperative control system and method for a gas turbine and a micro-grid, and the method comprises the steps: constructing a micro-grid real-time monitoring module, continuously collecting distributed energy real-time output, controllable load demands, bus voltage frequency and equipment state parameters, and carrying out the filtering and noise reduction through a preprocessing unit, thereby guaranteeing the data precision; calculating a real-time power difference value based on the preprocessed data, calling an adaptive neural fuzzy inference system, taking the power difference value, the bus voltage deviation and the frequency deviation as input, and judging whether the power difference value, the bus voltage deviation and the frequency deviation exceed a preset threshold value by means of a fuzzy rule base and a neural network model; if the threshold values are not exceeded, the current states of the gas turbine and the energy storage system are maintained; if any one exceeds the threshold value, a dynamic cooperative control instruction is triggered, precise cooperative control of the gas turbine and the micro-grid is achieved, and the operation stability, the operation efficiency and the reliability of the micro-grid are improved.

The invention discloses a driving behavior risk assessment method and system, and relates to the technical field of intelligent traffic and driving safety, and the method comprises the steps: collecting the operation parameter data of a vehicle, carrying out the feature extraction of the operation parameter data, extracting feature parameters to form a feature vector, and calculating the Mahalanobis distance score of the feature vector; according to the Mahalanobis distance score of the feature vector, carrying out risk grade division by adopting an improved hierarchical fuzzy inference system to obtain a risk grade score; and establishing a driver portrait model according to the risk level score, and when the risk level score exceeds a personalized risk threshold, outputting a driving risk behavior improvement suggestion to complete driving behavior risk assessment. According to the invention, a refined grading basis is provided for individual risk monitoring of the driver, dynamic monitoring and real-time intervention of driver behaviors are realized, traffic accidents can be reduced, and driving safety is improved.

A database structure obtained by means of information retrieval, and a reasoning system, which structure and system specifically relate to a gut microbe knowledge graph system, comprising: a gut microbe knowledge graph consisting of a gut microbe knowledge base, a gut microbe and small-molecule drug therapy association knowledge base, and a clinical medicine database; and a multimodal uncertainty reasoning system, using the gut microbe knowledge graph. The gut microbe knowledge graph system predicts potential diseases, drugs, genes, etc., which are associated with gut microbes.

The invention discloses an e-commerce live broadcast real-time interaction quality evaluation system based on edge calculation, and relates to the technical field of e-commerce live broadcast, and the system comprises a multi-modal interaction data collection module which collects multi-modal interaction data of a live broadcast stream in real time through a distributed edge calculation node cluster, and constructs a multi-dimensional quality feature vector, the multi-modal interaction data comprises a video coding parameter, an audio quality index, user interaction behavior data and network transmission state data; according to the invention, the distributed edge computing node cluster collects the multi-modal interaction data of the live stream in real time, the lightweight space-time attention neural network model carries out data fusion processing, the deep reinforcement learning network generates a quality optimization scheme, and the adaptive fuzzy inference system corrects the optimization scheme in real time. And dynamic parameter adjustment is carried out in combination with network bandwidth fluctuation and a terminal device resource state, so that the effect of accurately and comprehensively evaluating the e-commerce live broadcast interaction quality in real time is achieved.

The invention belongs to the technical field of artificial intelligence, and relates to an artificial intelligence-based electric energy quality disturbance identification and positioning method, which comprises the steps of constructing an electric energy quality disturbance signal data set, performing segmented preprocessing on electric energy quality disturbance voltage data, enhancing time-frequency joint features and encoding disturbance sensitive areas. And constructing a deep learning model for power quality disturbance identification and positioning, and identifying and positioning the power quality disturbance. According to the invention, through adaptive denoising processing, boundary detection and multi-resolution time-frequency feature extraction, the identification precision and positioning precision of power quality disturbance are significantly improved; self-adaptive wavelet denoising and dynamic segmentation are combined, noise interference is effectively suppressed, and the edge characteristics of voltage sudden change points are kept; according to the dual-task sharing network, disturbance identification and positioning tasks are cooperatively optimized, so that the network can consider disturbance classification and time positioning at the same time; and through Bayesian reasoning, the system can output confidence estimation, provides credibility quantification of identification and positioning results, and effectively improves the reliability of the system.

The invention provides a crop planting intelligent decision inference system and method based on multi-source data fusion, and relates to the technical field of agricultural planting, and the system comprises a multi-source data fusion module which is used for extracting key characteristics of target crop growth according to multi-source data; the intelligent sensing module is used for constructing an agricultural knowledge graph according to the multi-source heterogeneous data of crop planting; and the reasoning and decision-making module is used for performing decision-making reasoning on the multi-source data and the key features according to the agricultural knowledge graph, a preset reasoning model and a decision-making model. According to the crop planting decision-making system, the defects that the precision in the planting management process is not high due to the fact that a traditional crop planting decision-making system is insufficient in decision-making ability, and the generalization ability of the system is insufficient due to the fact that most decision-making systems are optimized in a single field or specific crops and lack a cross-field multi-source data cooperative processing mechanism are overcome.

The invention discloses a large language model end-cloud collaborative inference system based on low-rank fine tuning, and belongs to the technical field of inference optimization of end-side cloud computing. Establishing an end-cloud collaborative reasoning architecture, and in an offline stage, performing parameter fine tuning on a large language model by a cloud side based on training data of different downstream tasks; in the online stage, user requests are classified through'variational auto-encoder-Gaussian mixture model 'clustering, whether a low-rank adapter matched with a current task exists in an end side cache is judged, and if yes, reasoning is executed on the end side; and otherwise, forwarding the task to the cloud side. After a plurality of user requests are processed by the architecture, historical user requests and cache states are analyzed based on a Mama model, and an end-side low-rank adapter library is dynamically updated. And monitoring end cloud load and reasoning delay in real time, and issuing the new adapter to the end side according to the task repetition rate increment. According to the method, dynamic balance of the system is realized, and high efficiency and adaptability of the system are ensured while calculation and storage overhead are reduced.

The invention relates to an inference system and method for a large model. The system comprises a routing component, a pre-fill component, a decoding service component deployed independently of the pre-fill component, and a communication component between the pre-fill component and the decoding service component. The routing component routes the data processing request before long to the pre-filling component for pre-filling processing based on the token information of the current data processing request, and routes the data processing request before short to the decoding service component for decoding processing; and performing load balancing routing based on the load states of the plurality of reasoning forces in the prefill component or the decode service component.

The invention discloses a multi-agent large-model disease diagnosis knowledge reasoning system based on data dual drive, and relates to the technical field of artificial intelligence assisted medical diagnosis. The system collects patient symptom follow-up records, laboratory test results, observation diagnosis probabilities and expert diagnosis recommendation results in a multi-source manner; time sequence evolution characteristics are extracted, a time sequence diagnosis sensitivity coefficient is calculated, and early recognition of disease risks is achieved; in combination with anti-fact simulation and statistical reasoning, a causal consistency coefficient is obtained and is used for verifying causal reasonability of observation diagnosis and contrast results; based on agent group consensus analysis, calculating a game consistency coefficient for judging the credibility of a diagnosis conclusion; positioning and multi-level verification are carried out on abnormal reasoning steps and knowledge fragments, so that the reliability and safety of a result are guaranteed; continuous optimization of the diagnosis model is realized through a log analysis and knowledge backflow mechanism; according to the invention, the accuracy, interpretability and safety of disease diagnosis can be obviously improved.

The embodiment of the invention discloses an inference method and device for a large language model, which are used for reducing bandwidth consumption of inference of the large language model. The method comprises the steps that a parallel reasoning system receives reasoning tasks of a large language model, wherein the reasoning tasks comprise a calculation-intensive task and a self-attention calculation task; the processor executes calculation-intensive tasks, generates intermediate data and sends the intermediate data to the near-memory calculation module, and the calculation-intensive tasks comprise one or more of the following tasks of the large language model: a feedforward neural network calculation task, a projection task and a layer normalization task. And the near memory calculation module executes a self-attention calculation task according to the intermediate data to generate a near memory calculation result. And the processor generates a reasoning result corresponding to the reasoning task based on the proximity calculation result.

The invention discloses a memory limited device MoE large model reasoning optimization system and method based on dual prediction, and belongs to the technical field of MoE large model reasoning optimization. In order to solve the problem of optimizing the reasoning performance of the LLM based on the MoE on the memory limited equipment, the system comprises a layer-by-layer predictor, a token-by-token predictor and an expert management module, and the expert management module comprises an expert cache, a temporary expert buffer area and an I / O scheduler. The layer-by-layer predictor is connected with the token-by-token predictor, the layer-by-layer predictor and the token-by-token predictor are respectively connected with the I / O scheduler, the token-by-token predictor is connected with the expert cache, and the I / O scheduler is respectively connected with the temporary expert buffer area and the expert cache. According to the method, a predictive expert Cache, a temporary expert buffer area and a token-by-token prefetching technology are innovatively provided; according to the invention, the reasoning system can use fewer memory resources, and the LLM reasoning speed is obviously improved.

The invention discloses an edge end large language model inference system. The system comprises a main computing chip, an LPDDR interconnection resource and a vertically stacked and packaged storage chip stack, the storage chip stack comprises an NAND flash memory chip and a DRAM (Dynamic Random Access Memory) chip, and the NAND flash memory chip and the DRAM chip are paired and share an LPDDR interconnection resource; the NAND flash memory chip comprises a flash memory chip bare chip and a CMOS (Complementary Metal-Oxide-Semiconductor Transistor) chip bare chip which are three-dimensionally interconnected based on hybrid bonding; a flash memory array is arranged on the flash memory chip bare chip; a logic block is arranged on the CMOS chip bare chip; the main calculation chip reads a parameter matrix of a model full connection layer from the NAND flash memory chip and reads other parameters from the DRAM chip for calculation in a pre-filling stage of large language model reasoning; and the NAND flash memory chip performs full connection layer calculation in a decoding stage. The system provided by the invention can improve the external transmission and internal reading bandwidth.

The invention relates to the technical field of network security, and provides an APT attack traceability and path restoration method and system, attack path validity is verified through a dynamic causal element path generator in combination with an anti-factual adversarial network, and fine-grained entity modeling is realized through a hierarchical multi-modal entity inference system. A causal attention mechanism is optimized to improve association analysis precision, a federal incremental learning framework is constructed to realize dynamic updating and privacy protection, and the problems of poor rule adaptability, coarse granularity of entity modeling, insufficient causal association distinguishing and low calculation efficiency in the traditional technology are effectively solved. The method has the technical effects of dynamically generating an effective attack path, improving attack traceability accuracy, reducing calculation overhead and enhancing privacy protection.

The invention discloses a cloud-side collaborative inference method and inference system, and the method comprises the steps: edge equipment receives a user task request, and sends a task notification to cloud equipment; the cloud equipment controls a deployed cloud large model to execute a user task, and sends a task intermediate result to the edge equipment; and the edge device executes the user task based on the task intermediate result and the user prompt to obtain a task result, and feeds back the task result to the user side. According to the application, the edge device cooperates with the cloud device, the edge device shares the task intermediate result in the reasoning process of the cloud device, and the user prompting user task with high real-time performance and low resource consumption is processed based on the task intermediate result, so that on one hand, the computing power of the cloud device can be utilized; and on the other hand, communication delay and data transmission quantity can be reduced, so that high delay caused by the fact that data transmission occupies a large amount of bandwidth can be reduced on the premise of ensuring that a user task can be executed.

Various examples, systems, and methods are disclosed relating to an agentic curation pipeline. One system can process questions and other inquiries about video content by using a combination of models and stored information. The system can receive a query related to an event in a video, selects relevant portions of the video using embeddings, and apply the selected video data and a related sub-query to a video model. The output from the video model can be used by a language model, along with stored context, to generate an answer to the original query. The system can returns the answer to the requester.

The invention belongs to the technical field of intelligent question-answering systems, and particularly relates to an intelligent question-answering inference system based on a knowledge graph, which is characterized in that firstly, a knowledge graph construction module fuses multi-source data to generate a structured graph, and after a user inputs a natural language question, a question-answering analysis module completes intention classification and entity disambiguation and converts the question into structured query; an inference engine module fuses symbol rules and graph neural network inference through a hybrid inference sub-module, and a dynamic weight adjustment sub-module optimizes weights according to errors and attenuation factors to generate an inference result; the knowledge updating module incrementally updates the atlas in real time and detects conflicts, the interactive interface module visually presents a result, and the evaluation optimization module iteratively optimizes parameters in combination with offline evaluation and online feedback. The whole process is from user question asking to result output, accurate reasoning and continuous performance improvement are achieved, and multi-field question and answer requirements are met.

The invention relates to the technical field of network security and data processing, and discloses a violation short message recognition method and system based on deep semantic understanding, and the method comprises the steps: firstly cleaning an original short message, generating a mixed embedding vector through characters, sub-words and pinyin, and carrying out the recognition of the violation short message; then processing through a double-layer detection engine, wherein the first layer utilizes rules and a lightweight model for rapid preliminary screening; in the second layer, for suspected samples, a double-tower fusion neural network architecture is adopted, local and global features are combined, fusion is carried out through a gating unit, and a large language model is input to carry out deep semantic reasoning. The system executes strategies such as interception or flow limiting according to the risk score, and realizes model iteration through a dynamic knowledge base and incremental learning. According to the method, the resource consumption and the detection precision are balanced through the layered architecture, the antagonistic variants are effectively identified by utilizing multi-dimensional feature fusion, and the method has the adaptive evolution capability for a novel violation mode.

The invention discloses an industrial equipment fault inference system based on a knowledge graph, and the system comprises a knowledge graph construction module, a fault data collection module, an inference analysis module and a response processing module. The entity extraction unit extracts equipment components, fault types and maintenance record entities from an industrial equipment operation document, equipment manual unstructured data supplementation attributes are integrated, the attributes and association weights are marked, and the relationship construction unit establishes a fault causal relationship between the entities and a component association relationship to form a multi-level knowledge network; a knowledge verification unit verifies entity attribute consistency and relation rationality, a dynamic updating unit receives data updating nodes and relation strength of each unit and receives feedback data optimization weights, and in a fault data acquisition module, a real-time monitoring unit acquires operation parameters and state signals and associates equipment identifiers.

The invention discloses a cross-working-condition bearing fault diagnosis method and device based on a multi-scale convolutional fuzzy neural network migration model, and the method comprises the steps: inputting a vibration signal of a to-be-diagnosed bearing into a trained cross-working-condition bearing fault diagnosis model, and outputting a diagnosis result; wherein the trained cross-working-condition bearing fault diagnosis model is obtained by training a multi-scale convolutional fuzzy neural network migration model by adopting a training data set, and a total loss function in the training process comprises classification loss guided by error samples, depth domain adaptive loss and confusion loss of an adversarial network domain; the training data set comprises a vibration signal from the bearing under the source domain working condition and a corresponding fault label, and a vibration signal from the bearing under the target domain working condition; the migration model based on the multi-scale convolutional fuzzy neural network comprises a multi-scale convolutional neural network module, a gated recursive convolutional attention module, an improved adaptive fuzzy inference system and an adversarial network module which are connected in sequence. The objective of the invention is to solve the problem of poor bearing fault diagnosis accuracy under variable working condition migration conditions.

The invention relates to the technical field of financial knowledge management, and discloses a multi-modal Agent coordinated reasoning system, and the key points of the technical scheme are that the multi-modal Agent coordinated reasoning system comprises a data interface module which is used for connecting a data source to obtain target data, and is also used for receiving a task instruction; the function management module is used for constructing functional Agents with various data processing functions and executing corresponding data processing on target data according to a scheduling strategy through the functional Agents; the business management module is used for constructing a business Agent of each business field and carrying out business processing according to a scheduling strategy through the business Agent; and the scheduling decision module is used for generating a scheduling strategy according to the task instruction and the target data, and performing scheduling and collaboration on the function Agent and the service Agent according to the scheduling strategy.

The invention provides a large model reasoning system, method and equipment based on Monte Carlo tree search, and relates to the technical field of data processing. According to the large model reasoning system based on Monte Carlo tree search, adaptive task disassembly is carried out for different tasks to obtain candidate thinking cards, the optimal effective reasoning path corresponding to each candidate thinking card is used as an explicit thinking chain type guiding signal, reasoning is carried out for a to-be-reasoned problem through a large model, and the reasoning accuracy of the to-be-reasoned problem is improved. And efficient reasoning is realized through cooperative operation between the two models. The system is expected to improve the performance of a large model in a complex reasoning task, and overcomes the limitation of the current model in the aspects of mathematics, logic and common sense reasoning.

The invention discloses an analysis method and device of a hybrid expert reasoning system, electronic equipment and a medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: building a hybrid expert reasoning system based on annular set communication, and further constructing a time dimension analysis model in combination with the hybrid expert reasoning system, thereby precisely reasoning the reasoning bottleneck of the model, and improving the reasoning accuracy. According to the invention, the technical problem that the communication bottleneck cannot be determined when the hybrid expert model is executed in the prior art is solved, and the technical effects of accurately determining the communication bottleneck factors, accurately designing the optimization strategy of the hybrid expert inference system and realizing dynamic optimization are achieved.

The invention belongs to the technical field of thinking chain reasoning, and particularly relates to a multi-modal reasoning method and system based on error attribution. The reasoning method comprises the following steps: on the basis of a current modal fusion weight, performing modal fusion on each piece of initial information in an initial information set, and then generating a thinking chain; after a reasoning dependency graph is constructed based on the thinking chain, check points are selected in the reasoning dependency graph; based on consistency, factuality and logicality, performing error possibility scoring on each check point, and if the error possibility scores of all check points in the current thinking chain are below a set threshold, outputting the current thinking chain; otherwise, marking the check points of which the error possibility scores exceed a set threshold value as error nodes; calculating relative contribution strength of different modes to error nodes; and on the basis of the relative contribution strength, updating the modal fusion weight, and regenerating the thinking chain. According to the invention, the accuracy of the reasoning result and the stability of the accuracy can be improved.

The invention discloses a large-model adaptive batch reasoning system based on time delay measurement, and the system comprises a request receiving and queue management module which is used for monitoring and receiving an LLM reasoning request sent by an external user or an application; the real-time delay sensing and batch monitoring module is used for measuring and analyzing performance indexes directly related to the current batch processing strategy in real time in the LLM reasoning process; the Token-by-Token batch processing and reasoning execution module is used for selecting a corresponding number of requests from the request queue according to the size of the current batch determined by the scheduler, organizing the requests into an effective calculation batch and submitting the effective calculation batch to the LLM reasoning core at the bottom layer to execute one or more decoding steps; and the double-stage batch adjustment decision module is used for obtaining the normalized time delay ratio. The invention also discloses a large-model adaptive batch reasoning method based on time delay measurement. According to the invention, substantive improvement and intelligent management of the overall performance of the LLM reasoning service are realized.

The invention provides a knowledge enhancement type sports video understanding method based on large-model dual-mode reasoning, and belongs to the field of video understanding. Firstly, a sports video needing questioning and a question text are obtained, and the sports video, the question text and cue words are input into a reactive reasoning agent; the reactive reasoning agent classifies the questions according to the question texts and the cue words, and if the questions belong to simple questions, the reactive reasoning agent answers the questions according to the input sports videos; if the questions belong to complex questions, the questions are answered through a deep reasoning agent, and the deep reasoning agent is composed of a dynamic motion divider, a key segment selector and a fine-grained matcher based on the sports knowledge graph. According to the method, a dual-mode reasoning system is innovatively introduced, the dynamics and domain specificity of the sports video and the diversity and complexity of questions asked by the user are fully considered, and the performance of a (multi-mode) large language model in a sports video understanding task is remarkably improved.

A variety of smart inference systems and robotic control devices are disclosed. A device networking system interconnects mobile devices, robotic devices, and others. A robotic controller secures and manipulates a controlled device user interface. A smart device system interprets data based on a plurality of models operating on a plurality of runtimes based on a plurality7 of capabilities. A smart payment processor system assigns payments accounts automatically as a function of a semantic matching between one or more inferred semantic identities. A robotic emulation device captures and analyzes a video signal from a target device and transmits manipulation signals emulating a peripheral input device. A system of carts are physically coupled in a charging configuration. A conveyor is configured to couple with another conveyor and having sensors to detect weight, size, location or other aspects of conveyed items, and implementing semantic analysis for management and augmentation.

The invention provides an inference system and method of a large language model based on multi-chip parallel computing, and relates to the technical field of artificial intelligence. The system comprises a pre-calculation module used for processing input instruction information to generate to-be-reasoned data, and the to-be-reasoned data is in a matrix form; the expert parallel module is used for sending the to-be-reasoned data to accelerator chips in the expert parallel module and determining sub-reasoning data processed by the activation expert units corresponding to the accelerator chips respectively, so that the activation expert units carry out calculation based on the corresponding sub-reasoning data and complete parallel calculation result data is determined. The input data is broadcasted to all the accelerator chips, each accelerator chip selects the corresponding input data for calculation according to the set activation expert unit, the same complete calculation result is obtained through global protocol operation among all the accelerator chips, and the overall operation performance and efficiency are improved.

The invention discloses a model reasoning system, method and device, electronic equipment, a medium and a product, and relates to the technical field of artificial intelligence, multiple types of multi-level caches are set to store different types of cache data, the cache data of a model can be fully utilized, the calculation operation of the model can be reduced, and therefore the calculation efficiency of the model is improved.