Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

145 results about "Reasoning system" patented technology

In information technology a reasoning system is a software system that generates conclusions from available knowledge using logical techniques such as deduction and induction. Reasoning systems play an important role in the implementation of artificial intelligence and knowledge-based systems.

False information multi-source association reasoning system based on knowledge graph

The invention discloses a false information multi-source association reasoning system based on a knowledge graph, and the system comprises a data collection and standardization module which is used for carrying out the multi-source collection and duplicate removal of a text, and generating a structured input data set; the semantic extraction and normalization module is used for executing alias merging and disambiguation and outputting a semantic extraction result; the entity alignment module is used for cross-platform entity matching and confidence evaluation, entity identification unification and attribute and alias merging; the graph construction and anchor point module is used for constructing a fact graph and a traceability graph; the candidate constraint generation module is used for forming a candidate constraint set based on the multi-source evidence statistics support degree; the space-time constraint and weight reduction module is used for executing path consistency and joint constraint according to Allen and RCC8 to obtain an updated evidence weight result; and the evidence chain and pushing module is used for enumerating and scoring the evidence chain and pushing the evidence chain through an external interface. According to the invention, false information multi-source association reasoning is realized.
Owner:ZHONGKE ANCHANG (ZHEJIANG) TECHNOLOGY CO LTD

Intelligent agent reasoning system based on multiple atlases

The invention discloses an agent inference system based on multiple maps, and relates to the technical field of artificial intelligence, and the system comprises the steps: based on industry report, academic literature and business manual multi-source data, extracting entity-relationship-attribute, and constructing a knowledge map; dynamically capturing cooperation, report and task allocation relationships among entities, and constructing a production relationship graph; constructing a decision graph based on a field expert heuristic rule; based on the thinking engineering theory, human thinking modes and emotional states are analyzed, and a thinking map is constructed; integrating a knowledge graph, a production relation graph, a decision graph and a thinking graph, performing entity and mode alignment, mapping multi-source nodes and edges into the same vector space, introducing conflict resolution, and constructing a unified multi-mode heterogeneous knowledge graph; and guiding a large language model to generate a reasoning direction through path cue word injection, querying a constraint reasoning boundary, outputting an optimal reasoning result, and realizing agent reasoning of multiple maps. The method has the beneficial effect that the reasoning accuracy is improved.
Owner:SHANGHAI HECHUAN TECHNOLOGY CO LTD

Large model and knowledge graph dual-drive-based guide type inference system and method

The invention discloses a large model and knowledge graph dual-drive-based guided reasoning system and method, belongs to the technical field of artificial intelligence reasoning, and solves the problem of how to improve the process reasoning ability of a large language model for engineering subject courses and the reliability of solving complex engineering problems. According to the method, metadata is extracted from teaching materials, structured problem representation is constructed, and a knowledge graph is constructed to form a complete knowledge system; the method comprises the following steps: decomposing a complex engineering problem into a structured solving plan with knowledge marks, and carrying out iterative loop based on a Monte Carlo tree search algorithm to generate a search tree comprising a plurality of high-quality candidate problem solving paths; then determining an optimal answer and a corresponding reasoning path in all simulated paths in a voting mode, performing confidence evaluation on each node of each path in the candidate path set, and further selecting a path of an optimal solution; and the process reasoning capability of the large language model on engineering subject courses and the reliability of solving complex engineering problems are effectively improved.
Owner:ANHUI UNIV

Combinatorial reasoning systems and methods

Techniques of reasoning generative intelligence that include: receiving a query; determining a set of system instructions corresponding to the query; generating, based on the query and the set of system instructions, an initial prompt comprising a set of reason queries; submitting the initial prompt to a first large language model (LLM) to obtain a set of sample reasons corresponding to the set of reason queries; determining, based on application of optimization to the set of sample reasons, a reduced set of reasons; generating, based on the reduced set of reasons, an execution prompt; submitting the execution prompt to a second LLM to obtain a query response; and employing the query response in response to the query.
Owner:ICOSA COMPUTING INC

Multi-view zero sample anomaly detection method and system based on cross-modal prompt reasoning

The invention belongs to the related technical field of product detection, provides a multi-view zero sample anomaly detection method and system based on cross-modal prompt reasoning, and aims at solving the problem of multi-view zero sample anomaly detection by constructing core technologies such as multi-view pose estimation and alignment, static-dynamic prompt collaboration, vision-language progressive fusion, feature space semantic enhancement and the like. And a set of end-to-end anomaly detection and reasoning system is formed. Particularly, a collaborative mechanism of a dynamic learnable prompt pool and a static attribute prompt library is designed, deep fusion of prompts is realized through cross attention, and multi-view feature compression and semantic decoding are performed by adopting a visual angle self-adaptive hybrid expert model. Zero sample anomaly detection and visual question and answer performance is further improved on multiple industrial public data sets, and the method can be widely applied to industrial precision part quality inspection, intelligent manufacturing and other complex scenes needing high-precision and multi-view perception and semantic reasoning.
Owner:UNIV OF JINAN

Dynamic knowledge graph and deep learning fused cognitive inference system

The invention relates to the technical field of cognitive inference, and discloses a cognitive inference system fusing a dynamic knowledge graph and deep learning. The system comprises a cognitive event stream processing module which is used for acquiring a real-time event stream and a cognitive target stream, identifying entity state change and extracting a reasoning intention; the graph mapping generation module is used for receiving the entity state change and the reasoning intention, constructing a mapping relation with knowledge graph topology and generating a multi-dimensional graph mapping library; the cognitive path decision-making module is used for extracting key topological characteristics from the multi-dimensional map mapping library, calculating a reasoning path migration probability and generating an initial cognitive path set; the time sequence evolution prediction module is used for carrying out time sequence evolution modeling on the knowledge graph topology based on the initial cognitive path set, identifying node state offset and updating a multi-dimensional graph mapping library; and the reasoning optimization module is used for analyzing a reasoning stage and a reasoning dependency relationship of the cognitive target flow according to the updated multi-dimensional map mapping library, and generating a dynamic cognitive reasoning library.
Owner:ZHOUSHAN MUNICIPAL PUBLIC SECURITY BUREAU

Automatic identification and reasoning system for spatial geometric features and process knowledge of parts

The invention relates to the technical field of automatic feature recognition, in particular to a part space geometric feature and process knowledge automatic recognition reasoning system, which comprises a model acquisition module for acquiring a B-Rep model of a part to obtain triangular patches in each plane in the B-Rep model; the curved surface segmentation module is used for calculating a region attribution degree and dividing a surface into a plurality of sub-regions; the curved surface evaluation module is used for calculating a discrimination coefficient and distinguishing all surfaces into process surfaces and auxiliary surfaces; calculating a coherence evaluation value and structural complexity of each process surface; and the feature recognition and process reasoning module is used for determining the sampling precision of each surface, discretizing the surfaces and the edges, constructing an attribute adjacency graph of coding B-Rep model information, and machining the part based on a machining feature recognition result of the attribute adjacency graph. According to the invention, the processing technology feature identification precision of the part is improved.
Owner:HUNAN SANYUE SUWEI TECH CO LTD

Multi-mode identity relation inference system based on graph neural network

The invention relates to the technical field of artificial intelligence and data processing, and discloses a multi-mode identity relation inference system based on a graph neural network. The system comprises a multi-modal feature extraction module, a cross-modal alignment module, a graph structure construction module, a dynamic relation reasoning module and a decision output module. According to the method, the cross-modal alignment module is introduced to project the image features and the text features to a unified public semantic space, so that the nonlinear distribution difference of heterogeneous modals in an embedding space is effectively eliminated, and cross-modal alignment errors are avoided from the source; by integrating the attention mechanism of modal perception in the graph neural network, the system can dynamically learn the semantic association strength between the nodes in different modals, adaptively adjust the weight distribution in the neighborhood information aggregation process, and significantly improve the accuracy of node characterization.
Owner:FUJIAN RONGJI SOFTWARE ENG CO LTD

Self-adaptive questioning method of multi-agent collaborative inference system based on large language model

The invention belongs to the technical field of artificial intelligence, and relates to an adaptive questioning method of a multi-agent collaborative inference system based on a large language model. According to the method, a layered multi-agent collaboration architecture is established, and the multi-agent collaboration architecture comprises a supervisor agent and a plurality of working agents; the supervisor agent allocates reasoning tasks for each working agent; and in the process of executing the reasoning task, the working agent actively puts forward a question to the supervisor agent through a self-adaptive questioning mechanism, and receives knowledge or guidance fed back by the supervisor agent. Through organic combination of a Supervisor-Worker multi-agent architecture, a self-adaptive question decision mechanism and Actor-Critic reinforcement learning optimization, the agent system driven by a large language model is endowed with a new ability of'thinking and good questioning ', the limitation of traditional fixed scripts or single-round dialogues is broken through, and the method has the advantages of being simple in structure, convenient to operate and high in practicability. Therefore, the intelligent agent can autonomously seek information and correct thinking in a complex and unknown task environment.
Owner:COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI

Knowledge graph enhanced reasoning method and system for high-risk field medical decision

The invention discloses a knowledge graph enhanced reasoning method and a knowledge graph enhanced reasoning system for high-risk field medical decision, which are used for strictly limiting the reasoning of a large language model within a high-quality knowledge graph range, so that the reliability is improved, and factual errors and'model illusion 'are fundamentally eliminated. Through an innovative constraint generation and traceability mechanism, each conclusion can be traced to a direct evidence in the knowledge graph, the interpretability is enhanced, and the complete transparency of the reasoning process is realized. The mixed query driven sub-graph retrieval method can deeply understand the intention of a user, accurately position and extract structured knowledge related to complex problems, improves the retrieval precision, and has a retrieval effect far better than that of traditional keyword or vector retrieval.
Owner:BEIJING TELECOM PLANNING & DESIGNING INST +1

Visual language model binarization compression method and system for image-text understanding task

The invention provides a visual language model binarization compression method and system for an image-text understanding task. The method comprises the steps that the structure of a visual language model for the image-text understanding task is divided into an image coding module, a text coding module and a cross-modal fusion module; dividing the network hierarchy in each module into a plurality of compressible structural units; and carrying out binarization processing on the structural unit in each module, and replacing the original structural unit with the structural unit subjected to binarization processing to obtain a visual language model formed by the compressed image coding module, the text coding module and the cross-modal fusion module. The method further comprises a cross-modal semantic preserving mechanism design. According to the method, the semantic expression capability and task performance of the model are maintained to the maximum extent while the storage and calculation overhead of the model is remarkably reduced, so that the efficient and deployable image-text understanding inference system of the visual language model in a resource-constrained environment is realized.
Owner:SHANGHAI JIAOTONG UNIV

Large language model reasoning scheduling method and device based on semantic communication

The invention discloses a big language model reasoning scheduling method and device based on semantic communication. The method comprises the steps that edge equipment extracts semantic information of a reasoning request through a combined lightweight model, predicts the length of an output token and uploads the length to a big language model server; the large language model server sorts the waiting requests according to a semantic scheduling scoring function, the scoring function performs dynamic weighted calculation based on token length, channel quality and historical retransmission times, and a request group with the highest priority is selected and a corresponding edge device is indicated to upload semantic tensors of reasoning requests extracted by the joint lightweight model; and the large language model server receives the semantic tensor and then reconstructs information for batch reasoning. According to the method, the throughput capacity of an inference system in a high-concurrency environment can be effectively improved, the task response time delay is reduced, the stability and the service quality of an edge semantic communication system are enhanced, and the method has wide applicability and popularization value for deployment of a large language model in an edge calculation and multi-user semantic communication scene.
Owner:SHANGHAI UNIV

Gear machine tool expert system construction method based on production rule

The invention discloses a gear machine tool expert system construction method based on a generative rule, and the method comprises the steps: firstly carrying out the multi-dimensional modeling of a gear and a machine tool through an object-oriented technology, enabling a gear model to distinguish the characteristics of an axis position, a tooth curve and the like through an interface, and enabling a machine tool model to distinguish the machining technology and the precision grade through an interface; secondly, establishing a generation type rule mapping system from geometric, precision, material and functional attributes of the gear to machine tool movement, precision, process and rigidity attributes; finally, an intelligent reasoning system including forward reasoning, reverse verification, conflict coordination and self-learning iteration is constructed, and automatic and accurate matching from gear design requirements to machine tool optimization configuration is achieved. According to the method, the problems of high subjectivity and low efficiency caused by dependence on expert experience in the prior art are solved, and knowledge-driven intelligent decision making is realized.
Owner:CHONGQING UNIV

Multi-hop reasoning method based on dynamic reasoning guidance and multistage self-feedback retrieval

A multi-hop reasoning method based on dynamic reasoning guidance and multistage self-feedback retrieval belongs to the field of natural language processing, and comprises the following steps: deconstructing a multi-hop reasoning process into a target-oriented sequence decision problem, carrying out dynamic reasoning guidance by using a large language model, generating a sub-problem sequence matched with a reasoning progress in real time, and carrying out multi-level self-feedback retrieval on the sub-problem sequence; target document retrieval is guided, and sub-questions are dynamically generated; according to the generated sub-questions, obtaining associated documents by adopting a three-level collaborative retrieval mechanism; and performing information refining on the associated document through a large language model, fusing the refined information into an inference chain, and performing inference to generate an answer. The invention further discloses a multi-hop reasoning system, a storage medium and a computer program product. The method aims at solving the complex multi-hop problem that multiple dispersed knowledge fragments need to be integrated, high-accuracy and high-efficiency reasoning is achieved, the retrieval requirement is dynamically generated through an explicit thinking chain guiding mechanism, and evidence obtaining is optimized and redundant information is filtered in combination with a three-level self-feedback retrieval mechanism.
Owner:XI AN JIAOTONG UNIV

Large model mixed load-oriented self-adaptive low-delay reasoning configuration generation method and device, computer equipment and storage medium

The invention discloses a large model mixed load-oriented self-adaptive low-delay reasoning configuration generation method and device, computer equipment and a storage medium, and the method comprises the steps: determining a first token generation delay and an adjacent token delay interval which are historically configured on requests with different reasoning configurations, and obtaining tuples to form a configuration performance database, generating a delay prediction model by combining a least square method with the configuration performance database; dynamically dividing the historical request into a plurality of buckets according to the input length and the output length through a self-adaptive bucket dividing strategy; a configuration generator generates reasoning configuration for each bucket according to the input length and the output length of the historical request of each bucket; under the real mixed load, the problems of remarkable resource contention, queue head blockage, KV Cache switching overhead increase and the like are avoided in concurrent execution of long and short requests, and meanwhile, the problem of tail delay amplification is avoided, so that a reasoning system gives consideration to low delay and high throughput among different requests.
Owner:NORTHEASTERN UNIV CHINA

Task scheduling and state switching method for inspection robot of quantitative state machine

The invention relates to the technical field of robot intelligent control, and discloses an inspection robot task scheduling and state switching method for quantifying a state machine, which comprises the following steps: acquiring state machine operation configuration data; performing health degree evaluation on the sensor, navigation, communication and battery systems in an initial state; in the idle state, a segmented charging strategy is adopted, and task priorities are calculated through a neural network; a breakpoint resume and event-driven architecture is adopted to execute tasks in the inspection state; in a warehouse returning state, a deep neural network is adopted to predict return flight energy consumption, and a path is re-planned through multi-objective optimization when the electric quantity is insufficient; processing a control instruction by adopting speed limitation in a manual or mapping state, and starting an SLAM module in the mapping state; and in an abnormal state, a fuzzy logic reasoning system is adopted to calculate an abnormal grade, and recovery waiting, degradation protection or alarm is executed according to the grade. According to the invention, autonomous operation and intelligent decision making of the inspection robot in a complex dynamic environment can be realized.
Owner:ANHUI XINLI GONGQING TECHNOLOGY CO LTD

Prospective reasoning method for dynamically predicting output length based on hardware load state

A speculative reasoning method for dynamically predicting output length based on a hardware load state comprises the following steps: for a fixed batch size, obtaining a saturation prediction length capable of realizing throughput saturation of each round of reasoning; dynamically setting a predicted output length of each request according to a hardware resource load state; the hardware resource load state comprises a saturation prediction length, a batch size and a real-time video memory residual capacity; and constructing the prediction tree based on the token acceptance rate of each layer in the historical statistical prediction tree, and taking the prediction output length as the total prediction token number of the prediction tree. The invention provides a mechanism for dynamically adjusting the predicted output length on the basis of hardware load states such as GPU-accept computing power, batch size and video memory occupation, the computing power limit of a large model reasoning system is sampled and evaluated, and the optimal predicted output length of each request is dynamically determined in combination with real-time batch size and video memory occupation, so that the optimal prediction output length of each request is obtained. The GPU utilization rate can be maximized under different reasoning loads, the throughput and resource occupation are balanced, and therefore the overall reasoning performance of the system is remarkably improved.
Owner:HANGZHOU DIANZI UNIV

Systems and methods for perturbation-based zero-shot hallucination reasoning for large language model generated text

A method may include: receiving a prompt and generated text from the LLM; computing an original token probability distribution for each token in the prompt and in the generated text; receiving a token position probability distribution for each token position in the generated text from the LLM; identifying keywords in the prompt; perturbing embedding vectors for the keywords used by the LLM by adding noise to the embedding vectors; computing a perturbed probability distribution for the perturbed embedding vectors by providing the perturbed embedding vectors as an input to a neural network used by the LLM, wherein the neural network returns a perturbed token probability distribution; evaluating a divergence between the original token probability distribution and the perturbed token probability distribution; identifying semantically meaningful tokens in the generated text; calculating a mean of divergences for the semantically meaningful tokens; and classifying the LLM based on the mean of divergences.
Owner:JPMORGAN CHASE BANK NA

Figure relation reasoning system and figure relation reasoning method based on knowledge graph

The invention discloses a character relationship reasoning system and a character relationship reasoning method based on a knowledge graph, and the method comprises the steps: aligning entities in different data sources to entities in the knowledge graph, extracting character relationships from the data sources, and adding the character relationships into the knowledge graph; extracting features of a plurality of modes from the figures in the knowledge graph, projecting the extracted features of the plurality of modes to the same semantic space, and generating a unified semantic representation after fusion; on the basis of a graph neural network model, performing representation learning on entity and character relationships in the knowledge graph after the unified semantic representation is generated, so as to obtain graph topological structure information and semantic information of knowledge; an incremental learning technology is used, and the graph neural network model is trained only through newly added data; utilizing a domain adversarial network to extract domain features of each data source, and dynamically adjusting parameters and a structure of the graph neural network model according to the domain features; and capturing associated entities and relationships in the reasoning process by using an attention mechanism, and generating a reasoning path.
Owner:深度亲近(苏州)人工智能科技有限公司

Cooperative reasoning method and system for adaptive model segmentation in heterogeneous computing power environment

The invention discloses a collaborative reasoning method and system for adaptive model segmentation in a heterogeneous computing power environment. The method comprises the following steps: establishing a numerical calculation precision difference model between a source computing device and a target computing device; at a source equipment end, carrying out sensitivity analysis on a state tensor to be migrated according to the difference model, and asymmetrically dividing the state tensor into a core sensitive part and an edge part; performing dimension reduction processing on the edge part to generate a low-precision basic tensor, extracting precise residual information from the core part, compressing to generate a residual compensation vector packet, and sending the two to target equipment; and at a target equipment end, main calculation is carried out by using the low-precision basic tensor, a residual error compensation vector packet is decompressed in a bypass manner, and recovered residual error information is injected into an intermediate result of a main calculation stream to complete precision compensation. The problems of reasoning state semantic drift and error accumulation caused by dynamic migration between heterogeneous devices are solved, and the robustness and efficiency of a collaborative reasoning system are improved while the model reasoning accuracy is guaranteed.
Owner:WUHAN CHAOQING DIGITAL INTELLIGENCE TECH CO LTD

Target detection scene compliance reasoning system and method based on multi-modal large model and GraphRAG

The invention relates to the technical field of artificial intelligence, in particular to a target detection scene compliance reasoning system and method based on a multi-modal large model and GraphRAG. The method comprises the following steps: firstly inputting scene data into a multi-modal target detection and information extraction module, and outputting structured multi-modal detection information; the scene compliance rule is input into a scene rule knowledge graph construction module, and a searchable knowledge graph is output; the detection information and the knowledge graph are synchronously input into a GraphRAG retrieval reasoning module, and a reasoning result is output after entity matching, rule filtering and path sorting; a reasoning result is input into a compliance judgment and intelligent suggestion generation module, and a compliance conclusion and an intelligent suggestion are output; and when a new rule is accessed, dynamic updating of the knowledge graph is supported. The information extraction integrity is improved, accurate association of multi-modal detection information and compliance rules is ensured, cooperation of multi-modal target detection and structured compliance reasoning is realized, and the problems of detection information fragmentation, rule modeling non-structuring and opaque reasoning process in a traditional scheme are solved.
Owner:CHANGZHOU INST OF MECHATRONIC TECH

Large model reasoning system and method based on combination of flash memory controller and NPU

The invention relates to the technical field of cross of storage controllers and artificial intelligence acceleration, and discloses a large model reasoning system and method based on combination of a flash memory controller and an NPU (Network Processing Unit), and the large model reasoning system comprises the flash memory controller, the NPU and a flash memory array, the flash memory controller integrates a host interface module, a flash memory interface module, an independent AI acceleration interface module and an AI management engine, and the AI management engine autonomously completes NPU initialization, model weight direct loading, KV Cache hierarchical management, RAG knowledge base retrieval and model switching; the flash memory array is divided into a firmware partition, an AI special partition and a user storage partition, and different data storage requirements are met. According to the method, large model reasoning with low delay and low CPU dependence can be realized, and the model loading delay is reduced from 5-30 seconds to lt; after 500 milliseconds, the CPU occupancy rate of the host is reduced from 15-25% to lt; 2%, and concurrent operation of 4-8 models is supported. According to the invention, integration of storage and calculation is realized, and edge end, data center and mobile equipment scenes are adapted.
Owner:YEESTOR MICROELECTRONICS CO LTD

Image calculation-based interpretable artificial intelligence analysis and reasoning system

The invention belongs to the field of artificial intelligence, particularly relates to an interpretable artificial intelligence analysis and reasoning system based on image calculation, and aims to solve the problems that the AI image decision process is opaque and the causal logic is non-traceable. The system comprises a multi-scale feature extraction interface, a semantic concept generation interface, a causal inference engine interface, an anti-fact interpretation generation interface and a man-machine collaborative verification interface, and high-credibility image analysis is realized by constructing an interpretable path from pixels to semantic concepts and then to a causal chain.
Owner:BEIJING ANRUISHENG TECH CO LTD

An AI native operating system construction method and system based on ecological synergy

PendingCN122284988AOperational systemConfigfs
This invention discloses a method and system for constructing an AI-native operating system based on ecosystem collaboration, belonging to the field of operating system technology. The invention first acquires and decomposes target requirements to form a set of functional and non-functional requirements, constraints, and priority lists. Based on this, it generates an operating system architecture description including kernel configuration and subsystem division. Then, it generates and completes multi-dimensional checks on module code and configuration files, and compiles, links, and packages them through a toolchain to generate an operating system image. This invention employs a three-layer AI model to realize requirement reasoning, system construction, and test optimization, forming a complete automated closed loop from requirement input to runnable image output. Simultaneously, it establishes a unified ecosystem collaboration mechanism to support multi-vendor collaborative development. This invention effectively reduces errors and repetitive work caused by manual intervention, shortens the development cycle, improves system stability and adaptability, and promotes the collaborative evolution and improvement of the AI-native operating system ecosystem.
Owner:四川华鲲振宇智能科技有限责任公司

Low-altitude intelligent networking dynamic collaborative reasoning method based on multi-agent reinforcement learning

The application discloses a low-altitude intelligent networking dynamic collaborative reasoning method based on multi-agent reinforcement learning, relates to the technical field of low-altitude intelligent networks and edge artificial intelligence, and comprises the following steps: preloading a light model and a complex model on each unmanned aerial vehicle (UAV), deploying a complete complex model by means of a ground station, and constructing an air-ground integrated intelligent reasoning system. By introducing an enhanced multi-agent deep reinforcement learning algorithm, each UAV can dynamically select a model type, determine a model segmentation point, and reasonably allocate bandwidth and ground computing resources based on the state of the UAV, network conditions and task characteristics during task execution, so that multi-DNN flow heterogeneous resource-aware collaborative reasoning is realized. The application can effectively improve reasoning accuracy and reduce average delay under different device performance, bandwidth conditions and task density, has good system scalability and adaptability, and solves the problems of limited single-machine processing capacity, restricted communication resources and inefficient model switching.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Large language model offline inference task inference acceleration method and system under limited resources

The application discloses a large language model offline reasoning task reasoning acceleration method and system under limited resources, a model construction module, a dynamic batch processing reorganization module, a dynamic memory management module and an unloading strategy adjustment module; based on the lexGen large language model offline reasoning system, dynamic batch processing reorganization is performed on the reasoning task, dynamic memory management design is combined, reasoning tasks are managed in an iterative level fine-grained manner, occupied memory of completed reasoning tasks is released in real time, and dynamic arrangement is performed on uncompleted reasoning tasks, so that the waste of reasoning resources in the reasoning process is reduced, and the offline reasoning system throughput based on the unloading technology is improved. The application efficiently utilizes the idle memory of hardware, improves the throughput of offline reasoning, reduces the influence of unloading on the reasoning process, and transfers part of tensors in a device with low bandwidth to the idle memory, so that the I / O overhead during transmission is reduced.
Owner:TIANJIN UNIV

An unmanned aerial vehicle intelligent perception and intention reasoning system and device

The application discloses an unmanned aerial vehicle intelligent sensing and intention reasoning system and device, which comprises image acquisition, target detection, knowledge graph, multi-modal large model, airborne computing power and edge-cloud cooperation module. The system is guided by target detection, enhances scene knowledge through the knowledge graph, improves the analysis ability of the multi-modal large model, and realizes the intelligent monitoring of the unmanned aerial vehicle based on the RK3588 platform. Real-time monitoring is realized by using the maneuverability of the unmanned aerial vehicle, which can not only analyze the scene, but also infer and predict the behavior intention and situation, thereby realizing early warning. The local and cloud systems are equipped with a historical database, a visual interface and a large parameter model, and the returned information is deeply analyzed. The system can be applied to the scenes of border patrol, city security, animal protection and the like.
Owner:SICHUAN UNIV

Course of action large language model

PendingUS20260187493A1DatasheetLinguistic model
The present disclosure generally relates to a framework for recommending and evaluating courses of action (COAs) using large language models (LLMs). In accordance with some aspects of the present disclosure, a system may generate a structured data representation using a retrieval augmented generation (RAG) system connected to data sources and an LLM. The system may provide the structured data representation to a graph-based logical induction with differentiable reasoning (GLIDR) system. The GLIDR system may select one or more solving units and provide data from the structured data representation to the selected solving units. The selected solving units may generate action data that causes an actuating device to perform one or more operations. The system may provide this action data to the actuating device. In some implementations, the structured data representation includes a knowledge graph or a graph schema.
Owner:EXPRESSION NETWORKS LLC

Multi-agent-based long thinking reasoning system and working method thereof

The invention relates to a multi-agent-based long thinking inference system and a working method thereof, the system comprises a long inference model, a lemma verification model and a proof verification model, and the method comprises the following steps: collecting a plurality of mathematical questions and corresponding correct answers as a sample data set; based on a mathematical problem in the sample data set, performing multi-stage reasoning and multi-round reflection correction by using a long reasoning model, a lemma verification model and a proof verification model to obtain training data; screening the training data by using the correct answer to obtain correct training data, and training the long reasoning model again to obtain a trained long reasoning model; and inputting the current mathematical problem into the trained long reasoning model, carrying out multi-stage reasoning and multi-round reflection correction by combining the lemma verification model and the proof verification model, and outputting to obtain a complete proof corresponding to the current mathematical problem. Compared with the prior art, the method can achieve the long-time thinking of completing the answering of high-difficulty questions, and effectively improves the reasoning capability.
Owner:SHANGHAI ARTIFICIAL INTELLIGENCE INNOVATION CENT

Document reasoning system and method based on large language model

The invention relates to the technical field of text generation, in particular to a document reasoning system and method based on a large language model.A knowledge graph and a large language model are adopted, and text content is generated according to document data, user cues and a document template; according to the user prompt words, relevant information in the document data is extracted through the knowledge graph, the relevant information is integrated and analyzed through the large language model, and the text content is generated based on the document template. Tedious work of constructing complex text generation logic from the beginning is avoided by adopting the knowledge graph and the large language model, the format and the content structure of the generated text can be flexibly adjusted according to different user requirements, information in the knowledge graph and application scenes by combining the document template and the user prompt words, and the user experience is improved. And the system can be widely applied to various business scenes to meet complex and diversified business requirements.
Owner:BEIJING HONGSHAN INFORMATION TECH RES CO LTD