Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

16988 results about "Large model" patented technology

Ancient building risk prediction management and control method and system based on large model

The invention discloses an ancient building risk prediction management and control method and system based on a large model, and relates to the technical field of ancient building protection. An ancient building risk prediction management and control system based on a large model comprises a multi-source data acquisition module, a multi-modal data fusion module, a large model risk prediction module, a risk assessment and early warning module, a digital twinborn dynamic management and control module and a repair decision module. According to the method, the structure state data, the visual image data and the environment data are fused, so that the state of the historic building is comprehensively perceived; the self-supervised learning pre-trained ViT-GPT model is combined with the LSTM time sequence model, so that the time sequence analysis capability and the multi-modal data processing capability of risk prediction are remarkably improved, the future damage probability and the risk trend of the historic building can be accurately predicted, and the defects of the prior art in long-time span risk prediction are overcome.
Owner:PUTIAN UNIV

Graph neural network-based power grid dispatching decision-making method and large model

The invention discloses a power grid dispatching decision-making method based on a graph neural network and a large model, and the method comprises the steps: collecting an original power grid data set, and generating a fusion feature tensor through adaptive distribution mapping and recursive decomposition; importing a fusion feature tensor and a power grid topology matrix, and generating a dynamic graph embedding matrix through spectral decomposition and matrix manifold analysis; performing Markov jump process analysis and optimal transmission fusion on the dynamic graph embedded matrix to generate an integrated feature matrix; a multi-target Lyapunov function is constructed on the basis of the integrated feature matrix, and a robust decision strategy is generated by solving a Hamilton-Jacobi-Bellman equation; and performing multi-dimensional performance monitoring and statistical manifold learning on the robust decision strategy to realize strategy optimization. According to the method, the uncertainty in power grid operation can be effectively processed, and the accuracy and reliability of scheduling decisions are improved.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI

Aerospace intelligent manufacturing large model construction method

The invention discloses an aerospace intelligent manufacturing large model construction method, which comprises the steps of collecting original data, performing preprocessing and data association, and constructing an aerospace intelligent manufacturing database; establishing a knowledge acquisition and structured conversion assembly line, a multi-dimensional associated domain knowledge graph, a knowledge quality control system and a dynamic updating mechanism, and constructing a professional knowledge base; aligning the cross-modal manufacturing data to generate a corpus; combining base general large model pre-training, injecting terminology semantics and multi-modal association capability, and completing knowledge migration; based on the pre-trained aerospace intelligent manufacturing large model, constructing an aerospace manufacturing cognitive agent, and forming a complex engineering problem solving framework; professional ability is optimized through a two-stage progressive multi-task training strategy, and dynamic adaptation of a production environment is realized in combination with an online learning and incremental updating mechanism. The intelligent level of aerospace intelligent manufacturing is remarkably improved.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Exhibition hall robot visual language navigation method based on large model

The invention discloses an exhibition hall robot visual language navigation method based on a large model, belongs to the field of exhibition hall robots, and aims at solving the problems existing in an existing exhibition hall robot. According to the method, an exhibition hall robot multi-mode scene sensing system senses a current scene, and candidate target objects are obtained through fusion features of RGB images and laser point clouds; extracting image features of all candidate target objects in the scene; according to the exhibition hall robot multi-mode environment understanding system, an exhibition hall robot receives a voice instruction, a visual language multi-mode large model is used for understanding a target object and a user intention, then high-dimensional semantic features of a target object text are extracted from the system, and the target object is found out from candidate target objects; according to the exhibition hall robot intelligent navigation system based on the multi-modal large model, an exhibition hall robot carries out path planning and autonomous movement according to a pose sequence generated by an intention, and self behaviors are dynamically adjusted according to a real-time changing scene provided by the exhibition hall robot multi-modal scene sensing system.
Owner:HARBIN INST OF TECH +1

Large model prompt project optimization system and method fusing domain knowledge graph

The invention discloses a large model prompt project optimization system and method fusing a domain knowledge graph. The system comprises an analysis module, a template generation engine module, a large model interaction interface module, a feedback analysis module and an optimization strategy module. And the analysis module forms a constraint coding signal containing an entity attribute incidence matrix. The template generation engine module forms an enhanced prompt text stream with a reservoir physical property parameter slot; the large model interaction interface module receives the enhanced prompt text stream and generates a question and answer response data stream containing geological terminologies; the feedback analysis module forms a feedback signal containing semantic deviation measurement through a semantic error vector calculation algorithm; and the optimization strategy module forms a parameter optimization instruction signal and transmits the parameter optimization instruction signal to the analysis module to complete iterative updating of the constraint condition. According to the large model prompt project optimization system fusing the domain knowledge graph, the problem of low answer accuracy of a large model in the oil-gas exploration field due to lack of professional constraints can be solved.
Owner:KARAMAY HONGYOU SOFTWARE

Intelligent question answering method based on collaboration between large language model and knowledge graph

Provided in the present application is an intelligent question answering method based on a collaboration between a large language model and a knowledge graph, relating to the technical fields of artificial intelligence and natural language processing, the method comprising: decomposing a complex question into a plurality of simple questions, and analyzing the degree of association between the simple questions and a basic function so as to form a multi-hop reasoning path; automatically extracting structured information from the simple questions on the basis of a multi-task learning framework of a large model, so as to construct a knowledge graph; and constructing a cumulative reasoning learning framework on the basis of a logic reasoning large model, and performing iterative verification on a process result formed by the knowledge graph on the basis of the multi-hop reasoning path, so as to correct the reasoning path until a correct answer is inferred.
Owner:INSPUR GENERSOFT CO LTD

Intelligent programming auxiliary method and system based on multi-mode AI language model

The invention discloses an intelligent programming auxiliary method and system based on a multi-modal AI language model, and belongs to the technical field of programming auxiliary tools. The method comprises the following steps: a multi-modal input processing stage; a dynamic context modeling stage; a hierarchical semantic analysis stage; in the code generation stage, codes are generated in two stages by adopting a Codex-Plus large model; the reinforcement learning driven code optimization stage is used for carrying out multi-objective optimization and reward function design on the codes generated in the code generation stage; a multi-dimensional feedback stage; an interaction and visualization stage; code semantic deep analysis, dynamic context sensing, multi-target optimization generation and real-time interactive feedback are realized by fusing code texts, natural language description, developer behavior data and a domain knowledge graph, and programming efficiency and code quality can be remarkably improved.
Owner:积至(海南)信息技术有限公司

Intelligent operation and maintenance management and alarm system based on large model agent

The invention discloses an intelligent operation and maintenance management and alarm system based on a large model agent, and the system comprises a data collection and fusion module which is used for processing original data collected from an IT system to obtain an operation and maintenance data graph, and the original data at least comprise logs, indexes and link tracking data; the anomaly detection module is used for performing analysis based on the preprocessed data and the time sequence characteristics to determine abnormal data; the alarm optimization module is used for analyzing the semantic information corresponding to the abnormal data so as to determine the priority of the corresponding alarm; the root cause analysis module is used for performing fault reasoning on the abnormal data based on a pre-constructed knowledge graph and generating fault interpretation according to data corresponding to the abnormal data; and the automatic operation and maintenance decision module is used for generating an automatic repair strategy according to the abnormal data and the fault interpretation and executing the automatic repair strategy to repair the abnormal data.
Owner:CALLISTO (BEIJING) TECH CO LTD

Knowledge graph construction method and system based on large language model

The invention relates to a knowledge graph construction method and system based on a large language model, and the method and system achieve the automatic construction and dynamic maintenance of a knowledge graph through multi-modal data fusion, reinforcement learning and comparative learning joint optimization, teacher-student model knowledge migration, time sequence dynamic analysis and an incremental updating mechanism. Constructing a reinforcement learning framework, and taking accuracy and integrity as reward indexes to train a large model to extract an entity relationship; a large-scale knowledge graph is used as a teacher model, and conflict resolution and semantic alignment of newly added knowledge and an existing graph are realized through a graph attention network; a verification rule is dynamically generated based on historical data and domain knowledge, and relation periodicity and mutation points are detected in combination with Fourier transform and a CUSUM algorithm; and finally, generating a traceable knowledge graph through incremental updating and version control. And the multi-modal data processing precision, the entity relationship extraction dynamic adaptability and the knowledge graph maintenance efficiency are improved.
Owner:SICHUAN UNIV JINCHENG INST

Tidal river reach storm surge rapid forecasting method based on deep learning and AI large model

The invention discloses a tidal river reach storm surge rapid forecasting method based on deep learning and an AI large model. The method comprises a data acquisition and preprocessing step, a meteorological element forecasting step, a typhoon path and flow forecasting step and a storm surge forecasting step. Multi-source data fusion is realized through a four-dimensional variational assimilation method and an adaptive weight fusion algorithm; a multi-model integrated system such as FourCatNet and the like is used for forecasting meteorological elements; an improved XLSTM-Transformer model is adopted to predict the flow and the typhoon path; and carrying out storm surge forecasting based on a three-layer nested model system and a multi-process coupling technology. According to the method, full-process automation from data acquisition to forecasting is realized, the forecasting timeliness is improved by 60%, the average absolute error is reduced by 45%, and a reliable basis is provided for disaster prevention and reduction decisions.
Owner:NANJING HYDRAULIC RES INST

Building digital twin three-dimensional reconstruction method and system based on large model

The invention discloses a building digital twinning three-dimensional reconstruction method and system based on a large model, and relates to the technical field of building digital twinning and three-dimensional modeling fusion, and the method comprises the steps: laying multi-source equipment in a building, collecting building multi-angle data, and carrying out type distinguishing and structured preprocessing. An adaptive deep network model is constructed and trained to identify building features, and the robustness of the model is improved by adopting a multi-type enhancement strategy. Point cloud splicing and coordinate unification are realized by using a fusion algorithm, and twin model updating and synchronization are realized based on a multi-dimensional threshold. According to the method, high-quality input is established for a depth model; building structure feature recognition has the advantages of robustness and precision; and the twinborn model has dynamic updatable capability. The three parts form a complete closed loop, the technical bottlenecks of a traditional reconstruction method in precision, stability and renewability are finally broken through, and a new building digital twinning three-dimensional modeling path facing a complex scene is achieved.
Owner:中亿丰数字科技集团股份有限公司

Large model enhanced code security detection method

The invention discloses a large model enhanced code security detection method. The method comprises the following steps: dynamically associating CVE vulnerability features with code semantic representation through a knowledge graph construction module; extracting vulnerability features from a CVE vulnerability library by utilizing a knowledge graph construction module, and dynamically associating the vulnerability features with code semantics; based on the CodeQL standard, a query language is generated by adopting a large model and input into CodeQL for AST analysis, and code structure features are extracted; the large model generates a query language meeting the CodeQL standard, codes are analyzed through CodeQL, and key structure features are extracted; integrating a static analysis tool chain to carry out multi-dimensional credible verification on model output; integrating an SAST tool and a symbolic execution tool, and verifying the model output from different dimensions; and summarizing and fusing detection results of the enhancement layers, and determining a final detection result by adopting a decision optimization method. According to the method, through technical fusion and dynamic optimization, the problems of rule stiffness, one-sided detection and low result credibility are systematically solved.
Owner:SOUTHWEST JIAOTONG UNIV

Large model-based standard document automatic generation and multi-dimensional auditing method and system

The invention provides a standard document automatic generation and multi-dimensional auditing method and system based on a large model, and relates to the technical field of artificial intelligence, and the method comprises the steps: 1, building a distributed database of a multi-source document, and analyzing a heterogeneous text through natural language processing to obtain a standardized knowledge network; step 2, extracting index elements based on the standardized knowledge network, and forming a structured parameter library through verification and verification; and step 3, based on the structured parameter library, constructing a template library, analyzing user demands in combination with semantic matching, and automatically generating a standard document outline. The document generation efficiency and quality are improved, the manual auditing cost is reduced, and the auditing comprehensiveness and accuracy are enhanced.
Owner:浙江金汇数字技术有限公司

Ai large model reasoning method based on knowledge graph enhancement

The invention relates to a cross-domain intelligent reasoning method based on knowledge graph enhancement, and the method achieves the precise reasoning in a complex scene through the construction of a hierarchical knowledge expression framework and a dynamic optimization mechanism. A multi-source heterogeneous data fusion technology is adopted, subject fine-grained knowledge units are generated through multi-modal feature extraction, and a three-dimensional knowledge graph structure comprising a core common concept layer, a subject feature ontology layer and a dynamic semantic mapping layer is established; based on a path exploration algorithm driven by reinforcement learning, cross-domain implicit association is mined while subject independence is reserved, and controllability and interpretability of the reasoning process are achieved in combination with an attention fusion mechanism of a large language model. According to the method, the limitation of traditional unified ontology modeling is broken through, the problems of concept drift and path deviation existing in reasoning in the cross fields of medicine-finance, engineering-law and the like are effectively solved, and the accuracy and knowledge traceability of complex decision tasks are remarkably improved.
Owner:HUNAN SANY IND VOCATIONAL & TECH COLLEGE

Industrial innovation knowledge graph dynamic construction method based on large language model

The invention discloses an industrial innovation knowledge graph dynamic construction method based on a large language model, and belongs to the technical field of data processing. According to the method, multi-source heterogeneous data are integrated, cleaning, format conversion and standardization processing are performed, entities, relationships and attributes are automatically extracted by adopting a large model driven zero sample extraction technology, a high-precision triple library is constructed by combining entity embedding alignment and context anaphora resolution, and a knowledge graph is generated based on a graph database. According to the method, incremental data are captured in real time through a dynamic sensing layer, graph dynamic updating is achieved through an atomization updating mechanism, and data timeliness is guaranteed in combination with timestamps and multi-source verification. According to the method, the knowledge graph construction efficiency and coverage rate are improved, the defects that a traditional method is high in manual dependency degree, long-tail knowledge is missing, updating lags and the like are effectively relieved, and accurate support is provided for technical innovation decision making.
Owner:JILIN UNIVERSITY

Equipment intelligent guarantee system based on off-line large model

The invention discloses an equipment intelligent safeguard system based on an offline large model, and relates to the field of equipment management and safeguard, and the system comprises a collection module which collects an equipment surface defect image and a time sequence signal through an unmanned plane, collects a text log, processes the defect image, the time sequence signal and the text log, and generates a multi-modal data set; the feature fusion module is used for performing feature extraction on the multi-modal data set and fusing the three features to generate a multi-modal feature; the updating module is used for extracting a fault triple from the semantic vector, constructing a Bayesian causal graph according to the fault triple, dynamically updating node confidence and generating a knowledge graph; the maintenance strategy module is used for matching the multi-modal features with a knowledge graph and positioning a fault root cause; and the lightweight model deployment module is used for pre-training a lightweight model in an edge server, accelerating parameter aggregation by using a quantum annealing algorithm, adjusting and optimizing a global large model according to the aggregated parameters, and generating a strategy in combination with reinforcement learning.
Owner:陕西万禾数字科技有限公司

Method and system for collecting decision data by multi-modal large model driven intelligent agent

The invention discloses a method and a system for collecting decision data by an intelligent agent driven by a multi-modal large model. The method comprises the following steps: collecting original data of a predetermined sensor, calculating information entropy and a normalized mass score, and generating a fusion feature vector through self-adaptive multi-modal information fusion; time sequence sensitive multi-mode alignment processing is carried out on the image, and time sequence alignment features are obtained by combining timestamp embedding and a self-attention mechanism; based on this, decision distribution is generated by using a Bayesian neural network, uncertainty is evaluated, and a final decision and index set is generated; evaluating a task score in combination with task description, and making an execution plan according to a resource state; initializing the model, generating synthetic data, optimizing the model and storing experience. According to the invention, the efficient decision-making process of the intelligent trolley is realized, and the execution capability and task completion precision of the intelligent trolley are improved.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI +1

Dynamic tool selection and optimization system and method for large model external tool calling

The invention discloses a dynamic tool selection and optimization system and method oriented to large model external tool calling. The method comprises the steps that data input by a user is obtained, and standardization processing and feature extraction are carried out; performing multi-dimensional task analysis based on the extracted features to generate a task analysis result; constructing a tool feature space, wherein the tool feature space comprises functional features, performance indexes and resource requirements; performing tool selection and combination optimization by adopting a dynamic self-adaptive matching engine; executing intelligent call link optimization, including parallel scheduling and resource allocation; the calling process is monitored in real time, and multi-level anomaly detection and early warning are carried out; generating a multi-objective optimization strategy based on the monitoring data; and continuously optimizing and updating the calling strategy through a reinforcement learning mechanism. According to the method, the tool selection accuracy can be improved, the calling efficiency is optimized, and the system reliability is enhanced.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI

NL2SQL optimization method and device based on large model, equipment and medium

The invention discloses an NL2SQL optimization method and device based on a large model, equipment and a medium, and relates to the technical field of artificial intelligence, the method comprises the following steps: constructing a target metadata knowledge base, and obtaining an initial natural language query request; determining each target entity corresponding to the initial natural language query request, and determining missing target SQL elements in the initial natural language query request based on each target entity; generating a first cue word based on the initial natural language query request, the target SQL element and the target metadata knowledge base, and complementing the target SQL element based on the first cue word by utilizing the target large model to obtain a target natural language query request; and generating a plurality of candidate SQL statements corresponding to the target natural language query request by using the target large model, verifying each candidate SQL statement, and determining a target SQL statement from each candidate SQL statement based on a verification result. According to the method, the accuracy of the NL2SQL can be improved by utilizing a large model.
Owner:SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD

Intention recognition intelligent dialogue method and system based on large model

The invention discloses an intention recognition intelligent dialogue method and system based on a large model, relates to the technical field of dialogue processing, and is used for solving the problem that multiple conflict intentions in multiple rounds of dialogues cannot be efficiently recognized and processed in the prior art. The method comprises the following steps: performing semantic analysis on input data in multiple rounds of conversations by utilizing a pre-trained large-scale language model, and extracting a plurality of initial intentions of a user; establishing an intention conflict detection mechanism based on a predefined intention conflict rule base, analyzing the extracted preliminary intention, and screening to obtain a logic conflict intention combination; the opposition degree of the logic conflict intention combination in logic mutual exclusion and fuzzy overlapping is evaluated through a semantic graph and a graph neural network, the dynamic relation entropy of the logic conflict intention combination is analyzed, the fluctuation change degree of semantic dependency in multiple rounds of dialogues is evaluated, and finally the processing sequence of the logic conflict intention combination is dynamically adjusted. And the intention conflict processing accuracy and the priority distribution reasonability are improved.
Owner:JIANGSU HUIZHI INTELLIGENT DIGITAL TECH CO LTD

Large-model-assisted self-lifting multi-modal industrial equipment knowledge graph construction method

The invention discloses a large-model-assisted self-lifting multi-modal industrial equipment knowledge graph construction method. The method comprises the following steps: collecting and preprocessing multi-modal data; obtaining structured knowledge data in a triple form based on a few-sample prompt; gradually self-optimizing the triple from three evaluation dimensions in combination with thinking chain skills to ensure normalization, integrity and reliability of knowledge expression; the problems of data redundancy and ambiguity in the knowledge graph are solved by adopting a triple-step entity alignment method and utilizing the self-lifting capability of a large model; based on a knowledge graph completion template and a retrieval enhancement mechanism, a relationship prediction and entity completion task is completed by applying a large model, so that the integrity and applicability of the knowledge graph are ensured. According to the method, a large amount of manually labeled data is not needed, the automation level and knowledge quality of knowledge graph construction are improved through the self-lifting thought of a large model and multi-time iterative optimization, and powerful support is provided for industrial equipment management, process optimization and intelligent diagnosis.
Owner:ZHEJIANG UNIV +1

Decision generation execution method and system based on AI intelligent agent

The invention provides a decision generation and execution method and system based on an AI agent, and the method comprises the steps: analyzing a user demand document through a natural language processing technology, and extracting key information to construct a structured cue word; then inputting the cue word into a private domain AI agent based on a large model, and generating a preliminary decision scheme in combination with a professional domain database; automatically generating adversarial introspection probe cues, and guiding an AI agent to carry out consistency, risk and constraint conformity evaluation on the preliminary scheme; the system collects feedback response of the AI intelligent agent, analyzes the feedback through a pre-trained graph neural network, and calculates a confidence score of a decision scheme; when the confidence reaches a preset threshold value, automatically generating an execution script according to the decision scheme; and the execution script automatically operates the target system through the preset API and generates an execution document. The whole process realizes a closed-loop intelligent decision-making process from demand understanding, scheme generation, self-verification and automatic execution, and the decision-making efficiency and reliability are remarkably improved.
Owner:DEEP PERCEPTION (WUHAN) TECHNOLOGY CO LTD

Large model deployment method and system based on multi-level cache mechanism

The invention provides a large model deployment method and system based on a multi-level cache mechanism, and the method comprises the steps: building a first-level dynamic semantic cache, preferentially feeding back a reconstruction answer when a new request is matched, starting a second-level context association cache for a missed request, and starting a second-level context association cache for a missed request; the method comprises the following steps: extracting an implicit semantic trajectory vector and constructing a dynamic association graph to identify a potential context dependency relationship, realizing progressive answer splicing, if coverage is still not performed, activating a third-level intention decision cache, performing scene classification and state marking by utilizing a multi-level analysis structure, and finally performing classification and state marking by utilizing a multi-level analysis structure. Based on a knowledge topology network, a query instruction is generated, multi-modal response elements are extracted to generate a combined response, a system synchronously executes multi-level cache collaborative optimization, a cache strategy is adjusted according to user feedback, cache data are adaptively expanded and eliminated, and a multi-level cache is obtained. According to the technical scheme provided by the embodiment of the invention, the response speed, the context understanding capability and the personalized service level of large model deployment are remarkably improved.
Owner:XIAODUO INTELLIGENT TECH (BEIJING) CO LTD

Intelligent building remote operation and maintenance management and control system based on large model and cloud edge collaborative architecture

The invention relates to the technical field of operation and maintenance management and control, and discloses an intelligent building remote operation and maintenance management and control system based on a large model and a cloud edge collaborative architecture, and the system comprises a configuration subsystem which is used for carrying out the reverse proxy and persistent connection configuration of edge gateway equipment in an intelligent building, and obtaining a TLS encryption bidirectional communication channel; the construction subsystem is used for constructing a cloud-edge-end three-layer cooperative computing architecture; the conversion subsystem is used for performing unified semantic abstraction and conversion on the heterogeneous protocol data to obtain semantic data in a standard JSON (JavaScript Object Notation) format; the rule processing subsystem is used for performing rule processing through a near-end decision engine of the edge gateway to obtain a local intelligent response result; the multi-dimensional analysis subsystem is used for carrying out multi-dimensional analysis through a cloud large model engine to obtain an equipment health score, a fault prediction result and an energy optimization strategy, seamless fusion and interoperation of heterogeneous system data are achieved through the system, and then global optimization and linkage control of the intelligent building are achieved.
Owner:SHENZHEN GEMDALE BUILDING ENG CO LTD

Knowledge graph-combined brilliance large-scale model culture knowledge generation and retrieval method

The invention relates to a brilliance large-scale model culture knowledge generation and retrieval method combined with a knowledge graph. The method comprises the steps that entity extraction, relation modeling and dynamic completion processing are carried out according to multi-modal culture data, a culture knowledge graph is constructed in combination with a fuzzy time reasoning algorithm and a cross-modal alignment mechanism, and the multi-modal culture data comprises an unstructured culture text, image data and space-time metadata; the space-time metadata comprises text space-time metadata and image moment metadata; performing semantic alignment processing by combining a large model through a user query statement and a culture knowledge graph to obtain joint representation of cross-modal semantic alignment; and performing multi-modal retrieval-generation joint optimization based on the joint representation to obtain cultural knowledge description and associated multi-modal content. According to the method, through multi-modal data fusion, dynamic knowledge completion and fuzzy time reasoning, culture knowledge description can be accurately generated, associated multi-modal content can be retrieved, and the accuracy and the intelligent level of culture knowledge service are improved.
Owner:JINAN DONGDE CONSTRUCTION LABOR CO LTD

Digital human video generation method based on multi-modal large model

The invention belongs to the technical field of virtual person generation, and particularly relates to a digital person video generation method based on a multi-modal large model, and the method comprises the following steps: 1, constructing a multi-modal data system; 2, multi-modal large model training and adaptation are carried out; 3, constructing a digital human three-dimensional model; step 4, performing semantic analysis and modal mapping; 5, generating a time sequence action and a mouth shape; step 6, building and rendering a virtual scene; step 7, audio and video synchronous rendering and synthesis; step 8, quality optimization and defect repair; and step 9, performing user interaction and iterative optimization. Through technical innovation and engineering, the core pain point in digital human video generation is solved, efficient, vivid and customizable content production capacity is provided for virtual anchors, intelligent customer service, enterprise training and other scenes, and the AI digital human technology is promoted to be applied to large-scale business from experiments.
Owner:ZHE JIANG YAN HUANG KE JI YOU XIAN GONG SI

Electric power work order intelligent processing method with RPA fused with multi-mode large model

The invention relates to the technical field of intelligent operation and maintenance and artificial intelligence crossing of a power system, in particular to an intelligent power work order processing method of an RPA fused multi-modal large model, which analyzes multi-modal work order data such as texts, voices, images and the like through a domain adaptation large language model, and realizes fault key information extraction and conflict resolution in combination with a dynamic knowledge graph; performing work order priority scoring and resource allocation by using space-time constraint reinforcement learning; an analysis result is converted into an automatic execution script through an RPA engine, and a whole-process closed loop of order sending, processing and feedback is achieved; meanwhile, a feedback optimization and conflict resolution cooperation mechanism is constructed, and the knowledge graph and the model precision are continuously iterated. The method improves work order processing efficiency and analysis precision, enhances decision scientificity, and is suitable for an intelligent operation and maintenance scene of a power system.
Owner:FUJIAN ZEYUAN INFORMATION TECHNOLOGY CO LTD

Intelligent vulnerability mining platform construction method and system based on large model

The invention provides an intelligent vulnerability mining platform construction method and system based on a large model. The intelligent vulnerability mining platform systematically identifies and analyzes potential security risks, collects and identifies code snippets with the security risks, arranges the code snippets into risk code paragraphs, identifies target code paragraphs, determines known vulnerabilities, generates context information, captures key events in actual operation, and records real execution paths and state changes. The method comprises the steps of generating a dynamic execution track, simulating different paths, generating an attack vector path, predicting unknown vulnerabilities and credibility scores of the unknown vulnerabilities, testing prediction results of high-credibility scores, confirming and generating real vulnerability information, recording the information to a vulnerability knowledge base, and generating a security report containing vulnerability description, influence ranges, risk levels and repair suggestions. According to the technical scheme provided by the embodiment of the invention, the detection accuracy and efficiency of the security vulnerabilities in the software system are improved.
Owner:HUAQING WEIYANG (BEIJING) TECHNOLOGY CO LTD

Cross-modal knowledge reasoning method based on multi-modal large model

The invention relates to a cross-modal knowledge reasoning method based on a multi-modal large model. In a cross-modal knowledge reasoning process, an existing model is usually limited by single-modal information extraction and shallow feature fusion, so that deep semantic association among data such as texts, images and videos is difficult to fully capture. In order to solve the problem, the invention provides a model for fusing multi-modal information such as texts, images, videos, documents and the like, and processing of multi-modal data is converted into unified feature extraction, interaction and deep reasoning tasks by fully utilizing a supervision fine tuning strategy, a self-adaptive attention mechanism and a cross-language processing technology. The model adopts a modular design, integrates multi-source data complementary analysis, spatial-temporal feature modeling and emotional semantic analysis, and realizes multi-modal collaborative interaction, dynamic scene understanding, long video key event analysis and man-machine co-emotional response. Through sufficient training, the multi-modal large model shows excellent logical reasoning ability and emotion understanding ability in a complex cognitive task, and a brand new solution is provided for efficient extraction, deep semantic analysis and intelligent response of cross-modal information.
Owner:SHENYANG INST OF COMPUTING TECH CO LTD THE CHINESE ACAD OF SCI

Intelligent heat supply decision-making system based on artificial intelligence large model

The invention discloses a heat supply intelligent decision-making system based on an artificial intelligence large model, and the system comprises a data layer which is used for storing multi-type data of a heat supply system source network load; the knowledge base establishment and large model training layer is used for establishing a heat supply intelligent decision diversified task knowledge base and establishing each task large model; the man-machine enhancement optimization large model layer is used for providing improvement suggestions for a large model, optimizing generated answers, evaluating the answers generated by the large model and performing large model parameter optimization training; the agent decision-making layer is used for integrating each task large model into each agent to carry out environment perception, collaborative interaction and autonomous adaptive decision-making; the analogue simulation layer is used for providing a simulation operation environment, a user interaction interface and scene dynamic parameter simulation; and the agent evaluation optimization layer is used for constructing performance indexes for evaluating the agents, and evaluating, optimizing and adjusting behaviors and decisions of the agents.
Owner:HANGZHOU YINGJI POWER TECH CO LTD