Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1439 results about "Syntax" patented technology

In linguistics, syntax (/ˈsɪntæks/) is the set of rules, principles, and processes that govern the structure of sentences (sentence structure) in a given language, usually including word order. The term syntax is also used to refer to the study of such principles and processes. The goal of many syntacticians is to discover the syntactic rules common to all languages.

Self-adaptive software vulnerability repairing system based on deep learning

ActiveCN120086865APlatform integrity maintainanceNeural learning methodsSelf adaptive softwareSyntax
The invention discloses a self-adaptive software vulnerability repair system based on deep learning. The self-adaptive software vulnerability repair system comprises a multi-modal feature fusion engine, a spatio-temporal joint modeling module, a vulnerability repair strategy generator and a cross-language representation model. The multi-modal feature fusion engine generates a mixed feature vector of a code, inputs the mixed feature vector into the spatio-temporal joint modeling module, captures code structure and time sequence dependence, and identifies risk features; the vulnerability repair strategy generator generates a repair scheme based on the risk features and optimizes the repair scheme through static verification; and the cross-language representation module performs feedback training by using the newly added sample and outputs a final detection result and a repair scheme. According to the method, the vulnerability trigger points can be accurately positioned, all the associated code snippets are extracted, a solid foundation is provided for subsequent vulnerability analysis, and the repaired codes conform to grammatical rules and keep original semantic consistency.
Owner:ANHUI PERCEPTION FUTURE ELECTRONIC TECH CO LTD

Data query method and system based on natural language text

The invention discloses a data query method and system based on a natural language text. The method comprises the following steps: dynamically shielding the natural language text to generate a semantic vector sequence; key entities and association relationships thereof in the semantic vector sequence are extracted, and a structured entity relationship set is obtained; matching the structured entity relationship set with knowledge graph nodes to generate a heterogeneous semantic graph; performing heterogeneous fusion on the heterogeneous semantic graph and text syntactic features to generate intermediate query representation; processing the intermediate query representation to generate an executable statement carrying a semantic association identifier; and verifying the semantic consistency of the response content of the executable statement and the original input, and iterating to regenerate the executable statement when the semantic consistency does not pass the verification. And efficient and accurate natural language query conversion and response generation are realized through dynamic shielding enhanced semantic robustness, knowledge graph path extension and weight iterative optimization, heterogeneous feature fusion and a multi-modal verification mechanism.
Owner:NORTH CHINA UNIV OF WATER RESOURCES & ELECTRIC POWER

CAPEC vulnerability management system based on large language model

The invention discloses a CAPEC vulnerability management system based on a large language model, and belongs to the technical field of network security. The system comprises three modules: a vulnerability-CAPEC dynamic mapping module jointly encodes vulnerability description and code context through a bimodal large language model, accurately associates vulnerability logic with a CAPEC attack mode in combination with comparative learning and knowledge graph construction, and breaks through semantic limitation of traditional rule matching; the adversarial repair code generation module is used for generating high-robustness repair codes through adversarial training and syntax tree verification by fusing CAPEC relieving suggestions and code features on the basis of the association result, so that the secondary vulnerability risk is remarkably reduced; and the full-process automatic verification and DevOps integration module performs multi-dimensional security verification such as symbolic execution, fuzzy testing and the like on the generated repair code, and deeply integrates a development tool chain to realize real-time pushing and closed-loop management of a repair scheme.
Owner:BEIJING SHIXING TECH CO LTD

Virtual digital human interaction system based on AI

The invention provides an AI-based virtual digital human interaction system, and relates to the technical field of data processing, and the system is used for obtaining a user feature data set by performing feature extraction on an interaction data set, calculating an audio change rate and speech speed stability, obtaining speech emotion data, calculating syntactic complexity and counting the number of emotion words. Calculating a facial expression symmetry degree; obtaining facial emotion data; calculating body stability and identifying a visual staying area; obtaining attention state data; adjusting tone and speed of the virtual digital person according to the virtual digital person text, optimizing sentence pattern complexity and sentiment words in the virtual digital person text, adjusting changes of eyes, eyebrows and mouth corners of the virtual digital person, and adjusting information display sequence and visual focus guidance. According to the method, the interaction efficiency of the virtual digital human is improved by analyzing the facial expressions and the body actions of the user.
Owner:GANSU YUSU TECH DEV CO LTD

Method and device for compressing cue words of large language model and medium

The invention discloses a cue word compression method and device of a large language model and a medium. The method comprises the steps that redundant vocabularies and redundant statements are recognized and removed according to the size relation between the vocabulary importance score and the importance threshold value of each vocabulary after original cue word segmentation; constructing a local syntax tree of each statement, and constructing a global analysis tree by the local syntax trees according to the dependency relationship among the cue words; calculating a local information entropy so as to align the LLM word segmentation device with nodes on the global analysis tree and adjust node values of the global analysis tree; trimming the global analysis tree through a recursive algorithm according to the adjusted node value, and generating a compression prompt corresponding to the prompt word; according to the method, the compression prompt is evaluated, the compression prompt is iteratively optimized according to an evaluation result, the cue word is reconstructed according to the optimized compression prompt, and compression of the cue word is achieved.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

Variation test method and device based on intelligent automation script

The invention discloses a variation test method and device based on an intelligent automation script. The method comprises the following steps: extracting a statement execution sequence and a branch dependency relationship in an original source code by using a context-aware syntax tree, and generating a control flow diagram and a data flow diagram; performing code semantic analysis on the multi-dimensional code features by using a large language model, identifying potential defect types and variation rules, predicting the test efficiency of variants in combination with a deep Q learning model, and generating to-be-processed variants; performing grammar check and equivalence analysis on the to-be-processed variants to obtain effective variants, and testing the effective variants; variation test indexes are calculated, code weak points are positioned, and test blind areas are identified according to survival variants, so that a visual analysis report is generated; and iteratively generating a new test case according to the current survival variant and the visual analysis report, and testing the current survival variant by using the new test case. According to the invention, the variation test efficiency can be improved.
Owner:BEIJING YULORE INNOVATION TECH

Structured text code generation and review method

The invention discloses a structured text code generation and review method, which comprises the following steps of: receiving a control task demand input by a user, supporting natural language, structured form or graphical process input, performing deep semantic analysis by utilizing a demand analysis module, identifying control conditions, control actions and constraint factors, and generating and reviewing a structured text code. The task is converted into a plurality of control units through the SCoT chain; the SCoT chain reader generates a semantic vector according to a task demand, the AST reader generates AST representation through a grammar rule structure and a hierarchical relationship, and the decoder predicts a next grammar rule and generates an ST code in combination with the SCoT chain and AST features; and verifying grammar and logic of the ST code through an interactive automatic review and repair mechanism, if compiling errors occur, analyzing errors by the teacher model and providing repair suggestions, and performing code repair by the student model according to guidance until the code conforms to an expected function and passes compiling.
Owner:CHINA JILIANG UNIV

Context-based cyberattack signature generation with large language models

A context-based cyberattack signature generation system (“signature generation system”) disclosed herein comprises a signature prompt schema for generating prompts to a language model that generates cyberattack signatures. The signature prompt schema comprises a description of syntax for the cyberattack signatures and descriptions of case knowledge and domain knowledge for a type of cyberattack corresponding to a cyberattack signature. The signature generation system tests cyberattack signatures generated with the signature prompt schema against minimum signature conditions and traffic with ground-truth malicious / benign labels. Once the signature prompt schema passes the tests, the signature generation system deploys the tested signature prompt schema in combination with the language model for cyberattack signature generation.
Owner:PALO ALTO NETWORKS INC

Code exception analysis method and device, storage medium and program product

The embodiment of the invention provides a code exception analysis method and device, a storage medium and a program product. In the embodiment of the invention, in the preset plug-in, the global knowledge graph is constructed through the logic syntax tree of the plurality of original business codes, so that intelligent anomaly analysis is carried out on the modified to-be-detected codes, multi-language and heterogeneous programming styles and complex dependency limitation are broken through, and cross-language and cross-file analysis is supported; change code snippets and associated influence code snippets thereof are accurately identified, and a data basis is tamped and analyzed; the analysis depth is deepened and the accuracy is improved through a multi-dimensional anomaly analysis large model and four-dimensional collaborative analysis in combination with an adaptive review rule and a knowledge graph; and finally, performing correction based on the generated repair scheme. Through the technical fusion of an MCP protocol, a multi-AI model, a syntax tree and a knowledge graph, the high efficiency, accuracy and real-time performance of code examination and repair are realized, and the service development quality and the system operation stability are remarkably improved.
Owner:BEIJING 58 INFORMATION TTECH CO LTD

Method and system for converting natural language to SQL based on RAG enhancement

The invention discloses a natural language-to-SQL (Structured Query Language) method and system based on RAG (Random Access Gateway) enhancement, and the method comprises the steps: constructing a query intention graph through dependency syntax analysis, recognizing and complementing semantic missing components, and forming complete semantic representation; vector representation is carried out on the business term segments by adopting vectorization coding, accurate definitions of business terms are obtained from a factory structured knowledge base, and an enhanced context set is formed through expansion retrieval in a low-confidence region; an SQL template mapping network is established based on historical query records, a mapping relation matrix is generated through field candidate matching, mapping conflict positions are identified, and multiple SQL candidate sequences are generated; grammar verification is carried out on the candidate sequence to identify grammar errors, semantic consistency verification is carried out to calculate the intention alignment degree, and an optimal SQL statement is selected through a deviation correction factor; and performing formatting processing and statistical abstract on an execution result, and providing data query capability for scenes such as factory quality management and equipment maintenance.
Owner:WUXI XINSOFT INTELLIGENT CONTROL SYST CO LTD

Intelligent query decomposition, specialized model routing, and hierarchical aggregation with conflict resolution

Systems, methods, and devices that relate to intelligent query decomposition and parallel routing for specialized model processing are disclosed. In one example aspect, the system receives a query from a user comprising a request relating to a particular domain. The system determines, using a decomposition model, a set of sub-queries based on semantic boundaries, syntactics, tasks, relationships, and rules relating to particular domains. The system inputs the set of sub-queries into a routing model to determine a set of specialized models. For each sub-query, the system routes the sub-query to a respective specialized model, generates an output, and assigns a confidence score. The system detects conflicts among outputs using a conflict detection model configured to identify discrepancies. The system generates an aggregated output by combining outputs according to a weighted aggregation algorithm prioritizing higher confidence scores and conflict resolution rules, then displays the aggregated output.
Owner:CITIBANK N A

Tibetan language multi-dialect real-time semantic conversion method based on cross-language BERT model

The invention discloses a Tibetan language multi-dialect real-time semantic conversion method based on a cross-language BERT model, and the method comprises the following steps: S1, collecting original text corpora of each dialect of the Tibetan language, and constructing a standardized training corpus set; s2, performing parameter initialization on the mBERT model, and preliminarily training the mBERT model; s3, constructing a semantic modeling model, and performing fine adjustment on the semantic modeling model; s4, receiving to-be-converted text input, and encoding; s5, obtaining an intermediate semantic representation vector of the text through a semantic coding sub-module; s6, inputting the intermediate semantic representation vector into a semantic generation sub-module, and generating target text output; and S7, executing syntactic consistency correction and language fluency correction. According to the method, mBERT modeling and an adversarial optimization mechanism are fused, real-time semantic consistency conversion of multiple dialects of the Tibetan language is achieved, and the method has the advantages of being high in accuracy, high in robustness and low in response delay.
Owner:TIBET MIRAN EDUCATION TECH CO LTD

Multi-modal aspect-level sentiment analysis method based on multi-scale text visual feature enhancement

The invention relates to the field of natural language processing technology, computer vision and multi-modal sentiment analysis, in particular to a multi-modal aspect-level sentiment analysis method based on multi-scale text visual feature enhancement, which comprises the following steps of: 1, acquiring a multi-modal aspect-level sentiment data set; 2, inputting a pre-training language model to obtain global context features; 3, combining target emotion semantic fusion to obtain aspect-related visual emotion features; 4, obtaining a dependency relationship among text information words, and obtaining syntactic enhanced text features; 5, fusing the global context feature, the syntactic enhanced text feature and the aspect-related visual emotion feature to obtain a multi-modal fusion feature; the method has the following beneficial effects that the feature information is expanded, so that effective interaction of text images is realized, noise generated by text and picture data is reduced, and the quality of multi-modal fusion features is ensured.
Owner:JIANGSU OCEAN UNIV

Tibetan rumor model training method and device and Tibetan rumor model detection method and device

The invention discloses a Tibetan rumor model training method, a Tibetan rumor model detection method and a Tibetan rumor model detection device, and the Tibetan rumor model detection method achieves the remarkable beneficial effects through the following technology: firstly, encoding a Tibetan text by using a CINO pre-training model, generating an initial representation vector capable of capturing specific grammar and semantic features of Tibetan, and then performing classification on the initial representation vector; the problem that modeling is difficult when the Tibetan language serves as a low-resource language under the condition of data scarcity is effectively solved. Secondly, local semantic features are extracted through a convolutional neural network, and n-gram modes of different granularities in a text are captured by using a convolution kernel, so that the recognition capability of phrases and local modes is enhanced. Meanwhile, a multi-head self-attention mechanism further processes local features, models a long-distance dependency relationship and generates global context information, and the modeling difficulties that the Tibetan syntax is complex and the dependency relationship is far are solved.
Owner:TIBET UNIVERSITY FOR NATIONALITIES

Complex question and answer method and system based on adaptive task deconstruction and multi-modal evidence aggregation

The invention provides a complex question and answer method and system based on adaptive task deconstruction and multi-modal evidence aggregation, belongs to the technical field of natural language processing, and designs a dynamic Few-shot prompt construction method based on dependency syntax fingerprints to ensure that a prompt template is matched with a question structure; the invention discloses a dynamic problem deconstruction method based on confidence evaluation and auto-reflection. The method comprises the following steps: recursively decomposing a problem tree by using a large language model; converting the problem tree into a standardized linear task execution sequence by a problem tree context dependence specification and task sequence generation method; obtaining a high-correlation evidence set of each task based on an evidence generation method of two-way recall and cross encoder rearrangement; and the task sequence is reasoned and dynamically optimized by a question answer extraction method based on double-strategy aggregation reasoning. According to the method, the accurate complex question and answer result can be provided on the premise of ensuring the question disassembling quality, restraining error propagation and comprehensively recalling evidences.
Owner:BEIJING JIAOTONG UNIV

Intelligent number asking method for large model index query

The invention provides an intelligent number asking method for large model index query, and belongs to the field of natural language processing and database query. An auxiliary information base is constructed to store a database structure and historical question and answer examples, and key entities and fields are extracted by conducting structured format processing on natural language questions; a large language model guided by a small number of examples is utilized to generate an intermediate expression close to an SQL grammar and a plurality of SQL query candidates, and a consistency alignment mechanism is designed to verify candidate SQL in the aspects of field matching, aggregation functions, data tables and the like so as to screen out an optimal SQL query. Finally, the generated correct SQL and the corresponding question and answer pairs are fed back to the auxiliary information base, and self-learning enhancement is achieved. According to the method, under the condition that only a small number of training examples are needed, the accuracy and expandability of large language model text generation SQL query are improved.
Owner:INSPUR SOFTWARE TECH CO LTD

Dynamic mesh geometry refinement component adaptive coding

Computer-implemented methods and systems for processing geometry replacements are disclosed. The methods include decoding / encoding a syntax element associated with a coding mode from / into a bitstream associated with geometry displacements; and reconstructing / converting, based on a coefficient configuration associated with the coding mode, a plurality of quantized transform coefficients from / to a plurality of zero-run length codes.
Owner:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

Human-computer interaction dialogue method, system and equipment based on natural language and medium

The invention relates to a man-machine interaction dialogue method, system and device based on a natural language and a medium. The method comprises the steps that firstly, multi-modal interaction data is acquired and preprocessed, and segmented words and syntax are analyzed through a natural language processing technology to construct intention feature vectors; combining the intention feature vector with a historical dialogue record, and using a pre-trained language model to generate context semantic elements containing a semantic relationship; if the context semantic elements are matched with the preset scene feature library information, predicting a user intention change trend by adopting a reinforcement learning model to obtain an intention prediction result; and finally, evaluating user intention change based on an intention prediction result, extracting associated domain knowledge by utilizing a knowledge graph if significant change occurs, and inputting the associated domain knowledge into a dialogue generation model to obtain a natural language reply sequence. According to the method, the understanding precision of the user intention is improved, the dynamic prediction of the intention change is realized, the relativity and coherence of reply are guaranteed, and a more efficient processing path is provided for natural language man-machine interaction.
Owner:KAILI UNIV

Domain NL2SQL data automatic synthesis method and system based on large language model

The invention provides a field NL2SQL data automatic synthesis method and system based on a large language model, and the method comprises the steps: building an SQL template library through collecting a public data set and real business query data, carrying out the grading according to the SQL complexity, and forming an SQL template set covering different difficulties; specific SQL queries are generated based on an SQL template library and a large language model, verification is carried out through multiple mechanisms such as grammar check, execution verification and result dimension consistency check, and correctness and performability of the SQL queries are ensured. Generating a plurality of candidate natural language questions according to the verified SQL query and the large language model, calculating a semantic consistency score of each candidate question and the SQL query through a cross consistency evaluation mechanism, screening out the question with the most consistent semantics as a final question-answer pair sample, and meanwhile, eliminating low-quality samples by setting a consistency threshold value, so as to obtain a final question-answer pair sample; and the data accuracy and consistency are further improved.
Owner:SHANGHAI JIAOTONG UNIV

Intelligent SQL (Structured Query Language) generation system based on multistage intention recognition and generation method thereof

The invention discloses an intelligent SQL (Structured Query Language) generation method and system based on multistage intention recognition. The method comprises the following steps: receiving a natural language query of a user; vector matching: carrying out vector matching based on a knowledge base to obtain Top-K candidate query objects, the knowledge base containing multilayer structure description information; a large language model intention understanding step: determining a final query object in combination with the candidate query object description; loading a branch workflow, analyzing a field and a table structure, and dynamically configuring a database table and field information; sQL generation: generating SQL statements conforming to grammatical rules, including automatic field addition, time condition conversion and field priority matching operation; and executing the SQL statement and returning a result, and if the result fails, recording a log to prompt correction. By combining a natural language processing technology with a database knowledge base, an efficient, accurate and user-friendly database query solution is provided.
Owner:SICHUAN ZHONGLI JIAHUA INFORMATION TECH CO LTD

Large model tool calling method and device based on multiple constraint sets and electronic equipment

The invention provides a large model tool calling method and device based on multiple constraint sets and electronic equipment. The method comprises the steps that a current constraint set comprises a permission constraint set, a state constraint set and a context constraint set; based on the current constraint set and a tool set cue word builder, obtaining a tool set cue word corresponding to the current constraint set, and generating a calling intention based on the task demand instruction and the tool set cue word; and generating a tool call description based on a cue word formed by the large language model and the call intention, and executing tool function call under the condition that grammar and semantic check of the tool call description is passed. On one hand, a current constraint set uniformly manages authority, state and context constraint conditions, and the constraints are flexibly subjected to set operation to dynamically judge the availability of a tool; and on the other hand, the tool set cue words are dynamically screened, redundancy of the tool set cue words is avoided, the calculation amount of a large language model is reduced, and the possibility of calling wrong tools is reduced.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI

Code change influence intelligent analysis method and system based on syntactic structure tree

The invention provides a syntactic structure tree-based code change influence intelligent analysis method and system, and the method comprises the steps: extracting a control flow, a data flow and a call flow according to an AST generated through the analysis of an original code and a changed code, and constructing a static dependency graph SDG containing a multi-dimensional dependency relationship; the method comprises the steps that a base layer is used for comparing AST differences before and after code change and generating grammatical structure change feature vectors; the service layer matches a corresponding service label for the changed AST node by using the service domain template; the change labeling layer constructs a cross-version dependency chain for the change AST nodes and generates historical feature vectors; and calculating a risk value of changing the AST node by utilizing a feature calculation result and combining with a multi-dimensional influence diffusion algorithm, and automatically generating a decision suggestion. According to the method, multiple dimensions of a control flow, a data flow and a call flow are deepened, risk prediction is optimized by utilizing natural language processing and historical change data, and the influence brought by code change is assisted to be better understood and managed.
Owner:BEIJING YIYUANKU TECH CO LTD

Code recommendation method and apparatus, and device and computer-readable storage medium

The present application belongs to the technical field of artificial intelligence. Disclosed are a code recommendation method and apparatus, and a device and a computer-readable storage medium. The method comprises: acquiring code generation information, wherein the code generation information is used for describing a programming task of a code; generating at least one candidate code on the basis of the code generation information; determining from among the at least one candidate code a candidate code to be repaired, wherein the candidate code to be repaired comprises a wrong parameter, which does not meet at least one of a syntax constraint and semantic constraint of a programming language corresponding to the programming task; and repairing the wrong parameter comprised in the candidate code to be repaired, so as to obtain a repaired candidate code, and recommending the repaired candidate code and an unrepaired candidate code among the at least one candidate code, wherein the unrepaired candidate code is different from the candidate code to be repaired. After a candidate code is generated, a candidate code having an error is automatically repaired, thereby improving the accuracy of a recommended code.
Owner:HUAWEI CLOUD COMPUTING TECHNOLOGIES CO LTD

Specialist language model set mapping and selection for prompt delegation

A method of processing a compound prompt includes decomposing the compound prompt into a plan having multiple steps, and associating a domain descriptor with each of several specialized machine learning models. For each step of the plan, a relevance score for each specialized model is assigned by semantic comparison between its domain descriptor and the step. A subset of the models are selected based on relevance score and used to produce a step output. The outputs of all steps are assembled into a syntactically and semantically coherent final output via an integration module utilizing a large language model.
Owner:INSIGHT DIRECT USA INC

Text entity recognition model construction method and equipment based on large model data enhancement

The invention provides a method and equipment for constructing a text entity recognition model based on large model data enhancement. The method comprises the following steps: firstly, constructing an initial model comprising a preprocessing unit, a syntax dependency analysis unit, a data correction enhancement unit, a context coding unit, a syntax enhancement unit, an expression fusion unit and a sequence decoding processing unit; preprocessing the training sample to obtain a preprocessed text, and establishing a preliminary dependency graph through syntactic analysis; correcting and enhancing the text and the dependency graph by the large language model to obtain a text sequence and a dependency graph for subsequent use; encoding the text sequence to obtain an initial representation vector, and enhancing the vector in combination with the dependency graph; after fusion, decoding and outputting a prediction label containing a lexical entity label; and calculating loss by using a function containing conditional random field structure loss, judging convergence, and if not, updating parameters and continuing training until a target model is obtained. According to the method, data are optimized and expanded by means of a large language model, syntactic dependency enhancement features are combined, and the recognition capability of the complex text named entities is improved.
Owner:北京中科闻歌科技股份有限公司

Intelligent real-time language synchronous translation system and terminal thereof

The invention relates to an intelligent real-time language synchronous translation system and a terminal thereof. The system comprises a voice segmentation module used for carrying out semantic analysis on target voice to be translated and segmenting the target voice according to obtained semantic information to obtain voice units; the scene recognition module is used for analyzing the voice unit to obtain scene information; the syntactic rhythm analysis module is used for converting the voice unit into a text, performing syntactic analysis, and analyzing the voice unit in combination with the information and the semantic information to obtain voice rhythm information and statement structure information; the semantic optimization module is used for correcting the semantic information based on the statement structure information, the scene information and the voice rhythm information to obtain optimized semantic information; and the speech translation module is used for translating the optimized semantic information based on the target language to obtain a target language translation. According to the system, through multi-module cooperation, voice semantics can be accurately mastered, different scenes are fitted, and the accuracy, smoothness and practicability of translation are effectively improved.
Owner:CHANGCHUN VOCATIONAL INST OF TECH

PLC programming using large language models

Methods for generating programmable logic controller (PLC) code and corresponding systems and computer-readable mediums. A method (400) includes receiving (402) at least one specification (160) by a computer system (100). The method includes generating (404) a model-based design plan (158) based on the at least one specification (160) and a large-language model (LLM) (154) and processing (406) the model-based design plan (158) using low-rank adaption techniques (162) and the LLM (154) to produce PLC code (156). The method includes performing (408) a syntax check on the PLC code (156) and outputting (414) the PLC code (156).
Owner:SIEMENS AG +1

Modelica language-based large model driven automobile model modeling method

The invention discloses a large model driven automobile model modeling method based on a Modelica language, and belongs to the technical field of intelligent modeling and automobile simulation. The method comprises the following steps: firstly, accurately analyzing a natural language demand into a structured triple by adopting a BERT-CRF (domain knowledge enhanced) multi-task model; matching an optimal component combination through a multi-objective optimization algorithm driven by a graph neural network, and cooperatively predicting an interdisciplinary parameter feasible region in combination with symbolic mathematical derivation and machine learning; a topological connection matrix is innovatively optimized by using a graph attention network, and intelligent generation and dynamic verification of simulation codes are realized by fusing a template engine and syntax tree analysis; and finally, constructing a multi-target reward function optimization control strategy through reinforcement learning, and establishing a closed-loop knowledge iteration mechanism. Compared with a traditional modeling method, through deep combination of the large model and Modelica, the technical difficulty of automobile system modeling is remarkably reduced while the preciseness of physical modeling is kept, and the method is particularly suitable for complex scenes such as new energy vehicle model development and intelligent driving system integration.
Owner:JIANGSU UNIV +1

Automata-based constraints for model decoding

PCT designated stageWO2025213022A1Natural language translationMachine learningPushdown automatonSequence processing
Provided are systems and methods for enhancing the output accuracy and consistency of sequence processing models, particularly when generating text that must conform to a specific formal language. Systems and methods can integrate finite-state or push-down automata with the decoding process to ensure that the generated sequences adhere to the desired syntax or grammar rules. A system can generate or otherwise leverage a finite-state or push-down automaton that encodes constraints associated with a particular formal language or syntax. At each decoding iteration of a sequence processing model, the decoding system can use the finite-state or push-down automaton to evaluate the token validity for each of a number of possible output tokens. The output of the sequence processing model can then be limited to or otherwise guided towards tokens that are indicated as valid by the finite-state or push-down automaton.
Owner:GOOGLE LLC

Systems and Methods for Sequential Retrieval Augmented Generation

Disclosed herein are systems and methods for improving the auto-generation of pipelined search query statements by a large language model (LLM) through novel processes for performing retrieval augmented generation (RAG). In some examples, such a method includes operations of receiving a natural language user-provided prompt, performing a first RAG process including retrieving first RAG data including natural language, programming syntax pairings from a vector database and performing a second RAG process including retrieving second RAG data including additional programming syntax examples from a vector database that have a second level of similarity with programming syntax of the natural language, programming syntax pairings retrieved during the first RAG process. The method may also include generating an auto-generated prompt requesting generation of programming code by a large language model (LLM) and generating a graphical user interface that displays the response to the auto-generated prompt from the LLM.
Owner:CISCO TECHNOLOGY INC