Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

35 results about "Loss function" patented technology

In mathematical optimization and decision theory, a loss function or cost function is a function that maps an event or values of one or more variables onto a real number intuitively representing some "cost" associated with the event. An optimization problem seeks to minimize a loss function. An objective function is either a loss function or its negative (in specific domains, variously called a reward function, a profit function, a utility function, a fitness function, etc.), in which case it is to be maximized.

Training method, reasoning method and related device of stream matching generative model

The embodiment of the invention provides a training method, a reasoning method and a related device for a stream matching generation model, which are used for improving the accuracy of an action sequence predicted by the trained stream matching generation model. The method provided by the embodiment of the invention comprises the following steps: acquiring noise, a moment t and an environment characteristic of a first action, wherein the environment characteristic of the first action at least comprises an observation value of the first action; inputting the noise, the moment t and the environment characteristics into an initialized flow matching generation model to obtain an output predicted velocity field vector of the conditional probability path at the moment t + 1; calculating the loss between the predicted velocity field vector and the real velocity field vector by using a preset loss function, wherein the preset loss function comprises at least one of a first loss function and a second loss function, and a third loss function; and training the initialized stream matching generation model by using a loss and back propagation algorithm until the stream matching generation model converges to obtain a trained stream matching generation model.
Owner:BEIJING HUMANOID ROBOTICS INNOVATION CENTER CO LTD

Lithium carbonate price prediction method and equipment based on large language model, and medium

The invention specifically discloses a lithium carbonate price prediction method and device based on a large language model, and a medium, and relates to the technical field of financial prediction and intelligent decision support. The method comprises the following steps: firstly, collecting and processing numerical type and text type data, constructing a causal graph network by the numerical type data, and extracting factual abstracts by the text type data to construct a news event library; then designing a three-layer progressive prompt template, and driving the large language model to generate a prediction result with explanation; then, implementing a dual-verification self-optimization reflection mechanism, and triggering an reflection generation improvement strategy when misjudgment is carried out or an error exceeds a threshold value; using a KTO algorithm to construct asymmetric loss function fine tuning model parameters; and finally, deploying the optimized model to a production system. According to the method, the dynamic adaptability and robustness of the model are improved through a'prediction-reflection-optimization 'closed-loop optimization architecture and a KTO algorithm driven by a foreground theory, prediction precision and interpretability are considered, and multi-dimensional decision support is provided for lithium carbonate price prediction.
Owner:HEFEI UNIV OF TECH

Dynamic concept cognitive anomaly detection method and system under unbalanced condition

The invention relates to a dynamic concept cognitive anomaly detection method and system under an unbalanced condition, and the method comprises the steps: collecting the related feature data of a sample set in a scene facing a specific extreme event, and dividing an initial data set and a test set; constructing an initial learning model; performing dynamic event type prediction based on the test set, and classifying the event as an extreme event or a non-extreme event; constructing an active three-way concept learning module to form a positive concept space and a negative concept space based on a three-way decision idea and prediction probability values of extreme events and non-extreme events; according to the positive concept space and the negative concept space, introducing a concept center domain strategy for dynamic updating; and adopting a loss function minimization strategy to obtain an optimal learning model. The effectiveness of dynamic detection is improved by utilizing an active three-way concept learning method, a concept center field and a concept dynamic optimization strategy, and the capability of identifying extreme events under the extremely unbalanced scene condition is realized.
Owner:CENT SOUTH UNIV

Two-stage label noise learning classification method and system

PendingCN120597066AData setOptimality model
The invention discloses a two-stage label noise learning classification method and system, and the method comprises the following steps: constructing a relative similarity filter through the comprehensive measurement of relative similarity and Euclidean distance, inputting an original data set into the relative similarity filter, screening out noise samples through the calculation of the relative similarity of the samples, and carrying out the classification of the noise samples. Outputting the filtered data set; inputting the filtered data set into a robust sorting support vector machine model based on a non-convex slope loss function and a local label weighting strategy for training, and converting the non-convex loss function into a convex optimization problem through a convex-concave process for solving to obtain an optimal model parameter; and updating a model threshold by using the optimal model parameter, and classifying a to-be-classified sample by using the updated model. According to the method, data-level screening and model-level noise suppression are both considered, the problem of unstable performance under a single processing path in a traditional method is solved, and the method is particularly suitable for stable learning tasks under high-dimensional and high-noise scenes.
Owner:GUANGDONG UNIV OF TECH

Method and apparatus for training of large model based solution generation and optimization model

The application provides a large model-based scheme generation and optimization model training method and device, the large model-based scheme generation and optimization model training method comprises the following steps: obtaining a sample experiment scheme and sample requirements thereof; taking the sample experiment scheme and the sample requirements as training samples, and training a scheme generation model by taking a first autoregressive loss as a loss function; taking a historical optimization trajectory and a target scheme as training samples, and training a feedback model by taking an improved opinion loss as a loss function; taking the sample requirements, the historical optimization trajectory, and sample improved opinions output by the feedback model in a historical training process as training samples, and training an optimization model by taking a second autoregressive loss as a loss function; and obtaining a scheme generation and optimization model based on the scheme generation model, the feedback model, and the optimization model; the method realizes automatic design and optimization of a scheme for a special device or system, and improves experiment scheme generation efficiency and accuracy.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI +1

META-SCHOLAR EVOLUTION STRATEGY BLACKBOX OPTIMIZATION CLASSIFIERS

ActiveDE102021204943B4Measurement devicesMachine learningMultivariate normal distributionAlgorithm
A computational method (400) for training a meta-learned evolutionary strategy black-box optimization classifier to learn an actuator control command for actuating a computer-controlled machine, the method comprising: Receiving (402) one or more training functions F and one or more initial metalearning parameters Θ of the metalearning evolutionary strategy blackbox optimization classifier; Sampling (404) a generation of λ samples z1,...,z λ a sampled objective function f ∈ F of the one or more training functions F and an initial mean m (0) of the sampled objective function f ∈ F, where the generation of λ samples z1,...,z λ with a multivariate normal distribution N(m (0) = 0, e (0) C (0) = 1) with initial mean m (0) = 0 and an initial covariance matrix C (0) = 1 in samples x1,...,xλ is shifted and scaled using the equation: xi = m ( t ) + σ ( t ) C ( t ) 1 2 zi , where σ (t) a step size of a number T steps in t = 1,...,T; for the number of T steps in t = 1,...,T, calculating (406) a set of T means m (1) ,...,m (T) by running the meta-scholarly evolutionary strategy black-box optimization classifier on the sampled objective function f ∈ F using the initial mean m (0) ; Calculate (408) a loss function L(f(m 0 ), ..., f(m T )) of the set of T means m (1) ,...,m (T) ; and Updating (410) the one or more initial metalearning parameters Θ of the meta-learned evolutionary strategy black-box optimization classifier in response to a characteristic of the loss function L to obtain an updated meta-learned evolutionary strategy black-box optimization classifier that includes a weighted combination of the generation of λ samples with larger weights for samples with smaller values ​​for the objective function f ∈ F; Sending input signals received from a sensor into the updated meta-scholarly evolutionary strategy black-box optimization classifier to obtain output signals designed to characterize a classification of the input signals; and Sending an actuator control command to an actuator (14) of the computer-controlled machine in response to the output signals; and Actuating the computer-controlled machine in response to the actuator control command.
Owner:ROBERT BOSCH GMBH

Information processing device and information processing method

This improves the accuracy and speed of solving large-scale combinatorial optimization problems by dividing them into subproblems. [Solution] The information processing device 100 for processing combinatorial optimization problems includes: a graph creation unit 112 that creates one or more subgraphs from a main graph; a mathematical optimization unit 115 that solves the combinatorial optimization problem for each subgraph using a mathematical optimization solver; a machine learning unit 117 that trains each subGNN so that the output of the subGNN corresponding to each subgraph is close to the solution of the mathematical optimization solver; a feature vector assignment unit 118 that assigns the feature vectors at each vertex of the subGNN obtained as a result of training to the corresponding vertices of the main GNN as input to the feature vectors of the main GNN corresponding to the graph data of the main graph; and a solution output unit 119 that outputs the solution obtained as a result of training the main GNN by setting a loss function so that the machine learning unit 117 solves the combinatorial optimization problem for the main graph.
Owner:HITACHI LTD +1

Retriever model training method, birt-hogg-dube syndrome identification method and system based on retrieval enhancement generation

This application discloses a retrieval model training method, a retrieval-enhanced generation-based Bert-Hogg-Dubbs syndrome (BHD) identification method and system, relating to the field of rare disease identification. The training method includes acquiring positive and negative sample pairs; inputting the positive and negative sample pairs into an initial retrieval model; calculating the loss function of the initial retrieval model; and dynamically adjusting the angle margin of the loss function in real time according to a metric variance adaptive mechanism. The initial retrieval model is then optimized based on the loss function calculation results. This application forcibly expands the angle interval between BHD and non-BHD by using the angle margin of the loss function, and uses a metric variance adaptive mechanism to dynamically adjust the angle margin based on the statistical variance of the cosine similarity among all positive sample pairs in the current training batch. This solves the problem of weak image differences and blurred category decision boundaries in DCLDs caused by the highly similar imaging features of various rare diseases, thus improving the recognition accuracy of large models for query information.
Owner:UNIV OF SCI & TECH OF CHINA

A multi-modal model hallucination elimination method based on sharpness perception and target-oriented disturbance

PendingCN122634101AData setAlgorithm
The application discloses a multi-modal model object hallucination elimination method based on sharpness perception and target-oriented disturbance. In view of the hallucination suppression failure and index sharp rebound problem of the existing machine forgetting technology after parameter fine-tuning, the application firstly automatically constructs negative, positive and general sentence data sets based on alignment scores; then a target-oriented min-max optimization model is established, and the sensitive direction of the model on the loss function surface is locked by simulating the parameter disturbance in the worst case; finally, a sharpness perception parameter updating mechanism is used to force the model to converge to the flat extreme value region of the loss space. The application solves the problem that the hallucination rate of the model significantly increases when the model faces parameter disturbance or incremental training interference, realizes deep robust elimination of hallucination, and effectively maintains the general utility of the model on the regular task.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Student mathematical ability evaluation method based on time series regression and incremental learning model

The application discloses a student mathematical ability evaluation method based on a time series regression and an incremental learning model, relates to the technical field of mathematical ability evaluation, and comprises the following steps: S1, establishing a mathematical question bank and performing ability dimension division, and recording the examination proportion of the ability dimension; S2, setting a dynamic data screening mechanism of a sliding window; S3, collecting student answering sequence data; S4, constructing a mathematical ability evaluation regression model based on the dynamic data screening mechanism of the sliding window and a time decay weight; S5, constructing a loss function of the mathematical ability evaluation regression model, and searching for the mathematical ability evaluation regression model parameters when the loss function reaches a minimum value by adopting a Bayesian optimization algorithm; and S6, performing real-time dynamic evaluation and diagnostic evaluation on the mathematical ability of students.The application has the characteristics of small calculation amount, low complexity, real-time incremental updating, strong interpretability and personalized analysis of learning paths, and can be applied to mobile terminal deployment under resource-limited conditions.
Owner:SOUTHWEST JIAOTONG UNIV

Data model modeling method based on mathematical data analysis operation processing

A data model modeling method based on mathematical data analysis operation processing comprises the steps that (a) dynamic feature screening is conducted on original data, feature importance is calculated based on information entropy and a covariance matrix, redundant features are removed by setting a dynamic threshold value, and the feature weight distribution proportion is adjusted in real time according to data distribution changes; (b) performing tensor decomposition dimension reduction on the screened high-dimensional data: decomposing three-dimensional or more tensors into a product of a low-rank core tensor and a factor matrix by adopting a CP decomposition or Tucker decomposition method, and extracting potential correlation features; (c) constructing a multi-objective optimization model: combining a least square loss function with an L1 / L2 regularization item, and adjusting model parameters in real time through a dynamic feedback mechanism which comprises an error back propagation algorithm and a self-adaptive learning rate strategy; and (d) adjusting and optimizing the hyper-parameters based on a Bayesian optimization algorithm, inspecting and evaluating the distribution consistency of the model by using Kolmogorov-Smirnov, and dynamically adjusting a training strategy according to an inspection result.
Owner:NANJING INST OF MECHATRONIC TECH

Power marketing language model reasoning optimization method and system based on chain thinking

The invention discloses an electricity marketing language model reasoning optimization method and system based on chain thinking. The optimization method provided by the invention comprises the following steps: encoding initial information of power marketing multi-modal input by using a head module to generate an initial state; iteratively calculating and gradually optimizing the initial state through a recursion module to obtain a potential state, participating in a generation process of soft target distribution by the recursion module in each iteration, and supervising, training and reasoning the potential state in combination with a teacher model; meanwhile, corresponding soft target distribution is generated through a teacher model to serve as a reference standard, selection of the teacher model in each iteration stage and the generation quality of the soft target distribution are optimized by adopting a suitable distillation loss function, and adaptation of a dynamic supervision signal is achieved; and decoding the final potential state by using a tail module to generate prediction information. According to the invention, the reasoning capability and generalization performance of the power marketing language model in a complex power marketing business scene are enhanced.
Owner:STATE GRID ZHEJIANG ELECTRIC POWER CO MARKETING SERVICE CENT

A knowledge distillation method based on inference step disassembly and differentiated supervision

The present application relates to a kind of knowledge distillation method based on inference step deconstruction and differentiating supervision, belong to artificial intelligence field.The structured thinking chain generated by acquiring teacher model is separated according to line, each inference step is deconstructed into independent unit;Each step is type labeled, according to the five-level classification system of basic calculation, basic fact, operation execution, logical reasoning, strategy planning, differentiating weight is distributed, and weight superposition is used to composite step;Weighted loss function is constructed, step weight is introduced into cross-entropy loss, and student model is distilled training.The present application focuses on key inference link in the learning process by step-level type perception and differentiating supervision, overcomes the problem of detail loss and global understanding damage caused by flat sequence supervision in traditional distillation.Experimental results show that, on mathematical reasoning task, compared with equal-weight step distillation method, accuracy is improved by 4.6 percentage points, and efficient migration of large model reasoning ability to lightweight model is realized.
Owner:ZHEJIANG UNIV

Optimization method for solving mixed integer linear programming problem

The invention discloses an optimization method for solving a mixed integer linear programming problem, and the method comprises the steps: employing a bipartite graph structure composed of variable nodes and constraint nodes for the modeling of the MILP problem, and the bipartite graph structure comprises variable node features, constraint node features and edge features; variables of the bipartite graph structure are divided into stable variables and unstable variables, a corresponding total loss function is determined, and the total loss function is determined based on a cross entropy loss function and a comparison loss function; carrying out label learning on the stable variables by adopting a cross entropy loss function, and carrying out comparative learning on the unstable variables by adopting a comparative loss function; based on the total loss function, training learning of the corresponding relation of the MILP problem and the solution is carried out to obtain a corresponding prediction model, and based on the prediction model, the MILP problem is solved. According to the method, prediction precision and solution feasibility can be considered in the MILP problem solving process, and good stability and practicability are shown in various types of actual problems.
Owner:UNIV OF SCI & TECH OF CHINA

Physical scene multi-region cooperative computing method based on self-adaptive guaranteed structure

The invention relates to the technical field of computer-aided solution of physical fields or mathematical equations, and discloses a physical scene multi-region cooperative computing method based on an adaptive guaranteed structure. The method comprises the following steps: firstly, dividing a global solution domain into a plurality of mutually connected and partially overlapped sub-domains through domain decomposition, and configuring an independent physical information neural network model for each sub-domain; then circularly executing the following steps: performing multi-dimensional feature extraction in each sub-domain based on the composite feature index; constructing a probability function according to the characteristic indexes, and implementing adaptive sampling to dynamically update a training set; after each round of training is finished, dynamically optimizing the weight of the loss function according to the change trend of different loss items, and adding a physical structure retention constraint item into the total loss function; and circularly executing until a convergence condition is met, and outputting a physical field numerical solution. According to the method, precise capture of the local high-gradient region of the physical field is realized, and the stability and physical conservation of the model are ensured while the calculation precision and efficiency are improved.
Owner:SHANGHAI UNIV

Training method, reasoning method and related device of stream matching generative model

The embodiment of the invention provides a training method and a reasoning method of a stream matching generation model and a related device, which are used for improving the efficiency of a stream matching generation model training process. The method provided by the embodiment of the invention comprises the following steps: acquiring noise, a moment t, a first modal object acquired from the noise and environment characteristics of the first modal object; inputting the noise, the moment t, the first modal object and the environmental characteristics into an initialized flow matching generation model to obtain a predicted velocity field vector of a conditional probability path at a (t + 1) moment output by the initialized flow matching generation model; using a preset loss function to calculate loss between the predicted velocity field vector and the real velocity field vector, the preset loss function including at least one of a first loss function and a second loss function, and a third loss function; and training the initialized stream matching generation model by using a loss and back propagation algorithm until the stream matching generation model converges to obtain a trained stream matching generation model.
Owner:BEIJING HUMANOID ROBOTICS INNOVATION CENTER CO LTD

Convexity self-learning size gear optimization method and system

The invention discloses a convexity self-learning size gear optimization method and system, and belongs to the technical field of metal calendaring, and the method comprises the steps: collecting actual production data in a preset production period of a production site, and integrating data required by gear optimization; determining an effective target size range of the plate strip, and dividing the effective target size range into a plurality of intervals; constructing a loss function for evaluating the reasonability of size gear division; and taking the gear number and the interval number contained in each gear as optimization objects, and based on the loss function, solving an optimal solution of the optimization objects by utilizing a swarm intelligence algorithm to realize convexity self-learning size gear optimization. By adopting the convexity self-learning size gear optimization method and system provided by the invention, the scientific reliability of optimization work can be improved, meanwhile, the optimization efficiency can be improved, the performance of a self-learning scheme in the aspects of precision and stability can be enhanced, and finally, the plate shape control effect can be effectively improved.
Owner:UNIV OF SCI & TECH BEIJING

Method and device for determining a search rearrangement model

The present application discloses a method and apparatus for determining a search rearrangement model. An initial scoring and ranking model is used to perform initial ranking and scoring on multiple search result entries of a target search term to obtain their respective initial ranking scores. A scoring and evaluation model is used to evaluate the initial ranking scores according to the expected ranking and determine their respective reward scores. Further, a loss function of the multiple search result entries is determined based on the initial ranking scores and the reward scores, and the initial scoring and ranking model is trained for the ranking model according to the loss function to obtain a target scoring and ranking model for performing search rearrangement on the multiple search result entries. Since the reward scores are determined based on the expected ranking, training the initial scoring and ranking model for the ranking model using the loss function determined based on the initial ranking scores and the reward scores enables the initial scoring and ranking model to be optimized in the direction of outputting the expected ranking, obtaining the target scoring and ranking model and improving the accuracy of the ranking result.
Owner:BEIJING QIYI CENTURY SCI & TECH CO LTD

A parameter identification method for mathematical model of machine tool feed system based on gradient optimization

The application belongs to the technical field of numerical control machine tools, and discloses a mathematical model parameter identification method for a machine tool feeding system based on gradient optimization. The method comprises the following steps: S1, establishing a mathematical model for the machine tool feeding system; S2, collecting actual operation data of the machine tool; setting initial parameters to be identified; constructing an update model for the parameters to be identified; S3, inputting a preset instruction position signal and the current parameters to be identified into the update model for the parameters to be identified to update the parameters to be identified, simulating and calculating a loss function by using the updated identification parameters, and judging the relationship between the current loss function and an optimal loss function; if the current loss function is smaller than the optimal loss function, the value of the current parameters to be identified is kept, otherwise, the number of times that the loss function increases is increased; S4, updating the number of iterations, and judging whether the current number of iterations reaches a preset maximum number of iterations; if yes, the current parameters to be identified are output; otherwise, the step S3 is returned. By the application, the identification efficiency of parameters with low sensitivity to the global loss function is improved.
Owner:HUAZHONG UNIV OF SCI & TECH +1

Student mathematical ability assessment method based on time sequence regression and incremental learning model

The invention discloses a student mathematical ability assessment method based on a time sequence regression and incremental learning model, and relates to the technical field of mathematical ability assessment, and the method comprises the steps: S1, building a mathematical question bank, carrying out the ability dimension division, and recording the investigation proportion of the ability dimension; s2, setting a dynamic data screening mechanism of the sliding window; s3, collecting student answer sequence data; s4, constructing a mathematical ability assessment regression model based on a dynamic data screening mechanism of a sliding window and a time attenuation weight; s5, constructing a loss function of the mathematical ability assessment regression model, and searching by adopting a Bayesian optimization algorithm to obtain mathematical ability assessment regression model parameters when the loss function obtains a minimum value; and S6, carrying out real-time dynamic evaluation and diagnostic evaluation on the mathematical ability of the student. The method has the advantages of being small in calculation amount, low in complexity, capable of achieving real-time incremental updating, high in interpretability and capable of achieving personalized analysis of learning paths, and can adapt to mobile terminal application deployment under the condition that resources are limited.
Owner:SOUTHWEST JIAOTONG UNIV

Method and apparatus for solving linear equations using variational quantum circuits

The application discloses a method and device for solving linear equations by using a variational quantum circuit, and the method comprises the following steps: firstly, determining a linear equation group to be solved, constructing a variational quantum circuit, and obtaining an approximate solution of the linear equation group corresponding to variational parameters; then, constructing a loss function according to the approximate solution and judging whether the value of the loss function meets the accuracy; if yes, taking the approximate solution as a target solution of the linear equation group; otherwise, updating the variational parameters, obtaining an approximate solution of the linear equation group corresponding to the updated variational parameters, and continuing to execute the steps of constructing the variational quantum circuit and obtaining the approximate solution of the linear equation group corresponding to the variational parameters until the approximate solution meeting the accuracy of the value of the loss function is obtained as the target solution of the linear equation group to be solved. By using the variational quantum circuit, the technical solution for calculating the linear equation group can be realized, the complexity and difficulty of solving the linear equation group are reduced, and the related technical blank in the field of quantum calculation is filled.
Owner:ORIGIN QUANTUM COMPUTING TECH (HEFEI) CO LTD

Shot-Efficient Quantum Solver for Differential Equations

PendingKR1020260139672ALimits of integrationQuantum circuit
Systems and methods for solving differential problems using a hybrid computer system including a classical computer system and a quantum processor are disclosed. The method includes receiving or determining one or more variational quantum circuits that define a parameterized quantum model of an execution function, and an integral formula of a differential equation. The integral formula defines an equation having a differential order smaller than the differential order of the differential equation, and the integral formula includes at least some of the boundary conditions. The integral formula includes a path integral having a first integral limit corresponding to a point on the boundary. The method includes determining a solution to the differential problem based on a loss function associated with the parameterized quantum model and the integral formula of the differential problem. The evaluation of the loss function for a point under consideration includes calculating an integral based on one or more collocation points between the point on the boundary and the point under consideration. The step of determining the solution includes varying variational parameters to determine a set of optimal parameters that define the solution to the differential equation.
Owner:파스칼 에스에이에스

A pseudo-label-based target detection training method

The present application relates to a kind of target detection training methods based on pseudo label, belong to semi-supervised learning field.The classification output of the present application is processed in multiple stages, and the class output probability greater than or equal to the first threshold value is as the class pseudo label of this target, the class output probability value greater than the second threshold value and less than the first threshold value is marked as special class, and the class output probability value less than or equal to the second threshold value is as background class;In optimization loss function, special class has no contribution to loss function;The output of target detection algorithm model includes classification branch, regression branch and regression frame reliable judgment branch, on the basis of the output of regression branch, the IoU value of the output result of regression branch and the labeled frame is calculated, and the IoU value is used as the learning goal of regression frame reliable judgment branch, and the corresponding regression branch output is more accurate for the output value of regression frame reliable judgment branch higher.The present application maintains the diversity of the output of new model, maintains the class accuracy of pseudo label, and also can guarantee the position accuracy of pseudo label.
Owner:BEIJING INST OF COMP TECH & APPL

Abnormal defect detection application for performing generation and discrimination task based on diffusion model

The invention provides an abnormal defect detection application for performing generation and discrimination tasks based on a diffusion model. The abnormal defect detection application comprises the following steps: acquiring a standard sample for detection; forward diffusion processing is performed on the standard sample through a diffusion anomaly generation module, disturbance is introduced, an abnormal sample is generated, and a diffusion loss function of the diffusion anomaly generation module is calculated; the difference between the abnormal sample and the standard sample is captured through a diffusion discrimination module, an abnormal area is identified and positioned according to probability distribution, and meanwhile, a difference loss function of the diffusion discrimination module is calculated; the probability distribution of the generated abnormal samples is optimized through a probability optimization module, and an optimization loss function of the probability optimization module is calculated; and a comprehensive loss function is designed, and the diffusion loss function, the difference loss function and the optimization loss function are integrated to balance contributions of the diffusion anomaly generation module, the diffusion discrimination module and the probability optimization module so as to obtain a detection algorithm score. According to the invention, the detection precision of abnormal defects is improved through the diffusion model.
Owner:FUJIAN UNIV OF TECH

Electrical equipment fault early warning method and system driven by mathematical fusion

The invention discloses a mathematical fusion driven power equipment fault early warning method and system, and belongs to the technical field of power equipment operation and maintaining.The method comprises the steps that by extracting fault evolution laws of key state variables such as partial discharge and gas dissolved in oil from historical operation data, an index change mathematical model, a linear change mathematical model and a statistical distribution mathematical model are established respectively; difference processing is carried out on various laws, and the deviation between an actual value and a fitting curve is calculated; carrying out weighted association on the deviation and a model prediction probability, and constructing a comprehensive loss function containing cross entropy loss and a multi-source law loss item; a neural network based on an attention mechanism is adopted, and the comprehensive loss function is introduced in the training process for optimization, so that the model follows a physical evolution path while learning data features; meanwhile, a lightweight edge calculation framework is designed, and efficient reasoning and real-time early warning of the mathematical fusion model on the site of the converter station are achieved.
Owner:CHINA ELECTRIC POWER RESEARCH INSTITUTE CO LTD

An Image Segmentation Method Based on a Neural Network Inspired by a Sparse Optimization Algorithm

The present invention discloses an image segmentation method based on a neural network inspired by a sparse optimization algorithm. First, a mathematical optimization model for the sparse feature image segmentation problem is constructed; secondly, the Proximal Point Algorithm (PPA) is used to solve the mathematical optimization model, and a neural network module, namely the PPA module, is constructed according to the algorithm; then the PPA module is used to build a U-shaped neural network for solving the image segmentation problem using sparse features; then the training set is divided, the loss function is designed, and the neural network training is completed; finally, the input image is used, and the trained neural network is used to complete the image segmentation. The neural network designed under the inspiration of the proximal point algorithm in the present invention not only endows the neural network structure with interpretability in the mathematical sense, but also can improve the segmentation effect while reducing the number of network model parameters when facing the image segmentation task with sparse features, realizing more accurate segmentation.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

A training method and an inference method of a flow matching generation model and related devices

Embodiments of the present application provide a training method and an inference method of a flow matching generation model and related devices, to improve the accuracy of the action sequence predicted by the trained flow matching generation model. The method of the embodiments of the present application comprises: obtaining noise, time t and environment features of a first action, wherein the environment features of the first action at least include observation values of the first action; inputting the noise, time t and environment features into an initialized flow matching generation model to obtain an output predicted velocity field vector of a conditional probability path of time t+1; calculating a loss between the predicted velocity field vector and a real velocity field vector by using a preset loss function, wherein the preset loss function includes at least one of a first loss function and a second loss function, and a third loss function; and training the initialized flow matching generation model by using the loss and a back propagation algorithm until the flow matching generation model converges, to obtain a trained flow matching generation model.
Owner:BEIJING HUMANOID ROBOTICS INNOVATION CENTER CO LTD

World model multi-task learning optimization method based on hybrid expert structure

The invention discloses a world model multi-task learning optimization method based on a hybrid expert structure, and belongs to the field of multi-task learning optimization, and the method comprises the steps: setting an independent expert for each task, and combining a gating layer weighting mechanism, thereby avoiding a seesaw effect caused by hard parameter sharing; the same variance uncertainty modeling is introduced into the loss function, the loss weights of different tasks are dynamically adjusted, and the training stability and the convergence efficiency are improved. The method achieves higher precision in state prediction, return prediction and termination prediction tasks, shortens the training time, and has strong generalization ability and complex environment adaptability.
Owner:BEIJING NORMAL UNIVERSITY

Method, device, storage medium and equipment for quantizing combinatorial optimization problems

The application discloses a quantum solution method and device for a combination optimization problem, a storage medium and computer equipment. The quantum solution method comprises the following steps: mapping a loss function corresponding to a combination optimization problem to be solved into a whole Hamiltonian; decomposing the whole Hamiltonian into a plurality of sub-Hamiltonians, and the sum of the quantum bit numbers of each sub-Hamiltonian being equal to the quantum bit number of the whole Hamiltonian; obtaining eigenvalues and corresponding eigenstates of each sub-Hamiltonian satisfying a preset combination condition based on a variational quantum algorithm, taking the product of the eigenvalues of each sub-Hamiltonian as the eigenvalue of the whole Hamiltonian, and taking the tensor product of the eigenstates of each sub-Hamiltonian as the eigenstate of the whole Hamiltonian. The method converts the measurement of the whole Hamiltonian into the measurement of the plurality of sub-Hamiltonians, so that the optimal solution of the combination optimization problem to be solved is obtained, and a larger-scale problem is calculated and a larger-scale system is simulated by using fewer quantum resources.
Owner:SHENZHEN SPINQ TECHNOLOGY CO LTD

Two-stage dynamic regularization method and system for article recommendation model

The invention provides a two-stage dynamic regularization method and system oriented to an article recommendation model, and belongs to the technical field of article recommendation model optimization. Results obtained on a certain index by a current round of training and a previous round of training are calculated; obtaining a difference between a result obtained on a certain index in the current round of training and a result obtained on the same index in the previous round of training; amplifying the obtained difference according to the amplification coefficient, and normalizing the amplified difference; multiplying the normalized results of a certain index in continuous T rounds, and multiplying the products obtained by all the evaluation indexes in the consideration range; and calculating the difference obtained by subtracting the product of all the evaluation indexes from 1 to obtain a dynamic gating coefficient, and multiplying the dynamic gating coefficient by a cross entropy loss result to obtain the value of a final loss function. According to the method, an index-driven regularization strategy is adopted, the problem of misalignment of an optimization target and an evaluation index is relieved, and the generalization ability of a complex scene is improved; a two-stage self-adaptive gating mechanism is adopted, and the optimization process better fits the training dynamics.
Owner:BEIJING JIAOTONG UNIV