388 results about "Latent vector" patented technology

The present invention provides a system and method for causality-augmented generative intelligence capable of autonomously discovering non-obvious actionable insights from heterogeneous and multimodal data sources. The system integrates a data ingestion unit for semantic and temporal harmonization of structured and unstructured datasets, a causal inference processor for constructing a dynamically evolving directed causal knowledge representation using perturbation-based validation, a latent representation processor that combines multimodal semantic embeddings with causal parameters to generate fused latent vectors, and a generative insight processor utilizing causally constrained generative reasoning to synthesize hypotheses anchored to verified cause-effect dependencies. A validation processor performs counterfactual assessment and observational verification to ensure retention of only those insights that remain consistent with causal ground truth.

The invention discloses a long video role scene decoupling generation method and system based on multi-modal diffusion, and relates to the technical field of image processing, and the method comprises the steps: S1, synthesizing the advanced features of a role and a scene through a SigLIP encoder and a DINOv2 encoder; s2, performing cross-modal feature fusion on the advanced features to obtain joint features, and compressing the joint features to obtain compact vectors; s3, generating text features according to the text prompt; s4, potential codes are generated from an input video through a causal 3D convolution encoder, the potential codes pass through a linear projection matrix and then are spliced with a memory state for dimension reduction, and a segmented potential vector sequence is obtained; s5, performing decoupling perception generation on the segmented potential vector sequence through an improved 3D-UNet, and performing deconvolution up-sampling reconstruction after deterministic sampling to obtain an RGB video segmented sequence; according to the method, the key problems of rough dynamic control, limited generation length and over-high resource consumption in long video generation are solved, and the quality and efficiency of the generated video are remarkably improved.

The invention provides a spatial intelligent three-dimensional modeling method based on a two-dimensional structure design sketch image, and the method comprises the steps: carrying out the preprocessing of an input two-dimensional structure design sketch image, and obtaining a preprocessed design sketch image, extracting two-dimensional structure design features from the preprocessed design sketch image, and encoding the two-dimensional structure design features to generate structured tensor representation; deducing space components, function partitions and constraint logic based on structured tensor representation to construct a sketch semantic graph, nodes of the sketch semantic graph representing physical structure units, and edges of the sketch semantic graph representing connection relations and stress constraints among the physical structure units; determining a node embedding vector corresponding to each node in the sketch semantic graph so as to perform three-dimensional space coding on the node embedding vector to obtain a node potential vector, and generating a geometric reasoning sequence during three-dimensional structure geometric reasoning according to a mechanical logic definition on the basis of edges in the sketch semantic graph, and performing three-dimensional structure geometric reasoning based on the node potential vectors and the geometric reasoning sequence to generate a three-dimensional structure model.

The invention relates to a method for generating an image watermark based on potential space multi-scale feature modulation. The method mainly comprises a watermark residual embedding and extracting method based on potential space multi-scale feature modulation, a watermark intensity regulation and control strategy based on time sequence gating and a robust watermark end-to-end training framework based on potential space. According to the method, watermark information is fused by using a multi-scale structure in a potential space of a diffusion model, meanwhile, a time sequence gating strategy dynamically determines the embedding time step of a watermark by calculating the convergence degree of a potential vector, and the image quality and the watermark robustness are balanced. Sigmoid weighted noise prediction loss is introduced in the model training process, and denoising control over low time steps is enhanced. The method can be widely applied to scenes such as image generation, copyright identification and content traceability, and has good practicability and popularization prospects.

The invention provides a robot motion control model training method, device and equipment based on deep reinforcement learning, a robot and a medium, and relates to the technical field of robots. The method comprises the following steps: acquiring a first potential vector obtained after a student encoder encodes robot body observation data, and a second potential vector obtained after a teacher encoder encodes privilege observation data; based on the current training step number and a preset probability function, calculating a sampling probability for controlling a fusion proportion of the first potential vector and the second potential vector; fusing the first potential vector and the second potential vector based on the sampling probability to generate a third potential vector, and inputting the third potential vector into a strategy network; and updating the parameters of the policy network based on the value estimation of the current state output by the value network and the action policy output by the policy network. According to the method, updating oscillation caused by sudden change of input distribution in the training process of the strategy network can be avoided, the training efficiency is improved, and the training cost is reduced.

The invention provides a face image restoration method based on generative adversarial network inverse mapping, and belongs to the technical field of image restoration and computer vision. According to the method, an encoder-decoder architecture is adopted, an encoder is a ResNet combined with a channel attention mechanism and can encode a to-be-restored face image (containing block-shaped shielding) to a potential space of a StyleGAN, and a W + vector of 18 * 512 dimensions is obtained; and the decoder is a pre-trained StyleGAN generator, and can convert the potential vector into a complete face image to realize restoration. In the training process, through a weighted combination constraint model of L2 loss, perception loss and face identity loss, it is ensured that a restoration result is consistent with an original image in pixel, feature and identity levels. Meanwhile, by means of the decoupling characteristic of the StyleGAN potential space, the repaired face features (such as smile and age) can be edited. According to the method, complex preprocessing is not needed, large-area missing face images can be efficiently repaired, identity consistency is kept, and the method is suitable for monitoring image enhancement, old photo repair and other scenes.

The invention discloses an adversarial texture generation method and system applied to a depth estimation model. The method comprises the following steps: generating an initial adversarial texture pattern based on a potential vector driving pattern generator; performing up-sampling processing on the initial confrontation texture pattern to obtain an up-sampling texture pattern; mapping the up-sampling texture pattern to a specified area of the object model, and performing image rendering on the mapped object model M by using a rendering engine to generate an object image; performing background synthesis on the object image to generate a complete scene attack image; inputting the complete scene attack image into the depth estimation model to obtain the predicted depth of the image at the current view angle; and designing a loss function for optimization based on the predicted depth and the reference depth. According to the scheme, based on the potential vector driven generator, texture mapping and background synthesis processing, the method is not limited to a two-dimensional image task any more, the training efficiency is improved, and the diversity and stability of generated textures are improved.

The invention discloses a confrontation trajectory prediction method, a readable storage medium, electronic equipment and a vehicle, and belongs to the field of automatic driving. The prediction method comprises the following steps: constructing a trajectory prediction model; inputting a historical track, a real track and environment context information; track features are obtained through feature extraction and a space-time attention mechanism; constructing a confrontation model of the explicit space; mapping the track features to a submerged space; disturbance is carried out on the submerged vectors, and the submerged vectors are regularized to specific distribution; and mapping the latent vector to the explicit space, and generating a confrontation trajectory of the target driving vehicle. The readable storage medium stores a program of the method. A program including the method is stored in the electronic equipment. The vehicle comprises the intelligent system for executing the method. According to the method, the explicit space and the implicit space are emphasized for multi-space collaborative optimization, the pertinence and the real concealment of attacks are remarkably improved, the prediction precision is improved, and then the target driving vehicle track can resist surrounding vehicles and cope with complex vehicle conditions.

The invention discloses a depth time sequence prediction method and system based on an event gating mechanism, and belongs to the technical field of artificial intelligence, and the method comprises the steps: obtaining time sequence data and corresponding event sequence data; mapping the time sequence data and the corresponding event sequence data to a low-dimensional potential vector space to obtain a time sequence feature representation and an event sequence feature representation; according to the time step sequence, inputting the time sequence feature representation and the event sequence feature representation into an improved recurrent neural network for processing to obtain a hidden state sequence; performing attention calculation based on the hidden state sequence to obtain final vector representation; and obtaining a prediction result according to the final vector representation. According to the invention, the prediction capability of the time sequence containing the non-periodic event interference can be improved.

A latent transformer architecture with latent attention mechanisms and expert processing systems for federated deep learning is disclosed. The system operates entirely within latent space, eliminating traditional embedding and positional encoding layers while maintaining full attention capabilities. Input data is compressed into latent vectors via variational autoencoder encoding, then processed by a latent attention module that computes query, key, and value matrices directly from latent representations. The architecture incorporates expert processing systems including gated latent expert networks for sparse computation and latent mixture of experts for collaborative processing. In the gated approach, a routing network selectively activates specialized expert modules based on latent vector characteristics. The mixture approach enables all experts to contribute through weighted combination, facilitating distributed computation and enhanced model expressiveness.

A method for training a model for generating a representation of long-term motion from a text input comprises: training a motion encoder of an autoencoder to compress and map an input motion into a latent representation comprising a sequence of latent vectors in a discrete latent space, each latent vector representing a fixed length of motion; training a quantization module to quantize the latent vectors to a sequence of quantized latent vectors in quantized latent space; and training a motion decoder to reconstruct the quantized sequence as a sequence of single-frame pose representations. A text encoder is trained to predict a latent sequence conditioned on a text input and a duration using the mapped latent representation as a target.

Causal discovery is performed using knowledge graph link prediction. Information from a causal network is transformed into a causal knowledge graph according to a mapping, the causal knowledge graph including a plurality of causal links, wherein each causal link includes a cause entity, a causal relation, an effect entity, and a causal weight indicating a relative strength of causal influence of the cause entity on the effect entity. The causal knowledge graph is converted into embeddings, where the embeddings include a latent vector space representation of the causal knowledge graph. The embeddings are trained using a subset of the causal links of the causal knowledge graph. The embeddings are used for causal discovery to predict additional causal links of the causal knowledge graph.

The invention provides a semantic-driven real scene video super-division method and system, and belongs to the technical field of video data. Understanding the obtained low-resolution video, and converting the low-resolution video into a hierarchical semantic representation form; channel self-attention and channel mutual attention are alternately used for the obtained low-resolution video to extract intra-frame features and inter-frame features, fusion is carried out, aligned features are obtained through motion compensation operation, and coarse-grained video restoration is carried out according to the aligned features; adding Gaussian noise to the coarse-grained restored video to obtain an intermediate state of a current diffusion step, converting the intermediate state to a semantic equivalent space, and decoding the potential vector to generate a refined frame; and performing deep convolution fusion on the coarse-grained restored video and the refined frame to generate a final super-resolution reconstruction frame. According to the method, the reconstruction fidelity and reality sense of the video in the complex degraded scene are improved based on hierarchical semantic representation, and the definition and reality sense of texture details in the reconstructed video are enhanced.

The invention relates to the technical field of civil engineering structure calculation and artificial intelligence crossing, in particular to a load displacement curve prediction method for a CFRP reinforced concrete filled steel tubular column, which comprises the following steps: acquiring load displacement curves and corresponding input parameters of the CFRP reinforced concrete filled steel tubular column under different parameter combinations, and constructing a training database; constructing a load displacement curve prediction model by taking a conditional variation auto-encoder as a framework; for the real-time state parameters of the target CFRP reinforced concrete filled steel tubular column, N times of sampling is carried out from prior distribution of a potential space to obtain N potential vectors, and the N potential vectors and the corresponding real-time state parameters are input into a decoder for prediction to obtain a curve cluster; and averaging the curve clusters to obtain a final prediction curve. According to the method, the variational auto-encoder is combined with the deep neural operator, so that a continuous and smooth whole-process load displacement curve can be directly predicted and generated, and the prediction precision and integrity are greatly improved.

A Large Codeword Model (LCM) with a latent transformer core is a deep learning architecture that operates on discrete, compressed representations of data called codewords. The latent transformer core incorporates a Variational Autoencoder (VAE) which allows for the removal of the embedding and positional encoding layers from the Transformer. Input data is compressed into a latent space representation using the VAE encoder, which is then processed by the Transformer. The VAE decoder generates outputs based on the processed latent vectors. This approach enables efficient handling of diverse data types beyond language, including time series, images, and audio.

The invention discloses a neural radiation field three-dimensional reconstruction method and system based on a variational auto-encoder, and the method comprises the steps: constructing a variational auto-encoder, carrying out the feature coding of scene data in a training set, and generating a low-dimensional potential vector representing the global information of a scene; carrying out high-dimensional coding on the three-dimensional space coordinates and view angle direction information of the sampling points, and splicing a high-dimensional coding result with the low-dimensional potential vector to form an enhanced input vector; constructing an adaptive sampling algorithm, and adjusting a sampling strategy of a neural radiation field based on importance distribution of a scene region to realize high-precision sampling of a key region; constructing a neural radiation field optimization model fusing a variational auto-encoder and adaptive sampling, training the neural radiation field optimization model by using the enhanced input vector, and realizing three-dimensional reconstruction of a target scene through optimized neural radiation field parameters; according to the method, the calculation cost can be reduced, the sampling efficiency is improved, and the reconstruction integrity under sparse data is enhanced.

The invention discloses a face privacy protection-oriented generated image detection method and a face privacy protection-oriented generated image detection system. The method comprises the following steps of: firstly, preparing face and text pairing data, and finely adjusting a diffusion model; secondly, on the basis of the diffusion model after fine tuning, potential vectors are extracted and clustered, and text prompts and center vectors obtained through clustering form a dictionary; and finally, based on the obtained dictionary, obtaining a pseudo image and a label through the fine-tuned diffusion model, and outputting a detection result through a classifier. According to the method, potential spatial clustering and conditional diffusion generation are combined, privacy protection and data diversity are taken into consideration, and the security and generalization ability of forged face image detection are remarkably improved.

The invention relates to the technical field of diffusion model AI application, and discloses an AI aided design workflow method and system based on a diffusion model, and the method comprises the steps: receiving multi-modal data; vectorizing the sketch, and extracting key set features; analyzing the text into structured semantics; parameter constraints are converted into mathematical expressions or boundary conditions; mapping the multi-modal data to a unified space; selecting a generation path with the minimum loss function from the candidate paths; gaussian noise is gradually added into the submerged space, and noise distribution is predicted; injecting the parameter constraint into a denoising process to generate a path; and the optimized latent vector is converted into a vector graph through a decoder, and a geometric topological relation is reserved. The system comprises a unified multi-modal data module, a path generation module and a user interaction module. According to the method, the actual availability of a design result is improved; the design period is shortened, the process is simplified, and human resource investment is reduced.

The invention provides a sensor data recovery method and system based on mask perception space-time modeling, and belongs to the technical field of Internet of Things and intelligent sensing data processing. The method comprises the following steps: modeling a missing position into a trainable potential vector representation through an adaptive missing representation module, and avoiding noise introduced by traditional zero filling or mean filling; a missing perception space-time decoding module is adopted, and a dynamic weight distribution mechanism of mask constraint is combined in the decoding process, so that information is effectively prevented from being excessively smooth; designing a space-time dual-channel feature aggregation unit, and capturing spatial dependence and time sequence dependence between the sensors at the same time; and finally realizing accurate completion of a large-scale space-time sensor matrix through an output recovery unit. According to the method, the accuracy and robustness of sensor data restoration can be remarkably improved, the reliability of subsequent monitoring, prediction and anomaly detection is enhanced, and the method has wide engineering application value.

The invention relates to a steel wire rope surface defect image generation method and device. The method comprises the following steps: loading a non-missing reference image to a basic feature extraction network, extracting through the basic feature extraction network to obtain a non-missing reference implicit vector, and loading the extracted non-missing reference implicit vector to a fusion decoding network; loading the defect feature text and the defect reference image to a defect feature generation network, generating a text-guided defect implicit vector through the defect feature generation network, and loading the generated text-guided defect implicit vector to a fusion decoding network; and performing fusion decoding processing on the non-missing reference implicit vector and the text-guided defect implicit vector by using a fusion decoding network so as to generate a steel wire rope target defect image after fusion decoding processing. The method can achieve the generation of high-quality steel wire rope surface defect images, and improves the generation efficiency and reliability of the steel wire rope surface defect images.

An object detection device may include a variational autoencoder (VAE) configured to encode image data to generate a latent vector, and decode the latent vector to generate new image data. The object detection device may also include a quantum computing circuit configured to perform quantum subset summing, and a processor. The processor may be configured to generate a game theory reward matrix for a plurality of different deep learning models, cooperate with the quantum computing circuit to perform quantum subset summing of the game theory reward matrix, select a deep learning model from the plurality thereof based upon the quantum subset summing of the game theory reward matrix, and process the new image data using the selected deep learning model for object detection.

The invention discloses a crystal material generation method and system based on an energy band condition and a space group symmetry constraint. The method comprises the following steps: obtaining crystal structure data; calculating energy band data corresponding to the crystal structure, performing standardization processing on the energy band data, and generating a training data set together with the crystal structure data; performing feature compression on the energy band data, and generating an energy band condition implicit vector by using an encoder; constructing a conditional autoregression generation model, and training an autoregression model by using the training data set to obtain a trained model; jointly inputting an embedded vector of a space group number and an energy band condition implicit vector into the trained model, generating an atom type, an atom fraction coordinate and a lattice parameter according to a Wyckoff alphabetic sequence, and generating a crystal material structure; and through position selection of Wyckoff letters in a symmetric mask constraint generation process, a lattice parameter consistency loss function optimization model is utilized, so that a predicted energy band of a crystal material structure is matched with a target energy band.

Neural coding techniques may be implemented for transmission of redundant audio data. An encoding technique is implemented that uses forward encoding along with an initial state to include multiple audio frames from audio data represented as latent vectors in a network packet transmitted to a recipient. The recipient can then use backward decoding and the initial state to obtain the multiple audio frames from the latent vectors. The multiple audio frames provided in the network packet are redundant audio data that can be used to generate missing audio data.

The invention discloses a digital human expression generation method based on multi-modal feature fusion and emotion enhancement, and belongs to the technical field of generative artificial intelligence. Comprising the steps of extracting voice semantic features and voice emotion features based on driving voice, extracting text emotion features based on an emotion text, and extracting visual latent variables and image semantic features based on a reference image; fusing the voice emotion features and the text emotion features through a perception resampling mechanism to generate fused emotion control features; fusing emotion control features, voice semantic features, visual latent variables and image semantic features as conditions, inputting the conditions into a DiT video generation model, generating a denoised video potential vector, mapping the denoised video potential vector into a facial expression potential vector by a Transform adapter, and restoring the facial expression potential vector into a facial expression parameter sequence by a FaceVese decoder to drive a digital human. According to the invention, end-to-end generation from voice and text to high-fidelity and emotion-controllable facial expression parameters can be realized.

The present application relates to an image generation method and apparatus based on a Brownian bridge diffusion model, a device and a medium, wherein the method includes: receiving an image combination including a satellite image and a ground panoramic image; extracting shared features of the satellite image and the ground panoramic image; performing a polar coordinate transformation on the satellite image to obtain an initial latent vector of the satellite image and a latent vector of the ground panoramic image; gradually adding noise into the latent vector of the ground panoramic image to obtain a latent vector of the satellite image; gradually removing the noise in the latent vector of the satellite image to generate a target latent vector; and decoding the target latent vector to generate a target ground panoramic image. The efficiency and quality of conversion from the satellite image to the ground panoramic image are improved.

The embodiment of the invention provides a CSI (Channel State Information) feedback method based on Transform and entropy constraint vector quantization. The method is applied to the technical field of wireless communication. The method comprises the following steps: receiving an input angle-time delay domain channel matrix, and performing feature extraction on the channel matrix through a convolutional layer to obtain a first feature tensor; the first feature tensor is input into a trained Transform encoder for analysis processing, and a latent vector is obtained; performing quantization processing on the latent vector through the trained vector quantization variational auto-encoder to obtain discretization representation of the latent vector; performing dequantization processing on the discretized representation of the latent vector to obtain a dequantized latent vector; performing feature extraction on the dequantized latent vector through a convolutional layer to generate an initial channel feature; the initial channel characteristics are input into a trained Transform decoder for analysis processing, and final channel characteristics are obtained; and the final channel feature is mapped to the target resolution to obtain a reconstructed channel matrix, so that the reconstruction precision of the channel matrix is improved.

The invention discloses a digital human action stylized generation method based on text driving, and belongs to the technical field of digital human action generation. The method comprises the following steps: extracting a 3D human body action parameter sequence from a target person video; performing automatic verification and physical optimization on the sequence to obtain a pure data set; extracting quantized style features and encoding the quantized style features into low-dimensional style latent vectors; encoding a natural language instruction into a text semantic vector, and fusing the text semantic vector with the style latent vector to generate a control signal; a diffusion model is driven by the control signal to generate an action parameter sequence conforming to instruction semantics and personalized styles; and finally mapping to a digital human model and rendering and outputting an animation video. According to the method, deep fusion of the text instruction and the personalized exercise style is realized, the problems of single style, unreasonable physics and the like of the generated action are solved through a systematic physical compliance guarantee system, and the sense of reality and expressive force of the digital human action are remarkably improved.

The present disclosure performs image in-painting with controlled text generations to overcome the challenges persisting in traditional diffusion-based methods, especially when it comes to generating textual content within the image with complex font attributes. In the present disclosure, initially, an input image and a textual prompt and a plurality of control parameters are given as input to the present disclosure. Further, character mask and conditional mask are extracted based on the inputs. Finally accurate customized textual images are generated based on the character mask and the conditional mask using a textual image generating diffusion model. The textual image generating diffusion model generates an intermediate image based on the input image and the random gaussian noise. This intermediate image is iteratively refined to generate a latent vector image, and the accurate customized textual image is generated from the latent vector image using a trained customized character map-guided consistency model.

A technique for generating a sequence of geometries includes converting, via an encoder neural network, one or more input geometries corresponding to one or more frames within an animation into one or more latent vectors. The technique also includes generating the sequence of geometries corresponding to a sequence of frames within the animation based on the one or more latent vectors. The technique further includes causing output related to the animation to be generated based on the sequence of geometries.

The invention discloses a news standard term detection and correction method based on a large language model, which is characterized in that a generator-detector cooperative training architecture is adopted, a Qwen2.5-7B-Instruct model is used as a generator, a detector module is assisted to finely screen implicit vectors, the generator is guided to avoid excessive sensitivity and false change, and the accuracy of the news standard term detection and correction is improved. And the problem of news expression deformity caused by improper use of words, nonstandard language expression and noun errors in the news manuscript is effectively solved. Compared with the prior art, the method has the advantage that the problem of news expression deformity caused by improper use of words, nonstandard language expression and political noun errors in news manuscripts is solved. Experimental results show that the method obtains an ideal F0.5 index on the news term correction task, and shows that the large language model has a wide application prospect in the fields of text quality control and intelligent editing.