156 results about "Image translation" patented technology

The invention relates to a multi-modal implicit sentiment analysis method based on a multi-granularity attention mechanism, which belongs to the field of artificial intelligence, and comprises the following steps: S1, extracting visual features in image information by using a visual feature extraction strategy of multi-scale attention fusion; s2, generating a text description of the image information by adopting an image translation engine, splicing the text description with an original text, and extracting text features through a hierarchical attention mechanism; s3, carrying out normalization processing; s4, performing multi-modal fine-grained correlation fusion on the visual features and the text features by adopting a bidirectional cross attention mechanism, and extracting fine-grained features in the visual features and the text features through a multi-head attention mechanism and residual connection; and S5, fusing the fine-grained features by using an adaptive multi-modal classification module to complete sentiment classification. The multi-modal sentiment analysis method solves the problems that multi-modal sentiment analysis is insufficient in inter-modal correlation mining, insufficient in fine-grained information capture and large in noise interference.

Disclosed is a method for training a diffusion model for image-to-image translation, which is performed by a computing device. The method may include: obtaining an image of a target domain; sampling random noise from a distribution of a source domain; and training a diffusion model that translates an image of the source domain to the image of the target domain based on the sampled noise.

The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various examples for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claims require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed example. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.

The invention discloses an antenna structure parameter optimization method based on image translation, and the method comprises the following steps: S1, selecting a to-be-optimized structure parameter according to a basic structure of a target antenna, and determining a target electromagnetic response performance parameter; s2, performing sample generation on the selected structure parameter vector through an LHS algorithm to obtain electromagnetic response data corresponding to the structure parameter; s3, performing image data conversion on the structure parameters and the electromagnetic response data to form a data set, and training an image translation network through the data set; s4, performing image translation on the target electromagnetic response image by using the trained image translation network to obtain a corresponding structure parameter image; and S5, performing parameter extraction on the structure parameter image to obtain structure parameters of the target antenna, and completing antenna design. The method solves the problems that in the prior art, the requirement for priori knowledge of engineers is high, calculation cost and time cost are high, accuracy is insufficient, and generalization of different antenna design tasks is poor.

The invention provides a controllable text image generation method based on attention modulation and text replication. According to the method, the semantic consistency high-definition image with the specific layout can be generated according to the text description. Specifically, in the first stage, image layout information is generated according to input text content through visual concept understanding and layout arrangement capability of a large language model. In the second stage, an attention map in the diffusion process is adjusted in a self-adaptive mode through an attention modulation mechanism based on layout, and it is ensured that the object is generated in the given layout. And a third stage, regenerating the text by using the image translation model, designing a semantic regeneration supervision strategy to restrain semantic alignment of the regenerated text and the input text, and indirectly correcting an error generation region. A large number of experimental data and qualitative results show that the method is excellent in performance on the task of generating the image through the text, meanwhile, the operation complexity is remarkably reduced through a training-free mode, a user does not need to give specific layout information, and the method is convenient for the user to use.

The invention relates to an ultra-short-term photovoltaic power prediction method and device based on random skyline video prediction, and a medium. The method comprises the following steps: S1, extracting color cloud picture feature points from a foundation cloud picture sequence; s2, carrying out feature matching by adopting an FLANN algorithm, carrying out filtering correction by adopting an IRANSAC algorithm, and calculating a feature point coordinate transformation matrix according to a cloud picture feature point coordinate matching condition of adjacent time points to obtain a cloud cluster movement track; s3, if the cloud layer displacement speed is greater than a set threshold value, turning to S4, otherwise, performing image translation operation and then turning to S5; s4, adopting a SkyGPT model to carry out random skyline video prediction, and generating a skyline image sequence of a future set time period; s5, extracting the cloud cluster by adopting a threshold segmentation method, and constructing an irradiation coefficient representing the irradiance condition at the next moment; and S6, constructing an incidence matrix of the image and the irradiation coefficient, extracting irradiance, and fusing image features and irradiance features to obtain a photovoltaic power prediction result. Compared with the prior art, the method has the advantages of high prediction precision, high reliability and the like.

The invention discloses a tomato seedling detecting and counting method based on multi-scale feature fusion, and aims to provide an efficient and accurate solution for detecting and counting tomato seedlings in a seedling raising plate. In the aspect of data preprocessing, image feature information is enhanced by adopting image translation, overturning, cutting and CLAHE methods, and the quality and diversity of images are improved. In the model training module, an ASF-P2 feature fusion neck network performs multi-scale feature extraction, a RepVGGBlock feature extraction module enhances the feature extraction capability through multi-path convolution and jump connection, and a ContextGuideFusion Module module guides feature fusion and channel dimension dynamic adjustment weight through context, so that the attention of the model to key features is further improved, and the feature extraction capability of the model is improved. And the interference of irrelevant background information is reduced. According to the method, by optimizing multi-scale information fusion, the precision and robustness of seedling detection are improved, the problems of low efficiency, high cost and high error rate in manual counting are solved, and the detection accuracy under the condition that seedlings are highly crossed and overlapped is improved. The model can accurately detect and count tomato seedlings in a seedling raising tray, has a hole positioning function, and supports intelligentization and automation of seedling management.

The invention discloses a quality self-adaptive image cross-domain mapping method. The method comprises the following steps: 1, carrying out quality self-adaptive image cross-domain mapping; the method comprises the following steps of: 1, acquiring data of a target domain image s and a source domain image c, and preprocessing; 2, designing a generative adversarial network model, and inserting a quality adaptive convolution module into a GLD generator network by the adversarial network model on the basis of a network structure of an unsupervised image translation model; 3, inputting the target domain image s and the source domain image c preprocessed in the step 1 into the generative adversarial network model in the step 2 for training; and step 4, mapping from a source domain image to a target domain image by using the generative adversarial network model trained in the step 3. After an unsupervised image translation model is modified, an image translation result better than that of an original model is achieved.

The invention provides an aircraft thin-wall component positioning rigidity characterization method based on a generative model, and relates to the field of aircraft equipment intelligent manufacturing, and the method comprises the steps: generating a process characteristic graph corresponding to a rigidity field through constructing a three-dimensional digital model and actual process parameters; acquiring a data set for model training; constructing a generative model based on an image translation mechanism and a conditional generative adversarial network; fine training is carried out on the model by inputting brand new data of'unseen 'of the network; the complete refined training model can adapt to various components, so that the time cost of rigidity field simulation is effectively reduced. According to the method, an effective solution is provided based on the process design of the stiffness field, digital twinning, augmented reality visualization and the like.

The invention discloses a migration method and device from simulation to a real image for an unmanned system, and the method comprises the steps: constructing a double-flow architecture comprising a convolution encoder and a visual Mama encoder, wherein the convolution encoder is used for extracting the local texture information of an image, and the visual Mama encoder employs a visual state space model to capture the global context information of the image; and the two features are input into a decoder after channel dimension fusion, and a real style image after style migration is generated. In order to improve the unsupervised learning ability of the model, a cyclic consistency training framework is introduced, training can be completed under the condition of no paired image samples, and the image structure consistency is kept. According to the method, the sense of reality and the structural fidelity of a simulation image are effectively improved, and compared with an existing method, the method shows lower distortion and higher generalization ability in an image translation task. The method can be widely applied to simulation data field adaptation and training sample enhancement tasks in the fields of automatic driving, virtual simulation, robot vision and the like.

Disclosed herein are methods and systems to translate text on images shared between participants online to the preferred language of the viewer. The system determines the material shared between participants. The system then uses optical character recognition (OCR) to determine which portion of the shared image is text. The system translates the text into the preferred language of the viewer and overlays the translated text onto the image. The system monitors the shared screen to determine a revision in the image. When a revision is detected, the system finds and translates the text to the preferred language of the viewer.

The invention discloses a robot motion control system and control method based on machine vision, relates to the technical field of machine vision, and provides effective data input for an error calculation and correction module by extracting a local feature point set Fp during operation of the system. And the error calculation and correction module calculates an image translation error Et and a rotation error Er based on the feature point set Fp, obtains a translation vector T and a rotation error R by correcting the image position, generates a complete panoramic image P, and provides reliable visual information support for subsequent target positioning and path planning. The motion control and target positioning module is combined with a panoramic image P and a positioning algorithm, so that the target positioning precision is improved, the path planning is optimized, the problems of image dislocation, positioning errors and path instability in a traditional method are solved, and the adaptive capacity and task execution efficiency of the robot in a dynamic environment are greatly improved.

The invention discloses a grayscale image translation motion blur recovery method and system based on optical flow guidance, and belongs to the technical field of image processing. A target area is determined based on a video stream H; calculating a translational motion vector field matrix between every two adjacent frames in the video stream H by adopting an optical flow method, obtaining a translational motion vector located in a target area, further constructing a track representation matrix for reflecting a motion track of a motion target generating translational motion, normalizing the track representation matrix to serve as a blurring kernel, and obtaining a motion vector field matrix; and translational motion blur of the target area is removed in a targeted manner. According to the method, the high-density time sampling information provided by the video stream H with the high frame rate and the low signal-to-noise ratio is utilized, and the complex translational motion track of the blurred image B with the low frame rate and the high signal-to-noise ratio in the exposure period can be accurately captured. The fuzzy kernel synthesized based on the accurate translational motion trails can highly approach a real physical fuzzy process, and an image with a high signal-to-noise ratio and high definition can be reconstructed.

The invention discloses a multi-modal fusion image translation method and system based on large language model prior, and the method comprises the steps: obtaining a registered infrared-visible light fusion image and a corresponding semantic mask and text description, and carrying out the data preprocessing, and obtaining a fusion image feature, semantic mask visual feature and text semantic feature sequence; constructing a multi-modal fusion image modal translation model based on the text-visual state space block and the three-dimensional selective scanning block; and performing image translation processing on the fused image features, the semantic mask visual features and the text semantic feature sequence based on a multi-modal fused image modal translation model to obtain a translated target image with visible light distribution characteristics. According to the method, the long-term dependency relationship can be captured through interaction among the text, the mask and the image, and the precision of multi-modal fusion image translation is improved. The multi-modal fusion image translation method and system based on large language model prior can be widely applied to the technical field of image processing.

The invention discloses a multi-modal remote sensing image matching method based on modal transformation and comparative learning. The method comprises the following steps: S1, constructing a training data set; s2, constructing a generation path of an image continuous domain; s3, designing a shortest path constraint; s4, defining the total loss of image conversion; s5, extracting rotation invariance feature expression of comparative learning; and S6, establishing a feature matching framework, and outputting a matching result. According to the method, potential sharing features are mined, the generation process of image translation is converted into a step-by-step generation mode based on a network path, the shortest path constraint is realized by constructing an intermediate domain, and the significant nonlinear radiation difference and noise between a reference image and an image to be registered are effectively eliminated; and meanwhile, by utilizing an EfficientNet architecture optimized by an expansion convolution and an attention mechanism, the representation quality of deep features is remarkably improved, and a training system of sample augmentation is designed in combination with twinning and pseudo-twinning networks to obtain better rotation consistency feature expression, so that the matching robustness of a descriptor to a weak texture region is effectively enhanced.

The invention relates to an aerospace target radar image data generation method based on low illumination enhancement correction. The method comprises the following steps: designing a content delivery decomposition network, decomposing low light characteristics into illumination-independent reflection components and adaptive illumination components through Hadamard product constraint in a submerged space, proposing a learnable intensity compression function, and dynamically generating a submerged space mask through gradient consistency constraint and sparse regularization; embedding a mask into a reverse denoising process to realize directional repair of a degraded region, and combining the generation capability of a diffusion model with the guidance of physical prior; a diffusion path is reconstructed based on a bidirectional diffusion principle, physical consistency of a generation process is constrained through end point binding, a diffusion step length is adaptively adjusted, a cyclic implicit iteration mechanism is introduced, a generation result is gradually refined through a cyclic neural network module, and accurate optical-ISAR image translation can be realized.

The present invention discloses a semantic segmentation method for cross-satellite remote sensing images based on unsupervised bidirectional domain adaptation and fusion. The method includes training of bidirectional source-target domain image translation models, selection of bidirectional generators in the image translation models, bidirectional translation of source-target domain images, training of source and target domain semantic segmentation models, and generation and fusion of source and target domain segmentation probabilities. According to the present invention, by utilizing source-target and target-source bidirectional domain adaptation, the source and target domain segmentation probabilities are fused, which improves the accuracy and robustness of a semantic segmentation model for the cross-satellite remote sensing images; and further, through the bidirectional semantic consistency loss and the selection of the parameters of the generators, the influence due to the instability problem of the generators in the bidirectional image translation models is avoided.

The invention provides a medical image registration method and system based on image-to-image translation, and belongs to the technical field of medical image registration, and the method comprises the steps: obtaining a linear X-ray image, processing the linear X-ray image, and inputting the processed linear X-ray image to an image-to-image translation module to obtain a simulation DRR image; inputting the obtained linear X-ray image into a pose initialization module to obtain an initialized pose; setting the obtained initialized pose as a global variable, inputting the global variable into an optimizer, down-sampling a simulation DRR image and a standard DRR image to a certain scale, calculating the image similarity between the images, inputting the image similarity into the optimizer, continuously updating the pose output by the optimizer, and carrying out optimization of different scales to obtain a final pose. And calculating a target registration error based on the final pose.

The invention provides an image enhancement method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a to-be-processed source domain image and a to-be-processed noise image, extracting the edge information of the source domain image, inputting the edge information and the noise image into a preset image enhancement diffusion model, and obtaining an enhanced target domain image, according to the method, conversion from the source domain image to the target domain image is achieved, the target domain image is generated by guiding the image enhancement diffusion model through the edge information, details of the source domain image can be reserved, the fidelity and the structural similarity of the enhanced image are greatly improved, and compared with an existing image translation method, the enhanced image with higher quality can be generated.

The invention discloses a discrete feature mapping-based SAR image-to-optical image translation method and device, and the method comprises the steps: obtaining an SAR image and a corresponding real optical image, and constructing a training set and a test set; constructing and training a compression-reconstruction device; constructing and training a cross-modal feature mapper; and based on the compression-reconstruction device and the cross-modal feature mapper, translating the SAR image to be translated to obtain an optical image. According to the method, cross-modal translation from an SAR image to an optical image is realized based on a feature mapping method of pixel-feature conversion and frequency-attention fusion. The method aims at improving the processing and conversion precision of image data and is suitable for multi-source fusion and application of remote sensing image data.

A system debiases image translation models to produce generated images that contain minority attributes. A balanced batch for a minority attribute is created by over-sampling images having the minority attribute from an image dataset. An image translation model is trained using images from the balanced batch by applying supervised contrastive loss to output of an encoder of the image translation model and an auxiliary classifier loss based on predicted attributes in images generated by a decoder of the image translation model. Once trained, the image translation model is used to generate images with the minority image when given an input image having the minority attribute.

The invention discloses a sketch progressive image translation method and system based on a conditional diffusion model, and the method comprises the steps: inputting a to-be-processed sketch into a grayscale image generation model, and obtaining a sketch grayscale image, the grayscale image generation model comprising a potential space unit and a conditional diffusion noise unit; respectively carrying out feature extraction on the sketch to be processed and the sketch gray-scale image to obtain a sketch vector and a gray-scale image vector; performing feature fusion on the sketch vector and the grayscale image vector to obtain image fusion feature information; image translation is carried out through a conditional diffusion model according to the image fusion feature information and the sketch grayscale image, a real sketch image is obtained, and the conditional diffusion model comprises a forward diffusion unit and a reverse diffusion unit. According to the method, sketch features and the generated grey-scale map are combined and then added into the translation process from the grey-scale map to the real image, so that accurate understanding of the overall structure and local features of the sketch can be excellently kept, and the image translation quality is improved.

The present disclosure provides a visual stereoscopic enhancement method, device, equipment and storage medium, relates to the technical field of image processing, in particular to the technical field of image mask, image translation, image fusion and the like, and can be applied to the scenes of portrait visual stereoscopic enhancement, virtual digital person, image or video space sense enhancement and the like. The specific implementation scheme comprises the following steps: according to the configured light direction and light angle, a mask is translated by a target distance in a first mask image corresponding to a target object in a target image to obtain a second mask image; after the first mask image and the second mask image are subtracted pixel by pixel, the regions with a translation increment less than 0 and greater than 1 are discarded to obtain a shadow image; after the shadow image and the first mask image are added pixel by pixel, the target image is multiplied pixel by pixel to obtain an image after stereoscopic enhancement of the target object. The present disclosure can simply and quickly realize visual stereoscopic enhancement and improve visual stereoscopic sense.

An adaptable deep learning method is provided that delivers sound hepatic lesion identification in NETs, while significantly reducing human effort for data annotation and improving model generalizability for PET image quantification. A region-guided GAN (RGGAN) model conducts image-to-image translation between list-mode simulated PET images and real-world clinical data, while preserving semantic content of interest, e.g., lesions. The RG-GAN model is integrated with a lesion detection model into an end-to-end, unified framework for joint-task learning, such that the two models can benefit from each other. The RG-GAN translates the list-mode simulated data into real world-style images, which appear to be drawn from the real clinical PET image dataset, and feeds the translated images into the lesion detection model for training. In order to deal with the limited diversity of list mode-simulated PET image data, a specific data augmentation module is incorporated into the unified framework to improve model training.

The invention discloses an image translation-based inclined view angle rotator vibration displacement measurement method. The method comprises the following steps of: performing cutting operation on an acquired rotator vibration image under a standard view angle and an acquired rotator vibration image under L random view angles; randomly extracting a preset number of random view angle cutting images and standard view angle cutting images of matched frames from the L random view angles, and taking the standard view angle cutting images as labels of the random view angle cutting images to construct a data set; training and verifying the image translation model through the training set and the verification set to obtain a trained image translation model; selecting one of the obtained rotating body vibration images of the preset time length under the L random view angles, inputting the selected rotating body vibration images into a trained image translation model, and obtaining a standard view angle image of a frame number corresponding to the preset time length; carrying out image splicing operation according to the standard view angle images with the frame number corresponding to the preset duration to obtain a spliced image; and performing edge detection on the spliced image, extracting an edge contour of the rotating body, obtaining sub-pixel-level displacement data, and converting the sub-pixel-level displacement data into a displacement value under a world coordinate system. According to the invention, the vibration displacement of the rotor can be effectively and accurately extracted from a plurality of shooting angles, and a more reliable and accurate scheme is provided for the measurement of the vibration displacement of the rotating body.

Described herein are methods and systems for training image to image translation machine-learning models, wherein the image to image translation machine-learning models are trained using unpaired images. The trained image to image translation machine-learning models can be used to digitally identify markers of a fluorescent image depicting a plurality of markers in a single color channel from a single fluorophore and / or enhance a fluorescence image.

The application discloses a sketch progressive image translation method and system based on a conditional diffusion model, and the method comprises the following steps: inputting a to-be-processed sketch into a grayscale image generation model to obtain a sketch grayscale image, wherein the grayscale image generation model comprises a latent space unit and a conditional diffusion noise unit; performing feature extraction on the to-be-processed sketch and the sketch grayscale image respectively to obtain a sketch vector and a grayscale image vector; performing feature fusion on the sketch vector and the grayscale image vector to obtain image fusion feature information; and performing image translation on the image fusion feature information and the sketch grayscale image through a conditional diffusion model to obtain a sketch real image, wherein the conditional diffusion model comprises a forward diffusion unit and a reverse diffusion unit. The sketch feature is combined with the generated grayscale image, and then is added to the translation process from the grayscale image to the real image, so that the accurate understanding of the overall structure and the local feature of the sketch can be excellently maintained, and the quality of the image translation is improved.

A computer-implemented method of training a generator for transforming a given image according to a given target foreground domain is disclosed. A generator, discriminator, Mapping network, and a Style-Content encoder are trained. Furthermore, a method of image to image translation according to a given target foreground domain by the trained generator is provided. The generator may be trained to generate images depicting defects.

The application discloses a privacy protection heterogeneous federated learning method and system based on image translation, which are corresponding solutions, in the solutions: a generated model with local user data semantic retention capability is optimized through an image translation server, a local user performs data enhancement on a local heterogeneous data set by using the generated model, so that the local data presents a state of uniform distribution of class labels, and a classification model of the local user is trained by using transformed data and enhanced data, so that the global model accuracy and the privacy protection capability are balanced. Moreover, there is no interaction between the image translation server and the data classification server, and the image translation server is in a trusted computing environment, so that the privacy protection capability is ensured.