Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

706 results about "Image domain" patented technology

Image domain is the domain in which the arrangement and relationship among different gray level intensities (pixels) are expressed.

Multi-modal image-text tampering detection and positioning method based on feature enhancement

The invention relates to a feature enhancement-based multi-modal image-text tampering detection and positioning method, which comprises the following steps of: obtaining a tampered image-text pair, respectively preprocessing an input image and an input text, and constructing a data set; constructing a multi-modal image-text tampering model, wherein the multi-modal image-text tampering model comprises a text encoder, an image encoder, an image frequency domain enhancement module, a text enhancement module, a multi-cross attention fusion module and a multi-task tampering detection and positioning head; the image frequency domain enhancement module is used for selecting an optimal frequency band and sending the optimal frequency band out of the module; performing feature fusion on the frequency domain feature output by the image frequency domain enhancement module and the image domain feature output by the image encoder to obtain an image enhancement feature; fusing the aligned image enhancement features and text enhancement features by using a multi-cross attention fusion module; and training a multi-modal image-text tampering model by using the data set, and detecting and positioning multi-modal image-text tampering. According to the invention, the feature extraction capability of the network is enhanced, and the tampering detection and positioning capability is improved.
Owner:HEBEI UNIV OF TECH

Deep forgery detection method based on visual language model

The invention discloses a deep forgery detection method based on a visual language model, and relates to the field of image forensics. The deep forgery detection method based on the visual language model aims to combine multi-source information to improve the discrimination capability of the model on a real image and a generated image. The method comprises the following steps: firstly, extracting image features through an image encoder of a pre-trained CLIP model; meanwhile, a frequency domain enhanced counterfeit perception adapter is embedded in the image encoder to mine potential anomalies of counterfeit images in the image domain and the frequency domain. Secondly, a manual feature extraction module is provided, discriminative low-dimensional features are extracted from the four aspects of the edge, the texture, the frequency and the symmetry of the image, and the discriminative low-dimensional features are used as auxiliary information input in the forgery detection process, so that the robustness and the interpretability of the model are improved; meanwhile, the text cue words are converted into feature vectors through a text encoder of a pre-training CLIP model; and finally, the model predicts a forgery score by calculating the cosine similarity between the image features and the text features so as to realize the discrimination of the authenticity of the image. According to the method, the problem that the detection capability of the model on the cross-dataset is insufficient is effectively improved.
Owner:GUILIN UNIV OF ELECTRONIC TECH

Underwater image enhancement method based on wavelet Mama

The invention relates to an underwater image enhancement method based on wavelet Mama, which aims at the problems of color shift, low contrast ratio and fuzzy details of an underwater image, extracts shallow layer features of an underwater low-quality image, inputs the shallow layer features into a multi-scale coding network, and performs joint enhancement on low-frequency color information and high-frequency detail features by using a wavelet Mama unit. Global semantic features are obtained by combining down-sampling layer-by-layer compression, and global modeling of color offset correction and contrast enhancement is completed; the spatial resolution is recovered through up-sampling, and reconstruction and enhancement of texture details and color information are realized in combination with jump connection and a wavelet Mama unit; and finally, the features are mapped to an image domain and fused with input image residual errors, and an enhanced underwater image with natural color, clear texture and balanced contrast is generated. According to the method, frequency domain-space domain joint feature modeling is realized through the wavelet Mama unit, and the color authenticity, the structural definition and the detail perceptibility of the underwater image are remarkably improved.
Owner:NAVAL AVIATION UNIV

Clustering-based multi-prototype SAR image out-of-domain data post-detection method and device

The invention relates to a clustering-based multi-prototype SAR image out-of-domain data post-detection method and device, and the method comprises the steps: carrying out the feature extraction of all SAR sample images in a training data set through a feature extraction part of a pre-trained classification neural network, obtaining a feature data set, and carrying out the detection of the out-of-domain data of a multi-prototype SAR image according to a preset prototype number, performing hierarchical clustering based on the feature data set to obtain a plurality of clusters, taking the cluster center of each cluster as a feature prototype, and performing feature extraction on the SAR image to be subjected to target classification by using a feature extraction part of a pre-trained classification neural network to obtain target features, and judging according to the distance between the feature vector of the target feature and each feature prototype to obtain a detection result that the SAR image is out-of-domain data or in-domain data. By adopting the method, the out-of-domain data can be accurately and quickly detected, so that the reliability of the classification model in practical application is improved.
Owner:NAT UNIV OF DEFENSE TECH

Concrete crack intelligent identification and analysis platform based on image and point cloud fusion

The invention relates to the technical field of constructional engineering, and discloses a concrete crack intelligent identification and analysis platform based on image and point cloud fusion, the platform operates a concrete crack intelligent identification and analysis method, and the method comprises the following steps: S1, synchronously collecting image data and point cloud data of a concrete structure in the same scene; s2, establishing a unified world coordinate system and generating a depth map corresponding to the image; s3, generating image domain crack candidates; s4, generating a depth domain crack candidate; s5, performing weighted fusion on the image domain crack candidate and the depth domain crack candidate to generate a fusion crack response; s6, extracting a crack skeleton; s7, obtaining a crack three-dimensional model; and S8, selecting an optimal view angle to trigger re-acquisition of the crack area. Through a closed-loop feedback mechanism, an optimal view angle is selected for re-acquisition by calculating a comprehensive utility value after preliminary acquisition, so that information insufficiency caused by illumination, angle or sparse data is effectively made up.
Owner:赵立财

Remote sensing image domain generalization semantic segmentation method based on multi-scale instance decoupling

The invention relates to a remote sensing image domain generalization semantic segmentation method based on multi-scale instance decoupling, which relates to the technical field of remote sensing image interpretation and comprises the steps of multi-scale instance coding, domain invariant instance decoupling and domain generalization semantic decoding. Image features in a segmented backbone network are used as input, and a multi-scale instance coding module effectively senses feature responses of cross-domain instances through deep convolution, multi-scale cooperation and multi-path sensing and is not affected by scale differences, spatial deformation and noise; designing a domain invariant instance decoupling module to decouple the cross-domain style from the image representation; and finally, the decoupled features are input into a domain generalization semantic decoding module so as to predict a segmented image on a target domain which is not seen, and the segmentation method can generalize various remote sensing images which are not seen so as to obtain better segmentation capability.
Owner:GUIZHOU SURVEY & DESIGN RES INST FOR WATER RESOURCES & HYDROPOWER

Computer vision-based hundred-million-pixel panoramic situation awareness method and system

The invention relates to the technical field of computer vision and artificial intelligence, and discloses a computer vision-based hundred-million-pixel panoramic situation awareness method and system, and the method comprises the steps: synchronously collecting original local field-of-view images through multiple cameras; independently executing target detection and semantic segmentation in an original image domain; constructing local-to-global coordinate mapping based on the calibration parameters; projecting the target features to a global coordinate system and detecting a cross-view-field target; extracting multi-view-field texture, edge and color features, and performing weighted fusion according to a visible area; according to the method, through identification preposition and semantic level feature fusion, geometric splicing distortion is avoided, the cross-boundary identification precision is improved, the calculation load is reduced, target continuous tracking and situation real-time output in a high-density scene are realized, and the method has high engineering suitability and industrial popularization value.
Owner:WUHAN ZHUOHE TECH CO LTD

Methods and Systems for Parking Zone Mapping and Vehicle Localization Using Mixed-Domain Neural Network

Methods and systems for assisting a vehicle to park using mixed-domain image data. Image-domain data is generated based on raw image data received from a plurality of cameras mounted on a vehicle. The raw image data is associated with a parking zone outside the vehicle, and the image-domain data is generated by a feature-detection machine learning model. A bird's-eye-view (BEV) image is generated based on the raw image data, wherein the BEV image is a projected image of the parking zone. BEV-domain data associated with the BEV image is generated. The BEV-domain data includes data associated with parking landmarks in the parking zone. A computing system localizes the vehicle within the parking zone based on the BEV-domain data and the image-domain data to generate localization data. The computing system performs mapping of the parking zone based on the BEV-domain data, the image-domain data, and the localization data.
Owner:VALEO SCHALTER & SENSOREN GMBH

System and method for denoising in magnetic resonance imaging using a transform domain local low rank technique

A system and method for denoising magnetic resonance images (MRI) in a transform domain are provided. In one aspect, the method incudes reconstructing a series of images of the target using the image data, transforming the series of images into a transform domain, and selecting patches in the image domain. The patches can be used to form matrices that can be decomposed to distinguish signal and noise components. Thresholding can be applied to remove the noise components in the transform domain. The denoised data can be inversely transformed back to the image domain to produce denoised images.
Owner:REGENTS OF THE UNIVERSITY OF MINNESOTA

Magnetic resonance image reconstruction method and device, model training method and device, equipment and medium

The invention provides a magnetic resonance image reconstruction method and device, a model training method and device, equipment and a medium. The method comprises the following steps: inputting acquired to-be-reconstructed under-sampling k-space data into a pre-constructed image reconstruction model, and carrying out continuous k-space reconstruction processing for multiple times to obtain a magnetic resonance reconstruction image; wherein the k-space reconstruction processing in the image reconstruction model comprises the steps of performing frequency domain restoration on input k-space data based on a Transformer encoder introduced with symmetric weight, performing image domain signal restoration on the k-space data after frequency domain restoration, and performing data consistency processing on the k-space data after image domain signal restoration. According to the method, the image reconstruction model is constructed in an end-to-end expansion training optimization mode, so that the frequency domain and image domain information of the undersampled data can be fully utilized, the accuracy of image reconstruction is effectively improved, the computing resource overhead and the time cost can be effectively reduced, and the high efficiency of the reconstruction process is ensured.
Owner:PIONEER ORIGINAL (SHANGHAI) NEW TECHNOLOGY RESEARCH CO LTD

Deep learning-based cross-dataset magnetic resonance multi-modal super-resolution image synthesis method

The invention discloses a cross-dataset magnetic resonance multi-mode super-resolution image synthesis method based on deep learning, and relates to the field of magnetic resonance imaging. An unsupervised method in deep learning is utilized, and the architecture of a generative adversarial network is adopted, so that the synthesis of a magnetic resonance multi-mode super-resolution image is realized. Carrying out data preprocessing on the image, wherein the data preprocessing comprises registration, slicing and normalization; constructing a high-frequency template, performing FFT (Fast Fourier Transform) on the data to obtain a K space, multiplying a K space image by the high-frequency template to obtain high-frequency information of the K space, and performing IFFT to obtain high-frequency information of an image domain; the prepared image and the high-frequency information thereof are fed into the network as inputs. And through network training, synthesis of multi-modal data is realized. And constructing an image degradation algorithm of the super-resolution reconstruction network. And constructing a network architecture for super-resolution image reconstruction, and inputting the degraded image and the original real image into a network for training to obtain a high-resolution multi-modal magnetic resonance image.
Owner:XIAMEN UNIV

Adaptive learning framework for digital pathology

The present disclosure relates to techniques for efficient development of initial models and efficient model update and / or adaptation to a different image domain using an adaptive learning framework. For efficient development of initial models, a two-step development strategy may be performed as follows: Phase 1: Model preconditioning, where an artificial intelligence system leverages existing annotated datasets and improves learning skills through training of these datasets; and Phase 2: Target-model training, where an artificial intelligence system utilizes the learning skills learned from Phase 1 to extend itself to a different image domain (target domain) with less number of annotations required in the target domain than conventional learning methods. To efficiently perform model update and adaptation to new datasets after initial model development, a digital pathology scenario is identified, an adaptive-learning method is selected based on the scenario, and the model is updated and adapted to new datasets using the adaptive-learning method.
Owner:VENTANA MEDICAL SYSTEMS INC

Correction processing method and apparatus for scattering artifact of cone-beam CT image

The present invention relates to the technical field of image processing. Provided are a correction processing method and apparatus for a scattering artifact of a cone-beam CT (CBCT) image. The method comprises: constructing a synthesis network, wherein the synthesis network at least includes two generators, two discriminators, two CBCT image domain feature extraction units and two pCT image domain feature extraction units, and is used for converting a CBCT image into an spCT image; respectively performing forward projection on the CBCT image and the spCT image to obtain a CBCT projection and an spCT projection, and determining a residual projection according to the CBCT projection and the spCT projection; extracting a scattering artifact and image details from the residual projection, removing the image details from the residual projection, and retaining the scattering artifact; subtracting the scattering artifact from the CBCT projection to generate a corrected projection; and reconstructing the corrected projection, so as to obtain a corrected CBCT image.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Contrast learning-based X-ray image domain adaptive pulmonary nodule detection method

The invention discloses a contrast learning-based X-ray image domain adaptive pulmonary nodule detection method, which comprises the following steps of: training a model by using a source domain image, copying the model to obtain a teacher model and a student model, and sending the source domain image into the student model through strong data enhancement; the target domain image is sent to the student model and the teacher model through strong data enhancement and weak data enhancement. For a source domain image, supervision loss is calculated through a label, and for a target domain image, non-supervision loss is calculated through a pseudo label. The hierarchical contrast learning module calculates region-level and pixel-level contrast losses respectively, and the adversarial learning module obtains adversarial classification losses through region-level features from a source domain and a target domain. And finally, combining loss functions to carry out model optimization, updating student model parameters, and updating teacher model parameters through an exponential moving average strategy. According to the method, a unique hierarchical contrast learning strategy is adopted, so that the problem of low-quality false labels is solved, and the accuracy of the X-ray image domain adapting to pulmonary nodule detection is effectively improved.
Owner:ANHUI UNIV

Passive unsupervised graph domain adaptive mechanical fault diagnosis method and device based on privacy protection constraint

The invention discloses a privacy protection constrained passive unsupervised graph domain adaptive mechanical fault diagnosis method and device, and the method comprises the steps: inputting a mechanical vibration signal into a pre-trained mechanical fault diagnosis model, and outputting a diagnosis result; the mechanical fault diagnosis model is obtained by training a passive domain multi-scale image domain adaptive network by adopting training data, and the passive domain multi-scale image domain adaptive network comprises a multi-scale feature extractor module, a topological graph convolution module and a feature classifier module which are connected in sequence; the training process comprises two stages of performing pre-training by using source domain data and performing unsupervised domain adaptive training by using target domain data, and a loss function of the training process comprises a label smooth cross entropy loss function for the pre-training process. And the unsupervised domain adaptive loss function used for the unsupervised domain adaptive training process comprises neighbor clustering loss, regularization loss and label prediction diversity loss. The objective of the invention is to realize complete representation and generalization of fault features by deeply mining topological structure information, and optimize decision boundaries to significantly improve inter-domain alignment precision in a passive domain adaptive process, thereby solving the problem of cross-working condition diagnosis of mechanical equipment under data privacy protection constraints.
Owner:XI AN JIAOTONG UNIV

Bimodal tracking sensing method and system for far small target based on point cloud inspiration

The invention relates to the field of target detection and multi-sensor data fusion, in particular to a point cloud inspiration-based far and small target bimodal tracking sensing method and a point cloud inspiration-based far and small target bimodal tracking sensing system. The method comprises the steps that original radar point cloud and video data are acquired and preprocessed, and a point cloud cluster vector set and original image data are acquired; the point cloud cluster vector set, the original image data and the original radar point cloud pass through a bimodal fusion perception framework to obtain the position and identity characteristics of a far small target in an image domain; and performing bimodal joint tracking, completing sensing of a far small target, and outputting position information of the sensed target in the aerial view. According to the method, firstly, preprocessing is carried out to reduce noise points, then the image representation capability of the far-small target is inspired and enhanced through radar point cloud, then the detection accuracy of the far-small target is improved through bimodal feature fusion, and position information and identity features of the far-small target in an image domain are obtained. And finally, bimodal joint tracking is carried out to realize continuous sensing of a far small target.
Owner:GUANGDONG UNIV OF TECH

Remote sensing image domain adaptive classification method based on high-order prototype guidance

The invention relates to a remote sensing image domain adaptive classification method based on high-order prototype guidance. The method comprises the following steps; constructing a cross-scene remote sensing image classification data set; constructing a high-order category prototype generation network based on feature interaction; constructing a high-order causal prompt generation network based on prompt learning; and training and testing a remote sensing image domain adaptive classification method based on high-order prototype guidance. Compared with the prior art, through the cross-scene remote sensing image classification network, the problem that in an existing remote sensing image classification task, due to the fact that style differences exist between different satellite remote sensing images, a source domain training model is difficult to migrate to a target domain data set is solved. In addition, key causal features are decoupled by adopting a prompt learning method based on high-order prototype guidance, so that an innovative method for effectively migrating a model trained on source domain satellite data to target domain satellite data is realized.
Owner:ANHUI UNIV

Intra-image nonrigid motion correction in tomography

Certain aspects pertain to intra-image motion correction methods and systems configured to divide an image domain into subdomains and estimate motion of each subdomain along one or more axes and determine a motion corrected image based on the motions.
Owner:CALIFORNIA INST OF TECH

Hyperbolic space open scene semantic segmentation method based on image language supervision

The invention discloses a hyperbolic space open set semantic segmentation method based on image language supervision. The method comprises the following steps: constructing a hyperbolic space training framework of an image domain and a language domain, and training the hyperbolic space training framework; constructing an open scene semantic segmentation model according to the training framework of the image domain and the language domain; and inputting a to-be-segmented image into the trained open scene semantic segmentation model to obtain a semantic segmentation result. According to the method, the characteristic that the hyperbolic space can encode a hierarchical structure is utilized, and an image and text encoder of a large-scale language vision model is directly migrated from an image-level classification level to a pixel-level classification level in a manner of finely adjusting the large-scale language vision model in the hyperbolic space; on the basis that the open scene capability is reserved, the large-scale language vision model has the semantic segmentation capability.
Owner:SHANGHAI JIAOTONG UNIV

Hyperspectral image domain generalization classification method, system, equipment and medium

The invention relates to the technical field of image classification, and discloses a hyperspectral image domain generalization classification method, system and device and a medium. The method comprises the following steps: acquiring a plurality of hyperspectral images of different ground feature types; obtaining a mean value and a variance of each hyperspectral image in a channel dimension, performing random disruption, and determining a spectral variation parameter of the hyperspectral image according to the mean value and the variance before and after random disruption so as to generate a corresponding spectral variation image; separating the center and the background of each hyperspectral image to obtain respective center image and background image, randomly disorganizing the center image and the background image, and generating a corresponding spatial variation image by combining the disorganized center image and background image of each hyperspectral image; a hyperspectral image classification model is obtained by training an enhanced hyperspectral image obtained by fusing a plurality of corresponding spectral variation images and spatial variation images, so that ground feature classification is performed on a to-be-classified hyperspectral image, and the domain generalization performance of the hyperspectral image classification model is improved.
Owner:ANHUI AGRICULTURAL UNIVERSITY

Image processing method and device and electronic equipment

The invention provides an image processing method and device and electronic equipment, and the method comprises the steps: determining a first image, the first image is an image obtained by projecting a panoramic image to a spherical surface, the first image comprises a second image, and the second image comprises an image covered by a field angle of a user in the first image; determining a first angle of horizontal opening of the second image relative to a sphere center corresponding to the first image and a second angle of vertical opening of the second image relative to the sphere center; based on the first angle and the second angle, performing equal-angle division on the second image domain to obtain M * N sub-images, M and N being positive integers determined based on a preset resolution; and carrying out pixel sampling in the M * N sub-images to obtain a sampled image.
Owner:DOUYIN VISION CO LTD

Unsupervised CT image denoising method and device based on multi-mode large model text prompt

The invention provides an unsupervised CT image denoising method and device based on multi-mode large model text prompt. The method comprises the following steps: performing preliminary denoising on an original CT image by using a pre-training coding and decoding model to generate a first denoised CT image; inputting the first de-noised CT image and a preset text into a multi-modal visual language large model to generate quality cues and detail cues about the first de-noised CT image; denoising the first denoised CT image again by using a trained generation diffusion model according to the quality cue words and the detail cue words to generate a second denoised CT image; inputting the second de-noised CT image serving as an initial de-noised CT image into a three-domain consistency iteration framework for fidelity, and obtaining a final de-noised CT image when an iteration stop condition is met; wherein the three domains comprise an image domain, a projection domain and a wavelet domain. The method can be conveniently applied to various noisy CT images by utilizing the emergence capability and the characterization capability of a large model and combining and designing a denoising frame.
Owner:Chinese People's Liberation Army Cyberspace Force Information Engineering University

Extremely sparse angle CT reconstruction method of multi-stage processing neural network based on double-domain joint mode

The invention belongs to the field of industrial CT image processing, discloses an extremely sparse angle CT reconstruction method of a multi-stage processing neural network based on a double-domain joint mode, and is used for solving the problem that a traditional reconstruction method cannot reconstruct a high-quality CT image at an extremely sparse sampling view angle. The reconstruction method comprises the following steps: firstly, carrying out extremely sparse sampling on full-angle projection data A acquired by a computed tomography system to obtain projection data B; interpolating the projection data B, and inputting the interpolated projection data B into the trained sine domain network to obtain optimized projection data C; secondly, preliminarily reconstructing the projection data C into a CT image D by using a fast iterative soft threshold shrinkage algorithm (FISTA); and finally, optimizing the image D through a trained image domain network to obtain a high-quality CT image E. According to the method, the CT image under extremely sparse angle sampling can be reconstructed, and the reconstructed CT image has higher structural integrity and definition.
Owner:GUANGDONG UNIV OF TECH

Reshaper for learning based image / video coding

An input image represented in an input domain is received from an input video signal. Forward reshaping is performed on the input image to generate a forward reshaped image represented in a reshaped image domain. Non-reshaping encoding operations are performed to encode the reshaped image into an encoded video signal. At least one of the non-reshaping encoding operations is implemented with an ML model that has been previously trained with training images in one or more training datasets in a preceding training stage. A recipient device of the encoded video signal is caused to generate a reconstructed image from the forward reshaped image.
Owner:DOLBY LABORATORIES LICENSING CORP

Computed tomography reconstruction method and related device

The invention discloses a computed tomography reconstruction method and a related device, and relates to the technical field of image reconstruction, and the method comprises the steps: obtaining original projection domain data; de-noising processing is carried out on the original projection domain data to obtain projection domain data after de-noising processing; inputting the denoised projection domain data into a computed tomography reconstruction model to obtain computed tomography of an image domain output by the computed tomography reconstruction model; and enhancing the computed tomography of the image domain output by the computed tomography reconstruction model to obtain the final computed tomography. According to the method and the device, the improvement of the efficiency and the effect of computed tomography reconstruction is realized based on projection domain data denoising, computed tomography reconstruction model and enhancement of a model result.
Owner:SPARTICLE HEALTHCARE CO LTD

Image style migration method based on two-way vision Transform

The invention discloses an image style migration method based on double-path visual Transform, which comprises the following steps of: respectively configuring a path of visual Transform encoder for a content image and a style image to obtain a content code and a style code; representing the style code as a style parameter vector by a Transform style parameter extractor; and carrying out weighted fusion on the content code and the style code through a visual Transform image decoder, predicting a feature distribution parameter of a target style based on a style parameter vector to obtain a stylized code, and finally decoding, outputting and generating a stylized image. According to the method, on the basis of a visual Transform architecture of double-channel coding-decoding, coding differences among different image domains are considered, the accuracy of style representation is improved, style distribution measurement is introduced, the style expression ability is further improved, the color distribution and texture texture of image rendering are highly matched with a real style, and the image rendering efficiency is improved. Meanwhile, original content semantics can be completely reserved, and the problem of distortion caused by application of local style textures is avoided.
Owner:NANJING UNIV

Image Processing Method, Apparatus, Computer Device, and Storage Medium

The present application relates to an image processing method, apparatus, computer device, and storage medium. The method includes: inputting a first image in a first image domain into a to-be-trained image processing model to obtain a second image in a second image domain; acquiring a first image feature corresponding to the first image and a second image feature corresponding to the second image; obtaining a first model loss value based on a target feature correlation degree between the first image feature and the second image feature; acquiring a first eigenvalue distribution corresponding to the first image feature and a second eigenvalue distribution corresponding to the second image feature; calculating a distribution correlation degree between the first eigenvalue distribution and the second eigenvalue distribution, and obtaining a second model loss value based on the distribution correlation degree, where the second model loss value has a negative correlation relationship with the distribution correlation degree. Using this method can improve the image processing effect. The image processing model in the present application can be an artificial intelligence-based neural network model, and an artificial intelligence cloud service is provided based on this model.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Dual-mode forged information detection method fusing emotion features

The invention discloses an emotion feature fused bimodal forged information detection method, which comprises the following steps of: extracting emotion features, respectively extracting emotion categories of a text and an image through a large language model, respectively giving emotion intensity of the categories, and scoring the emotion; analyzing the emotion consistency of the mixed modal features of the text and the image; the hybrid expert network calculates domain probabilities to which a text mode, an image mode and a hybrid mode belong respectively through a text domain encoder, an image domain encoder and an image text hybrid feature domain encoder based on domain class processing features; the hybrid expert network learns feature information of a text mode, an image mode and a hybrid mode according to the domain information; the AdaIN network adjusts modal distribution, the AdaIN network adjusts feature distribution according to contribution of each modal, the adjusted features are fused and input into the classifier, a final classification result is obtained, and the information detection accuracy is greatly improved.
Owner:SHENZHEN KIM DAI INTELLIGENCE INNOVATION TECHNOLOGY CO LTD

Feature domain optical flow determining method and related device

This application provides a feature domain optical flow determining method and a related device, and relates to the field of video or picture compression technologies based on artificial intelligence (AI). The method specifically includes: obtaining a picture domain optical flow between a current frame and a reference frame; performing multi-scale feature extraction on the reference frame, to obtain M feature maps of the reference frame, where M is an integer greater than or equal to 1; and performing M times of feature domain optical flow estimation based on the M feature maps of the reference frame and the picture domain optical flow between the current frame and the reference frame, to obtain M feature domain optical flows. A feature domain optical flow obtained by using the solutions of this application is more accurate and more stable, thereby improving inter-prediction accuracy.
Owner:HUAWEI TECH CO LTD

Virtual restoration method for cultural relics

PendingCN119722522AImage enhancement3D modellingStiefel manifoldTucker decomposition
The invention relates to a cultural relic virtual restoration method, and specifically, the method comprises the steps: firstly, depicting the global correlation of a cultural relic image through low-rank Tucker decomposition and Stiefel manifold; then, Gaussian noise is removed by utilizing a Frobenius norm, and meanwhile, sparse noise is removed by adopting an L0 norm aiming at the deficiency of an L1 norm; furthermore, a weighted L0 norm is introduced into a gradient image domain to explore a local segmentation smooth structure of the cultural relic image. In addition, the patent designs an ADMM algorithm based on a hard threshold to solve the provided model. In each step of algorithm iteration, a rank increase strategy is adopted to dynamically adjust a tensor rank, so that the burden of searching an optimal tensor rank is avoided, and the calculation cost is reduced. Therefore, the damaged area of the cultural relic is complemented and repaired, and the original appearance of the cultural relic is recovered while the cultural relic is protected.
Owner:HUNAN UNIV