Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

204 results about "Information redundancy" patented technology

Redundancy (information theory), the number of bits used to transmit a message minus the number of bits of actual information in the message Redundancy in total quality management, quality which exceeds the required quality level, creating unnecessarily high costs The same task executed by several different methods in a user interface.

Substation equipment health state assessment method, system and equipment based on few-sample multi-modal fusion, and storage medium

The invention relates to the technical field of power grid equipment state monitoring, in particular to a transformer substation equipment health state assessment method, system and equipment based on few-sample multi-modal fusion and a storage medium. The method comprises the following steps: acquiring image, sound, text, structuralization and other multi-modal operation data of transformer substation power distribution equipment, preprocessing the data, and establishing a comprehensive equipment state data basis; cLIP, BERT and Wave2vec pre-training models are selected and finely adjusted, multi-modal features are deeply fused through a cross attention mechanism by using the transfer learning ability of large-scale pre-training knowledge, pairwise interaction and information complementation among different modals are realized, information redundancy is effectively eliminated, and a complex association relationship among the modals is mined; a hierarchical structured model is constructed, a structured data health state result is calculated in combination with a discrimination matrix, and traditional power system expert experience and quantitative analysis are organically combined; and carrying out weighted fusion on the multi-modal health state result and the structured data health state result.
Owner:GUIZHOU POWER GRID CO LTD

Sentiment analysis method based on prototype guide mode fusion and prompt enhancement

The invention discloses a sentiment analysis method based on prototype guide mode fusion and prompt enhancement, and constructs a multi-mode sentiment analysis network which comprises a multi-mode coding module, a prototype guide mode fusion module, a dynamic mode weight adjustment mechanism and a context prompt generation module. The method comprises the following steps: firstly, extracting semantic features of each mode by using a multi-mode encoder, and constructing a prototype feature library based on a labeled sample to describe typical representations of different modes under each category; and then, dynamically evaluating modal contribution through prototype similarity to realize modal adaptive fusion. Furthermore, a context prompt is generated according to a similarity retrieval result of the input sample and the prototype library, and the pre-training language model is guided to complete sentiment classification. According to the method, the problems of modal inconsistency, information redundancy, weak small sample generalization and the like can be effectively relieved, and the accuracy and robustness of sentiment analysis are improved.
Owner:SOUTH CHINA UNIV OF TECH

Lung cancer gene mutation classification method based on frequency domain multi-scale fusion guidance

The invention discloses a lung cancer gene mutation classification method based on frequency domain multi-scale fusion guidance, and relates to the technical field of medical image processing and gene detection. According to the MFHA mechanism provided by the invention, the pathological image is decoupled into low-frequency global and high-frequency detail sub-bands through wavelet transform, and extraction of key high-frequency features such as cell nucleus morphology and local texture is enhanced by combining multi-scale convolution and up-sampling guided by high-frequency information; the problems of insufficient feature detail mining and low feature fusion efficiency in a traditional pathological image analysis method are solved; key features are screened and focused through a channel, frequency domain-space feature deep fusion is realized through up-sampling, robust representation is constructed by combining space attention with cosine similarity and multi-dimensional statistical features, a frequency domain analysis-space focusing collaborative optimization mechanism is formed, information redundancy caused by simple feature splicing is avoided, and the robustness of the system is improved. And the classification stability of the model in a complex pathological scene is improved.
Owner:CHONGQING NORMAL UNIVERSITY +1

Reservoir multi-objective optimization scheduling decision-making method based on digital twinning and AI simulation

The invention discloses a reservoir multi-target optimization scheduling decision-making method based on digital twinning and AI simulation, and relates to the technical field of reservoir scheduling, the method effectively solves the problems of data fragmentation and information redundancy in traditional scheduling by constructing a multi-source data fused reservoir digital twinning body, realizes accurate virtual-real mapping of reservoir working conditions, and improves the scheduling efficiency. A high-reliability simulation basis is provided for subsequent optimization scheduling, and decision errors caused by data errors or model deviation are avoided; four core targets of flood control, power generation, ecology and water supply are considered, an engineering safety bottom line and rigidity requirements are defined through a layered constraint system, constraint satisfaction degree screening is enhanced by means of an improved multi-target optimization algorithm, and target weights can be dynamically adjusted according to a real-time scene. And after the non-dominated scheme set is optimized and output, candidate schemes are screened in combination with real-time demand quantitative scores.
Owner:XIAN YUYUAN WATER CONSERVANCY TECHNOLOGY CO LTD +1

Query statement generation method and electronic equipment

The invention discloses a query statement generation method and electronic equipment, and relates to the technical field of query statement generation, and the query statement generation method comprises the following steps: obtaining a historical query record in response to a received natural language query request of a user; judging whether query relevance exists between the natural language query request and a historical query record or not, and if yes, determining a candidate data table set based on a historical query data table; calling a pre-trained language model, and performing first reasoning on the natural language query request and the candidate data table to generate an initial query statement; executing the initial query statement on a first data table set constructed based on the candidate data table set, verifying whether a query score of an initial query result meets a preset availability standard threshold value or not, and if yes, taking the query score as a target query statement. According to the method and the device, the problems of input information redundancy, high overhead loss, low statement verification efficiency and insufficient correction capability in related technologies are solved, and efficient and accurate generation from the natural language query request to the query statement is realized.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Operation and maintenance scheme generation method, system and equipment based on cooperation of large language model and knowledge graph, and medium

The invention relates to the technical field of computer intelligent operation and maintenance and artificial intelligence, in particular to an operation and maintenance scheme generation method, system and device based on cooperation of a large language model and a knowledge graph and a medium. The method comprises the following steps: denoising and abstracting multi-source heterogeneous operation and maintenance data by using a large language model, extracting key fact dimensions, further identifying a fault entity, mapping the fault entity to an operation and maintenance knowledge graph to position an initial anchor point, executing two-stage collaborative reasoning based on the anchor point, and generating a plurality of candidate traceability paths by alternately performing relationship exploration and entity exploration; and finally, reordering the candidate paths based on path length perception and semantic correlation, dynamically controlling the termination and understanding strategy of reasoning by using a comprehensive confidence score, outputting a final solution, effectively overcoming the problems of information redundancy interference reasoning and large model illusion in a complex operation and maintenance scene through the cooperation of a large model and a knowledge graph, and improving the reliability of the system. And the accuracy of root cause positioning and the executable performance of the solution are obviously improved.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

Intelligent manufacturing factory production line environment online real-time monitoring management and control system

The invention discloses an intelligent manufacturing factory production line environment on-line real-time monitoring management and control system, and relates to the technical field of environment monitoring, and the system comprises a system architecture including a sensor sensing module, a credible verification module, a self-repairing module and a management and control module. And full-flow closed-loop monitoring from data acquisition, credibility analysis to repair feedback is realized. The sensor sensing module distributes multiple environmental monitoring acquisition nodes on a production line, and performs zoning distribution according to the process layout and the characteristics of an air flow field. The acquisition nodes in each area form a local trust cluster, and local redundancy and data mutual correction among the nodes are realized, so that a distributed environment sensing structure based on spatial correlation is established. According to the arrangement, the space coverage density of environmental parameters is remarkably improved, and information redundancy and structural stability can be achieved through neighborhood nodes under the condition that any node breaks down, drifts or loses data.
Owner:深圳市永迦电子科技有限公司

Partial discharge mode identification method based on multi-channel sound signal time-frequency space spectrogram fusion

The invention provides a partial discharge mode recognition method based on multi-channel sound signal time-frequency space spectrogram fusion, and belongs to the technical field of partial discharge mode recognition. The problem that information redundancy and difference between existing multi-channel sound signals cannot be effectively fused and discriminant features cannot be extracted is solved. The method comprises the following steps: collecting and summarizing multichannel sound signal data corresponding to different partial discharge models as a data set; performing normalization processing on the original multichannel partial discharge sound signal, and mapping a time domain signal into time-frequency joint distribution to obtain a gray scale time-frequency spectrogram; performing multi-scale and multi-direction decomposition on the grayscale time-frequency spectrogram to obtain each channel sub-graph; different fusion strategies are used for fusing the channel sub-graphs obtained through decomposition; reconstructing a time-frequency space fusion spectrogram from the fused sub-graphs of each channel through inverse transformation; extracting features; identifying a partial discharge mode; the method is applied to partial discharge detection.
Owner:ELECTRIC POWER RES INST STATE GRID SHANXI ELECTRIC POWER

Multi-modal data real-time processing method for Internet of Things gateway

The invention relates to the technical field of Internet of Things data processing, in particular to a multi-modal data real-time processing method for an Internet of Things gateway, and the method comprises the steps: obtaining multi-source operation data, and packaging the multi-source operation data into a standard operation data set; obtaining high-bandwidth modal data in the standard operation data set; when the maximum link delay time is greater than a preset delay abnormal threshold value, obtaining a version effective fingerprint of the target model and a local model fingerprint; when a model version abnormity diagnosis result is obtained, calculating information redundancy; obtaining correction delay time, and comparing the correction delay time with a preset normal reference delay interval; and when the correction delay time is greater than or equal to the upper limit value of the normal reference delay interval, adjusting the current decision period. By monitoring delay in real time, diagnosing consistency of model versions, eliminating redundant information and executing link adjustment, accurate processing of high-bandwidth modal data is realized, and real-time performance and reliability of Internet of Things gateway data processing are improved.
Owner:BEIJING KINGDOES RFID TECH

Method and device for controlling vehicle functions, vehicle and storage medium

The invention provides a method and device for controlling vehicle functions, a vehicle and a storage medium, and relates to the technical field of vehicle function control. According to the method, function control information is determined, an analysis object can be clearly analyzed, and introduction of irrelevant data in the initial stage is avoided. Information redundancy needing to be processed by the preset large model is reduced from the source, and a foundation is laid for subsequent efficient analysis. And further performing semantic analysis on the function control information according to a layer-by-layer screening mode through a preset large model and a vehicle function formed based on a vertical progressive layered structure. According to the hierarchical structure, the preset large model does not need to traverse all vehicle functions, and each layer only focuses on the function of the corresponding layer, so that the number of functions needing to be processed by the preset large model can be greatly reduced, and the consumption of lexical elements is directly reduced. Meanwhile, layer-by-layer screening replaces one-by-one reasoning, the target range of each layer is rapidly narrowed, and all vehicle functions do not need to be analyzed one by one. The path for determining the function of the target vehicle can be remarkably shortened, and the determination efficiency is improved.
Owner:GREAT WALL MOTOR CO LTD

Vibration measurement information enhancement method based on fusion data

The invention discloses a vibration measurement information enhancement method based on fusion data, and relates to the technical field of vibration measurement information enhancement. Edge nodes splice reasoning probability, frozen layer activation statistics, weak spectrum gradient direction and frozen layer gradient variance to generate a multi-source confidence tensor, and a heat peak list is formed through adaptive time-frequency kernel mapping; the information is uploaded after being subjected to redundancy elimination screening; a central node distributes domain credibility to each domain and then constructs a global heat map by adopting self-attention weight fusion heat peaks, and links hierarchy, frequency bands, links and working condition nodes in a mechanism attribution map network to calculate a causal path; and an attribution result triggers a strategy rule engine to select a corresponding maintenance script or a network self-checking instruction, and the maintenance script or the network self-checking instruction is pushed to a monitoring large screen, a mobile terminal and a mail in a unified message packet format along with a global heat map and a reason link, so that display and explanation of weak fault abnormity and operation and maintenance instruction closed loop are completed.
Owner:INNOVATION CENT OF TSINGHUA UNIV RES INST SHENZHEN ZHUHAI

Ultra-lightweight low-resolution dark light face enhancement method and system

The invention discloses an ultra-lightweight low-resolution dark light face enhancement method and system, and belongs to the technical field of computer vision and artificial intelligence, and the method comprises the steps: obtaining a degraded image, and processing the degraded image into a shallow feature map; inputting the shallow feature map into a hierarchical network structure; setting a module group in each level of the encoder and the decoder; only the first Transform module is used for carrying out complete self-attention calculation; the other Transform modules except the first Transform module in the module group execute attention sharing operation; inputting the deep feature map into an image reconstruction module formed by a convolutional layer to generate a residual image; and carrying out pixel-level addition on the residual image and the input degraded image to obtain a recovered clear image. According to the method, the problems of high calculation complexity and information redundancy in the prior art are solved. According to the method, the calculation overhead is remarkably reduced through an attention sharing strategy, and the excellent recovery quality is ensured through wavelet enhancement.
Owner:ZAOZHUANG UNIV

Data packet transmission method and device, electronic equipment and readable storage medium

Embodiments of the invention provide a data packet transmission method and apparatus, an electronic device and a readable storage medium. The method comprises the steps of obtaining a target data packet; extracting a target field from the target data packet; acquiring historical communication data of the network equipment, and extracting a field in the protocol frame from the historical communication data to determine information redundancy of the field; according to the importance degree corresponding to the information redundancy evaluation field, determining the importance degree corresponding to the field matched with the target field as the importance degree corresponding to the target field; splitting the target data packet into sub-data packets according to the importance degree corresponding to the target field and the network state of the network equipment, and determining a transmission strategy of the sub-data packets; the transmission strategy at least comprises a window size and / or a bandwidth proportion when the sub-data packets are transmitted; and transmitting the sub-data packets according to the transmission strategy. According to the embodiment of the invention, the target data packet is transmitted according to the importance degree of the field in the target data packet and the network state, so that the transmission efficiency and reliability are ensured.
Owner:GREE ELECTRIC APPLIANCE INC OF ZHUHAI +1

Vibration acceleration monitoring point clustering optimization method and system for satellite mechanical test

The invention provides a vibration acceleration monitoring point clustering optimization method and system for a satellite mechanical test, and the method comprises the steps: obtaining initial data of a frequency response function of each vibration acceleration monitoring point of a satellite through a dynamic test, carrying out the standardization and merging, and obtaining the final data of the frequency response function; dividing the vibration acceleration monitoring points with similar dynamic characteristics into a cluster by taking data correlation as a clustering distance based on a k-means clustering algorithm; classifying the clusters according to the number of the measuring points in the clusters, and determining reserved measuring points of each cluster and cutting measuring points of each cluster according to the correlation of each vibration acceleration monitoring point in each cluster; the number of the reserved measuring points is determined by calculating the redundant correlation coefficient between the cutting measuring points of each cluster and the reserved measuring points in the same cluster and the independent correlation coefficient between the reserved measuring points of each cluster, so that the information independence of the reserved measuring points and the information redundancy of the cutting measuring points are ensured, the cutting method is quantified, the measuring point cutting result is more reliable, and the measurement accuracy is improved. And the efficiency of a ground environment test link is improved.
Owner:BEIJING INST OF SPACECRAFT ENVIRONMENT ENG

Content abstract generation method based on chapter structure analysis

The invention discloses a content abstract generation method based on chapter structure analysis, and belongs to the technical field of natural language processing. The method comprises the steps that firstly, an original text is preprocessed, then text structure deep analysis is carried out, the text type of the text is recognized, an explicit / implicit text relation is extracted, and special symbols are introduced through a Prompt normal form for implicit text relation extraction to strengthen logic semantics; secondly, scoring sentences by adopting a double-path scoring mechanism in combination with a deep neural network model of chapter structure features and an optimized text sorting algorithm, and fusing scores through a logistic regression model; then, screening target sentences based on a chapter relation weighted secondary modulus function and a greedy algorithm, and finally, carrying out post-processing to generate an abstract. According to the abstract generation method, the chapter structure logic is deeply utilized, so that the problems of logic unsmoothness, information redundancy or key relation missing in the existing abstract generation are solved, and the semantic coherence and information integrity of the abstract are improved.
Owner:MAIGET INFORMATION TECH (BEIJING) CO LTD

Collaborative awareness and identification method and system based on unmanned aerial vehicle cluster

The invention discloses a collaborative awareness and recognition method and system based on an unmanned aerial vehicle cluster, and relates to the field of unmanned aerial vehicle cluster control and computer vision. The method comprises the steps of starting ground control software to load a route path file, constructing a sequence image optical scene and evaluating the effect, dynamically fusing and evaluating the effect of a wide-area optical scene, intelligently and collaboratively recognizing an optical target, confirming and judging collaborative recognition data, and counting and evaluating recognition accuracy. The system comprises a central node unmanned aerial vehicle subsystem, an edge node unmanned aerial vehicle subsystem and ground control software. According to the method, the central node and the edge nodes cooperatively work, the global scheduling decision-making capability of the central node and the real-time computing capability of the edge nodes are exerted, efficient coverage of a wide-area scene, high-resolution image splicing and cooperative recognition and tracking of a dynamic target are achieved, the problems of unbalanced computing load, information redundancy and the like of a traditional architecture are solved, and the method is suitable for large-scale popularization and application. The image quality and the target recognition accuracy are improved, the reliability is high, and the expandability is high.
Owner:NANJING UNIV OF AERONAUTICS & ASTRONAUTICS

Information display frequency control method based on user behavior characteristics

The invention discloses an information display frequency control method based on user behavior characteristics, relates to the technical field of information display control, is used for solving the problem of excessive pushing of display contents, and obtains similar potential groups by setting a group division mechanism for initial users. Selecting target information according to the information display duration of each group, extracting word frequency, screening representative vocabularies, screening a target group according to the representative vocabularies, displaying the information of the target group on a user interface, setting a display frequency, monitoring the browsing duration and the browsing amount of a user in real time, performing statistics, and screening out the target group according to a result. Generating an update ratio according to the screening quantity to enter a frequency adjustment mechanism, adjusting a display frequency by using the update ratio to obtain a precise frequency, monitoring a screening result in real time to judge whether to quit the frequency adjustment mechanism, and collecting user click search and active refresh times during quit to determine whether to quit the group division mechanism; user fatigue caused by information redundancy is avoided, and information utilization efficiency and resource allocation rationality are improved.
Owner:YUNDONG (SHANGHAI) TECH CO LTD

Image semantic segmentation method based on gated attention and multi-scale enhancement

The invention discloses an image semantic segmentation method based on gating attention and multi-scale enhancement, and belongs to the field of image semantic segmentation, and the method comprises the steps: building a channel space attention gating sequence building module; constructing a multi-scale feature enhancement block; constructing a gating fusion block; an encoder-decoder network is improved based on a channel space attention gating sequence building module, a multi-scale feature enhancement block and a gating fusion block, and a semantic segmentation neural network is obtained; obtaining an image training set, and training the semantic segmentation neural network by using image training to obtain a trained semantic segmentation neural network; and obtaining a to-be-classified image, and classifying the to-be-classified image by using the trained semantic segmentation neural network. According to the method, the problems that the context information capturing capability is limited, the global modeling capability is relatively weak, the multi-scale fusion lacks a dynamic adaptation mechanism and the jump connection information is redundant in the existing method are solved.
Owner:CHONGQING UNIV OF EDUCATION

Visual navigation optimization method and device, computer system and storage medium

The invention provides a visual navigation optimization method and device, a computer system and a storage medium, and relates to the technical field of visual synchronous positioning and mapping. The method comprises the following steps: acquiring relative pose information and a semantic tag of a target semantic object, and combining the relative pose information and the semantic tag into semantic object information corresponding to the target semantic object; converting the semantic object information into landmark information; fusing the landmark information as a constraint node into global optimization through a graph optimization framework; and generating a navigation path or a space control parameter and performing navigation. According to the optimization method of the visual navigation, the effect of optimizing the synchronous positioning and mapping back-end module is remarkably improved, the semantic information of the map is enriched, the understanding and usability of the map are enhanced, and the robot can realize more intelligent and efficient navigation in a complex environment. Meanwhile, optimization precision and stability are improved, information redundancy and inconsistency are reduced, resource use efficiency is optimized, and wide application prospects are shown.
Owner:UBTECH ROBOTICS CORP LTD

ViT model lightweight method for video action recognition

The invention discloses a ViT model lightweight method for video action recognition, which comprises the following steps of: performing motion estimation in a data processing stage, calculating to obtain motion intensity and time redundancy scores of tokens, and performing window division on video frames according to the scores. Afterwards, a window-global token merging strategy is adopted to effectively merge redundant tokens, the first three layers of the model process local information through adaptive window merging, and from the fourth layer, the model repeatedly executes global merging according to the depth of the layers so as to realize gradually enhanced feature representation; therefore, the number of tokens is reduced, the complexity of the ViT model in space-time self-attention calculation is reduced, and the problem of high calculation resource consumption caused by space-time information redundancy of the current ViT model in a video task is solved. Calculation overhead and energy consumption can be remarkably reduced in tasks such as video action recognition, action detection and time sequence event understanding, and meanwhile the characterization capacity of a key dynamic area is kept.
Owner:HOHAI UNIV

Vector character watermark embedding and extracting method and device based on multi-modal features

The invention relates to the technical field of digital watermarking, in particular to a watermark embedding and extracting method and device based on deep learning. According to the vector character watermark embedding and extracting method based on the multi-modal features, information redundancy and complementation are provided through multi-modal feature fusion, and a loss function system (particularly a triple, redundancy and anti-loss) with extremely high robustness is constructed, so that vector character watermark embedding has high anti-attack capability.
Owner:HEFEI HIGH DIMENSIONAL DATA TECH CO LTD

Image fusion system and method based on multi-branch feature fusion and attention mechanism

The invention discloses an image fusion system and method based on multi-branch feature fusion and an attention mechanism, and belongs to the field of multi-modal medical image fusion. The problems of incomplete feature capture, unreasonable weight distribution, information redundancy or loss and the like caused by insufficient single-scale feature extraction, insufficient attention mechanism modeling, low efficiency of a multi-scale fusion strategy and complex network structure are solved. According to the invention, a multi-branch feature extraction module containing shallow-layer, middle-layer and deep-layer parallel branches is constructed, BM, GCACConv and FeatureEnhancement modules are combined, features are fused through a multi-scale fusion module, and then output is carried out through an image reconstruction module, so that high-quality medical image fusion is realized. Through cooperation of the multi-branch extraction module, the multi-scale fusion module and the reconstruction module, features of all levels are comprehensively captured, key information is highlighted, redundancy is suppressed, a fusion image considering details and structures is output, the diagnosis efficiency and accuracy are improved, and practicability is high.
Owner:CHANGCHUN UNIV

Product traceability authentication full-process management system

The invention relates to the technical field of product traceability information management, in particular to a product traceability authentication full-process management system, which comprises the following steps of: determining equipment feature tags of different user types by analyzing equipment communication information in historical account login information, and matching current user equipment scanning information to identify the type of the current user equipment; historical browsing information is called based on the user type, the occurrence frequency of page browsing content and a node time coefficient are analyzed, a node content expression coefficient is calculated to generate information arrangement data, and finally the data are displayed on terminal equipment, so that a product full-process traceability data closed loop is realized, the authentication credibility is improved, and the user experience is improved. And meanwhile, the user type is accurately identified and the service is adapted, so that information redundancy is avoided, the terminal experience is optimized, the user acceptability is enhanced, and the problems of insufficient whole-process coverage and extensive service of a traditional system are further solved.
Owner:FUJIAN POLYTECHNIC OF INFORMATION TECH +1

GIS foreign matter identification and positioning method and system based on multi-perception dual-order fusion network

The invention relates to the technical field of power equipment detection, and discloses a GIS foreign matter recognition and positioning method and system based on a multi-sensing double-order fusion network, and the method comprises the steps: synchronously collecting ultrahigh frequency, ultrasonic wave and pulse current signals of GIS partial discharge through a multi-mode sensor, and constructing a discharge pulse correlation octree after clock synchronization and adaptive noise reduction; foreign matter recognition is completed by means of feature-level and decision-level dual-order fusion, and accurate positioning of a discharge source is achieved by combining initial positioning of a time difference method and bisecting face iteration. And furthermore, the foreign matter motion trail is restored, the discharge risk is evaluated, and a graded early warning instruction is output. According to the method, multi-modal features can be effectively associated, information redundancy is eliminated, GIS foreign matter identification accuracy and positioning precision are improved, and dynamic assessment and graded early warning of discharge risks are realized.
Owner:LINXIA COUNTY ELECTRIC POWER CO

Robust intelligent fault diagnosis method and system based on dynamic hypergraph semantic fusion and adaptive decoupling distillation

The invention discloses a robust intelligent fault diagnosis method and system based on dynamic hypergraph semantic fusion and adaptive decoupling distillation. Comprising the steps of multi-source heterogeneous signal synchronous sample generation, cross-modal space-time hypergraph semantic map construction, self-adaptive decoupling distillation model construction, multi-target game optimization and self-adaptive fusion, and uncertainty perception decision and early warning. The incidence relation between different modals and scale features is modeled through high-order hyperedge, advantage complementation and efficient fusion of the features are achieved, and the ability of capturing tiny fault abnormal details and the robustness of the model are remarkably enhanced. Dynamic weighted fusion and interaction among multi-modal and multi-granularity features are realized through a cross-granularity dynamic adaptive fusion layer, the problems of information redundancy and low fusion efficiency in a traditional feature splicing method are solved, and continuous prediction and early fault early warning of the equipment health state are realized. And the decision reliability in a complex industrial scene is improved.
Owner:SHANGHAI MARITIME UNIVERSITY

Dual-granularity alignment efficient partial correlation video retrieval based on implicit fragment modeling and semantic decomposition

The invention provides double-granularity alignment efficient partial correlation video retrieval based on implicit fragment modeling and semantic decomposition, and aims to solve the problems of information redundancy and low efficiency in an existing video modeling method, the problem of granularity mismatching between sentence representation and video frame features and the problem that alignment between a text and a video is not refined enough. According to the method, the expression and modeling of video data are optimized by introducing a structure combining a Gaussian mixture model and Transform, and multi-scale local details with short time span are adaptively integrated by introducing a window attention mechanism and a cross attention mechanism, so that finer features are obtained, and cross-modal similarity score calculation of texts and videos is facilitated. The method comprises the following steps: data preprocessing and frame segmentation: preprocessing and segmenting an input video into frames, and preparing for feature extraction after each frame of image is subjected to standardization processing; implicit modeling is carried out on the fragment-level features, uniformly sampled frame-level visual features are input into a Gaussian mixture modeling module, adjacent frame focusing modeling is carried out through a multi-scale Gaussian attention mechanism, and fragment-level representation of different receptive fields is implicitly formed. Enhancing local details of the frame-level features, performing convolution operation on each frame by adopting windows with different scales, and calculating a feature relationship in each local window; local features of all scales are fused through a cross attention mechanism, semantic expression of frame features is enhanced, and it is ensured that each video frame can capture important local details.
Owner:NANJING TECH UNIV

Video description information generation method and device, electronic equipment and storage medium

The invention provides a video description information generation method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target video of to-be-generated video description information; segmenting the target video to obtain a plurality of video clips; extracting a key frame set corresponding to each video clip from each video clip; performing character recognition on the key frame set to obtain text information corresponding to each video clip; inputting the key frame set corresponding to each video clip and the text information into a preset target model to obtain clip description information corresponding to each video clip; and generating video description information of the target video based on all the fragment description information. By means of the information processing method and device, the technical problems of key information loss and irrelevant information redundancy in the related technology are solved.
Owner:BEIJING QIYI CENTURY SCI & TECH CO LTD

Lens defect evaluation system and method based on visual inspection

The invention discloses a visual inspection-based lens defect evaluation system and method, and relates to the technical field of lens detection, the evaluation system comprises a multi-modal data acquisition and preprocessing module for acquiring multi-modal data of a lens and removing abnormal data in the multi-modal data; and the cross-modal feature fusion module is used for dynamically distributing attention weights of different types of features and carrying out conversion of the features in time and frequency dimensions. According to the lens defect assessment system and method based on visual inspection, comprehensive and high-quality basic data are provided for subsequent assessment after data purification treatment by combining a hyperspectral image, three-dimensional structured light scanning data and full-life-cycle associated data; secondly, key features are highlighted through an attention mechanism, deep fusion of multi-type data is realized in combination with time-frequency conversion and feature alignment, the problem of information redundancy or key information loss in traditional feature fusion is solved, and a data foundation is laid for accurate evaluation.
Owner:AUTEK CHINA

Sea surface vessel detection method and system based on tri-modal attention fusion

The invention discloses a sea surface vessel detection method and system based on tri-modal attention fusion. According to the invention, visible light, short-wave infrared and medium-wave infrared images are fused, and the problem of missing detection of existing single-mode ship detection under complex sea conditions such as haze, night and thermal interference scenes is solved; according to the invention, multi-level features of a three-mode image are extracted through a backbone network, multi-feature interaction is realized through a double-path deformable attention fusion module, texture-thermal radiation feature complementation is realized, and fusion output is distributed in combination with adaptive weight; in consideration of the problem of poor night short wave infrared data quality, a medium wave dominant degradation fusion strategy is designed, it is ensured that only visible light and medium wave infrared interaction characteristics are used in a night mode, and the influence of low-quality data on model performance is avoided. According to the improved DH-DINO algorithm provided by the invention, the multi-scale information capturing capability can be enhanced, and the problems of modal information redundancy and insufficient complementarity of ship detection under complex sea conditions are solved.
Owner:ZHEJIANG UNIV +1

Motor imagery electroencephalogram signal classification method and device, terminal and storage medium

The invention discloses a motor imagery electroencephalogram signal classification method and device, a terminal and a storage medium, and relates to the field of biomedical signal processing.The method comprises the steps that electroencephalogram signals based on user motor imagery are obtained and preprocessed, and electroencephalogram features are determined; performing multi-scale spatio-temporal feature extraction and space and channel decoupling reconstruction on the electroencephalogram features, and determining target spatio-temporal enhancement features; and classifying the target space-time enhancement features through a classification output layer, and determining a classification result. Due to the fact that space and channel decoupling reconstruction is carried out on the features, redundant correlation of the cross-electrode electroencephalogram signals is systematically eliminated, and the problems that in the prior art, space and channel information are jointly processed, information redundancy is caused, and calculation burden is increased can be effectively solved.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI