Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

18 results about "Sparse methods" patented technology

A quadrant amplitude mapping array sparsification method and related apparatus

This invention discloses a sparse method and related equipment for quadrant amplitude mapping arrays. The method, through recursive partitioning and a deterministic amplitude mapping mechanism, eliminates the randomness of traditional probabilistic methods, ensuring the uniqueness and stability of the output layout under the same input conditions, thereby significantly improving the repeatability and engineering reliability of the design results. The method in this embodiment achieves high-precision matching between amplitude distribution and cell position through sparse cell allocation based on recursive quadrant partitioning, significantly reducing sidelobe levels while lowering the standard deviation of performance fluctuations. Furthermore, the method in this embodiment is independent of specific array geometry and naturally supports rectangular, circular, and irregular arrays with internal obstacles through its recursive processing mechanism, demonstrating excellent versatility and flexibility, and can be widely applied in the field of data processing technology.
Owner:BEIJING INST OF TECH

Applying a sparse-dense-sparse methodology to language models

Embodiments herein describe a sparse-dense-sparse (SDS) process that achieves a better pruning scheme that benefits from pruning-friendliness relative to one-shot pruning schemes. The SDS process performs a first pruning to generate a sparse ML model followed by reconstruction to generate a re-dense ML model, followed by a second pruning to generate another sparse ML model. By pruning a ML model and then re-constructing the ML model, the ML model can be made more pruning-friendly by performing data and / or weight regularization. As a result, performing the second pruning in the SDS process can result in a smoother weight distribution and lower perplexity relative to one-shot pruning.
Owner:XILINX INC

A speed sampling sparse method, a storage medium and an electronic device

The application discloses a speed sampling sparse method and a path planning algorithm thereof, a storage medium and an electronic device, and comprises the following steps: obtaining a speed sampling interval through a current speed of a robot, a maximum limited speed, a minimum limited speed, a control period, a maximum acceleration and a minimum acceleration; obtaining a probability density sampling interval through the speed sampling interval and the current speed of the robot; obtaining a distribution interval corresponding to the probability density sampling interval through a cumulative distribution function of a Gaussian distribution; equally dividing the distribution interval to obtain a sampling point in the distribution interval; obtaining a sampling point speed corresponding to the sampling point through an inverse function of the cumulative distribution function of the Gaussian distribution; obtaining a sampling speed of the robot through the sampling point speed and the current speed; and the above technical scheme reduces the calculation power consumption of a path planning algorithm caused by equidensity sampling speed, controls the accuracy of the sampling speed, and balances the calculation power consumption and the control accuracy.
Owner:福建汉特云智能科技有限公司

Fine-grained distributed training method and system based on gradient quantization sparse compression

PendingCN121981211ABiological modelsSparse methodsForward propagation
The invention discloses a fine-grained distributed training method and system based on gradient quantization sparse compression, proposes a dynamic tensor fusion technology, automatically searches an optimal tensor fusion buffer threshold by using a binary search method, merges gradient tensors of a plurality of layers into a larger buffer for transmission, does not need manual adjustment and optimization, and improves the training efficiency. And the optimal balance between the communication delay and the bandwidth utilization rate is realized. A fine-grained pipeline scheduling mechanism for communication decoupling is provided, a gradient synchronization process is decoupled into a sparse communication task in a back propagation stage and a quantitative communication task in a forward propagation stage, fine-grained overlapping with forward and backward calculation tasks is realized, the utilization rate of calculation resources is maximized, and communication delay is completely masked. In the back propagation stage, a fragmentation Top-k sparsification and AlltoAll routing strategy is adopted, transmission of a large number of zero values is avoided, and the communication complexity of back propagation is reduced; in the forward propagation stage, a low-bit sparse quantization and AllGather strategy is adopted, and the bandwidth bottleneck problem caused by the fact that a traditional sparse method becomes dense back in the parameter synchronization stage is solved.
Owner:CHENGDU UNIV OF INFORMATION TECH

Model sparse method and device, electronic equipment and storage medium

PendingCN121599012ANeural learning methodsSparse methodsAlgorithm
The invention provides a model sparse method and device, electronic equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: adding auxiliary parameters into an original model by the electronic equipment to obtain an intermediate model; the auxiliary parameters are used for adjusting the precision of the intermediate model. And the electronic equipment adjusts the auxiliary parameters in the sparse process of the intermediate model to obtain a target model. The original model, the intermediate model and the target model can be collectively referred to as neural network models. According to the embodiment of the invention, in the process of sparse processing of the neural network model, the precision of the neural network model can be improved by adjusting the auxiliary parameters, and the loss of model performance caused by sparse processing of the model is reduced; and the auxiliary parameters are adjusted, and all parameters of the sparse neural network model do not need to be adjusted, so that the number of the parameters needing to be adjusted is reduced, computing resources consumed in the model rarefaction process can be reduced, the model rarefaction speed can be increased, and the efficiency of the model rarefaction process can be improved.
Owner:HUAWEI TECH CO LTD

Hardware accelerator supporting dynamic and static sparse attention mechanisms

ActiveCN117744728BBiological modelsComputer hardwareSparse methods
The application discloses a kind of support dynamic sparse and static sparse hardware accelerator, comprising: data segmentation and reordering module is used to the input data is segmented to adapt to the size of spatial accelerator hardware;Spatial accelerator module is used to support the operation of sparse attention mechanism;Weight summation module is used to support the segmentation of hybrid attention mode, the result obtained by the calculation of segmented input data is merged to obtain the final output;Pattern matching module includes matrix multiplication operation module, double tuning sequencer and sliding window comparator, for hybrid attention mode matching.The application simultaneously supports static sparse method and dynamic sparse method, and can carry out efficient static and dynamic sparse attention calculation.Saves at least 6.1 times of calculation amount, while maintaining the accuracy of output result.
Owner:SHANGHAI JIAOTONG UNIV

Target protection type mask prior guided low rank sparse reconstruction method for fmcw radar jamming suppression

PendingCN122260243AWave based measurement systemsRadar observationsSparse methods
This invention belongs to the field of radar signal processing and intelligent sensing technology, specifically relating to a target protection mask prior-guided low-rank sparse reconstruction method for FMCW radar interference suppression. The method includes the following steps: 1. Acquiring FMCW radar observation signals and preprocessing them; 2. Performing time-frequency transformation on the preprocessed FMCW radar observation signals to extract basic features; 3. Accurately locating the interference region in the time-frequency domain, forming a binary mask prior, and constructing a mandatory target protection region; 4. Constructing a low-rank sparse matrix and a target protection low-rank sparse decomposition model based on mask prior guidance; 5. Solving the target protection low-rank sparse decomposition model to obtain the decomposition results; 6. Reconstructing and post-processing the decomposition results, outputting the interference suppression results, and evaluating the effect. This method combines the intuitiveness of time-frequency detection methods with the reconstruction capability of low-rank sparse methods, reducing the probability of target echoes being misclassified into sparse terms.
Owner:HANGZHOU DIANZI UNIV

Bayesian doa estimation method and device based on weighted atomic norm with feedback information assistance

The application discloses a feedback information auxiliary Bayesian DOA estimation method and device based on a weighted atomic norm, and the method comprises the following steps: acquiring output information of a target tracker of a fusion center, and calculating a predicted direction of arrival (DOA) of each target according to the output information; constructing a prior interval of a DOA estimation value of each target according to the predicted DOA; and calculating the DOA estimation value of each target by using the prior interval and an atomic norm algorithm. The application converts the prior knowledge, i.e. the prior interval of the DOA estimation value of each target, into a semi-positive constraint, and then uses a meshless sparse method of atomic norm minimization to perform DOA estimation. The application combines array observation data and prior information, can obtain a high-resolution DOA estimation value, and reduces the calculation cost.
Owner:XIDIAN UNIV

Multi-baseline insar phase unwrapping method, system, device, and medium

ActiveCN120446894BClustered dataData set
The application discloses a multi-baseline INSAR phase unwrapping method, system, device and medium, wherein the method comprises the following steps: constructing a to-be-clustered data set: acquiring intercept information corresponding to each pixel according to interferograms corresponding to different vertical baselines, then combining position information of each pixel as multi-dimensional clustering features of the pixel, and taking the pixel as a to-be-clustered target to obtain the to-be-clustered data set; wavelet clustering processing: performing clustering processing on the to-be-clustered data set based on wavelet clustering; cluster result correction: correcting cluster labels of pixels in each noise cluster; cluster-by-cluster phase unwrapping: based on the corrected cluster distribution, calculating a blur vector of each cluster by using a closed solution formula or a sparse-TSPA method, and calculating absolute phases of each pixel in a corresponding cluster based on the blur vector of each cluster. When large-size interferograms are processed, the application has more advantages than existing multi-baseline phase unwrapping methods in terms of efficiency, accuracy and adaptability of a baseline ratio.
Owner:CHANGSHA UNIVERSITY OF SCIENCE AND TECHNOLOGY

Upa near field channel estimation method based on two-dimensional block sparsity

PendingCN122372370AComputation complexitySparse methods
This invention provides a UPA near-field channel estimation method based on two-dimensional block sparsity, comprising: representing the UPA near-field channel matrix as the sum of the outer products of the horizontal and vertical ULA near-field steering vectors; constructing improved DFT dictionaries in the horizontal and vertical directions respectively; representing the channel matrix as a total coefficient matrix under these dictionaries, which presents a two-dimensional block sparse structure determined by the outer product of the horizontal and vertical block sparse representation vectors, thereby transforming channel estimation into a two-dimensional block sparse signal recovery problem; and solving the problem using the 2D-PCSBL algorithm, in which the accuracy parameter of each sparse coefficient in the prior distribution is determined by the weighted sum of its own hyperparameter and the hyperparameters of its two-dimensional neighbors, to capture the sparse coupling characteristics of the UPA near-field channel in the horizontal and vertical dimensions. This invention achieves high-precision channel estimation with fewer pilots and a lower signal-to-noise ratio, and its computational complexity is comparable to that of the one-dimensional block sparse method.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

B-Scan atlas optimization data sparse method in time mode of ground penetrating radar and related device

PendingCN121935549AGuaranteed credibilitySolve the over-density problemRadio wave reradiation/reflectionSparse methodsAlgorithm
The invention discloses a B-Scan atlas optimization data sparse method in a ground penetrating radar time mode and a related device, and relates to the technical field of ground penetrating radar signal processing, and the method comprises the steps: determining the instantaneous dragging speed of a ground penetrating radar during collection based on a front A-Scan data association model and a rear A-Scan data association model; establishing a nominal speed judgment model according to the collection frequency and the number of sampling points; smooth filtering is carried out on the instantaneous dragging speed set, the average speed and the standard deviation are calculated, and the speed confidence coefficient is calculated; calculating a comprehensive difference value of the adjacent data frames, and removing one frame in the adjacent data frames based on a self-adaptive redundancy judgment threshold function; calculating a sparse coefficient based on the nominal speed judgment model and the instantaneous dragging speed set; and if the sparse coefficient threshold value is greater than or equal to the sparse coefficient threshold value, performing sparseness and data optimization on the data frame to obtain an optimized A-Scan data sequence, and generating a B-Scan atlas with a high signal-to-noise ratio.
Owner:UNDERGROUND SPACE TECHNOLOGY DEVELOPMENT CO LTD OF CNACG

A robust sparse method for suppressing abnormal noise of seismic data

ActiveCN117665938BSparse methodsAlgorithm
The application provides a robust sparse method for suppressing abnormal noise of seismic data, and belongs to the technical field of seismic exploration data processing. The two-dimensional seismic data is modeled as a combination of effective signals, random noise and abnormal noise, the abnormal noise is modeled as a Laplace scale mixed distribution, the EM algorithm is used to solve the model, the SPGL1 algorithm is used to obtain sparse representation in the discrete cosine transform domain, and the noise component is suppressed in the iteration updating process.
Owner:PETROCHINA CO LTD

Internet of Things data reconstruction method based on structure enhancement and learnable transformation tensor low-rank modeling, application and storage medium

The invention discloses an Internet of Things data reconstruction method, application and storage method based on structure enhancement and learnable transformation tensor low-rank modeling, and belongs to the field of Internet of Things data processing. The method comprises the following steps: dispersing a monitoring area into grid points, deploying a sensor, and constructing data of continuous T time slots into a third-order original tensor; constructing a Hankel block matrix by sliding a window of the original tensor in a space-time direction, and stacking the Hankel block matrix to form a structure enhanced tensor; executing tensor singular value decomposition by using unitary transformation, and minimizing a transformation tensor nuclear norm to establish a low-rank constraint; constructing a low-rank tensor completion model, and expanding the low-rank tensor completion model into an end-to-end trainable network SLRTC-T2Net through an alternating direction multiplier method; and finally, reestablishing missing data by using the trained network. According to the method, the space-time coupling characteristic is fully mined through a double Hankel structure enhancement mechanism, effective coupling of structured modeling and low-rank completion is realized in combination with learnable unitary transformation, the missing data reconstruction precision is effectively improved, and the problem of base mismatching of a traditional sparse method is relieved.
Owner:NORTH CHINA UNIVERSITY OF SCIENCE AND TECHNOLOGY

Layered detection method and system for oil temperature of transformer based on thin-plate spline basis function

The invention discloses a transformer oil temperature layered detection method and system based on a thin plate spline primary function. The method comprises the following steps: forming a detection point attribute by using a propagation time average value, a fusion amplitude, a fusion speed and a fusion coordinate corresponding to each transducer; mapping attributes of each detection point into a three-dimensional coordinate system of the oil tank, and obtaining a detection sparse network based on a graph structure sparse method; dividing the oil tank into a plurality of equal-height layers along the height direction of the oil tank, and performing thin-plate spline difference fitting on the detection sparse network by taking the minimum bending energy as an optimization target based on the thin-plate spline primary function of each layer to obtain a global detection network; determining a speed estimation value of the ultrasonic signal corresponding to any point in the oil tank by using the high-confidence representative value, the low-confidence representative value and a radial basis function of a thin plate spline basis so as to establish a sound velocity distribution field in the oil tank; and according to the sound velocity distribution field in the oil tank, a Bayesian statistical method is adopted, and a corrected oil temperature estimation value is obtained based on a Gaussian likelihood oil temperature observation model.
Owner:STATE GRID SHANGHAI MUNICIPAL ELECTRIC POWER CO +1

Cnn structured sparsification method and system combining knowledge distillation and kernel similarity

ActiveCN118364871BNeural learning methodsData setSparse methods
The present application relates to the technical field of neural network, more particularly, to a CNN structured sparse method and system combining knowledge distillation and kernel similarity. The present application comprises: obtaining a sample data set and dividing it into a training set and a test set; using the sample data set to pre-train an original CNN model to obtain a pre-trained CNN model; based on the pre-trained CNN model, using the training set to perform multiple rounds of formal training until the sparsity of the model and the accuracy on the test set reach an optimal balance, i.e. obtaining a final lightweight model. The present application introduces knowledge distillation and performs different degrees of sparse processing on the teacher model and the student model based on the knowledge distillation, and the loss function of the sparse processing adds a function term of kernel similarity construction, which can better maintain the accuracy performance of the original model while obtaining a model with sufficient sparsity. The present application solves the problem of imbalance between model accuracy and sparsity in the existing SSL method.
Owner:ANHUI UNIV

Neural network sparsity methods, systems, devices, and media

A neural network sparse method, by acquiring the input and output similarity of the attention module and the multi-layer perception module in each Transformer layer; according to the model target sparsity, the module preset quota ratio and the input and output similarity of the attention module and the multi-layer perception module in each Transformer layer, the module target sparsity of the attention module and the multi-layer perception module in each Transformer layer is obtained; according to the module target sparsity of the attention module and the multi-layer perception module in each Transformer layer, the global pruning template of each weight matrix of the attention module and the multi-layer perception module in each Transformer layer is generated; according to the corresponding global pruning template, the weight pruning and reconstruction of the weight matrix of the attention module and the multi-layer perception module in each Transformer layer are carried out. By once weight pruning, the large language model is compressed to a high sparse state, without retraining, and excellent performance can be maintained. Compared with the sparseGPT method, the accuracy of the benchmark test performance is more excellent in high sparsity.
Owner:SHANGHAI ZHICHEN MICRO TECHNOLOGY CO LTD

Asymmetric planar array sparse method and system based on quantum bitter fish search mechanism

PendingCN121615677AQuantum computersArtificial lifeLocal optimumSparse methods
The invention provides an asymmetric planar array sparse method and system based on a quantum bitter fish search mechanism, and belongs to the field of array signal processing. The problem that an existing sparse array optimization method is prone to falling into local optimum or improper parameter setting, and consequently the algorithm optimization capacity is reduced is solved. According to the method, a quantum calculation theory and a traditional bitter fish searching and foraging mechanism are combined, quantum coding is carried out on bitter fish individuals in a population, quantum positions of the quantum bitter fish individuals are evolved and updated by combining simulation of a quantum revolving door and design of a quantum revolving angle, and the positions of the quantum bitter fish individuals are updated according to a measurement rule; wherein the adsorption following strategy, the experience accumulation strategy and the host-side foraging strategy are optimized in a collaborative manner, so that compared with a traditional optimization method, the probability of falling into local convergence is reduced, the optimization speed of an evolution mechanism is increased, and the convergence precision is higher.
Owner:HARBIN ENG UNIV

Model sparse method and electronic equipment

The embodiment of the invention provides a model sparse method and electronic equipment. The method comprises the following steps: respectively acquiring original weights of network layers in an original image processing model; for each network layer, dividing the original weight of the network layer into at least one weight group according to a plurality of grouping modes; the original weights in the original image processing model are sparse according to the syn-position of each original weight in each weight group and a preset sparse ratio, a first sparse image processing model is obtained, and the syn-position is a sequence in which sorting is carried out according to the sequence from large to small. According to the invention, the accuracy of the result output by the image processing model and the occupied system resources can be balanced, so that the accuracy of the image processing model can be ensured on the premise that the image processing model can be deployed in the terminal equipment with less resources.
Owner:HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO LTD