18results about How to "Reduce inference time" patented technology

The invention discloses a real-time auricle identification and auricular point positioning method and system for multi-task feature sharing. An auricle identification and auricular point positioning combined model used in the method comprises an encoder and a decoder. The encoder includes a backbone network and a neck network. The decoder comprises a plurality of detection heads. A plurality of detection heads receive outputs of different layers of the neck network. The detection head comprises a target regression branch, a target classification branch and a feature point regression branch which are parallel. A plurality of detection heads share output features of the same encoder, and parallel target regression branches, target classification branches and feature point regression branches in the detection heads are respectively used for calculating loss functions of different tasks; therefore, auricle identification, frame selection and auricular point feature point marking tasks can be efficiently completed; on the basis, high-frame-rate real-time prediction is realized in the field of auricular point positioning for the first time, and the limitation of the prior art is broken through.

The application provides a large model inference acceleration method, device, equipment, storage medium and program product, and relates to the technical field of artificial intelligence, and the method comprises the following steps: inputting an interactive prompt word and historical dialogue into a large language model for self-recurrence decoding to obtain a current word element; it is detected whether the current word element is a text operation semantic word element; if the current word element is a text operation semantic word element, a target text segment is copied from existing text information based on the text operation semantic word element; a plurality of target word elements are updated to the end of the output text; based on the large language model, self-recurrence decoding is continued to generate a next word element, the next word element is taken as the current word element, and the step of detecting whether the current word element is a text operation semantic word element is returned to until the large language model generates an end symbol, and an updated output text is obtained. Through the above manner, the text copying efficiency is improved, the inference acceleration effect of the large language model is optimized, and the accuracy and stability of the copying operation are beneficially ensured.

The invention belongs to the field of computer vision and video generation, and particularly discloses a portrait animation generation method and system based on consistent distillation. The method comprises the steps that a reference image sample and a human body posture sequence sample are collected to serve as a training set, a pre-trained teacher model is constructed based on the training set, and the teacher model is used for generating a target video; initializing a consistency distillation model to obtain a student model, and transmitting knowledge of the teacher model to the student model through a track segmentation consistency distillation method; optimizing the student model through auxiliary loss optimization, dynamic region weighted optimization and facial detail injection to obtain an optimized model; and inputting a reference image to be reasoned and the human body posture sequence into the optimization model to obtain a portrait animation video. According to the invention, the time sequence consistency, coherence and detail fidelity of the generated video can be effectively improved.

This application relates to the field of data processing technology, and in particular to a method, apparatus, device, and storage medium for model training and 3D mesh reconstruction, used to rapidly generate high-quality 3D results. The model training method includes: obtaining an initial repair model by distilling a student model to be trained; the initial repair model is used to make the input initial sample set, after M iterative repairs, present the shape of a 3D point cloud corresponding to the initial sample set; obtaining an intermediate repair model by distilling the initial repair model; the intermediate repair model is used to make the input intermediate sample set, after N iterative repairs, present the shape of a 3D point cloud corresponding to the intermediate sample set; and obtaining a target repair model by adversarial training of the intermediate repair model based on the initial repair model, so that the error between the results obtained by repairing the same target sample set using the target repair model and the initial repair model conforms to a preset error range.

This invention discloses a lightweight joint estimation method for battery state of charge (SOC) in resource-constrained MCUs, comprising: extracting the weight matrices and bias terms of each layer of a trained LSTM time-series estimation network and flattening them into a one-dimensional static constant array; constructing a custom pure C language matrix operation library independent of a third-party AI inference framework on the target microcontroller, employing a global static memory pool management strategy, and defining a unified structure containing the number of matrix rows, columns, and one-dimensional floating-point data pointers at the C language level; the target microcontroller calling the custom pure C language matrix operation library to directly read the one-dimensional static constant array to complete the forward inference calculation of each gate unit of the LSTM network and output the prior SOC observation value; and calling the custom pure C language matrix operation library to perform state equation iteration of the Kalman filter and output the SOC estimation result. This invention enables the safe and efficient operation of complex coupled algorithms on a very low computing power platform.

The invention relates to a small sample point cloud semantic segmentation method and device, computer equipment and a storage medium. The method comprises the steps that support set point clouds and query set point clouds of corresponding masks are acquired, feature extraction is carried out on the support set point clouds and the query set point clouds, and support set features and query set features are obtained; according to the distance between the support set features and the query set features, aligning the support set features according to the distance to obtain the aligned support set features; obtaining a corresponding prototype according to the aligned mask supporting the set features, splicing the prototype with the query set features to obtain expanded query set features, extracting point cloud feature distribution information from the expanded query set features, and correcting the point cloud feature distribution information to obtain a point cloud feature distribution information set; and segmenting a corrected prototype and a corrected query set feature from the corrected point cloud feature distribution information. The method can reduce the reasoning time, and greatly reduces the point cloud segmentation error.

The application provides a multi-scene safety inspection method and system based on a UAV, and belongs to the technical field of UAV safety inspection, and comprises the following steps: constructing a multi-scene safety sample library; training a multi-task computer vision model based on the multi-scene safety sample library to obtain a safety inspection algorithm model integrating multiple recognition capabilities; the multi-task computer vision model comprises a shared feature extraction backbone network and multiple independent task head networks; a training set is input into the shared feature extraction backbone network to extract general feature maps; the general feature maps are respectively input into the multiple independent task head networks for parallel training to obtain the safety inspection algorithm model; and the safety inspection algorithm model is loaded on a UAV flight platform to perform parallel inference analysis on inspection images collected by the UAV in real time, and to identify preset safety hidden danger targets.

The invention discloses a crack detection method and system based on edge end equipment, and the method comprises the following steps: collecting an image frame of a crack condition to be detected, and carrying out the preprocessing of the image frame; performing matrix construction on the preprocessed data, and performing image feature extraction on the preprocessed data by using convolution calculation; performing quantization processing on a feature extraction result by using an INT8 quantization algorithm; inputting the quantized data into a Leaky ReLU function to carry out data nonlinear transformation; constructing a 2X2 data matrix, and processing the data after nonlinear transformation by using a maximum pooling method; carrying out fusion operation on the feature maps of different levels; performing further feature extraction on the fused feature data to obtain output layer data; analyzing the output layer data; and converting the target frame information into RGB data for visual display. The target detection effect can be improved, and the problems of large model size, large equipment weight, high system power consumption, dependence on a network and the like in the existing field environment crack detection technology are solved.

The application provides a SAR target scattering center parameter fast extraction method, and mainly solves the problems of slow speed and low precision of a traditional SAR target scattering center parameter extraction method; firstly, the application models a scattering center parameter solving problem based on a sparse representation theory; then, a SAR target scattering center parameter extraction problem model based on a semi-quadratic splitting method is constructed, a deep unfolding network is constructed according to an optimization process based on the semi-quadratic splitting method, and the SAR target scattering center parameter is extracted by using the deep unfolding network; compared with a traditional method, the method constructs a deep unfolding network based on the semi-quadratic splitting method and a scattering center model, and realizes efficient and interpretable SAR target scattering center parameter extraction.

This invention discloses a 3D multi-object tracking method based on spatiotemporal adaptive attention. The method includes: acquiring 2D multi-source data and 3D multi-source data of a target scene; extracting image features from the 2D multi-source data to obtain image features, and extracting point cloud features from the 3D multi-source data to obtain point cloud features; fusing the image features and the point cloud features to obtain fused features; determining the detection state of each object in the target scene based on the fused features; extracting cooperative features between the detected object and the predicted object based on the detection state; and updating the object detection and tracking state in the target scene in real time based on the cooperative features. This invention can effectively achieve better tracking performance and reduce inference time, and can be widely applied in the field of computer technology.

This invention discloses an interpretable low-light image enhancement method. It constructs an unpaired learning framework, EDC-Net, with enhancement and degradation branches forming a closed loop. The enhancement branch adaptively enhances the brightness and contrast of the low-light image through pixel-level affine mapping, while the degradation branch predicts physically meaningful degradation parameters such as color gain and exposure scaling. The enhanced image is then reconstructed into a low-light image through a chain of explicit degradation operators, forming a cyclic consistency constraint. Training employs a three-stage progressive optimization strategy: degradation warm-up, master adversarial training, and fine-tuning. During the inference phase, only the lightweight enhancement branch is run. This invention achieves physical interpretability and controllability of the enhancement process, avoids overexposure and artifacts, improves training convergence stability, and significantly increases inference efficiency. It is suitable for real-time image processing scenarios such as nighttime surveillance and autonomous driving.

The invention provides an event camera real-time deblurring method based on dynamic edge guidance. The event camera real-time deblurring method comprises the following steps: acquiring a to-be-recovered blurred image and event stream data in the same field of view; extracting an image modal feature and an event modal feature by using a double-flow visual encoder; constructing a dynamic edge guiding module, predicting pixel-level multi-level fuzzy probability distribution, and generating a dynamic space edge priori graph; removing redundant background events by using an edge prior graph, and screening out a key event Token rich in motion information; and constructing a cross-modal fusion module based on bidirectional RWKV, carrying out long-distance space-time modeling on the screened event Token and image features with linear calculation complexity, and finally decoding and outputting a clear image. According to the method, the sensor noise is effectively suppressed and the calculation redundancy is reduced under the condition of not depending on the traditional hard gating through a'guide-selection 'normal form, and the image deblurring which is high in signal-to-noise ratio and high in structural similarity and meets the real-time requirement is realized.

The invention discloses an electric meter detection method and device based on SVTRLCNetV3. The method comprises the following steps: setting a plurality of robot inspection points; constructing and training a state value identification model and a numerical value identification model of the intelligent polling ammeter; making a template drawing and an algorithm configuration file of each robot inspection point; training a bidirectional LSTM sequence result analyzer; the inspection robot records an electricity meter video; according to the ammeter video, the algorithm configuration file corresponding to the robot inspection point and the template drawing closest to the current time period, executing an algorithm detection program to obtain an ammeter reading sequence; and a bidirectional LSTM sequence result analyzer is used to carry out reasoning on the ammeter reading sequence, and an ammeter value corresponding to each state value is output. According to the method, effective detection can be realized for the intelligent polling ammeter with multiple states continuously and circularly switched, an interference identification result is effectively eliminated, and the accuracy of the identification result is finally ensured.

The invention provides an autonomous navigation laser radar-camera fast fusion target detection method and device and a storage medium, and belongs to the field of multi-modal target detection, and the method comprises the steps: obtaining a laser radar point cloud and a camera image; obtaining point cloud BEV features according to the laser radar point cloud; performing feature extraction on the camera image to obtain a first image feature, and converting the first image feature into an image BEV feature by using a dynamic view angle converter; fusing the point cloud BEV features and the image BEV features to obtain fused BEV features; and a final target detection result is obtained. According to the invention, the operand of BEVPooling is reduced through the dynamic view angle converter, and the time and space complexity of the network structure is reduced, so that the reasoning time of the laser radar-camera fusion perception neural network is reduced, and the real-time performance of target detection is improved.

The application provides a real-time target detection method in an ultrahigh-resolution image scene, comprising: processing an original image to generate a high-resolution image and a low-resolution image; processing the low-resolution image to obtain a reserved area; cutting the high-resolution image according to the reserved area to generate a plurality of regional subgraphs; and detecting the regional subgraphs to obtain a detection result. The application can quickly detect the area requiring further fine-grained detection from an ultrahigh-resolution image through resolution processing, multi-scale density regression, area determination and area generation processing. In addition, due to the scale normalization, target detection and result merging processing, the final ultrahigh-resolution detection result can be generated. In the target detection stage, the plurality of regional subgraphs can be processed in parallel, which can greatly improve the inference time. Since part of the object-free area can be discarded in the density estimation stage, the required storage resources and calculation time can be saved.

The invention relates to a rapid pesticide residue screening method based on an optimized electronic nose array. The rapid pesticide residue screening method comprises the following steps: selecting a plurality of gas sensors made of different sensitive materials to form a basic sensor group, and performing array arrangement optimization; grading the to-be-detected agricultural product sample; synchronously collecting resistance change signals and response peak value occurrence time of the sensor in a specified time period; performing baseline correction on the dynamic response data, and then removing environmental interference noise; screening out specified key feature parameters; dividing the screened key feature parameters into a training set, a verification set and a final feature set according to a specified proportion, and performing training optimization verification on a fusion model of the support vector machine and the random forest; inputting the final feature set into the optimized screening model, and outputting a positive / negative judgment result and confidence; and respective processing is carried out according to the division of the confidence. Through sensor array optimization, pretreatment, multi-dimensional data preprocessing and fusion model construction, rapid and accurate screening of pesticide residues is realized.

The invention relates to the technical field of image generation, and provides an image generation method and device, electronic equipment and a medium. The method can perform fusion processing on an image feature vector of a prompt style image and a time feature vector of a preset time step to obtain a time style fusion feature vector of the prompt style image; determining a style fusion feature vector of the prompt style image according to the image feature vector of the prompt style image; performing fusion processing on the image feature vectors of the to-be-identified image and the prompt style image to obtain an initial style feature vector of the to-be-identified image; determining a target feature vector of the to-be-recognized image according to the image feature vector of the to-be-recognized image; and denoising the noise map based on the feature vectors through a diffusion model to obtain a target image. According to the method, the efficiency and the effect of image style conversion are improved by optimizing feature fusion and denoising processing.

The present invention discloses a fully automatic and fast detection and segmentation method for photovoltaic cell defects. The present invention adopts a lightweight SSA-ViT image encoder to replace the heavyweight ViT image encoder in SAM, and adopts a separable self-attention mechanism (SSA) to replace a multi-head attention mechanism (MHA), which greatly reduces the complexity of the attention mechanism and the amount of calculation, and reduces the inference time of a single-frame image from an average of 4099ms to an average of 11.7ms (350 times), thereby greatly improving the detection efficiency of the model. Moreover, the prediction result of the YOLOv10 model is used as a new segmentation paradigm for YoMo-SAM prompt information, and the human-computer interaction segmentation paradigm of the original SAM is abandoned. Under the premise of ensuring the segmentation accuracy, the fully automatic target detection and segmentation tasks are truly realized; at the same time, the task generalization of zero samples is realized, and the problem of data scarcity is overcome while avoiding manual segmentation, thereby improving the detection and segmentation accuracy of the model.