Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

771 results about "Model compression" patented technology

Self-adaptive question-answering system and method based on knowledge distillation and multi-modal dynamic fusion

The invention discloses an adaptive question-answering system based on knowledge distillation and multi-modal dynamic fusion, and the system comprises a knowledge distillation module which is used for migrating knowledge of a teacher model pre-trained on corpora in the communication field to a lightweight student model, achieving model compression through optimizing a distillation loss function, and obtaining a multi-modal dynamic fusion model; the loss function comprises a soft label output by the teacher model and a KL divergence constraint output by the student model; the multi-modal knowledge fusion module comprises a feature extraction unit, a self-adaptive weighting unit and an attention fusion unit; the self-adaptive inference engine comprises a semantic analysis unit; according to the cross-modal reasoning method and system, semantic alignment of equipment parameters, protocol texts and topological graphs is achieved through the multi-modal dynamic fusion technology, and the cross-modal reasoning accuracy is improved; compared with an original model, the lightweight student model has the advantage that the reasoning speed is increased in a protocol analysis task.
Owner:NANJING UNIV OF POSTS & TELECOMM +1

Compressing Information Provided to a Machine-Trained Model Using Abstract Tokens

A technique uses a machine-trained model to generate a response based on a prompt which expresses current input information and abstract token information. The abstract token information summarizes a full dialogue history of a dialogue, and is generated by the model itself. The technique reduces the size of the prompt by incorporating the abstract summary information in lieu of the full dialogue history. A training system trains the machine-trained model by successively improving the predictive accuracy of the machine-trained model, while rewarding the machine-trained model based on an extent to which the machine-trained model compresses instances of abstract token information.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Fine adjustment and deployment method and system for domain-specific large model based on adaptive optimization

The invention discloses a field specialized large model fine tuning and deployment method and system based on adaptive optimization, belongs to the technical field of artificial intelligence and machine learning, and aims to solve the technical problem of how to improve the rapid adaptation capability of a large model on small-scale field data. In order to meet the requirements of special fields of law, medical treatment, finance and the like on professional terms and complex contexts, the technical scheme adopted by the invention comprises the following steps of: data processing and sample generation: performing cleaning, feature extraction and small sample expansion on field data, and generating a high-quality training sample through a field feature guide mechanism; small-sample fine tuning and migration: realizing rapid field adaptation of a large model through a small-sample learning technology and dynamic Prompt optimization, and reducing dependence on large-scale annotation data in combination with cross-field migration learning; compressing and optimizing the model; performing automatic deployment and collaborative reasoning; and monitoring and adaptive optimization are carried out.
Owner:INSPUR TIANYUAN COMM INFORMATION SYST CO LTD

Weld joint positioning and defect detection system and method based on deep learning

According to the weld joint positioning and defect detection system and method based on deep learning, the target detection pyramid network structure suitable for different image sizes is applied to weld joint detection, and the adaptability of intelligent weld joint detection to the image sizes is improved; meanwhile, a defect labeling mode of a free rectangular frame is selected, so that the identification accuracy of positioning is improved; welding seam positioning and defect identification are carried out by adopting a deep learning method based on an FPN network structure through marking defects of welding seams, air holes, welding beadings and pits in an image data set, and training of target detection and semantic segmentation functions is completed; according to the method, model compression is carried out by adopting double-correlation knowledge distillation, correlation between spatial positions and correlation between channels in a feature map are considered at the same time, and two types of correlation information are migrated from a complex model (teacher model) to a compact model (student model), so that compression of the model is realized, and balance between segmentation precision and reasoning speed is achieved.
Owner:HUANGHE S & T COLLEGE

Corn kernel quality detection model construction method and system based on multi-source data fusion

The invention relates to the technical field of corn kernel quality detection, in particular to a corn kernel quality detection model construction method and system based on multi-source data fusion, and the method comprises the following steps: S1, multi-source data collection: collecting apparent morphology data of corn kernels through a multi-spectral imaging device, synchronously utilizing a near-infrared spectrometer to obtain spectral data of internal components of the corn kernels, and measuring structural density characteristic data of the corn kernels in combination with a sonic sensor; s2, multi-modal feature construction: forming a multi-modal feature matrix; s3, dynamic weighted fusion: generating a mixed feature vector; s4, constructing a dual-channel neural network: constructing a dual-channel deep neural network based on the generated mixed feature vector; and S5, model compression and deployment optimization: generating a lightweight detection model suitable for the embedded device. According to the invention, multiple requirements of an agricultural field on real-time performance, precision and deployment flexibility are met.
Owner:BEIJING SUIHONG HUACHUANG TECHNOLOGY CO LTD

Large model increment training method and system based on dynamic sparsification

The invention belongs to the technical field of model training, and particularly relates to a large model increment training method and system based on dynamic sparsification. The method comprises the following steps: S1, evaluating the parameter importance of a large model by adopting a multi-dimensional evaluation method, and reflecting the contribution of parameters to the performance of the large model; s2, performing dynamic sparsification control on the large model structure by adopting a self-adaptive structure adjustment method; s3, performing incremental training management on the large model by constructing a capacity-adjustable empirical playback buffer pool and proposing a multi-objective loss function; and S4, carrying out model compression optimization on the large model by adopting a mixed precision quantification strategy. The method has the characteristics that the network structure can be dynamically adjusted by evaluating the importance of model parameters in real time, so that the efficient training is realized while the model performance is ensured.
Owner:HANGZHOU MICRO MACRO TECH CO LTD

Road safety early warning method and system based on mixed precision quantification visual large model

The invention discloses a road safety early warning method and system based on a mixed precision quantification visual large model, and the method comprises the steps: collecting road traffic safety videos and pictures, and carrying out the preprocessing, data enhancement and marking, thereby forming a diversified data set; a pre-trained visual large model is selected as a teacher model, after fine tuning, output layer and middle layer knowledge is extracted, key features are weighted, and meanwhile, a lightweight neural network is taken as a student model, same input is received, and prediction and middle feature maps are output. And inputting data into the two models and the student model to carry out mixing precision quantification forward propagation, constructing a total loss function containing tasks, knowledge distillation and quantification learning loss, and updating parameters through back propagation. And after training is completed, exporting a quantitative model, and deploying the quantitative model to an edge computing platform to realize safety early warning. The lightweight model can realize rapid reasoning on edge equipment such as a vehicle-mounted road side, and the problem that performance and efficiency are difficult to consider in a traditional model compression method is solved.
Owner:HARBIN INST OF TECH

Intelligent security remote inspection and control method based on AI

The invention relates to the technical field of security management, in particular to an AI-based intelligent security remote inspection and control method, which comprises the steps of front-end intelligent equipment deployment, intelligent inspection execution, data processing and intelligent analysis and remote control and linkage response. Compared with the defects of incomplete information and high false alarm rate due to the fact that equipment appearance anomaly detection mainly depends on single-modal data in the prior art, the scheme adopts multi-modal data preprocessing and feature extraction, constructs a cross-modal alignment network architecture, dynamically fuses laser radar, RGB-D images and IMU data by using a self-attention mechanism, and improves the detection accuracy of the equipment appearance anomaly. According to the method, more accurate equipment appearance abnormity identification is realized by combining environment self-adaptive adjustment, and the model is compressed and deployed to an edge end through a knowledge distillation technology, so that real-time reasoning and analysis are realized, the intelligent level of security inspection and the accuracy of abnormity detection are remarkably improved, the false alarm rate is reduced, and the practicability and reliability of the system are enhanced.
Owner:GUANGZHOU YOUSEN INFORMATION TECHNOLOGY CO LTD

Personalized fitness system and method based on multi-modal data and adaptive large model

The invention provides a personalized fitness system and method based on multi-modal data and an adaptive large model. According to the method, multi-modal data are integrated, and heterogeneous data collaborative analysis is realized by using a space-time alignment algorithm and a confidence coefficient weighting mechanism. A multi-task learning framework is adopted, physiological prediction, exercise risk early warning and psychological incentive strategy generation tasks are synchronously processed, a user stage target is adapted through a dynamic attention mechanism, and federal learning and transfer learning technologies are combined. A nonlinear periodic planning engine based on reinforcement learning dynamically adjusts training load and action difficulty according to real-time biomechanical simulation results and recovery state evaluation, and meanwhile, a lightweight model compression technology and end-side reverse dynamics calculation are adopted. Based on the scheme, the exercise performance prediction precision and the early warning timeliness are improved, and the exercise loss risk caused by overtraining is reduced; the cold start data bottleneck is broken through; low-delay virtual coach interaction and privacy protection are realized; and dynamically adjusting the training intensity and the incentive strategy.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

Large language model pruning method and device, storage medium and program product

The invention provides a big language model pruning method and device, a storage medium and a program product. The method comprises the steps of obtaining a pre-trained big language model and a corresponding text data set; dependent neurons are activated through iteration, interdependent coupling groups in the large language model are recognized, and the coupling groups serve as basic units of pruning; based on the coupling group, performing coarse-grained evaluation and fine-grained evaluation on the parameters in the group, and fusing and calculating the importance of the parameters to generate a pruning mask; redundant parameters in the model are removed through pruning operation according to the pruning mask; performing parameter optimization on the pruned model, and performing fine tuning through a text data set to generate a target large language model; and deploying the target large language model to a computing device, executing a text generation or semantic analysis task, and counting the task accuracy rate and the model compression rate. According to the method, the parameter quantity of the model is effectively reduced, so that deployment is simple, and the downstream task processing accuracy of the pruned model is improved.
Owner:INST OF COMPUTING TECH CHINESE ACAD OF SCI

Optimizing large language models with domain-oriented model compression

Systems and methods for optimizing large language models (LLM) with domain-oriented model compression. Importance weights for general knowledge in a trained LLM, pretrained with deep learning, can be determined by computing the error when removing a weight from the trained LLM. The trained LLM can be iteratively optimized to obtain a domain-compressed LLM with domain knowledge while maintaining general knowledge by: fine-tuning the trained LLM iteratively with domain knowledge using the importance weights for general knowledge to obtain a fine-tuned LLM; determining importance weights for domain knowledge in the LLM with a regularization term by using gradient descent to optimize parameters when the fine-tuned LLM is trained with domain knowledge; and pruning learned knowledge based on importance weights for domain knowledge. A corrective action can be performed on a monitored entity using the domain-compressed LLM.
Owner:NEC LABORATORIES AMERICA INC

End-side cloud cooperation system based on hybrid scheduling strategy

The invention relates to the technical field of artificial intelligence and edge computing, in particular to an end-side cloud collaboration system based on a hybrid scheduling strategy. The end-side cloud cooperation system based on the hybrid scheduling strategy comprises a model segmentation module, a state sensing module, a reasoning scheduling module, a model compression and deployment module, an edge optimization engine and a communication synchronization module. According to the end-side cloud cooperation system based on the hybrid scheduling strategy, elastic deployment and dynamic reasoning of a complex model in a multilayer heterogeneous environment are supported, the system state can be sensed in real time, a scheduling path can be optimized, and the robustness of the system is improved; and in combination with model compression and edge operator optimization, the reasoning efficiency is remarkably improved, the communication load is reduced, and then low-delay cooperation between the terminal and the cloud is ensured.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

Optical storage charging station cross-site heterogeneous data fusion health state early warning method

The invention discloses an optical storage charging station cross-site heterogeneous data fusion health state early warning method, which adopts transfer learning and domain adaptation technologies, measures the data distribution difference between a source site and a target site through the maximum mean value difference, realizes knowledge transfer and improves the generalization ability of a model. And on the basis of an Attention-LSTM feature fusion mechanism, feature weights are adaptively allocated, and the fault feature extraction capability is enhanced. And designing a fault mode sharing module, coding the fault mode of the source site into a knowledge base, and rapidly matching similar faults of the target site. A model compression technology is introduced, lightweight deployment is realized through knowledge distillation and a parameter quantification method, and operation of edge equipment is effectively supported. And furthermore, an online learning mechanism is adopted to dynamically update model parameters to ensure that the model adapts to the environment change of the target site. According to the method, the accuracy and robustness of cross-site fault prediction are remarkably improved, the model deployment time is shortened, and the method is widely applied to intelligent operation and maintenance of the optical storage charging and discharging integrated power station.
Owner:NANJING INST OF MECHATRONIC TECH

Multi-unmanned aerial vehicle and unmanned ship formation control method and device based on graph convolutional network and deep reinforcement learning

The invention discloses a multi-unmanned aerial vehicle and unmanned ship formation control method and device based on a graph convolutional network and deep reinforcement learning. The method comprises the following steps: constructing a first simulation environment of multi-agent formation; collecting motion control data of the unmanned ship according to the first simulation environment, and constructing a depth control model based on the motion control data and a sequence generation model; constructing a graph convolutional network model, and obtaining compression features according to the graph convolutional network model and the multiple agents; constructing an executor network and an evaluator network based on an independent near-end strategy optimization algorithm; obtaining an initial control model according to the graph convolutional network model, the compression features, the executor network and the evaluator network; and training and testing the initial control model in a first simulation environment according to the depth control model to obtain a target control model. The method can improve the sensing data processing efficiency and the real-time decision response performance, and can be widely applied to the technical field of multi-agent control.
Owner:SUN YAT SEN UNIV

Multi-modal property management scene risk point detection system based on artificial intelligence

The invention relates to the technical field of industrial intelligent inspection driven by artificial intelligence, and discloses a multi-modal property management scene risk point detection system based on artificial intelligence, and the system comprises a multi-modal data collection module which is used for synchronously obtaining visible light images, infrared thermal imaging and Internet of Things sensor data in building facilities; the domain self-adaptive defect generation module is based on a decoupling type generator and a StyleGAN2-ADA framework; a multi-modal feature fusion module; an attention enhancement detection module; a lightweight model compression frame; a real-time detection module; and a continuous learning module. High-fidelity defect samples are generated through the decoupling generator and the StyleGAN2-ADA, the problems of sample scarcity and class imbalance are solved, samples are generated through the cyclic generative adversarial network to cover multiple defect types, the acquisition period of the defect samples is shortened, and the requirement for training real samples is reduced.
Owner:SHENZHEN CHENGZECHENG THIRD PARTY SERVICE EVALUATION BIG DATA TECH CO LTD

Digital twin drive multi-source heterogeneous data fusion and intelligent analysis method for oil and gas pipeline construction

The invention discloses a digital twin-driven multi-source heterogeneous data fusion and intelligent analysis method for oil and gas pipeline construction. The method comprises the following steps: collecting multi-source heterogeneous data related to oil and gas pipeline construction; fusing data by using a space-time diagram neural network and constructing a dynamic offset compensation model to correct coordinate drift; constructing a data credibility dynamic evaluation chain, performing cross validation on sensor data to generate a confidence coefficient weight, and complementing missing data through a GAN complementing module to form a credibility enhanced data set; designing a layered distillation compression algorithm to compress the PINN model into a TinyLSTM engine, and developing a model increment updating protocol to realize efficient collaboration of a cloud end and an edge end; and training and optimizing a TinyLSTM engine by using the data set with enhanced credibility. According to the method, the defects in the aspects of data dynamic correction, credibility evaluation and complementation, model edge deployment real-time response and the like in the prior art are overcome, and the method has remarkable innovativeness and practicability.
Owner:INNER MONGOLIA WESTERN NATURAL GAS CO LTD +1

Image big data classification and identification method and system based on deep learning

The invention relates to the field of computer vision and deep learning, and discloses an image big data classification and recognition method and system based on deep learning, and the method comprises the steps: generating a gating matrix through the extraction of an image frequency domain energy coefficient, compressing a convolution kernel through the combination of asymmetric tensor decomposition, and carrying out the self-adaptive training through cross-modal semantic alignment and a meta-learning task. Efficient classification reasoning of dynamic path selection is realized, and the precision and the calculation efficiency are improved; the system comprises a frequency domain analysis module, a dynamic sparse gating module, an asymmetric tensor decomposition module, a meta-learning task generation module, a cross-modal alignment module and a dynamic inference engine module. According to the method, through cross-modal semantic alignment and meta-learning task optimization, in combination with lightweight parameter storage and edge calculation path selection, fine-grained classification precision improvement, model compression and high-efficiency reasoning are realized, and the calculation efficiency and generalization ability in a complex scene are remarkably enhanced.
Owner:BEIJING NANSHAN TONGXING TECHNOLOGY CO LTD

Small-amount data fine tuning and self-repairing generative model compression method for specific task of power system

The invention discloses a small-amount data fine tuning and self-repairing generative model compression method for specific tasks of an electric power system, which reduces calculation requirements through knowledge distillation and model compression technologies and enables an electric power system model to operate efficiently in a resource-limited environment. Knowledge distillation extracts core knowledge of a large model and migrates the core knowledge to a small model, then pruning and quantification are combined, the parameter quantity is optimized, and lightweight deployment is ensured. Meanwhile, through context awareness, self-repairing and anti-fact GAN, the model generation and adaptive capacity is further enhanced. The context-aware GAN can adjust a model in real time to cope with environmental changes, and the self-repairing GAN generates a replacement sample when data is abnormal, so that the data input quality is ensured; the anti-factual GAN simulates different strategies in a hypothesis situation, and provides support for risk assessment and optimization. Through the mechanism, the model maintains high-precision prediction and response in various scenes, and efficient and stable operation of a power system is guaranteed.
Owner:CHINA SOUTHERN POWER GRID COMPANY

Hydraulic power plant automatic debugging system with adaptive communication function

The invention discloses a hydraulic power plant automatic debugging system with a self-adaptive communication function. The system comprises a processing unit, a storage unit, a communication module, an input / output interface, a task classification module, a model architecture configuration module and other functional modules. The use method comprises the following steps: analyzing task complexity and high-dimensional features of input data through a task classification module, and grading by adopting algorithms such as principal component analysis and a support vector machine; the model architecture configuration module is used for matching a model architecture according to the complexity level and determining an initial calculation path; the dynamic path adjustment module optimizes a calculation path in combination with real-time data, and the resource distribution module redistributes resources when the calculation power exceeds the limit; the model compression module generates a compression model adaptive to the edge device through pruning and quantization algorithms; the parameter fine tuning module is used for jointly optimizing model parameters for a multi-task scene; according to the method, the adaptability and efficiency bottleneck of an existing debugging tool in a complex scene is effectively solved, and the intelligent debugging level of an automatic system of a hydraulic power plant is improved.
Owner:CHINA YANGTZE POWER

Large model compression method and device, task processing method and equipment and storage medium

The invention relates to the technical field of model compression, and provides a large model compression method and device, a task processing method and equipment and a storage medium, and the large model compression method comprises the steps: carrying out the layer-by-layer quantification of a linear layer of a to-be-compressed initial large model, and obtaining a first large model; the initial large model is a pre-trained large language model constructed based on an expert hybrid architecture; performing route calibration on each expert sub-model in the first large model to obtain a second large model; in the reasoning process of the second large model, based on the task type of a to-be-executed target task, the importance of each expert sub-model in the task type is evaluated; and performing dynamic pruning on each expert sub-model based on importance so as to compress the second big model. Through a compression mode of combining static quantification and dynamic pruning, on the basis of ensuring the model performance, the memory and calculation overhead required by large model reasoning can be reduced, and efficient operation of the large model on light-weight equipment with limited video memory resources is facilitated.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI

PDF drawing identification and information structured extraction method

The invention discloses a PDF (Portable Document Format) drawing recognition and information structured extraction method. The method comprises the following steps: generating a high-resolution bitmap through image preprocessing; positioning and classifying a text region, a table region and a symbol region in the drawing based on a target detection model of transfer learning; hough transform is combined with SIFT feature matching to identify engineering symbols, and sub-pixel positioning is realized through an RANSAC algorithm; after the oblique text is corrected through affine transformation, the content is extracted through OCR; reconstructing a table structure based on OPTICS clustering and projection analysis; constructing an RDF knowledge graph according to a coordinate association rule; and using U-Net difference to detect and position an omission area and complementing the omission area. According to the method, deep learning and image processing technologies are fused, the problems of low rotating text recognition rate, table structure loss and semantic association deficiency in a traditional method are solved, through lightweight model compression and TensorRT acceleration, the analysis accuracy is remarkably superior to that of the traditional method, and the method can be widely applied to the fields of constructional engineering, petrochemical engineering and the like and has wide application prospects. And the drawing information processing efficiency and the data integrity are improved.
Owner:ZHEJIANG THERMAL POWER CONSTR CO LTD

Alfalfa cold resistance evaluation system based on deep learning

The invention discloses a deep learning-based cold resistance evaluation system for medicago sativa L., and the system comprises a data generation module which is used for generating a phenotypic image and corresponding physiological data of medicago sativa L. under low-temperature stress through a diffusion model embedded with plant low-temperature response physical constraints; the evaluation model module is used for extracting cold resistance characteristics from the image and physiological data by adopting a causal-driven dual-channel adaptive network; and the decision module comprises a hierarchical model distillation unit and a federal reinforcement learning unit, and the hierarchical model distillation unit and the federal reinforcement learning unit realize joint training of model compression and decision strategy optimization through an edge-cloud collaborative architecture, output a cold-resistant decision and realize visualization through an augmented reality interface. The method can effectively solve the core problems of traditional medicago sativa cold resistance assessment in the aspects of data generation, model generalization, decision-making efficiency and the like.
Owner:INSTITUTE OF ECOLOGICAL PROTECTION & RESTORATION CHINESE ACADEMY OF FORESTRY SCIENCE +1

Visual monitoring system for condensate water level of micro hyperbaric oxygen chamber

The invention relates to the technical field of water level monitoring, in particular to a visual monitoring system for the condensate water level of a micro-hyperbaric oxygen chamber, which adopts the technical scheme that an internal image of a water receiving box is acquired at a preset frequency, and water mist and reflective interference are eliminated by adopting a dynamic illumination compensation and frequency domain filtering technology; a U-Net deep learning model is integrated, a water level line is segmented through multi-scale feature fusion, foam and impurity artifacts are recognized in combination with time sequence analysis, a water level value is dynamically corrected, graded alarm is triggered according to a water level threshold value, an air conditioner drainage system is linked, traditional image processing and the deep learning model are combined, and detection robustness under complex working conditions is improved. Real water levels and interferents are effectively distinguished through time sequence analysis and physical characteristic modeling, the real-time requirement under the high-pressure environment is met through the model compression and hardware acceleration technology, and absolute reliability of equipment operation is ensured through linkage of a grading early warning mechanism and a drainage system.
Owner:HEDE NEW ENERGY TECHNOLOGY (KUNSHAN) CO LTD

Remote sensing image classification model compression method based on incremental information guidance

The invention discloses a remote sensing image classification model compression method based on incremental information guidance, and mainly solves the problems of evaluation deviation caused by insufficient representation of dynamic characteristics of a filter and poor coordination of pruning and quantization technologies in the existing model compression technology. Comprising the following steps: 1) acquiring a remote sensing image data set and preprocessing the remote sensing image data set; 2) pre-training the model by using the preprocessed data; 3) obtaining rank information and gradient information of the feature map, and calculating an importance score of a filter in the model according to the information; 4) optimizing affine transformation parameters, obtaining scores and generating a sorting result; and 5) performing compression and fine adjustment on the model in stages to obtain a lightweight model. According to the method, model compression is guided by gradient information, collaborative optimization is realized through integrated design of pruning and quantification in combination with rank information, the model scale and the calculation complexity can be remarkably reduced under the condition that the precision is not affected, and the compression effect is effectively improved.
Owner:XIDIAN UNIV

Discriminator knowledge distillation personalized federated learning method based on conditional generative adversarial network

The invention relates to the technical field of federated learning, and discloses a discriminator knowledge distillation personalized federated learning method based on a conditional generative adversarial network. The problems of appearance of massive participants and influence of non-independent identical distribution of data on federal learning data cost and personalized learning efficiency are solved; a discriminator knowledge distillation model fused with the conditional generative adversarial network is put forward to be embedded into a personalized federated learning framework; the differentiated feature representation of the client model is enhanced through the discriminator knowledge distillation model, so that the personalized model effectively recognizes and captures specific modes and features of individuals, the representation capability and the personalized effect of the model are enhanced, the higher model compression rate is achieved, and meanwhile, the user experience is improved. The conditional generative adversarial network fused with the discriminator generates synthetic data specific to each client, and the synthetic data improves the generalization ability of personalized federal learning and the adaptability of the model on the premise of fully ensuring the data privacy.
Owner:HARBIN UNIV OF SCI & TECH

Face recognition method of intelligent robot

The invention relates to the technical field of intelligent robots, and discloses a face recognition method of an intelligent robot, which comprises the following steps: step 1, lightweight face detection and feature extraction: performing face detection and feature extraction through a lightweight neural network structure, and combining model compression and edge calculation to reduce calculation complexity; and step 2, illumination and attitude adaptability is realized through multi-modal fusion, and face processing under different illumination and attitude conditions is carried out based on the extracted face features by utilizing fusion of an RGB image and an infrared image, adaptive illumination enhancement and 3D attitude correction. Through a multi-modal fusion technology, 3D attitude correction and self-adaptive illumination enhancement, different illumination conditions and attitude changes can be adapted, then the recognition stability of the system in a complex environment is remarkably improved, it is ensured that face recognition has high accuracy and robustness under the conditions of insufficient illumination, strong light or multi-angle offset, and the face recognition accuracy and robustness are improved. And the application requirements of the intelligent robot in multiple scenes are met.
Owner:INNER MONGOLIA AEROSPACE FLYING EAGLE INTELLIGENT ROBOT TECHNOLOGY CO LTD

3D Gaussian sputtering compression method and system based on residual quantization and dynamic pruning

The invention belongs to the technical field of computer graphics and real-time 3D scene reconstruction, and relates to a real-time compression and optimization method based on a 3D Gaussian sputtering (3DGS) model, which realizes efficient storage, transmission and rendering of a three-dimensional scene through residual vector quantization (RVQ) and a dynamic pruning technology, and comprises the following steps: S1, residual quantization vector quantization; s2, enhancing a dynamic pruning strategy; and S3, index compression and coding optimization. The invention provides a real-time 3D Gaussian sputtering (3D Gaussian sputtering) model compression system combining residual vector quantization and dynamic pruning, which can realize high-quality real-time rendering and extremely high storage efficiency. Through three core technologies of a vector quantization strategy, dynamic pruning strategy enhancement and index compression and coding optimization, on the premise that the rendering quality is guaranteed, the purposes that the model storage amount is reduced by more than 45 times, and the rendering speed is increased by 3 times are achieved.
Owner:HUBEI UNIV OF TECH

Three-dimensional model compression transmission method and system based on dynamic feature perception

The invention relates to a three-dimensional model compression transmission method and system based on dynamic feature perception, and relates to the technical field of three-dimensional live-action modeling, and the method comprises the steps: obtaining the original three-dimensional data of a three-dimensional model, carrying out the multi-modal feature extraction based on a model scene, dividing a key region, a transition region and a non-key region, and generating a three-dimensional model partition map, compressing each region according to the partition map label and a preset compression algorithm to generate a multi-resolution LOD sequence, determining a transmission data hierarchy in combination with a network state and equipment parameters, and finally rendering the model according to the transmission data hierarchy, user behavior information and an environment state to obtain a target three-dimensional model. The technical effects of effectively compressing, transmitting and rendering the three-dimensional model according to various factors such as different area characteristics, network states, equipment parameters and user behaviors of the model and improving the transmission efficiency and the rendering quality are achieved.
Owner:BEIJING ZHIHUI YUNZHOU TECH CO LTD

Speech instruction recognition method based on BERT pre-training language model

The invention relates to the technical field of voice recognition, and discloses a voice instruction recognition method based on a BERT pre-training language model, and the method comprises the steps: receiving a to-be-recognized voice, and converting the to-be-recognized voice into a text sequence through an automatic voice recognition model; fine-tuning the BERT pre-training language model, and performing text classification on the text sequence by using the fine-tuned BERT pre-training language model to obtain an instruction category corresponding to the to-be-recognized voice; performing model compression on the fine-tuned BERT pre-training language model by utilizing knowledge distillation to obtain a sequence classification model; according to the method, the situation that the audio data is more difficult to obtain than the text data is considered, the BERT is selected to pre-train the language model, the classification accuracy is improved, the knowledge distillation is utilized to perform model compression, the instruction category label of the to-be-recognized voice is recognized, and the voice recognition accuracy is improved. And data support is provided for man-machine interaction.
Owner:BEIJING UNIV OF POSTS & TELECOMM

Dynamic reasoning path optimization method based on neural architecture search

The invention belongs to the technical field of neural network architecture, and particularly relates to a dynamic reasoning path optimization method based on neural architecture search, which comprises the following specific steps: S1, designing a neural architecture search algorithm: firstly defining a search space, then selecting a search strategy, and then setting constraint conditions; s2, constructing a dynamic reasoning path: firstly performing input data feature analysis, then performing reasoning path guidance based on a knowledge graph, and then predicting the reasoning path by using a model according to the input data features and the knowledge graph; and S3, model training and optimization: firstly carrying out joint training, and then carrying out model compression and acceleration. According to the method, through neural architecture search algorithm design and dynamic reasoning path construction, the problem of computing resource waste is effectively solved.
Owner:BEIJING RUIBO HOLDINGS (GROUP) CO LTD