357 results about "Counter propagation" patented technology

An optical coupling assembly for coupling light from an optical fiber including an angled tip into a planar waveguide via a waveguide coupling element is provided. In one embodiment, the optical fiber extends along the planar waveguide with the angled tip positioned such that light propagating in the optical fiber is coupled by the waveguide coupling element to propagate in the planar waveguide in counter propagation with respect to a fiber propagation direction. In another embodiment, the optical fiber includes a tapered peripheral portion tapering toward the angled tip and is disposed over the planar waveguide with the tapered peripheral portion extending therealong such that light propagating in the optical fiber is coupled to propagate in the planar waveguide with either forward or counter propagation. Embodiments of the present invention may be part of various photonic integrated circuits and may be manufactured more easily than known optical coupling assemblies.

The invention discloses a character detection method and device based on deep learning. The method comprises the steps: designing a multilayer convolution neural network structure, and enabling each character to serve as a class, thereby forming a multi-class classification problem; employing a counter propagation algorithm for the training of a convolution neural network, so as to recognize a single character; minimizing a target function of the network in a supervision manner, and obtaining a character recognition model; finally employing a front-end feature extracting layer for weight initialization, changing the node number of a last full-connection layer into two, enabling a network to become a two-class classification model, and employing character and non-character samples for training the network. Through the above steps, one character detection classifier can complete all operation. During testing, the full-connection layer is converted into a convolution layer. A given input image needs to be scanned through a multi-dimension sliding window, and a character probability graph is obtained. A final character region is obtained through non-maximum-value inhibition.

A method includes determining object class probabilities of pixels in a first input image by examining the first input image in a forward propagation direction through layers of artificial neurons of an artificial neural network. The object class probabilities indicate likelihoods that the pixels represent different types of objects in the first input image. The method also includes selecting, for each of two or more of the pixels, an object class represented by the pixel by comparing the object class probabilities of the pixels with each other, determining an error associated with the object class that is selected for each pixel of the two or more pixels, determining one or more image perturbations by back-propagating the errors associated with the object classes selected for the pixels of the first input image through the layers of the neural network without modifying the neural network, and modifying a second input image by applying the one or more image perturbations to one or more of the first input image or the second input image prior to providing the second input image to the neural network for examination by the neurons in the neural network for automated object recognition in the second input image.

The invention discloses an image marking method based on multi-mode deep learning. The method comprises the following steps: firstly, a depth neural network is trained by utilization of images without labels; secondly, each single mode is optimized by utilization of counter propagation; finally, weights among different modes are optimized by utilization of on-line learning power gradient algorithm. The method employs a convolution neural network technology to optimize parameters of the depth neural network, and the marking precision is raised. Experiments of public data sets show that the method can raise the image marking performance effectively.

The invention discloses a deformable convolutional neural network-based infrared image object identification method. The method comprises the steps of constructing a training set and a test set; establishing a convolutional neural network architecture; adding a softmax classifier to the last layer, and setting an objective function; performing sampling by adopting a convolution kernel of linear ornonlinear deformation; performing pooling operation in a pooling layer by adopting a rule block sampling-based ROI pooling method which is the best in the industry at present; setting learning rate parameters according to experience; and easily performing standard back propagation end-to-end training, thereby obtaining a deformable convolutional neural network. An experiment proves that the spatial geometric deformation learning capability is introduced in the convolutional neural network, so that an identification task of an image with spatial deformation is better finished; the geometric transformation modeling capability of the convolutional neural network and the effectiveness of target detection and visual task identification are improved; and dense geometric deformation in space issuccessfully learnt.

The invention discloses a training device for a memristor-based neural network and a training method thereof. The neural network comprises N neuron layers which are connected one by one. The trainingmethod comprises the following steps of: inputting input data into a first neuron layer of the neural network so as to output an output result of the neural network at the Nth neuron layer, and calculating an output error of the Nth neuron layer; and counter-propagating the output error of the Nth neuron layer in a layer-by-layer manner so as to correct weight parameters between the neuron layers;and in the layer-by-layer counter-propagation process, three-valuing an output error of the mth neuron layer, and reversely inputting a voltage signal corresponding to an output result of the three-valuing operation to the mth neuron layer so as to correct a weight parameter of the mth neuron layer, wherein N is an integer greater than or equal to 3, and m is an integer greater than 1 and smallerthan N. According to the training method, the calculation ability of the memristor-based neural network is improved.

The invention discloses a text classification method and device. The method comprises the following steps of: receiving a plurality of training texts, the categories of which are known; constructing graph structures of the training texts by adoption of a collinear relationship of words after preprocessing the training texts; training parameters of a convolutional neural network through a counter-propagation algorithm according to the graph structures of the training texts, so as to obtain a trained convolutional neural network; receiving an input to-be-classified text; constructing a graph structure of the to-be-classified text by adoption of the collinear relationship of the words after preprocessing the to-be-classified text; and predicting a category technical scheme of the to-be-classified text through the trained convolutional neural network according to the graph structure of the to-be-classified text. According to the method and device, the convolutional neural network is used for carrying out text classification, so that the text classification correctness and credibility are improved.

The invention discloses a super-short-term prediction method of photovoltaic power station irradiance. The method includes the steps that irradiance data are extracted from a history database, data of a night time quantum are removed, corresponding extraterrestrial theoretical irradiance is calculated, data abnormal detection is carried out based on the preceding operations, and the data are normalized in the difference value ratio method of an extraterrestrial irradiance theoretical value and practical irradiance; a training sample set is extracted according to input and output dimensionality of a model; a model of an irradiance time sequence is built through an ANFIS, a the rule quantity and an initial parameter of the ANFIS model are determined in a subtractive clustering method, and a fuzzy model parameter is optimized in a counter propagation algorithm and a least square method; a prediction sample is input, and a prediction value is obtained through calculation; the prediction value is added to form a new sample set, and multiple steps of prediction are achieved in a cycling mode; counter normalization processing is carried out on the prediction value. Super-short-term prediction of the irradiance can be achieved only by means of a history irradiance time sequence, prediction accuracy is good and the method is easy to carry out.

The invention relates to a deep belief network model based cement clinker fCaO prediction method. The method comprises the steps that major variables capable of reflecting the firing situation of a cement clinker are preliminarily selected to form an auxiliary variable set, and a prediction variable is the cement clinker fCaO content; a field instrument and an operator recorder respectively acquires auxiliary variables and field data of the cement clinker fCaO content, a grey relational analysis method is adopted conduct dimensionality reduction on the auxiliary variable set; parameters in a deep belief network structure, namely parameters training the deep belief network are determined according to a deep belief network algorithm and sample data volume, and further optimization of weighting and bias of the whole network is achieved; a counter-propagation algorithm is adopted to conduct error correction on the determined parameters in a deep belief network structure, and further a prediction model of the cement clinker fCaO is determined; real-time data of the auxiliary variable set is acquired, and errors of the obtained real-time data of the auxiliary variable set are eliminated according to 3delta criterions; further, the cement clinker fCaO content is predicted.

The invention discloses an overlay convolutional network-based rolling bearing failure mode recognition method and device, and relates to the field of rolling bearing failure diagnosis. The method comprises the following steps of: extracting a time-frequency domain feature of a vibration signal of a state-known rolling bearing; normalizing the obtained time-frequency domain feature of the state-known rolling bearing into a feature pixel according to a CNN network input format; inputting the feature pixel into a CNN network, and adjusting a model parameter of the CNN network through carrying out forward self-learning and gradient descent-based counter-propagation on the CNN network so as to obtain a trained CNN network; and during the recognition of a practical rolling bearing failure mode, extracting high-order features capable of reflecting intrinsic information layer by layer by utilizing the trained CNN network by taking a time-frequency domain feature of a vibration signal of a state-unknown rolling bearing, and inputting results of the feature self-learning into a top classifier layer by layer, so as to realize failure mode recognition of the rolling bearings under multiple working conditions and strong noises.

The invention discloses a multivariable logistics freight volume prediction method based on an LSTM network, which is used for solving the technical problem of low prediction precision in time seriesdata prediction in the prior art. The method comprises the following steps of: screening logistics freight volume influence factors and preprocessing influence factor data; converting a time series data set supervised learning mode; normalizing the time series data variables of the supervised learning format; dividing a data training set and a test set; setting parameters of an LSTM prediction model and carrying out forward training on the model; and performing back propagation of the model and back normalization of a logistics freight volume prediction value. According to the method, the long-term memorability of the LSTM network for the flow data is fully utilized, the relation between variables can be effectively explored through supervised learning, and the logistics freight volume prediction precision is improved.

The invention discloses a general disturbance generation method based on a generative adversarial network. Firstly, the generative adversarial network generates general disturbance to obtain an adversarial sample; discriminating the adversarial sample and the original sample by a discriminating network, calculating a discriminating network objective function, and performing back propagation for optimization; and finally, predicting adversarial sample classification by a deep learning model, discriminating adversarial samples by a discriminant network, calculating and generating a network objective function, and performing back propagation for optimization. The GAN-based general disturbance generation method provided by the invention can provide a thought of machine learning model safety research for users in the fields of computer vision, deep learning and the like.

The invention provides a deep migration learning method based on entropy minimization, and the method comprises the steps: S1) dividing a source field and a target field according to different migration learning tasks, constructing a migration learning network, and initializing hyper-parameters of the migration learning network; S2) inputting respective data samples of the source domain and the target domain into a transfer learning network and carrying out forward propagation to obtain a network prediction label; training the whole network by using a stochastic gradient descent method according to the proposed loss function, completing updating of network parameters by using back propagation, and stopping training until the model converges or reaches the maximum number of iterations; S3)storing the network model and a training result; according to the target domain label prediction method based on the entropy minimization technology. By maximizing the distribution diversity of each batch of data prediction categories in the target domain, a common solution result occurring when only the entropy minimization technology is used is avoided, and the reliability of transfer learning is guaranteed.

The invention provides a language task model training method and device, electronic equipment and a storage medium. The method comprises the steps of performing hierarchical pre-training in a languagemodel based on corpus samples of corresponding language tasks in a pre-training sample set; carrying out forward propagation on corpus samples corresponding to language tasks in a training sample setin the language task model; fixing parameters of the language model, and performing back propagation in the language task model to update the parameters of the task model; and performing forward propagation and reverse propagation on corpus samples corresponding to the language tasks in the training sample set in the language task model so as to update parameters of the language model and the task model. By means of the method and device, the catastrophic forgetting phenomenon of the language model can be prevented, and meanwhile it is guaranteed that the language model and the task model canachieve the training effect meeting the corresponding learning rate.

The invention discloses a collaborative multi-agent reinforcement learning method. The method comprises the following steps: obtaining observation information of each agent and a global state of a system; transmitting the obtained observation information of each intelligent agent into a deep neural network to calculate and obtain state action values of all actions of the intelligent agent; performing action selection by utilizing a greedy rule; transmitting the state action value corresponding to the adopted action and the global observation information into a reward highway network; rewardingthe highway network to perform information fusion and inputting a combined state action value; and performing gradient back transmission by utilizing a reward signal given by the environment and updating parameters of the neural network so as to obtain a strategy model of each intelligent agent. The data volume required in the training process of the multi-agent system can be reduced, and the invention is suitable for being popularized to large-scale multi-agent systems.

The invention discloses a neural network video deblurring method based on multi-attention mechanism fusion. The method comprises the following steps: S1, constructing a video deblurring model; S2, acquiring an original video sequence, and extracting spatial local and global information of different positions between video frames and similarity information between continuous video frames by using aspatial-temporal attention module in video deblurring; S3, capturing low-frequency and high-frequency different types of information of the input fuzzy video sequence by using a channel attention module in the video deblurring model; S4, fusing the extracted different information to obtain deblurred features, and mapping the deblurred features into an image from a feature space by using an imagereconstruction module to obtain a clear intermediate frame; and S5, calculating content loss and perception loss of the recovered intermediate frame and the corresponding clear image, and performing back propagation to train a network model. Effective deblurring processing can be carried out on the blurred video to obtain clear and real video data.

The invention discloses a small adversarial patch generation method and device, and the method comprises the steps: carrying out the random initialization of an adversarial patch image, adding the initialized adversarial patch image to a selected pasting region on a target object in training data, and manufacturing an adversarial sample; transmitting the adversarial samples into a deep learning model for adversarial feature extraction, and transmitting benign samples without adversarial patch images into the deep learning model for benign feature extraction; jointly inputting the adversarial features and the benign features into a feature enhancement loss function for loss calculation to obtain a loss result; adding a loss result into a model loss function, and updating a pixel value of the adversarial patch through an optimizer after back propagation; and after preset times of iteration, enabling the adversarial patch to enable the deep learning model to output an error result, and ending the adversarial patch processing process. According to the method, the size of the anti-patch in the physical world can be smaller, the manufacturing cost is reduced, the identifiability of the anti-patch is reduced, and a defense method based on detection is broken through more easily.

Systems, apparatuses, and methods for managing buffers in a neural network implementation with heterogeneous memory are disclosed. A system includes a neural network coupled to a first memory and a second memory. The first memory is a relatively low-capacity, high-bandwidth memory while the second memory is a relatively high-capacity, low-bandwidth memory. During a forward propagation pass of the neural network, a run-time manager monitors the usage of the buffers for the various layers of the neural network. During a backward propagation pass of the neural network, the run-time manager determines how to move the buffers between the first and second memories based on the monitored buffer usage during the forward propagation pass. As a result, the run-time manager is able to reduce memory access latency for the layers of the neural network during the backward propagation pass.

The invention relates to a face search method and system. The method includes the following steps that: a network framework for face retrieval is constructed, and the network framework is optimized; parameters in the network framework are adjusted according to a reverse propagation mode; training sample pictures are inputted into the adjusted network framework, so that test cases can be generated; quantization calculation is performed on the test cases according to a sign function, so that the binary codes of the test cases are obtained, and Hamming distances between the training sample pictures are calculated through the binary codes; and the approximation degrees of the training samples are sequenced according to the Hamming distances, and therefore, the training of the network framework for face retrieval is completed; and face pictures to be retrieved are inputted into the trained network framework for face retrieval, so that the face pictures to be retrieved can be retrieved, and the approximation degree-sequenced face pictures to be retrieved can be obtained. According to the face search method and system of the invention, the network and outputted features are optimized from the above aspects, so that the same accuracy can be maintained under a large-scale face database or the retrieval of face images can be performed quickly with accuracy decreased in a range as small as possible.

The invention relates to a multi-model knowledge distillation method and device, electronic equipment and a storage medium. The method comprises the steps of extracting features of a training image toobtain training data; inputting the training data into a plurality of sub-models included in a teacher model for operation, and obtaining a first feature output by the teacher model according to sub-features output by the plurality of sub-models; inputting the training data into a student model for operation to obtain a second feature output by the student model; determining a loss function of the student model according to the first feature and the second feature; and performing back propagation on the student model according to the loss function. According to the embodiment of the invention, different feature representations in the training data can be obtained by utilizing the plurality of sub-models in the teacher model, and the student model can learn features in the teacher model byutilizing a knowledge distillation mode, so that the problem of limited expression capability of a single model is solved, and the model precision of the student model is improved.

The invention discloses a deep extreme learning machine-based hazard source identification method. A deep neural network adopted by the method consists of two parts: a deep structure module and a single-hidden layer neural network module. The method comprises the following steps of: dividing hazard source information into different domain classifications by utilizing SVM and inputting the different domain classifications into corresponding network modules; carrying out an S-ELM algorithm on each network module to obtain each pre-identification result of the deep network; combining the pre-identification results of the deep network to serve as an input of a top neural network; calculating an initial hidden layer output and an output weight of a single-hidden layer ELM according to an ELM algorithm and an excitation function; determining a final input weight, a hidden layer feature space and an output weight of the network according to an improved counter propagation algorithm; and finally obtaining a hazard source identification result. The identification method disclosed by the invention can be used for improving the flexibility of the hazard source identification, decreasing the rapid expansion of empirical data, improving the utilization rate of experiential knowledge and relieving the internal memory pressure during high-dimensional data training.

The multi-wavelength laser is a ring laser source working at room temperature. The laser has an inner cavity disposed in an outer cavity. A pair of circulators disposed in the inner cavity is configured to assure counter-propagation of light between the inner cavity and the outer cavity. A gain-clamped semiconductor optical amplifier (GC-SOA) is formed by combining a SOA and a Fiber Fabry-Perot Tunable Filter (FFP-TF) with the circulator pair. This configuration in the laser cavity results in an improvement in terms of transient gain excursions by applying an optical feedback. This attribute of the GC-SOA enables realizing a stable multi-wavelength laser source.

The invention relates to a ship autopilot composite neural network PID control method. The method comprises the following steps: providing a composite neural network four-layer structure which comprises an error sequence input layer, a network algorithm hidden layer, a network output layer and a network identification layer; determining the number of neurons and parameter values of each layer through open-loop test training learning, wherein the output layer is composed of three adjustable PID control parameters with non-negative values larger than zero; taking a performance index function ofthe error quadratic sum to set a gradient steepest descent method of a weighting coefficient, and adding an inertia term to prevent local convergence; increasing jacobian information of the output course of the ship to the input steering angle, improving the learning capacity and sensitivity to control characteristics, and achieving PID control parameter online self-adaptive adjustment. Accordingto the control method disclosed in the invention, the course keeping control performance of the ship uncertain motion can be improved; a neural network algorithm improved by Jacobian information identification based on a gradient steepest descent method and ship course keeping and embedding of a radial basis Gaussian function into a back propagation hyperbolic function can be used to solve the problems of large course deviation amplitude and high course reciprocating crossing frequency, and energy conservation and consumption reduction are realized.