706 results about "Feature engineering" patented technology

The invention requests to protect a commodity recommendation method based on mobile electronic commerce of big data. The method comprises the following steps that: 101: carrying out a preprocessing operation on the historical behavior data of a user; 102: according to behavior time, carrying out a data division operation on the historical data of the user; 103: marking the historical behavior dataof the user; 104: carrying out a feature engineering construction operation on the historical data of the user; 105: establishing a plurality of machine learning models, and carrying out a model fusion operation; and 106: through an established model, according to the behavior data of the user, predicting whether the user purchases a certain commodity in one future day or not. By use of the method, the historical data of the user is preprocessed and analyzed to extract features, the plurality of machine learning models are established so as to predict a probability for the user to purchase the certain commodity in one future day, and accuracy for a merchant to recommend commodities to the user is improved.

The invention relates to a wind turbine generator bearing fault diagnosis method for a multi-channel deep convolutional neural network. The method comprises the steps of: simultaneously acquiring high-frequency vibration acceleration signals of a drive end and a non-drive end of a test bearing in various states by using a vibration acceleration sensor; analyzing the acquired vibration signals by using a time frequency analysis technology to obtain corresponding time frequency spectra; establishing a deep convolutional neural network diagnosis model, and training the diagnosis model by using the time frequency spectra and the states of the bearing as a training sample; evaluating the diagnosis model, and applying the diagnosis model to a bearing to be monitored. The method can realize automatic feature learning, avoids feature engineering, effectively utilizes multi-channel vibration signals, and has good universality and extensibility.

The invention provides a high potential user buying intention prediction method based on big data user behavior analysis. The high potential user buying intention prediction method comprises the following steps: 101 data preprocessing: the historical behavior data set of the e-commerce user is preprocessed; 102 sample defining and marking: samples are constructed with the interacted user product pairs to act as the keywords according to the historical consumption behavior of the user; 103 division of a training set and a test set: the historical data are divided into the training set and the test set by using a time window division method; 104 feature construction: feature engineering construction of the historical behavior data of the user is performed; and 105 algorithm design and implementation: feature selection of the feature group and unbalanced data processing of the data set are performed and then the final result of two-layer model iterative learning algorithm prediction is put forward. The prediction model is established on the basis of the historical behavior data of the e-commerce user of the time span of 45 days so that whether the user places an order of the commodityin the candidate commodity set P in the following 5 days can be predicted.

The invention provides a similarity analysis method and system for patients suffering from cardio-cerebral vascular diseases. The method comprises the following steps of 1 problem definition, wherein problem definition for the patients suffering from the cardio-cerebral vascular diseases is conduced; 2 data collection, wherein health care data of the patients suffering from the cardio-cerebral vascular diseases is collected; 3 data preprocessing, wherein data integration, data cleaning, missing value processing, feature deleting and abnormal point removing are included; 4 feature engineering, wherein feature construction, feature selection and feature processing are included; 5 patient clustering modeling; 6 diagnosis and treatment scheme recommendation. Accordingly, an effective similarity analysis model for the patients suffering from the cardio-cerebral vascular diseases is built, a clinician can obtain the similar populations of a give patient through the patient features and then recommends a personalized treatment plan to achieve the purpose of accurate medical treatment, population grouping based on similarity analysis can be well conducted on the patients suffering from the cardio-cerebral vascular diseases in the Chinese population, and pointed personalized rehabilitation therapy is conducted on different risk populations as early as possible.

The invention provides a fine-grained word representation model-based sequence labeling model, which is used for performing a sequence labeling task, and belongs to the field of computer application and natural language processing. The structure of the model is mainly composed of three parts including a feature representation layer, a BiLSTM layer and a CRF layer. When the sequence labeling task is performed by utilizing the model, firstly an attention mechanism-based character level word representation model Finger is proposed for fusing morphological information and character information ofwords; secondly the Finger and a BiLSTM-CRF model finish the sequence labeling task jointly; and finally a result with F1 of 91.09% is obtained in a CoNLL 2003 data set in end-to-end and no any feature engineering forms by a method. An experiment shows that the designed Finger model remarkably improves the recall rate of a sequence labeling system, so that the model identification capability is remarkably improved.

The invention discloses a disk fault detection method using multi-model prediction, which extracts multiple characteristics of disk SMART indexes through a sequential data processing means, and establishes a classification model to predict disk state. Step 1, data input: acquiring a data set composed of monitoring data of a plurality of disks in a period of time; step 2, SMART screening: adoptingmutation point detection mode to select SMART index; step 3, feature engineering: using SMART index as the input of the user-defined feature extraction module to extract the features of the SMART index, then extracting the corresponding parameter configuration, and transmitting the parameter configuration to the feature extraction module as a parameter, so as to extract the feature sets of the training set and the test set; step 4, data set balance: desampling the negative sample which occupies a large amount by adopting dimension reduction clustering; step 5, algorithm selection and modeling:on the basis of the step 4, training the classification model and testing whether the current disk belongs to the normal state or the fault state that needs to be replaced.

The invention discloses a method and system for detecting and locating network anomaly, which relates to the fields of Internet security, deep learning and neural network. The method comprises the following steps: firstly, dividing the URL according to special characters; secondly, performing word vector encoding on the divided URL with word2vec; putting word vectors into a convolution layer for automatic feature processing; combining a convolution layer result with an attention layer which possesses a sequential attention mechanism; and finally, performing maximum pooling and full-connectionon an attention layer result to obtain a final anomaly detection result, and at the same time, using the output of the attention layer to locate the malicious code in the URL. The invention has an excellent detection effect, not only is the detection rate high, but also the malicious code fragment in the URL can be located and visualized, thus effectively avoiding the drawbacks of the artificial feature engineering and the expert knowledge method.

The invention discloses an EMR (Electronic Medical Record) data drive based GDM (Gestational Diabetes Mellitus) forecasting method playing an increasing important role in smart medical service. The invention proposes a machine learning based GMD forecasting frame and constructs three forecasting frames including a full-domain data forecasting model, a staging data forecasting model and a weekly data forecasting model according different time window division methods for collected data. After a forecasting item is identified, high-dimensional EMR data digging is implemented through seven steps including input and ETL data cleaning, correlation of a medical record code and feature data, EMR data pre-treatment, secondary data treatment, feature engineering, machine learning and forecasting application. A mark data set related to definite diagnosis is constructed by using clinic data and is divided into two sub sets used for model training and testing. The method performs forecasting through supporting a support vector machine, a Bayesian network, a decision making tree and an integration based hybrid model and GDM mode classification is realized.

The invention provides a global average pooling convolutional neural network-based Chinese emotion tendency classification method, which is a technology for analyzing a Chinese text collected from a network by utilizing a computer. The method comprises the steps of building a global average pooling convolutional neural network-based Chinese emotion tendency classification model which extracts semantic emotion features by utilizing three channel transformation convolution layers; performing pooling calculation on the features extracted by the convolution layers by a global average pooling layerto obtain confidence values corresponding to output types; and outputting emotion classification tags by Softmax. According to the method, model parameters are set for performing multi-time training,and the model with the highest classification accuracy is selected for Chinese emotion tendency classification; and, complex feature engineering in conventional emotion analysis is avoided, the semantic emotion feature extraction capability of the model is enhanced, the model over-fitting is effectively avoided, and the emotion tendency classification performance of the model is improved.

The invention protects an O2O coupon usage big data prediction method. The method comprises the steps that 101, a historical consumption dataset of a user is subjected to preprocessing operation; 102, the historical consumption dataset of the user is marked, and a training set and a prediction set are divided and constructed; 103, the historical consumption dataset of the user is subjected to feature engineering construction; 104, feature selection and processing of unbalanced data are performed; 105, the data is subjected to multi-classifier integrated learning; and 106, coupon usage of the user is predicted through an established model according to historical consumption data of the user, and serving of an O2O coupon is optimized. According to the method, a prediction model is established mainly by processing the user consumption data and performing multi-classifier integrated learning on the data, therefore, the coupon usage of the user in the future is predicted, and serving of the O2O coupon is optimized.

The invention discloses a phishing website URL detection method based on depth learning, which can detect the phishing website on the Internet in real time only according to the website URL. At first,the URL string sequence is encoded into one-Hot two-dimensional sparse matrix, then transformed into dense character embedding matrix and input to a convolution neural network, local depth features are extracted, and then the input and the output of convolution neural network are input to long-term and short-term memory network, the correlation of URL sequences is captured, and finally a softmaxmodel is accessed to classify URLs. The invention can avoid redundant feature engineering, extract local depth correlation feature through convolution neural network, learn long-range dependency in URL through long-term and short-term memory network, and quickly and accurately detect phishing website URL.

The invention relates to the maintenance field of operation and maintenance equipment, in particular to an intelligent operation and maintenance alarm filtering method and system based on multi-platform autonomous prediction. The method comprises the following steps: (1) data acquisition integration; (2) data quality inspection; (3) data cleaning; (4) feature engineering; (5) sample collection; (6) model training and parameter optimization; ) model release (8) model use; (9) model feedback and optimization. The system includes a data acquisition and integration module, a data quality inspection module, a data cleaning module, a feature engineering module, a sample sampling module, a model training and parameter optimization module, a model release module, a model alarm filtering module, and a model feedback and optimization module. The invention guarantees the real-time processability of low-level alarm events, and avoids the possibility of potential sudden serious alarm events due to subjective judgment errors of experts and inability to work 24 hours a day.

The present invention relates to a drug-disease relationship classification method based on a neural network, which belongs to the technical field of biomedical text mining and data mining, and solvesthe problem of more accurate and effective classification of drug-induced relationship among drug-induced diseases for the drug-induced entities labeled in biomedical literature. The method comprisesS1 constructing a drug-induced relationship candidate case set; 2 performing text processing on that biomedical literature; 3 constructing the domain knowledge; 4 constructing an input vector; 5 constructing a text-level semantic information sub-network model; S6 adopting an attention mechanism to form the final representation of knowledge; S7 constructing a drug-disease relationship classification model; S8 predicting drug-disease relationships in the biomedical literature. The method can automatically identify the entity relationship of drug diseases between sentences and within sentences effectively, and overcomes the existing methods that most systems utilize a large number of feature engineering methods based on the traditional machine learning methods.

The invention belongs to the technical field of computer science, and discloses an online public opinion text information emotion polarity classification processing system and method, the online public opinion text emotion polarity is widely applied to a public opinion monitoring system, however, a feature engineering extraction module of a traditional machine learning method is large in text information loss, and the accuracy of a classification model is not high enough. The method comprises the steps of preprocessing data; the method comprises the following steps of: constructing a word vector in a way of pre-training a model fin-tuning through BERT; the BERT model calculates the correlation between the characters in the sentence and each of the other characters; the constructed word vector can better solve the problems of'one-word polysemy 'and'synonym' of Chinese; the loss of word vector representation is greatly reduced; in the classification model, firstly Bi-LSTM is used for effectively learning context information, then Attention is used for capturing main semantic information and effectively filtering valuable public opinion information, finally softmax classification is used, and the performance of an obtained public opinion text emotion polarity classification result is better than that of a current mainstream algorithm.

The invention discloses an automated supervised learning method with multi-source data supported, which comprises steps of (1) data pre-processing, (2) feature engineering, (3) model and super parameter regulation and (4) Bayesian pipeline optimization. The traditional data analysis process is automated, the process of manually regulating a machine learning pipeline is fundamentally improved, under the high coupling degree of super parameter regulation and pipeline optimization, the extensibility of the system on a supervised learning algorithm is greatly improved, a genetic algorithm is creatively put forward for regulation on the super parameters for the machine learning pipeline, and the efficiency for automated parameter regulation is greatly improved. Besides, a Bayesian optimizer is adopted for optimizing a pipeline algorithm combination, the problem of combination space explosion can be greatly solved, and finally, the accuracy and the efficiency of the automated supervised learning method are improved in the result.

Embodiments of a production-quality text-to-speech (TTS) system constructed from deep neural networks are described. System embodiments comprise five major building blocks: a segmentation model for locating phoneme boundaries, a grapheme-to-phoneme conversion model, a phoneme duration prediction model, a fundamental frequency prediction model, and an audio synthesis model. For embodiments of the segmentation model, phoneme boundary detection was performed with deep neural networks using Connectionist Temporal Classification (CTC) loss. For embodiments of the audio synthesis model, a variant ofWaveNet was created that requires fewer parameters and trains faster than the original. By using a neural network for each component, system embodiments are simpler and more flexible than traditionalTTS systems, wherein each component requires laborious feature engineering and extensive domain expertise. Inference with system embodiments may be performed faster than real time.

A data processing model construction method and device, a server and a client are provided in that present specification. The method comprises the following steps: acquiring model description parameters and sample data of the target data processing model; determining a basic model according to the model description parameters and the sample data; training the basic model according to the sample data to obtain a target data processing model. In the embodiment of that present specification, the model description parameters are obtained in a targeted manner, and based on the model description parameters, the server is able to accurately determine the modeling requirements of the user, and automatically matches the appropriate model as the basic model according to the user's modeling requirements, and then the corresponding data processing model is constructed, so that users do not have to do tedious test, feature engineering, model selection, model parameter search and other operations tofind the appropriate basic model, the difficulty of user operation is reduced, and the processing efficiency is improved.

The invention discloses a geological disaster prediction method, device and equipment, and the method comprises the steps of obtaining the monitoring data of a monitoring region, wherein the monitoring data comprises the spatial data and attribute information for describing geological disasters; performing preprocessing and feature engineering on the spatial data and the attribute information to determine a feature subset of the geological disaster; and establishing an artificial intelligence model based on the feature subset to determine the predicted occurrence probability of the geologicaldisaster of the monitoring area. The embodiment of the invention discloses the technical scheme which includes obtaining monitoring data, processing the data and subjecting to feature engineering, extracting the feature subsets related to the geological disasters, up/down sampling the unbalanced data, determining the occurrence probability of the geological disasters based on the artificial intelligence model, realizing real-time monitoring and automatic prediction of the occurrence probability of the disasters, and improving the prediction comprehensiveness and accuracy.

The invention particularly relates to a text sentiment analysis method and system based on deep learning. The method includes: normalizing initial text data to generated preprocessed text data, and clustering the preprocessing text data to preset fields; manually labeling part of data in different fields, training a sentiment analysis model based on the deep learning, and building the special depth of each preset field; using a formed classifier and the special depths to perform sentiment classification on to-be-classified text. The method has the advantages that manpower cost is reduced, influence of feature engineering on classification results is avoided, and workload of special engineering is reduced at the same time; in addition, the fields where the text belongs to are considered, sothat the accuracy of text sentiment analysis is increased.