75 results about "Semi supervised clustering" patented technology

Chat categorization uses semi-supervised clustering to provide Voice of the Customer (VOC) analytics over unstructured data via an historical understanding of topic categories discussed to derive an automated methodology of topic categorization for new data; application of semi-supervised clustering (SSC) for VOC analytics; generation of seed data for SSC; and a voting algorithm for use in the absence of domain knowledge/manual tagged data. Customer service interactions are mined and quality of these interactions is measured by “Customer's Vote” which, in turn, is determined by the customer's experience during the interaction and the quality of customer issue resolution. Key features of the interaction that drive a positive experience and resolution are automatically learned via machine learning driven algorithms based on historical data. This, in turn, is used to coach/teach the system/service representative on future interactions.

Techniques for creating training sets for predictive modeling are provided. In one aspect, a method for generating training data from an unlabeled data set is provided which includes the following steps. A small initial set of data is selected from the unlabeled data set. Labels are acquired for the initial set of data selected from the unlabeled data set resulting in labeled data. The data in the unlabeled data set is clustered using a semi-supervised clustering process along with the labeled data to produce data clusters. Data samples are chosen from each of the clusters to use as the training data. The selecting, presenting, clustering and choosing steps are repeated with one or more additional sets of data selected from the unlabeled data set until a desired amount of training data has been obtained, wherein at each iteration an amount of the labeled data is increased.

The invention belongs to the technical field of electronic commerce, and relates to a method and a device for personalized searching of commodities in an electronic commerce activity, in particular to a method and a device for personalized searching of commodities which are sequenced based on attributes. The method and the device are used by a user to search and find needed commodities by using a computer during online shopping. The method comprises the following steps of: collecting and analyzing interests of the user in commodity attribute information by analyzing electronic commerce data from the internet; converting the commodity attributes concerned by the user into attribute sequencing knowledge in data mining; merging the attribute sequencing knowledge as future knowledge; clustering the future knowledge by using a semi-supervised clustering method; and finally, sequencing the commodities in a clustering result, and presenting commodity searching results to the user so as to guide the user to select the commodities. The method is simple in technical process, convenient for operation, accurate in information acquisition, scientific in sort order and high in searching speed, and the device is simple in structure and flexible in operation, so the method and the device can be used for replacing a commodity searching technology and commodity searching equipment in the conventional electronic commerce.

The invention relates to an assessment method for transient voltage stabilization of a load area of an electrical power system and belongs to the electrical power system stability analyzing and assessment field. The assessment method for the transient voltage stabilization of the load area of the electrical power system includes that using data measured by a synchronous phasor measurement unit as basis, and building an initial sample database for data mining through a lot of simulation samples; extracting characteristics for reflecting the stabilization degree of each node through the quantitative evaluation for each node in the area; identifying through a multiple linear regression method to obtain sensitivity coefficients for reflecting the mutual influence relations between the nodes in a local area network; using a semi-supervised clustering method to demarcate all the samples; using a decision tree algorithm to perform classified learning to obtain a decision tree model, and using the decision tree model for online monitoring to assess the global transient voltage stabilization state of the load area of the electrical power system.

The invention discloses an internet flow distinguishing method. According to a small quantity of marked flow samples and by virtue of offline supervised learning classification, unmarked flows are identified according to the characteristics of classified flows, and application classes of generated flows can be predicted in the early stage of network flow generation, thereby ensuring the promptness of network supervision and classifying the network flows in an actual network environment further. Through further adding new application types in semi-supervised clustering, a correlation chart of application type marks and application types is perfected, and alleged flows in the network are effectively marked, therefore, flow data with accurate application type labels can be obtained in real time. Meanwhile, when the network environment changes, the change of the network environment is reflected in the semi-supervised clustering, and the requirement on the distinguishment of flows in a new network environment is further met.

The invention relates a self-adaptive semi-supervised network traffic classification method, system and equipment. The method comprises the following steps: acquiring a network stream, extracting thestream feature with the preset fixed quantity in each network stream to obtain a network stream feature vector; computing the centroid of the network stream feature vector in each type according to the marked network stream feature vector, thereby obtaining a vector set M; performing self-adaptive semi-supervised k-means clustering by taking the vector set M as an initial center point; mapping theobtained network stream in each type of cluster to the belonged traffic type according to the maximum posterior probability; taking the traffic cluster of the known type as the training data to trainan online traffic classifier. The invention further relates to a system, the system comprises an acquisition module, a vector set processing module, a clustering module, a classification module, andan output module. The invention relates to the equipment. The equipment comprises a processor, a memorizer, and a computer program stored on the memorizer and capable of being run on the memorizer.

The invention discloses a cloud network end cooperative defense method and system based on end-side edge computing, and relates to information security of an electric power industrial control system. The method comprises the following steps: setting an edge computing center at a terminal side, collecting industrial control system terminal equipment information and communication flow information, defining and identifying attribute characteristics of an electric power industrial control terminal by utilizing equipment fingerprints, automatically collecting the fingerprints of the electric power industrial control terminal equipment by utilizing an Nmap scanning method, establishing a training model by a decision tree algorithm, and achieving the dynamic fingerprint authentication of the terminal equipment; through setting a switch mirror image, intelligent monitoring host flow control and cloud computing center training flow baseline, industrial control terminal equipment flow anomaly detection is realized, and a cloud cooperative defense technology based on edge computing is realized. Through flow data acquisition, information entropy quantification flow characteristic attribute preprocessing and improved semi-supervised clustering K-means algorithm training, abnormal flow detection of the electric power industrial control intranet is realized, and cloud network real-time defense based on abnormal flow detection is realized.

The invention discloses an unbalanced text classification method and system combining SVM and semi-supervised clustering. The unbalanced text classification method comprises the steps: carrying out preprocessing on a to-be-processed text, and obtaining text data in a vector format, and enabling the text data to serve as a data set; using the training set to train the SVM classifier to obtain a classification model, and using the classification model to predict the test set to obtain the category and confidence of the test set; clustering the data set by using a semi-supervised clustering algorithm to obtain the category to which the test set belongs and the confidence coefficient of the test set; and fusing the category to which the test set obtained by the SVM classifier and the semi-supervised clustering algorithm belongs and the confidence coefficient of the test set to obtain final output. According to the unbalanced text classification method, different types of methods in the technical field of unbalanced text classification are combined; advantage complementation of the different methods is achieved; vectorization and normalization methods are used; and the defect that whenhigh-dimensional sparse text data are processed, a text classification result is inaccurate due to the fact that labeled texts are too few is overcome. The unbalanced text classification method effectively solves the problem of text class imbalance.

The present application provides a risk control method, device, apparatus and medium for user payment behavior, which relates to the technical field of data processing. The method comprises the following steps: acquiring a plurality of historical transaction result sample data corresponding to user payment behavior; Taking the transaction behavior characteristics and transaction behavior attributes in the sample data of historical transaction results as the input and output of semi-supervised clustering model respectively, constructing and training the semi-supervised clustering model to obtain the risk identification results; Inputting the transaction data corresponding to the user's payment behavior into the trained risk identification model to obtain the risk identification result; According to the risk identification result and the service type corresponding to the transaction data to be identified, determining the response operation to the transaction data to be identified. The present application is capable of risk identification in milliseconds with high speed and accuracy. The application can also automatically intercept the high-risk payment behavior, thereby improving thesecurity of the payment behavior of the user and reducing the property loss of the user.

A system, method and computer program product provides a solution to a class of categorization problems using a semi-supervised clustering approach, the method employing performing a Soft Seeded k-means algorithm, which makes effective use of the side information provided by seeds with a wide range of confidence levels, even when they do not provide complete coverage of the pre-defined categories. The semi-supervised clustering is achieved through the introductions of a seed re-assignment penalty measure and model selection measure.

The invention a cross-project defect prediction method based on semi-supervised clustering data screening; the method comprises: using a semi-supervised clustering algorithm to cluster software module data to discover subclusters; collecting, from all the generated subclusters, all cross-project historical software modules having the same marks as the historical software modules of this project, namely screened cross-project software module data; using a naive Bayesian classification algorithm to establish a cross-project defect prediction model based on the screened cross-project software module data and all the historical software module data of this project, and predicting software module data, to be predicted, of this project. The method has the advantages that the cross-project software prediction model can be protected from the influence by irrelevant cross-project software module data, cross-project historical software module information and historical software module information of this project are made full use, and the performance of the cross-project software prediction model is enhanced.

The invention discloses a semi-supervised text clustering method and device fusing pairwise constraints and keywords. The method comprises the following steps of: fusing pairwise constraints to assist in text clustering to obtain an initial feature word weight; fusing the pairwise constraints and keywords and performing the semi-supervised clustering at the same time based on the obtained initial feature word weight; and evaluating and selecting a clustering result according to a user satisfaction degree. The device provided by the invention comprises a pre-processing module, a text clustering module fusing pairwise constraints, a semi-supervised text clustering module fusing pairwise constraints and the keywords, and an evaluation and selecting result module. Since the semi-supervised text clustering method provided by the invention continuously adds keyword information on the basis of fusing pairwise constraint information, the keyword information is used for adjusting the corresponding feature word weight while applying the pairwise constraints to learning the feature word weight; and therefore, the two prior information can be mutually influenced and promoted to obtain a more accurate clustering result.

The invention discloses a flow data screening method and device. The device comprises a data acquiring module, a data processing module and a mapping and integrating module; the data acquiring module is used for acquiring heartbeat mechanism flow data of all application software depending on a probe through an analysis port and acquiring label data of the flow data; the data processing module is used for performing semi-supervised clustering processing on the flow data according to the label data and then sending the processed flow data to a data warehouse; the mapping and integrating module is used for mapping various data entities in the data warehouse into a table in a virtual data layer and performing data processing and integrating. According to the flow data screening method and device, data selection, data integrity, data cleansing and data reduction are performed on all applications based on heartbeat mechanisms, the screening validity of the heartbeat mechanism flow data of all the application software is improved, and reliable guarantee is supplied to the subsequent flow data analysis.

The invention discloses an image scene classification method and system combined with semi-supervised clustering, and the method comprises the steps of redefining an objective function of semi-supervised Kmeans through employing a labeled sample, and supplementing and defining an objective function of SVM, and obtaining semi-supervised Kmeans clustering and a base learning device based on SVM classification; enabling the two base learners to carry out cooperative training, and forming a selection and iterative training scheme of a pseudo label sample; and finally, according to the confidence coefficient, fusing results of the two learners to obtain a scene image category to which the sample belongs. According to the invention, different types of methods in the image scene classification field are used to construct a base classifier and carry out cooperative training. Meanwhile, a pseudo label sample is introduced to expand a training set, so that the problem of insufficient label samples is effectively solved. Furthermore, clustering is carried out on the label-free samples to obtain the distribution characteristics of the label-free samples, and the concept drift problem is solved. Finally, the labeling cost of the scene image is reduced, concept drift is solved, and the image scene classification accuracy is improved.

The invention provides a query expansion method based on semi-supervised clustering. The query expansion method includes the steps: (1) initially retrieving user queries by a query likelihood estimation language module and returning n front documents of retrieved results; (2) manually annotating k front documents in the initial retrieved results and dividing the k front documents into a relevant document set and an irrelevant document set; (3) analyzing the n front documents by a semi-supervised clustering algorithm for constraint and distance integration and extracting the documents related to the queries as feedback documents; (4) selecting expansion words by an expansion word selection module according to the feedback documents and forming new queries by the aid of the expansion words and original queries. By learning relevancy of a small number of annotated documents and query, relevancy of a large number of unknown documents and query can be accurately estimated, the quality of the feedback documents is improved, and accordingly, the recall ratio and precision of retrieval are effectively improved.

The invention discloses a user behavior analysis method based on user power consumption data. The method comprises the following steps: taking a batch user data training set of electricity consumptionper hour per day as input; pre-processing the input electricity data, including extracting the electricity characteristics, normalizing the data, and reducing the dimension by principal component analysis; taking the family characteristic information of some users as input; using the constrained seed k-means algorithm and some household information data, carrying out the semi-supervised clustering analysis on the training set of user power consumption data, and constructing the power consumption data models of different types of users; taking as input the data set of power consumption per hour per day of the user to be detected; using the model to detect the abnormal behavior of users. The method can efficiently identify and detect the user behavior according to the real-time power consumption data of the user.

A system and method for dynamic, semi-supervised clustering comprises receiving data attributes, generating a set of ensemble partitions using the data attributes, forming a convex hull using the set of ensemble partitions, generating a simplex vector by performing ensemble clustering on the convex hull, receiving dynamic links, deriving an optimal simplex vector using the simplex vector and the dynamic links, computing a current optimal clustering result using the optimal simplex vector, and outputting the current optimal clustering result.

The invention discloses a bank electronic channel abnormal transaction determination method based on semi-supervised learning, and relates to the technical field of machine learning. The invention aims to solve problems of high difficulty, low efficiency and poor accuracy in the existing abnormal transaction determination technology. According to the method, further integration and optimization are carried out on the basis that a hidden Markov model and a time sequence model (ARIMA) establish an account-level historical transaction sequence model, and an abnormal transaction behavior is predicted by combining semi-supervised clustering learning on the basis of HMM. Transaction data of each time section are converted into a time sequence vector through semi-supervised clustering learning, and semi-supervised learning is utilized to overcome the problem that label data is rare, an HMM is utilized to fit transaction vectors of everyone to generate a corresponding model, and the semi-supervised learning and the HMM are combined to improve the accuracy of anomaly recognition from two aspects of cross section data and time sequence data. Machine learning is adopted to solve the problem of abnormal transaction determination. Compared with a traditional expert method, the difficulty is greatly reduced, and the working efficiency is improved.

The present invention discloses a text clustering method. The method comprises: finding out a pairwise constraint instance from frequent vocabularies; extracting a frequent vocabulary set from a feature word with a largest weight in each document, so as to find out a positive constraint set and a negative constraint set; expanding the constraint set according to a K nearest neighbor set; and performing clustering according to a division result of the constraint set. According to the method of the present invention, a semi-supervised clustering algorithm is added for clustering the feature word, so that dimensions of vector space are reduced, and experiment efficiency is improved, and feature word clustering becomes more reasonable and reliable with guidance of a small amount of supervision information. In addition, hierarchical collaborative clustering is used for clustering of texts and feature words, so that a clustering effect is improved.