82results about How to "Alleviate the sparsity problem" patented technology

The invention discloses a text classification method based on a cyclic convolution network. The text classification method comprises the following steps: step 1, representing context vectors of all words by using a bidirectional cyclic network; step 2, combining the context vectors and a word vector of a current word into the representation of the current word; step 3, extracting the most important context information by using a maximum pool technology to obtain text representation; step 4, carrying out text classification by using the text representation. According to the method disclosed by the invention, more word order information in a text can be kept and a long-distance text dependence relation is captured; semantics of the words can be accurately described and the words and phrases, which have the greatest influences on the text classification, are found by the maximum pool technology, so that the text classification accuracy rate is effectively improved. A test shows that the efficiency of the method is averagely improved by 1% on the aspect of a plurality of text classification data sets.

The invention is proposed for solving the problem of low quality of translated texts and poor translation effect of a current Mongolian and Chinese machine. Because the Mongolian language belongs to low-resource language, a large quantity of Mongolian and Chinese parallel bilingual corpus can be collected difficultly. A transfer learning strategy is a method for solving the problems in the different but relevant fields by using existing knowledge. The method comprises the following steps: firstly, performing training by utilizing the large-scale English-Chinese parallel corpus based on a neural machine translation frame; secondly, transferring translation model parameters trained by the large-scale English-Chinese parallel corpus into the Mongolian and Chinese neural machine translation frame, and training a neural machine translation model by utilizing the existing English-Chinese parallel corpus; and finally, performing contrast and evaluation on texts translated by a neural machinebased on the transfer learning strategy and texts translated by a statistical machine in accordance with BLEU values and the fluency of the translated texts. Through operation of a control variable method, the transfer learning strategy is obtained, so that the translation performance of a Mongolian and Chinese machine is effectively improved.

The invention provides an information resource query recommendation method and system based on a knowledge graph, and the method comprises the steps: carrying out the preprocessing of the knowledge graph, enabling the knowledge graph to be mapped to a low-dimensional dense vector space through employing a representation learning method, and obtaining the vector representation of an entity; calculating the interest degree of the user in the information resource according to the historical behavior of the user, and constructing a user interest model by combining the vectorized representation ofthe information resource and the interest degree of the user in the information resource; achieving accurate recommendation of the information resources is achieved by calculating the similarity between the resources and the similarity between the users and the resources. According to the invention, the knowledge graph representation learning is combined with the user interest model to provide personalized service for the user; according to the method, the internal relation of knowledge and the interest of the user are considered, and the information resources related to the query content andconforming to the interest of the user are recommended to the user according to the queried resource name input by the user, so that the personalized query recommendation is more professional and targeted.

The invention discloses an entity relationship prediction method and a prediction system based on knowledge representation learning. The method comprises four modules, namely, knowledge preparation, knowledge representation model construction, knowledge representation model training and entity relationship prediction. The knowledge preparation module completes the data preparation and builds the knowledge map. The knowledge representation model construction module completes the construction of the model, which eliminates the semantic differences among different types of entities through projection operation; the training module of knowledge representation model forms the final knowledge representation model based on the parameters of the iterative training knowledge representation model ofknowledge map. Entity relationship prediction module can predict the possible relationship between any given two entities. The method of the invention predicts entity relationship based on knowledgemap, projects different types of entities to the same semantic space through a spatial projection algorithm, and performs calculation operation, thereby achieving high reliability of prediction results.

The invention discloses a statistic machine translation method and a statistic machine translation system. The method comprises the following steps that: firstly, phrase division of a source language statement is performed and bilingual phrases are searched from a bilingual phrase table according to divided phrases; secondly, the matching degree of the divided phrases and the bilingual phrases is inspected; under the condition of complete matching, the bilingual phrases are added into a candidate phrase table and the fourth step is executed; under the condition of partial matching, the third step is executed; thirdly, a translation template is constructed according to the divided phrases and the bilingual phrases, and word translations of the divided phrases which are different from the bilingual phrases are filled into the translation template to generate novel bilingual phrases which are then added into the candidate phrase table; fourthly, the source language statement to be translated is translated according to the candidate phrase table. The statistic machine translation method and the statistic machine translation system can effectively improve the translation quality under the condition that bilingual corpuses are limited and solve the problem of data sparseness of the statistic machine translation system.

The invention relates to text classification of natural language processing, and specifically relates to a class center vector text classification method based on dependency, word class and a semanticdictionary. To overcome the semantic defect of a feature selection algorithm based on statistics, the invention introduces the dependency, the semantic dictionary and the word class to optimize and cluster text features, provides an improved weight calculation formula, and further provides an improved class center vector text classification method. The text classification method of the inventionhas advantages of both high classification efficiency of a traditional class center vector method and high classification precision of a K-nearest neighbor algorithm, and can be widely used in variousclassification systems.

The invention discloses a group-oriented project recommendation method based on joint probability matrix decomposition. The group-oriented project recommendation method is characterized by comprising the following steps: (1), representing project scoring information of a user and information that the user belongs to a group by using a triple; (2), calculating the user relevance based on the triple of the information that the user belongs to the group; (3), implementing a joint probability matrix decomposition method based on the user relevance so as to obtain a user characteristic matrix and a project characteristic matrix; (4), calculating by utilizing an average strategy so as to obtain a group characteristic matrix; and (5), obtaining previous N projects having the highest project predication scoring in each group so as to obtain a recommendation list. According to the invention, the user relevance based on group information is integrated in probability matrix decomposition; joint probability matrix decomposition based on the user relevance is implemented; furthermore, the group characteristic matrix is obtained by calculation through the average strategy; therefore, a group-oriented recommendation result is obtained; and more accurate individual services can be provided for the group to a certain degree.

The invention relates to a service recommendation method based on trust extension and listwise rank learning, which comprises the steps of firstly representing each user to be the probability distribution of invoked service set arrangement by utilizing service ranking position information and referring to a Plackett-Luce model, and calculating the probabilistic user similarity based on the KL distance; taking a direct trust relationship and an indirect trust relationship between the users into consideration at the same time, calculating the direct trust degree by using a Beta trust model, calculating the indirect trust degree by using transfer characteristics of the trust relationships, obtaining the comprehensive trust degree, and constructing a trusted neighbor set of target users; integrating the trusted neighbor set into a matrix decomposition model, taking a cross entropy between a predicted ranking list and a correct ranking list as a loss function, designing a listwise rank learning algorithm to obtain an optimal ranking model, and outputting a recommendation list which best conform to user interests. The service recommendation method has high recommendation accuracy, and can satisfy potential functional requirements of the users to be greatest extent while ensuring the service recommendation quality.

The invention discloses a prediction model establishment and object recommendation method and system, equipment and a storage medium. The establishment method of the prediction model comprises the following steps: obtaining user data and object data, and respectively extracting a plurality of user characteristics and a plurality of object characteristics from the user data and the object data to form a characteristic matrix; Establishing an implicit vector representing the relevance between the features in the feature matrix based on a factor decomposition mechanism; Inputting the hidden vector as a training sample into a GBDT model, and performing training to obtain a prediction model of prediction object characteristics; Wherein the prediction model is used for predicting object characteristics of an object. Based on the factorization machine, the feature engineering construction is carried out. The feature sample data caused by One-hot coding is no longer sparse, and the influence of cross-term feature learning is insufficient. The hidden vector output by the factorization machine is used as the training sample to obtain the prediction model, which effectively improves. The accuracy of the model.

The invention designs a sequence recommendation method fusing a dynamic knowledge graph. The item sequence of the user in the latest session is utilized to predict the next item which is possibly interacted by the user, so that the short-term preference of the user is better captured according to the item sequence in the session. The feature representation of the item sequence and the operation sequence is learned by adopting a gating graph neural network and a recurrent neural network respectively; and meanwhile, related project knowledge (such as commodity brands, rating, categories and the like) is utilized to construct a dynamic knowledge graph, a dynamic knowledge graph method is fused, a graph convolutional network (GCN) is adopted for modeling in the time dimension to learn embedding of nodes, and parameters (weight matrixes) in the graph convolutional network are evolved by using long short-term memory (LSTM) so as to capture the dynamic state of a graph sequence, therefore, the next interaction item of the user can be predicted more effectively.

The invention discloses a social recommending method based on classification. The social recommending method comprises the steps that an evaluation matrix of a user on classification is constructed; an initial user classification matrix is constructed according to evaluation data of the user on a project and classification information of the project; normalization processing is carried out on the initial user classification matrix, and the user classification matrix is reconstructed through a matrix decomposition method; the credibility between the friends of the user is constructed through the friend information of the user; the parameters of an obtained model are learnt and obtained through a stochastic gradient descent method according to the evaluation of the user on the classification of the project in the user classification matrix, the evaluation of the user on the project predicted and obtained through a socialization model and the credibility between the friends of the user, and therefore the final evaluation of the user on the project is predicted. According to the method, project classification information is guided into the social recommending method for the first time, the socialization information of the user and the classification information of the project are integrated on the basis of original collaborative filtering recommendation, recommending precision is improved, and the problems of data sparseness and cold starting in a recommending system are solved.

The invention discloses a word frequency based skip language model training method, relates to the technical field of machine translation and aims at solving the OOV problem of a statistical language model caused by linguistic data shortage in the prior art. The word frequency based skip language model training method comprises the steps that Chinese sentences are collected; the Chinese sentences are segmented; a learning set corpus is generated; statistics is conducted on vocabulary and word frequency in the learning set corpus to generate a Chinese vocabulary wt; statistics is conducted on phrases and the emerging times of phrases in the corpus to generate a 1-n Chinese phrase table pt0; a selective skip standard k is set, and k judgment is performed according to the statistical results of the word frequency in the Chinese vocabulary wt, and when the sum of the number of all the vocabulary with the emerging times k not greater than i accounts for above 60% of the number of all the vocabulary, k = i; linguistic model training is performed according to a Chinese sentence table pt2 to obtain a skip-ngram linguistic model. The word frequency based skip language model training method is used for obtaining a linguistic model probability table.

The invention discloses a judgment document analysis method based on a criminal behavior chain, and the method comprises the following steps: step 1, extracting information from the fact description of a case, declaring the concept and construction rule of the criminal behavior chain, and constructing the criminal behavior chain; step 2, obtaining semantic information from fact description of a case by using a TextCNN; step 3, based on the criminal behavior chain, performing vector representation on the criminal behavior chain by using a Bi-LSTM method, and performing text classification; andstep 4, proposing a judgment document analysis method of a neural network structure for splicing and outputting a result of the TextCNN method and a result of the Bi-LSTM method, wherein an identification result can be used for supporting various auxiliary judgment applications. According to the method disclosed by the invention, the associated information of the criminal behavior chain is fully utilized, the defects of a traditional legal judgment document analysis method are avoided, the judgment document analysis efficiency is improved, and a technical support is provided for solving modelsand methods for assisting judgment such as legal provision recommendation and class case pushing.

The invention discloses a social interest recommendation method and system based on graph convolution matrix decomposition. The method comprises the steps of obtaining a user social project scoring matrix, a user social adjacency matrix and a user comment text feature matrix of a to-be-recommended user; inputting the user social project scoring matrix, the user social adjacency matrix and the usercomment text feature matrix of the to-be-recommended user into a trained graph convolution matrix decomposition model; outputting a user potential feature matrix and a project potential feature matrix of the to-be-recommended user by the trained graph convolution matrix decomposition model ; and recommending potential projects to the to-be-recommended user according to the user potential featurematrix and the project potential feature matrix.

The invention discloses a user movement behavior prediction method, device and equipment based on a multi-granularity neural network and a computer readable storage medium, and the method comprises the steps: mapping a prediction space of a user movement position to a map, and obtaining a map region corresponding to the prediction space; respectively dividing the map area according to different granularities, and respectively converting the current movement track of the user into a plurality of grid ID sequences corresponding to the different granularities under the different granularities; using a multi-granularity neural network model; and respectively predicting the plurality of grid ID sequences by using different prediction models under the different granularities to obtain a plurality of prediction results of the user moving position under the different granularities, and fusing the plurality of prediction results to obtain a target prediction result of the user moving position.According to the method, the device, the equipment and the computer readable storage medium provided by the invention, the accuracy of predicting the movement behavior of the user is improved.

The invention discloses an interest point recommendation method and system based on a co-occurrence graph. The recommendation method includes the five processes of data collection and processing, co-occurrence graph establishment, similarity calculation, position factor modeling and user recommendation. The interest point recommendation method based on the co-occurrence graph is characterized in that the co-occurrence graph between interest points is established through attendance data of users, two types of similarity between nodes is calculated based on the co-occurrence graph, and then the users are subjected to interest point recommendation according to the similarity between the nodes in the graph. Recommendation is carried out based on the novel perspective, namely the similarity between the interest points, and by means of the recommendation method, information in existing data is fully mined, and the problems of sparsity in the recommendation process of the interest points and scalability of recommendation methods in a large-scale social network are solved.

The invention relates to a multi-granularity word segmentation method and system based on sequence labeling modeling, and provides a method and system for acquiring a multi-granularity label sequenceby means of a machine learning method. The method comprises the steps that sentences in at least one single-granularity labeling data set are converted into word segmentation sequences complying withother n-1 word segmentation specifications respectively, n word segmentation sequences complying with the different specifications and corresponding to each sentence are converted into a multi-granularity word segmentation hierarchical structure, a multi-granularity label of each word in each sentence is obtained according to a predetermined coding method and the multi-granularity word segmentation hierarchical structures, and therefore a multi-granularity label sequence of each sentence is obtained; on the basis of the data set including the sentences and the corresponding multi-granularity label sequences, by training a sequence labeling model, a multi-granularity sequence labeling model is obtained. According to the multi-granularity word segmentation method and system based on sequencelabeling modeling, the concept of multi-granularity word segmentation is put forward for the first time, and the multi-granularity word segmentation hierarchical structures can be quickly and automatically obtained.

The invention provides a collaborative filtering recommendation algorithm fusing social trust influence, which comprises the following steps: step 1, preprocessing score matrix data of a project by users, filling and deleting unnecessary data, and calculating similarity among the users according to scores of the users; step 2, calculating a neighbor user set of the users; and 3, calculating the correct recommendation number of the user j to the user i, the local trust degree between the users and the global trust degree of each user according to the scoring matrix data of the user to the project. According to the invention, sparse user scoring information is fully mined; an implicit trust network is constructed, a local trust degree and a global trust degree are calculated through the scoring data; according to the method, the local trust degree and the global trust degree are combined to obtain the implicit trust degree, trust propagation of the users is considered for trust data between the users, the display trust relationship of the users is effectively expanded, and the problems of score matrix data sparseness and user cold start are relieved.

The invention belongs to the technical field of natural language processing methods, and in particular relates to a Bayesian word sense disambiguation method based on synonym expansion. The Bayesian word sense disambiguation method disclosed by the invention is used for mainly solving the problem that the current word sense disambiguation method has the problems of poor disambiguation effect, wasting time and energy to obtain disambiguation knowledge and the like. The Bayesian word sense disambiguation method based on synonym expansion disclosed by the invention comprises the following steps of: (1), expanding the context of a training corpus by adopting the Chinese thesaurus, and generating a lot of pseudo training corpuses; (2), removing noise in the pseudo training corpuses by utilizing a word collocation corpus, and generating a pseudo training corpus; (3), training a Bayesian disambiguation model by adopting the training corpus and the pseudo training corpus simultaneously; and (4), inputting a test corpus into the Bayesian disambiguation model, and co-determining word senses of ambiguous words by comprehensively utilizing the disambiguation knowledge in the two corpuses.

The invention provides a new method for representing crowd movement through a context-related graph embedding model. The method comprises the following steps: firstly, generating a fully-connected context correlation graph according to a historical track of a user; applying a word embedding technology to a graph model for the first time, learning sign-in point vector representation fused with context semantic information, then obtaining vector representation of each track through a recurrent neural network, and then introducing a reinforcement learning method to find out a current track generator. In the training process of the whole model, the track with the label and the track without the label are used for training synchronously, meanwhile, a strategy gradient method in adversarial learning is used for updating model parameters, and the model performance is further enhanced.

The invention discloses an information recommendation method and system based on a convolutional neural network and a noise reduction auto-encoder. Two deep learning models of a convolutional neural network and a noise reduction auto-encoder are used to learn user preferences from scores, trust, comments and other data. Meanwhile, a new correlation regularization method is provided to establish relationships of user preferences in different aspects, so that the performance is improved. Firstly, compared with a previous model, rich comment information is fused; then, preliminary processing is conducted on the comment text through a convolutional neural network model, the extracted effective features are put into a noise reduction auto-encoder model to extract hidden features of the commenttext, and more effective and compact representation of the comment text is obtained; finally, two noise reduction auto-encoders are added and used for processing scores and trust information respectively, corresponding prediction vectors are obtained through the three noise reduction auto-encoders respectively, weighted fusion is carried out, and therefore user preferences are modeled more accurately.

The invention discloses a cognitive diagnostic method for a cognitive process of a student, comprising the following steps: constructing a multi-granularity representation model of knowledge points and exercises, constructing a learning state representation model of a student node, and analyzing the cognitive diagnosis of the student node. The invention can use the method of knowledge map to express the academic state of the students in multi-granularity, so as to analyze the mastery degree of the corresponding knowledge points of the students according to the answers of the students accordingto the different cognitive processes of the students.

The invention discloses a recommendation system and a recommendation method based on relationship type cooperative topic regression. The system at least comprises an RCTR (Relationship type Cooperative Topic Regression) model establishing module, a parameter studying module and a predicted value calculating module, wherein the RCTR model establishing module is used for integrating user-item rating information, item content information and a relation structure between items into a hierarchy bayesian model to establish an RCTR model; the parameter studying module is used for utilizing maximum posteriori estimation to study parameters in the RCTR model, and finally obtaining a parameter user implicit vector, an item implicit vector, an item relation vector and a full posteriori possibility of an item topic ratio; and the predicted value calculating module is used for utilizing the user implicit vector, the item topic ratio and point estimation of item implicit deviation to calculate a predicated value of evaluation by using a predicted value calculating formula. According to the recommendation system and the method disclosed by the invention, the user-item rating information, the item content information and the relation structure between the items is integrated to one hierarchy bayesian model seamlessly to integrate a social network between the items into a recommendation process, so that the recommendation accuracy is improved.

The invention discloses a large-scale heterogeneous data oriented co-clustering method. The method comprises the following steps that entities and a heterogeneous relation between the entities are extracted from the heterogeneous data to obtain a heterogeneous relation matrix; the entity X2 of the small scale is selected from two corresponding entities in the heterogeneous relation matrix, and an incidence matrix is set according to an incidence relation of the entity X2; a symmetric matrix sparse decomposition method is adopted to decompose the incidence matrix to obtain a clustering instruction matrix B corresponding to the entity X2; the matrix B is used as an input, tri-decomposition is carried out on heterogeneous relation moment R to obtain a clustering instruction matrix corresponding to an entity X1, and entity type division is achieved through the clustering instruction matrix corresponding to the entity X1 and the clustering instruction matrix corresponding to the entity X2. According to the method, sparsity of the matrixes can be reduced, and the accuracy of the co-clustering method is improved.

The invention discloses a user recommendation method. The method specifically comprises the following steps of: determining input data of an auto-encoder; mapping the input data to an implicit layer of the auto-encoder through an activation function; mapping the implicit layer into a one-dimensional reconstructed vector; and training model parameters in a data set to obtain a predicted score of auser, wherein the step of training model parameters is carried out through minimizing a reconstruction error. The step of training the model parameters comprises the following steps of: carrying out sparseness on the input data of the auto-encoder; and carrying out training by combining score data of the data set and explicit trust information. The step of carrying out sparseness on the input dataof the auto-encoder comprises the following sub-steps of: extracting an input vector from a user-project score matrix in the data set; setting a missing value in the input value to be zero; adding masking noise in the auto-encoder; and before counter-propagation, setting an error of the missing value in the input vector to be zero. The method is capable of achieving the effect of improving the recommendation correctness.

The invention relates to the field of position prediction and recommendation, in particular to a user space-time similarity measuring method in interest point prediction and recommendation. The user space-time similarity measuring method in interest point prediction and recommendation includes the steps of preprocessing data; measuring space-time cooccurrence mode similarity; measuring user space-time similarity. The invention provides the user space-time similarity measuring method, the space-time cooccurrence mode and similarity thereof are defined through check-in time close degree and interest point position close degree, then the user space-time cooccurrence mode and similarity thereof are defined, user space-time similarity among users is defined based on the weight of interest point check-in frequency through the most similar space-time cooccurrence mode and similarity thereof, and the user space-time similarity measuring method is provided for a user-based collaborative filtering method in interest point prediction and recommendation.

The invention relates to a movie recommendation method based on a family knowledge graph. The method comprises the following steps: A, constructing and training to obtain a context-aware recommendation model: (1) constructing a family knowledge graph; (2) preprocessing data; (3) constructing a context awareness recommendation model; (4) integrating family member similarity; (5) training the context awareness recommendation model; B, predicting scores of family members for each known movie through the trained context awareness recommendation model, and recommending the scores to the family members. According to the method, the three-dimensional tensor model is constructed, the context information of the family knowledge graph is fused, and the similarity relationship of family members is fused into the score prediction model, so the problem of data sparseness can be remarkably relieved, and the recommendation accuracy is improved.

The invention relates to a depthwise separable convolution-based Chinese-Vietnamese neural machine translation method, and belongs to the technical field of resource scarcity type language neural machine translation. According to language characteristics of Vietnamese, Vietnamese is segmented into four different translation granularity sequences of words, syllables, characters and sub-words; secondly, a neural machine translation model is improved by utilizing depthwise separable convolution; a depthwise separable convolutional neural network is added; convolution operation is carried out on different granularity sequences input by the model and more feature data are extracted. By adding the depthwise separable convolutional neural network prior to an encoder embedding layer of the neuralmachine translation model, The depthwise separable convolution-based Chinese-Vietnamese neural machine translation method is constructed in the field of resource scarcity type language machine translation, so that the problem of sparse data of the resource scarcity type language neural machine translation is effectively relieved, and the translation performance is improved.

The invention discloses a scoring prediction method and device thereof. The method comprises the following steps of: a generating step: generating a representation of both a user and an item by constructing a neural network model for a user review of an item; a prediction step: optimizing a matrix decomposition model by utilizing the representation of a user and an item, and training the matrix decomposition model to predict target score, wherein the neural network model is a long and short time memory network model; extracting features of the user and the item by using an attention mechanismin the long and short time memory network model, and generating representation according to features; and adding the representation of the user and the item to the matrix decomposition model by nonlinear transformation. The scoring prediction method and device thereof provided by the invention is low in cost, and migration can be well performed among different data fields; the unknown score can bepredicted more comprehensively and correctly by combining the user scoring numerical information and the user comment text information; the prediction results can be obtained in a faster time with anoptimized matrix decomposition algorithm.