Multi-intention recognition method and system based on bert + bolstm + crf and xgboost models

Abstract

The invention belongs to the technical field of natural language understanding, and particularly relates to a multi-intention recognition method and system based on bert + bolstm + crf and xgboost models. According to the technical scheme, the bert is used for processing the preprocessed data set to obtain the dynamic word vector, and the dynamic word vector is different from a word vector obtained by using a word2vec or glove model in the past. Word vectors output by the Bert model have dynamic characteristics, and the problem that one word is polysemy can be solved. The word vector is converted into a sentence vector through bi < l > stm + crf, a bi < l > stm + crf model can process context text information with a long distance at the same time, and an optimal sentence vector prediction sequence is obtained through the relation of neighbor labels. An Xgboost model is used in the aspect of recognition of the subjective map, and the model is high in recognition precision and more flexible, so that the model is used in the subjective map. After all the ideograms are obtained, a TF-I DF model is utilized to select a standard intention, and the standard intention is taken as an intention judgment basis. And inputting the sentence vector processed by the bert + bi l stm + crf model into a new bert model, and finally outputting a sub-intention.

Description

technical field [0001] The invention belongs to the technology in the field of natural language understanding, and in particular relates to a multi-intent recognition method and system based on bert+bilstm+crf and xgboost models. Background technique [0002] Intent recognition mainly refers to the natural language understanding of the voice or text issued by the user in the interaction between human and machine, to determine the real intention of the user, and to provide accurate services for the user. [0003] At present, most applications of intent recognition are used to classify or match a single user intent. Single-purpose, as the name implies, means that the text or voice issued by the user has one and only one intention, and in other cases, when the user's voice or text interaction contains multiple intentions, when dealing with such interactions, a single intention is used. Difficulty in identification. [0004] In order to achieve multi-intent recognition, the cu...

AI Technical Summary

Problems solved by technology

[0005] The traditional single-intent recognition existing in the existing technology cannot meet the requirements of the user's multi-intent language instruction, and the traditional multi-intent recognition and splitting sentence scheme cannot fundamentally split a multi-intent sentence into multiple single-intent For the problem of sentences, the purpose of the present invention is to provide a multi-intent recognition method based on the bert+bilstm+crf and xgboost model, through sentence analysis, to parse out the multi-intent information contained in the sentence; on the one hand, the present invention uses bert+ bilstm+crf, Xgboost model for idea map recognition

Images