Text normalization method, device and equipment and storage medium

Abstract

The invention provides a text normalization method, device and equipment and a storage medium, and the method comprises the steps: obtaining a to-be-normalized text; extracting text regularization features from the to-be-normalized text, and the text regularization features at least comprising semantic features capable of representing semantics of the to-be-normalized text and generalization features capable of representing repeated parts in the to-be-normalized text; and determining a normalized text corresponding to the to-be- normalized text by utilizing the text normalized features and a pre-established text normalized model. According to the text normalization method provided by the invention, the to-be-normalized text can be normalized into the text with clear sentence meaning and relatively strong readability and logicality by utilizing the text normalization characteristics of the to-be-normalized text and the pre-established text normalization model.

Description

technical field [0001] The present application relates to the technical field of natural language processing, and in particular to a text regularization method, device, equipment and storage medium. Background technique [0002] In some application scenarios, text may be obtained, and the obtained text may need to be provided to target users for reading. However, due to some reasons, the obtained text may have problems such as poor readability and unclear meaning, which causes target users to Difficult to read text. [0003] Take the voice recognition scene as an example: voice input is the most natural and convenient way in human-computer interaction. During voice input, due to some reasons (for example, the voice stringing in near the speaker, the speaker's nervousness or thoughts) Unclearly send out some meaningless modal particles and repetitive words, the speaker will say some online vocabulary, personalized vocabulary, etc. that ordinary people cannot understand due t...

AI Technical Summary

Problems solved by technology

[0002] In some application scenarios, text may be obtained, and the obtained text may need to be provided to target users for reading. However, due to some reasons, the obtained text may have problems such as poor readability and unclear meaning, which causes target users to hard to read text

[0003] Take the voice recognition scene as an example: voice input is the most natural and convenient way in human-computer interaction. During voice input, due to some reasons (for example, the voice stringing in near the speaker, the speaker's nervousness or train of thought) Unclearly send out some meaningless modal particles and repetitive words, the speaker will say some online vocabulary, personalized vocabulary, etc. that ordinary people cannot understand due to language habits), and the voice recognition system will recognize the input voice to get the existence of the text. Poor readability, unclear meaning, etc. It is difficult for readers to understand what the speaker wants to express based on such texts

Images