Method for processing out-of-set words of Chinese-over-neural machine translation integrated with classification dictionary
A technology of machine translation and processing methods, which is applied in the field of processing out-of-set words in Chinese-Vietnamese neural machine translation, can solve problems such as incomplete context translation, effective processing, and difficult out-of-set words, so as to improve performance and effect and reduce difficulty Effect
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0043] Embodiment 1: as Figure 1-3 As shown, a Chinese-Vietnamese neural machine translation foreign word processing method integrated into the classification dictionary, the specific steps of the Chinese-Vietnamese neural machine translation foreign word processing method integrated into the classification dictionary are as follows:
[0044] Step1. Obtain the homepage of the Chinese-Vietnamese website, use web crawler technology to crawl the Chinese-Vietnamese data, and denoise it, and organize it into a training set, a test set, and a verification set;
[0045] Step2, construction of the classification dictionary: analyze the characteristics of the out-of-set words, and divide the out-of-set words into three categories to build the classification dictionary;
[0046] One is rare words, words outside the regular vocabulary, using words outside the regular vocabulary to build a bilingual dictionary; the construction method is: use GIZA++ to align the corpus, and then exclude ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com