Translation method and apparatus based on multi-modal machine learning, device and storage medium
HK40027470BActive Publication Date: 2026-09-11TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by
Patent Information
- Application Number
- HK42020017979
- Authority / Receiving Office
- HK · HK
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-10-14
- Publication Date
- 2026-09-11
Smart Images

Figure 00000000_0000_ABST
Abstract
The application discloses a translation method and device based on multi-modal machine learning, equipment and storage medium, relates to the technical field of artificial intelligence. The method performs semantic association on n modal source languages through a multi-modal graph representation layer, constructs a semantic association graph, connects semantic nodes of the same mode by using a first connection edge and connects semantic nodes of different modes by using a second connection edge in the semantic association graph, fully represents the semantic association between the source languages of multiple modes by using the semantic association graph, then fully fuses feature vectors in the semantic association graph by using a multi-modal fusion encoder to obtain encoded feature vectors, and further obtains a more accurate target sentence after decoding processing of the encoded feature vectors. The target sentence is closer to the content, emotion and language environment and the like expressed by the multi-modal source languages.
Need to check novelty before this filing date? Find Prior Art
