Translation method and apparatus based on multi-modal machine learning, device and storage medium

HK40027470BActive Publication Date: 2026-09-11TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
HK42020017979
Authority / Receiving Office
HK · HK
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-14
Publication Date
2026-09-11

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The application discloses a translation method and device based on multi-modal machine learning, equipment and storage medium, relates to the technical field of artificial intelligence. The method performs semantic association on n modal source languages through a multi-modal graph representation layer, constructs a semantic association graph, connects semantic nodes of the same mode by using a first connection edge and connects semantic nodes of different modes by using a second connection edge in the semantic association graph, fully represents the semantic association between the source languages of multiple modes by using the semantic association graph, then fully fuses feature vectors in the semantic association graph by using a multi-modal fusion encoder to obtain encoded feature vectors, and further obtains a more accurate target sentence after decoding processing of the encoded feature vectors. The target sentence is closer to the content, emotion and language environment and the like expressed by the multi-modal source languages.
Need to check novelty before this filing date? Find Prior Art