Method and system for instant messaging with visual messaging assistance

Abstract

The invention discloses a method and a system for instant messaging with visual messaging assistance. The method includes the following steps: constructing a picture database; extracting semantic key words based on text messages input by a user, and making an analysis to obtain grammatical relation between the key words; based on the extracted key words, selecting representative pictures in accordance with contexts of instant messaging from the picture database by utilizing context semantic clues and conspicuousness degree of pictures; reasonably arranging representative pictures to form visual information by utilizing grammatical relation between the key words, and transmitting the visual information together with the test messages to users of the other side. The invention further provides the system for instant messaging with visual messaging assistance, which combines the text messages for transmitting abstract concepts and the visual information for transmitting image concepts, helps users to better express themselves and understand the other side through complementation of the text messages and the visual information. Meanwhile, a machine translation module is also combined with the system for instant messaging with visual messaging assistance, and therefore, for users who speak different languages, the visual information and machine translation results can be jointly presented to users.

Description

technical field [0001] The invention relates to the field of multimedia content analysis and understanding, in particular to an instant communication method and system assisted by visual information. Background technique [0002] In the Internet age, real-time information services such as QQ and Aliwangwang have become the preferred communication tools for the majority of netizens. Real-time information service has many advantages such as convenience, speed, and free of charge. However, the present invention notices that current real-time information services mainly rely on text media to transmit information, so the obtained information generally has the characteristics of abstract content and single form. This also brings a series of problems, such as the following aspects: [0003] (1) The abstract nature of the text itself determines that the communication based on traditional real-time information services lacks vividness and interest. Traditional real-time informatio...

AI Technical Summary

Problems solved by technology

However, these icons must be manually selected, and the number is limited, most of which are limited to the expression of emotions

Although the fun of communication has been enhanced to a certain extent, it is still not satisfying.

[0004] (2) Different ages, different cultural backgrounds, different geographical influences, and different education levels lead to great differences in the understanding of things between users

This cognitive difference often creates trouble for communication

[0005] (3) For a large number of people who have mastered a foreign language, lack of vocabulary is a common problem for them, and there are even a considerable number of people who do not know a foreign language at all

Therefore, simply integrating the machine translation module into the real-time information service still cannot satisfy the communication between users of different languages.

Images