Image-text conversion method and device, intelligent interaction method, device and system, client, server, machine and medium

Abstract

The invention discloses an image-text conversion method and device, an intelligent interaction method, device and system, a client, a server, a machine and a medium. The image-text conversion method comprises the following steps: constructing a sample data set; training a deep learning model and a language characterization model by using the sample data set; when the user input is an image, extracting the visual features of the input image through the deep learning model, calculating the similarity of the visual features, and selecting the text corresponding to the image with the highest similarity as the corresponding output of the input image; and when the user input is the text, extracting semantic features through a language representation model, calculating semantic feature similarity, and selecting an image corresponding to the text with the highest similarity as corresponding output of the input text. By constructing the special data set and adopting various conversion models, richer and more efficient interaction functions are provided for users, and real deep interaction is realized.

Description

technical field [0001] The present invention relates to intelligent interaction technology, in particular to image-text conversion method, equipment, intelligent interaction method, equipment and system, client, server, machine, and medium. Background technique [0002] With the rapid development of computer network technology, various intelligent interactive devices or corresponding intelligent interactive systems such as smart phones, smart tablets, various home and office computers, interactive smart tablets, and interactive smart whiteboards are widely used in education, teaching, Various fields such as corporate conferences and commercial exhibitions have brought great convenience to people's study, work and life. [0003] However, the current intelligent interactive devices or systems still lack interactive functions or the interactive functions are too simple and single to achieve real in-depth interaction with users. For example, smart learning tablets or systems fo...

AI Technical Summary

Problems solved by technology

[0003] However, the current intelligent interactive devices or systems still lack interactive functions or the interactive functions are too simple and single to achieve real in-depth interaction with users.

For example, smart learning tablets or systems for users currently mainly actively provide learning content to users, but they cannot know the actual absorption and mastery of learning content by users, let alone provide targeted and personalized learning content for users based on this. learning path

Images