Learning method and system based on image recognition and voice interaction

Abstract

The invention discloses a learning method and system based on image recognition and voice interaction. The method includes the steps: taking photos through a mobile terminal or selecting one photo from the mobile terminal and uploading the photo to a server by a user; receiving the photo transmitted by the mobile terminal by an image recognition module of the server, and processing the photo intoat least one text, and pushing the texts to the mobile terminal; selecting one text or recommending one text by the user, automatically transmitting the text to a voice synthesis module of the serverby the mobile terminal, receiving the text transmitted by the mobile terminal by the voice synthesis module, processing and synthesizing the text into audio data and feeding back the data to the mobile terminal; receiving the audio data for learning of the user by the mobile terminal; reading after the audio data by the user, recording by the mobile terminal and transmitting record to a voice recognition module of the server; receiving the record transmitted by the mobile terminal by the voice recognition module, analyzing the record and feeding back evaluation to the mobile terminal to learnphoto taking whenever and wherever possible.

Description

technical field [0001] The invention relates to the field of image recognition and voice interaction, in particular to a learning system and method based on image recognition and voice interaction. Background technique [0002] Chairman Xi said that it is necessary to build a learning society in which "everyone learns, can learn everywhere, and can learn at any time". Unremittingly promote the informatization of education, and strive to expand the coverage of high-quality educational resources by means of informatization. Through education informatization, we will gradually narrow the digital gap between regions and urban and rural areas, and vigorously promote educational equity, so that hundreds of millions of children can share high-quality education under the blue sky and change their destiny through knowledge. [0003] In the existing technology, speech synthesis technology, online recording technology, and speech recognition technology are relatively mature technologi...

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, speech synthesis technology, online recording technology, and speech recognition technology are all relatively mature technologies, but there are still many deficiencies in the existing technology. For example, when students are studying, the learning content is stipulated in the textbook. , it is impossible to automatically generate teaching content, and there is no product that can automatically generate teaching content with graphics, text and sound for any content, and guide users in foreign language learning and practice.

Images