Picture-based vocabulary teaching interaction method, interaction device and storage medium

Abstract

The application provides a picture-based vocabulary teaching interaction method, an interaction device and a storage medium. The method comprises the following steps: obtaining a target picture to be recognized; in the case that the target picture contains a teaching vocabulary, displaying a vocabulary content block and a vocabulary teaching control, the vocabulary content block comprising a content area in which the teaching vocabulary in the target picture is located; receiving a triggering operation on the vocabulary teaching control, displaying a vocabulary display interface, the vocabulary display interface comprising at least one flash card and at least one vocabulary interaction control, each flash card comprising a teaching vocabulary, the at least one flash card being a flash card corresponding to at least one teaching vocabulary, and the vocabulary interaction control being used for triggering the execution of a vocabulary interaction task; and receiving a triggering operation on the vocabulary interaction control, displaying a vocabulary teaching interaction interface, the vocabulary teaching interaction interface comprising a teaching interaction resource corresponding to the teaching vocabulary. The technical solution does not need to find vocabulary teaching materials in advance, thereby saving time and improving efficiency.

Description

Technical Field

[0001] This application relates to the field of intelligent teaching, and in particular to image-based interactive methods, interactive devices, and storage media for vocabulary teaching. Background Technology

[0002] Vocabulary instruction is a crucial component of classroom teaching, aiming to guide students in correctly understanding and using new words. During lesson preparation, teachers typically prepare by presenting new characters, explaining them, and providing practice exercises. Presenting characters aims to visually introduce them, helping students form an intuitive impression. Through pronunciation demonstrations and guided reading exercises, students master the pronunciation and intonation of the words. Explaining characters involves providing detailed explanations, including parts of speech, meanings, usages, and collocations. Practicing characters aims to reinforce students' memory and application of the words through hands-on activities. Expanding vocabulary involves extending instruction beyond the vocabulary itself, such as through synonyms, antonyms, and word combinations, helping students broaden their vocabulary.

[0003] Preparing for vocabulary instruction requires teachers to search for and design various teaching materials, such as texts and pictures. This process is tedious, takes a lot of time and effort, and affects teachers' work efficiency. Summary of the Invention

[0004] This application provides a picture-based interactive method, interactive device, and storage medium for vocabulary teaching, aiming to improve efficiency.

[0005] Firstly, a picture-based interactive vocabulary teaching method is provided, including:

[0006] Obtain the target image to be identified;

[0007] If the target image contains teaching vocabulary, a vocabulary content block and vocabulary teaching controls are displayed, wherein the vocabulary content block includes the content area where the teaching vocabulary in the target image is located;

[0008] The system receives a trigger operation on the vocabulary teaching control and displays a vocabulary display interface. The vocabulary display interface includes at least one character card and at least one vocabulary interaction control. Each character card includes a teaching vocabulary. The at least one character card is a character card corresponding to at least one teaching vocabulary. The at least one teaching vocabulary is obtained by extracting teaching vocabulary from the vocabulary content block. The vocabulary interaction control is used to trigger the execution of a vocabulary interaction task.

[0009] The system receives a trigger operation on the vocabulary interaction control and displays a vocabulary teaching interaction interface. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction tasks corresponding to the vocabulary interaction control.

[0010] In this technical solution, after acquiring the target image to be identified, if the target image contains teaching vocabulary, a vocabulary content block and vocabulary teaching controls are displayed. Then, a trigger operation on the vocabulary teaching controls is received, and a vocabulary display interface is displayed. The vocabulary display interface contains flashcards corresponding to each teaching vocabulary in the vocabulary content block, as well as vocabulary interaction controls for triggering the execution of vocabulary interaction tasks. Finally, a trigger operation on the vocabulary interaction controls is received, and a vocabulary teaching interaction interface is displayed. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction tasks corresponding to the vocabulary interaction controls. Essentially, it intelligently extracts teaching vocabulary from the image and automatically generates and displays teaching interaction resources related to the teaching vocabulary. Teachers only need to select the image and the vocabulary interaction controls used to trigger the execution of vocabulary interaction tasks to carry out the corresponding vocabulary teaching activities, without needing to search for new vocabulary teaching materials in advance, saving time and improving efficiency.

[0011] In conjunction with the first aspect, in one possible implementation, the at least one vocabulary interaction control includes a classroom activity control; receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: receiving a trigger operation on the classroom activity control, displaying classroom activity resources, and obtaining the vocabulary teaching interaction interface, wherein the classroom activity resources are obtained by resource matching of the at least one teaching vocabulary.

[0012] The vocabulary interactive control includes a classroom activity control. When a trigger operation is received on the classroom activity control, classroom activity resources are displayed, resulting in a vocabulary teaching interactive interface. The classroom activity resources are obtained by matching the teaching vocabulary in the image, automatically generating classroom activities related to the teaching vocabulary. This eliminates the need for teachers to configure them in advance, making it convenient and quick.

[0013] In conjunction with the first aspect, in one possible implementation, each flashcard further includes supplementary teaching text corresponding to the taught vocabulary, the supplementary teaching text being used to assist in learning the taught vocabulary; the at least one vocabulary interactive control includes a hidden control; receiving a trigger operation on the vocabulary interactive control to display the vocabulary teaching interactive interface includes: receiving a trigger operation on a first hidden control to hide the taught vocabulary in the flashcard, thereby obtaining the vocabulary teaching interactive interface, wherein the first hidden control is a hidden control used to hide the taught vocabulary; or, receiving a trigger operation on a second hidden control to hide the supplementary teaching text in the flashcard, thereby obtaining the vocabulary teaching interactive interface, wherein the second hidden control is a hidden control used to hide the supplementary teaching text.

[0014] The vocabulary interactive control includes a hidden control. When a trigger operation is received to hide the hidden control used to hide teaching vocabulary or teaching aids text, the teaching vocabulary or teaching aids text is hidden, and an interactive vocabulary teaching interface is obtained, which makes it convenient for teachers to practice vocabulary.

[0015] In conjunction with the first aspect, in one possible implementation, after receiving a trigger operation on the first hidden control to hide the teaching vocabulary in the character card and obtain the vocabulary teaching interactive interface, the method further includes: receiving a cancellation operation on the first hidden control to restore the display of the teaching vocabulary in the character card and obtain the vocabulary display interface; or, after receiving a trigger operation on the second hidden control to hide the teaching auxiliary text in the character card and obtain the vocabulary teaching interactive interface, the method further includes: receiving a cancellation operation on the second hidden control to restore the display of the teaching auxiliary text in the character card and obtain the vocabulary teaching interactive interface.

[0016] When a cancellation operation is received for the hidden control used to hide teaching vocabulary or teaching aids text, the teaching vocabulary or teaching aids text will be restored to display, making it convenient for teachers to practice vocabulary.

[0017] In conjunction with the first aspect, in one possible implementation, after receiving a trigger operation on the first hidden control to hide the teaching vocabulary in the character card and obtaining the vocabulary teaching interactive interface, the method further includes: receiving a hide-restore operation on the teaching vocabulary at the first position and restoring the display of the teaching vocabulary at the first position, where the first position is the original position of the teaching vocabulary; or, after receiving a trigger operation on the second hidden control to hide the teaching auxiliary text in the character card and obtaining the vocabulary teaching interactive interface, the method further includes: receiving a hide-restore operation on the teaching auxiliary text at the second position and restoring the display of the teaching auxiliary text at the second position, where the second position is the original position of the teaching auxiliary text.

[0018] When a hidden teaching vocabulary or teaching aid text is hidden and then restored, the corresponding teaching vocabulary or teaching aid text is displayed, making it convenient for teachers to show them one by one for vocabulary practice.

[0019] In conjunction with the first aspect, in one possible implementation, the at least one vocabulary interactive control includes an explanation control, and each character card has a corresponding explanation control; receiving a trigger operation on the vocabulary interactive control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on the explanation control corresponding to the first character card, displaying the vocabulary explanation content corresponding to the first character card, and obtaining the vocabulary teaching interactive interface; the first character card is any one of the at least one character cards, and the vocabulary explanation content includes at least one of the following: the pronunciation of the teaching vocabulary, the definition of the teaching vocabulary, the related vocabulary of the teaching vocabulary, the usage of the teaching vocabulary, and the vocabulary composition of the teaching vocabulary.

[0020] The vocabulary interactive controls include explanation controls. Each flashcard has a corresponding explanation control. When a trigger operation is received on the explanation control of a flashcard, the corresponding vocabulary explanation content is displayed. The vocabulary explanation content includes pronunciation, definition, related words, vocabulary usage, and vocabulary composition. It automatically retrieves relevant teaching resources for the vocabulary, and triggering the explanation control allows for vocabulary explanation teaching. Teachers do not need to search for resources in advance, which is convenient and fast. Explanation controls are set for each flashcard, making it convenient for teachers to explain the vocabulary one by one.

[0021] In conjunction with the first aspect, in one possible implementation, the vocabulary teaching interactive interface includes a flashcard switching control; after receiving a trigger operation on the explanation control corresponding to the first flashcard, displaying the vocabulary explanation content corresponding to the first flashcard, and obtaining the vocabulary teaching interactive interface, the interface further includes: receiving a trigger operation on the flashcard switching control, switching the display of the vocabulary explanation content corresponding to the second flashcard in the vocabulary teaching interactive interface, wherein the second flashcard is the flashcard in the at least one flashcard that is adjacent to the first flashcard in sequence.

[0022] The vocabulary teaching interactive interface includes a flashcard switching control. When a trigger operation is received on the flashcard switching control, the corresponding vocabulary explanation content of the flashcard is switched and displayed, making it convenient for teachers to directly switch the vocabulary to be taught.

[0023] In conjunction with the first aspect, in one possible implementation, different types of vocabulary explanation content are displayed in pages on the vocabulary teaching interactive interface; the vocabulary teaching interactive interface includes multiple content menu controls, and different content menu controls are used to trigger the display of different types of vocabulary explanation content; after receiving the trigger operation of the explanation control corresponding to the first character card, displaying the vocabulary explanation content corresponding to the first character card, and obtaining the vocabulary teaching interactive interface, the method further includes: receiving the selection operation of the first content menu control, switching the display of the vocabulary explanation content corresponding to the first character card and the first content menu control in the vocabulary teaching interactive interface, wherein the first content menu control is any content menu control other than the second content menu control among the multiple content menu controls, and the second content menu control is the content menu control that is selected among the multiple content menu controls.

[0024] Different types of vocabulary explanations are displayed in pages on the vocabulary teaching interactive interface. When a selection operation is received from the content menu control, the vocabulary explanation content is switched to facilitate teachers' explanation of new words.

[0025] In conjunction with the first aspect, in one possible implementation, displaying the vocabulary explanation content corresponding to the first literacy card to obtain the vocabulary teaching interactive interface includes: obtaining the vocabulary explanation content corresponding to the first literacy card from a vocabulary explanation content database, wherein the vocabulary explanation content database is used to store vocabulary explanation content for different teaching vocabulary; if there is vocabulary explanation content corresponding to a third content menu control in the vocabulary explanation content corresponding to the first literacy card, displaying the third content menu control in the vocabulary teaching interactive interface, wherein the third content menu control is any type of content menu control; if there is no vocabulary explanation content corresponding to the third content menu control in the vocabulary explanation content corresponding to the first literacy card, not displaying the third content menu control.

[0026] The system determines whether to display the corresponding type of content menu control based on the obtained vocabulary explanations, thus enabling flexible display of the content menu control.

[0027] In conjunction with the first aspect, in one possible implementation, the flashcard further includes supplementary teaching text corresponding to the taught vocabulary, the supplementary teaching text being used to assist in learning the taught vocabulary; the at least one vocabulary interaction control includes an audio playback control; receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: receiving a trigger operation on the audio playback control and displaying a playback settings interface, the playback settings interface being used to set audio playback parameters, the audio playback settings interface including a playback start control; receiving a trigger operation on the playback start control and displaying an audio playback interface, playing the teaching audio corresponding to the at least one taught vocabulary according to the audio playback parameters set in the playback settings interface, the audio playback interface including current audio display text adapted to the function of the audio playback control, the current audio display text being the current flashcard corresponding to the currently played taught vocabulary or the current supplementary teaching text corresponding to the currently played taught vocabulary.

[0028] The vocabulary interactive control includes an audio playback control. When a trigger operation is received on the audio playback control, a playback settings interface is displayed. The playback settings interface contains a playback start control. Then, when a trigger operation is received on the playback start control, the audio playback interface is displayed, and the teaching audio corresponding to the teaching vocabulary is played according to the audio playback parameters set in the playback settings interface. This helps teachers to directly conduct dictation or reading practice. The playback settings interface is displayed first to set the audio playback parameters, which allows teachers to set more reasonable audio playback parameters according to the actual scenario.

[0029] In conjunction with the first aspect, in one possible implementation, playing the teaching audio corresponding to the at least one teaching vocabulary according to the audio playback parameters set in the playback settings interface includes: obtaining the audio file of each teaching vocabulary in the at least one teaching vocabulary to obtain at least one audio file; and playing each audio file in the at least one audio file sequentially according to the audio playback parameters.

[0030] The audio files for each vocabulary word are played sequentially according to the audio playback parameters to enable dictation or guided reading practice.

[0031] In conjunction with the first aspect, in one possible implementation, the display of the vocabulary content block and the vocabulary teaching control includes: displaying the vocabulary content block; receiving a selection operation on the vocabulary content block; and displaying the vocabulary teaching control.

[0032] Secondly, a picture-based interactive vocabulary teaching device is provided, comprising:

[0033] The image acquisition module is used to acquire the target image to be identified.

[0034] The display module is used to display a vocabulary content block and a vocabulary teaching control when the target image contains teaching vocabulary. The vocabulary content block includes the content area where the teaching vocabulary in the target image is located.

[0035] The display module is also used to receive the trigger operation of the vocabulary teaching control and display the vocabulary display interface. The vocabulary display interface includes at least one character card and at least one vocabulary interaction control. Each character card includes teaching vocabulary. The at least one character card is the character card corresponding to at least one teaching vocabulary. The at least one teaching vocabulary is obtained by extracting teaching vocabulary from the vocabulary content block. The vocabulary interaction control is used to trigger the execution of vocabulary interaction tasks.

[0036] The display module is also used to receive trigger operations on the vocabulary interaction control and display the vocabulary teaching interaction interface. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction tasks corresponding to the vocabulary interaction control.

[0037] Thirdly, an interactive device is provided, including a memory, a touch-sensitive display screen, and a processor. The memory and the touch-sensitive display screen are connected to the processor. The touch-sensitive display screen is used to display an interface and receive user operations. The processor is used to execute one or more computer programs stored in the memory. When the processor executes the one or more computer programs, it causes the interactive device to perform the picture-based vocabulary teaching interactive method of the first aspect described above.

[0038] Fourthly, a computer-readable storage medium is provided, which stores a computer program including program instructions that, when executed by a processor, cause the processor to perform the picture-based interactive vocabulary teaching method of the first aspect.

[0039] This application can achieve the following technical effects: it is equivalent to intelligently extracting teaching vocabulary from images and automatically generating and displaying teaching interactive resources related to the teaching vocabulary. Teachers only need to select images and vocabulary interaction controls to trigger the execution of vocabulary interaction tasks to carry out corresponding vocabulary teaching activities. There is no need to search for new vocabulary teaching materials in advance, saving time and improving efficiency. Attached Figure Description

[0040] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] Figure 1 A system block diagram of an image-based interactive vocabulary teaching system provided for embodiments of this application;

[0042] Figure 2 A flowchart illustrating an image-based interactive vocabulary teaching method provided in this application embodiment;

[0043] Figures 3A-3N Schematic diagrams illustrating the display interface under different conditions provided in the embodiments of this application;

[0044] Figure 4 This is a schematic diagram of the structure of an image-based vocabulary teaching interactive device provided in an embodiment of this application;

[0045] Figure 5 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application. Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0047] It should be noted that, unless there is a conflict, the various features in the embodiments of this application can be combined with each other, all of which are within the protection scope of this application. Furthermore, although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than the module division in the device or the order in the flowchart. Moreover, the terms "first," "second," and "third" used in this application do not limit the data or execution order, but only distinguish identical or similar items with essentially the same function and effect.

[0048] The technical solution of this application is applicable to vocabulary teaching scenarios. In vocabulary teaching scenarios, teachers need to prepare for vocabulary teaching.

[0049] In preparing for vocabulary instruction, teachers typically focus on the following aspects:

[0050] 1. Vocabulary Input: Based on the textbook content, input the teaching vocabulary from the printed textbook into the teaching courseware.

[0051] 2. Presentation of new words: Find or design flashcards to display new words, helping students form an intuitive impression and master the pronunciation and intonation of the words.

[0052] 3. Explanation of unfamiliar characters: Consult the dictionary for detailed explanations of unfamiliar characters, including part of speech, meaning, usage, collocation, etc.

[0053] 4. Vocabulary Practice: Design diverse practice activities, such as word guessing games, matching games, and translation games, to reinforce students' memory and application of new words.

[0054] 5. Vocabulary Expansion: Expand vocabulary by including synonyms, antonyms, and collocations for key vocabulary words to help students broaden their vocabulary.

[0055] The above preparations require teachers to search for and design resources in advance, as well as to format and layout them, which takes a lot of preparation time and affects teachers' work efficiency.

[0056] This application aims to save teachers' preparation time for vocabulary teaching and improve their work efficiency. To save teachers' preparation time for vocabulary teaching, this application obtains images provided by users. When the images contain teaching vocabulary, it displays vocabulary content blocks and vocabulary teaching controls. Upon receiving a trigger operation on the vocabulary teaching controls, a vocabulary display interface is displayed, showing the flashcards and interactive vocabulary controls corresponding to the teaching vocabulary extracted from the vocabulary content blocks. The interactive vocabulary controls are used to trigger specific vocabulary interactive tasks, with different interactive tasks corresponding to different teaching interactive resources. Based on the user's trigger operation on the interactive vocabulary controls, the application displays the vocabulary teaching interactive interface obtained from executing the corresponding interactive task, thus completing the display of the teaching interactive resources corresponding to the teaching vocabulary. Teachers only need to select the image and the interactive vocabulary control used to trigger the interactive task to carry out the corresponding vocabulary teaching activities. These activities can include classroom activities, hiding Chinese characters or their pinyin, hiding English words or their Chinese definitions, leading vocabulary reading, dictation, and explaining the part of speech, meaning, usage, synonyms, or antonyms of vocabulary, etc., eliminating the need to search for vocabulary teaching materials in advance, thereby saving time and improving efficiency.

[0057] The technical solution of this application is applied to an image-based interactive vocabulary teaching system. For ease of understanding, the image-based interactive vocabulary teaching system of this application is introduced first. See [link to relevant documentation]. Figure 1 , Figure 1 A system block diagram of an image-based interactive vocabulary teaching system provided in this application embodiment is shown below. Figure 1As shown, the image-based vocabulary teaching interactive system 10 may include a local display device 101 and a cloud processing device 102. The local display device 101 is a user-facing display device used for user interaction; it can also be called an interactive device. The local display device 101 includes a user client. It acquires images provided by the user through photography or image uploads, sends the acquired images to the cloud processing device 102 for intelligent image recognition and processing, and displays the processing results to the user. The local display device 101 also interacts with the user, acquires user actions, responds to user actions, and displays the response results to the user. The cloud processing device 102 is the background support device for the local display device 101, supporting the implementation of various functions supported by the image-based vocabulary teaching interactive system. The cloud processing device 102 performs image recognition and processing on the images sent by the local display device 101, obtains processing results, and assists the local display device 101 in completing various user operation responses. The cloud processing device 102 is equipped with one or more algorithm models based on artificial intelligence technology. These models may include image recognition models, large language models, such as GPT3.5 and GPT4.0 models. The algorithm models are used to intelligently segment images, obtaining content block segmentation results. These results include, for example, the location information and content tag information of the content blocks, generating content related to the content blocks in the image. This content may include, for example, teaching vocabulary within the content blocks. The cloud processing device 102 also includes a background scheduler that interfaces with the local display device 101. Based on requests from the local display device 101, the scheduler schedules the algorithm models configured in the cloud processing device 102, obtains the processing results from the algorithm models, and returns the results to the local display device 101 for display.

[0058] The technical solution of this application can be specifically applied to the local display device 101 in a picture-based vocabulary teaching interactive system. The technical solution of this application is described in detail below.

[0059] See Figure 2 , Figure 2 A flowchart illustrating an image-based interactive vocabulary teaching method provided in this application embodiment is shown below. Figure 2 As shown, the method includes the following steps:

[0060] S201, Obtain the target image to be identified.

[0061] Here, the target image to be identified can be a picture taken by the user or an image uploaded by the user from their local photo album. For example, the target image can be an image containing teaching material, which may include teaching vocabulary, such as Chinese characters or English words. For instance, the target image to be identified could be as follows: Figure 3A As shown in p1 or p2.

[0062] S202, if the target image contains teaching vocabulary, display the vocabulary content block and vocabulary teaching controls.

[0063] Here, the vocabulary content block includes the content area containing the teaching vocabulary in the target image, and the vocabulary teaching control is a functional control obtained based on the matching of the vocabulary content block, used to display the teaching vocabulary in the vocabulary content block. Specifically, the vocabulary teaching control is used to trigger the display of the teaching vocabulary in the vocabulary content block as cards, with one card representing one teaching vocabulary word.

[0064] The vocabulary content blocks and vocabulary teaching controls are processed by a cloud-based processing device. After the local display device sends the target image to the cloud processing device, the cloud processing device uses an algorithm model to identify the target image and determine whether it contains teaching vocabulary. If the target image contains teaching vocabulary, the cloud processing device uses the algorithm model to intelligently segment the target image, obtaining the content area where the teaching vocabulary is located. This content area is used as the vocabulary content block, generating the content block segmentation result of the target image. The content block segmentation result includes the position of the vocabulary content block in the target image and a vocabulary tag. The vocabulary tag indicates that the vocabulary content block contains teaching vocabulary. The cloud processing device also extracts teaching vocabulary from the vocabulary content block, obtaining at least one teaching vocabulary contained in the vocabulary content block. Based on the vocabulary tag, a vocabulary control identifier is obtained, which is used to uniquely identify the vocabulary teaching control. The cloud processing device then sends the content block segmentation result, the at least one teaching vocabulary contained in the extracted vocabulary content block, and the vocabulary control identifier to the local display device.

[0065] The local display device, based on the position of the vocabulary content block in the target image from the content block segmentation processing result, displays a content box in the target image to select the content area where the vocabulary content block is located, and then displays the vocabulary content block; it receives selection operations on the vocabulary content block and displays vocabulary teaching controls. Specifically, the local display device determines the vocabulary teaching controls based on the vocabulary control identifier and displays the vocabulary teaching controls.

[0066] With the target image such as Figure 3A Taking p1 as an example, since p1 contains Chinese characters, the vocabulary content block and vocabulary teaching controls can be displayed as follows: Figure 3BAs shown in J1, the area containing the Chinese characters is selected within J1, and the vocabulary teaching control, as shown in n1 within J1, is presented as a "Vocabulary Teaching" button. It is understood that the vocabulary teaching control can also have other presentation formats, and this application does not impose any restrictions on this.

[0067] S203 receives a trigger operation on the vocabulary teaching control and displays the vocabulary display interface.

[0068] Here, triggering a vocabulary teaching control refers to selecting the control to activate its corresponding function (such as displaying vocabulary words in a card format). A trigger operation is received when a user selects the vocabulary teaching control via mouse click or touch click. For example, refer to... Figure 3B When the user clicks with the mouse Figure 3B When the "Vocabulary Teaching" button is pressed, the system receives a trigger operation for the vocabulary teaching control.

[0069] The vocabulary display interface presents each teaching vocabulary word in a card format within a vocabulary content block. The interface includes at least one flashcard and at least one interactive vocabulary control. Each flashcard contains a teaching vocabulary word, and the at least one flashcard in the display interface corresponds to at least one teaching vocabulary word. This at least one teaching vocabulary word is obtained by extracting teaching vocabulary words from the vocabulary content block. Each flashcard presents a teaching vocabulary word extracted from the vocabulary content block. Optionally, each flashcard also includes supplementary teaching text corresponding to the teaching vocabulary word. This supplementary text assists in learning the vocabulary. When the teaching vocabulary word is a Chinese character, the supplementary text is the pinyin of the Chinese character; when the teaching vocabulary word is an English word, the supplementary text is the Chinese definition of the English word.

[0070] In this process, at least one of the aforementioned teaching words is extracted from the vocabulary content block by the cloud processing device and sent to the local display device. After receiving at least one teaching word from the cloud processing device, the local display device queries the corresponding teaching aid text for the teaching word through a preset dictionary database to obtain the teaching aid text corresponding to each of the at least one teaching words. The local display device then presents each teaching word and its corresponding teaching aid text in the display interface in the form of cards.

[0071] The vocabulary interaction controls are pre-set functional controls designed to assist teachers in conducting vocabulary teaching activities. These controls trigger the execution of vocabulary interaction tasks, providing teachers with the necessary functions for these activities. Different vocabulary interaction controls trigger different vocabulary interaction tasks, each offering different functionalities. In this application, the functions provided by the vocabulary interaction tasks corresponding to the controls in the vocabulary display interface include, but are not limited to, vocabulary explanation, hidden interaction, vocabulary dictation, vocabulary reading aloud, and classroom activity functions. The vocabulary explanation function provides various resources needed for explaining vocabulary, including but not limited to pronunciation, stroke distribution, radicals, pinyin, word formation, sentence construction, similar-looking characters, polyphonic characters, homophones, fixed collocations, example sentences, synonyms, and antonyms. The text hiding function assists teachers in hiding parts of the text displayed on the interface for interactive teaching. The vocabulary dictation function assists teachers in dictating vocabulary; the reading aloud function assists teachers in leading vocabulary reading; and the classroom activity function assists teachers in conducting classroom activities.

[0072] The vocabulary display interface includes at least one or more of the following: classroom activity controls, hidden controls, explanation controls, and audio playback controls; classroom activity controls are used to implement classroom activity functions; hidden controls are used to implement hidden interaction functions; explanation controls are used to implement vocabulary explanation functions; and audio playback controls are used to implement vocabulary dictation and vocabulary reading guidance functions.

[0073] For example, refer to Figure 3B The vocabulary display interface can be like Figure 3BAs shown in J2, the vocabulary display interface in J2 contains flashcards corresponding to each Chinese character in the vocabulary content block of J1. Each flashcard includes the Chinese character and its pinyin. Each flashcard has an "Explanation" button, which is an explanation control used to implement the function of explaining new words. The vocabulary display interface in J2 also includes "Hide Pinyin" and "Hide Chinese Character" buttons. Both "Hide Pinyin" and "Hide Chinese Character" buttons are hiding controls. "Hide Pinyin" is used to hide the pinyin of the Chinese character, and "Hide Chinese Character" is used to hide the Chinese character. The vocabulary display interface in J2 also includes "Dictation" and "Lead Reading" buttons. Both "Dictation" and "Lead Reading" buttons are audio playback controls. The "Dictation" button is used for dictating the vocabulary taught, and the "Lead Reading" button is used for leading the reading of the vocabulary taught. The vocabulary display interface in J2 also includes a "Classroom Activity" button, which is a classroom activity control used to provide classroom activities. Understandably, when the teaching vocabulary consists of English words, the "Hide Pinyin" and "Hide Chinese Characters" buttons in J2 can be replaced with "Hide Chinese Definitions" and "Hide English Words" buttons, respectively. Additionally, the vocabulary display interface includes a writing control. This method further includes the following steps: receiving a trigger operation on the writing control to open the writing application interface; receiving the writing operation on the opened writing application interface and displaying the corresponding handwriting. Thus, the writing application can also be opened during the teaching process for blackboard illustrations, writing exercises, etc.

[0074] S204, receive the trigger operation of the vocabulary interaction control and display the vocabulary teaching interaction interface.

[0075] Here, the triggering operation for the vocabulary interaction control refers to the operation of selecting the vocabulary interaction control to trigger its corresponding function. When a user's mouse click, touch click, or other operation to select the vocabulary interaction control is received, a triggering operation for the vocabulary interaction control is received. For example, refer to... Figure 3B When the user clicks with the mouse Figure 3B When the "Explanation" button is pressed, the system receives a trigger operation for the explanation control.

[0076] The vocabulary teaching interactive interface displays the teaching interactive resources corresponding to the vocabulary interactive controls. This interface includes interactive resources for the vocabulary words being taught. These resources are obtained by executing the vocabulary interactive tasks corresponding to the user-selected interactive controls. These resources assist teachers in teaching new vocabulary and include, but are not limited to, teaching aids, classroom games, and multimedia resources. Different user-selected interactive controls result in different interactive tasks, leading to different interactive resources and different vocabulary teaching interfaces. The specific details regarding receiving trigger operations on the vocabulary interactive controls and displaying the vocabulary teaching interactive interface will be explained in detail later.

[0077] In the above Figure 2 In the corresponding technical solution, after acquiring the target image to be identified, if the target image contains teaching vocabulary, a vocabulary content block and vocabulary teaching controls are displayed. Then, a trigger operation on the vocabulary teaching controls is received, and a vocabulary display interface is displayed. The vocabulary display interface contains flashcards corresponding to each teaching vocabulary in the vocabulary content block, as well as vocabulary interaction controls for triggering the execution of vocabulary interaction tasks. Finally, a trigger operation on the vocabulary interaction controls is received, and a vocabulary teaching interaction interface is displayed. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction tasks corresponding to the vocabulary interaction controls. Essentially, it intelligently extracts teaching vocabulary from the image and automatically generates and displays teaching interaction resources related to the teaching vocabulary. Teachers only need to select the image and the vocabulary interaction controls used to trigger the execution of vocabulary interaction tasks to carry out the corresponding vocabulary teaching activities, without needing to search for new vocabulary teaching materials in advance, saving time and improving efficiency.

[0078] The following describes the above. Figure 2 The corresponding technical solution receives the trigger operation of the vocabulary interaction control and displays the specific interaction of the vocabulary teaching interactive interface.

[0079] In one embodiment, at least one vocabulary interactive control in the vocabulary display interface includes a classroom activity control. The above-mentioned receiving a trigger operation on the vocabulary interactive control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on the classroom activity control, displaying classroom activity resources, and obtaining the vocabulary teaching interactive interface.

[0080] Among them, classroom activity resources are obtained by matching at least one teaching word displayed in the vocabulary display interface.

[0081] Classroom activity resources are interactive teaching resources used for classroom activities. For example, classroom activity resources might be interactive teaching resources corresponding to a fun matching game. After receiving at least one teaching vocabulary word from the cloud processing device, the local display device can obtain the teaching aid text corresponding to each of the at least one teaching vocabulary word; the obtained teaching vocabulary words and teaching aid text are then randomly arranged to obtain the interactive teaching resources corresponding to the fun matching game; these interactive teaching resources are then displayed as classroom activity resources on the display interface, thus obtaining the vocabulary teaching interactive interface. For example, refer to... Figure 3C When the user clicks the "Classroom Activities" button in J2, a trigger operation is received on the classroom activity control, displaying classroom activity resources and providing an interactive vocabulary teaching interface. Figure 3C As shown in J3.

[0082] It should be understood that classroom activity resources can also be teaching interactive resources corresponding to classroom games such as word puzzles, spelling games, and word formation games. Teaching interactive resources for different classroom games are stored in different teaching interactive resource libraries. Upon receiving a trigger operation on the classroom activity control, the local display device displays the activity settings interface, which is used to set the specific game. Based on the target game selected by the user in the activity settings interface, the teaching interactive resource corresponding to the target game is selected from the teaching interactive resource library that matches the teaching vocabulary in the vocabulary display interface and displayed as the classroom activity resource on the display interface.

[0083] It should be noted that the number of classroom activity controls in the vocabulary display interface is not limited to one. For example, the vocabulary display interface may include multiple classroom activity controls, with different controls used to trigger the retrieval of different classroom activity resources, such as triggering the retrieval of teaching interaction resources corresponding to different classroom games.

[0084] The vocabulary interactive control includes a classroom activity control. When a trigger operation is received on the classroom activity control, classroom activity resources are displayed, resulting in a vocabulary teaching interactive interface. The classroom activity resources are obtained by matching the teaching vocabulary in the image, automatically generating classroom activities related to the teaching vocabulary. This eliminates the need for teachers to configure them in advance, making it convenient and quick.

[0085] In one embodiment, at least one vocabulary interactive control in the vocabulary display interface includes a hidden control; the above-mentioned receiving a trigger operation on the vocabulary interactive control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on the first hidden control, hiding the teaching vocabulary in the flashcards in the vocabulary teaching interactive interface, and obtaining the vocabulary teaching interactive interface, wherein the first hidden control is a hidden control used to hide the teaching vocabulary.

[0086] For example, refer to Figure 3DWhen the user clicks the "Hide Chinese Characters" button in J2, making "Hide Chinese Characters" selected, a trigger operation is received on the first hidden control, hiding the teaching vocabulary in the flashcards, and the vocabulary teaching interactive interface can be obtained as follows: Figure 3C As shown in J4.

[0087] Optionally, after receiving a trigger operation on the first hidden control to hide the teaching words in the literacy cards and obtain the vocabulary teaching interactive interface, the method further includes: receiving a cancellation operation on the first hidden control to restore the display of the teaching words in the literacy cards in the vocabulary teaching interactive interface and obtain the vocabulary display interface.

[0088] For example, refer to Figure 3E When the user clicks the "Hide Chinese Characters" button in J4 again, deselecting it, the first hidden control is deselected, restoring the display of the vocabulary flashcards in the vocabulary teaching interactive interface. The resulting vocabulary display interface will then appear as shown. Figure 3E As shown in J5.

[0089] Alternatively, after receiving a trigger operation on the first hidden control to hide the teaching words in the flashcard and obtain the vocabulary teaching interactive interface, the method further includes: receiving a hidden restoration operation on the teaching words in the first position and restoring the display of the teaching words in the first position, where the first position is the original position where the teaching words are located.

[0090] The "hide and restore" operation refers to a preset operation used to restore the visibility of hidden content. The hide and restore operation for the teaching vocabulary in the first position includes, but is not limited to, clicking on the first position, swiping to highlight the first position, or clicking on the corresponding flashcard. Restoring the display of the teaching vocabulary in the first position means making the previously hidden teaching vocabulary in that position visible again.

[0091] For example, refer to Figure 3F When the user clicks on position z1 in J4, a hidden / restore operation is received for the teaching vocabulary at position z1, restoring the display of the teaching vocabulary at the first position, such as... Figure 3F As shown in J6.

[0092] In one embodiment, at least one vocabulary interactive control in the vocabulary display interface includes a hidden control; the above-mentioned receiving a trigger operation on the vocabulary interactive control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on a second hidden control, hiding the teaching auxiliary text in the flashcards in the vocabulary display interface, and obtaining the vocabulary teaching interactive interface, wherein the second hidden control is a hidden control used to hide the teaching auxiliary text.

[0093] For example, refer to Figure 3G, when the user clicks the "Hide Pinyin" button in J2 to make the "Hide Pinyin" button in a selected state, that is, a trigger operation on the second hidden control is received, the teaching auxiliary text in the literacy flashcard is hidden, and the vocabulary teaching interactive interface can be as Figure 3G shown by J7 in

[0094] Optionally, after receiving the trigger operation on the second hidden control, hiding the teaching auxiliary text in the literacy flashcard in the vocabulary display interface, and obtaining the vocabulary teaching interactive interface, the method further includes: receiving a cancel operation on the second hidden control, restoring and displaying the teaching auxiliary text in the literacy flashcard in the vocabulary teaching interactive interface, to obtain the vocabulary teaching interactive interface.

[0095] For example, reference may be made to Figure 3H , when the user clicks the "Hide Pinyin" button in J7 again to make the "Hide Pinyin" button in an unselected state, that is, a cancel operation on the second hidden control is received, the teaching auxiliary text in the literacy flashcard in the vocabulary teaching interactive interface is restored and displayed, and the vocabulary display interface can be as Figure 3H shown by J8 in

[0096] Alternatively, after receiving the trigger operation on the second hidden control, hiding the teaching auxiliary text in the literacy flashcard in the vocabulary display interface, and obtaining the vocabulary teaching interactive interface, the method further includes: receiving a hiding restoration operation on the teaching auxiliary text at the second position, restoring and displaying the teaching auxiliary text at the second position, where the second position is the original position where the teaching auxiliary text is located.

[0097] The hiding restoration operation on the teaching auxiliary text at the second position includes but is not limited to an operation of clicking the second position, an operation of double-clicking the literacy flashcard corresponding to the second position, and the like; restoring and displaying the teaching auxiliary text at the second position refers to re-displaying the teaching auxiliary text that has been hidden at the second position.

[0098] For example, reference may be made to Figure 3I , when the user double-clicks the literacy flashcard "Xi" corresponding to the position z2 in J7, that is, a hiding restoration operation on the teaching auxiliary text at the position z2 is received, and the teaching auxiliary text at the second position is restored and displayed as shown in Figure 3I J9 in

[0099] It should be noted that the number of hidden controls in the vocabulary display interface is not limited to one group. For example, each literacy flashcard in the vocabulary display interface corresponds to one group of hidden controls, and each group of hidden controls includes the first hidden control and the second hidden control described above. When the user clicks the first hidden control or the second hidden control corresponding to the literacy flashcard, the teaching vocabulary or the teaching auxiliary text in the corresponding literacy flashcard is hidden or restored and displayed. This application does not impose a limitation on this.

[0100] The vocabulary interactive control includes a hidden control. When a trigger operation is received on the hidden control used to hide teaching vocabulary or teaching aids text, the teaching vocabulary or teaching aids text is hidden, and a vocabulary teaching interactive interface is obtained. When a cancel operation is received on the hidden control used to hide teaching vocabulary or teaching aids text, the teaching vocabulary or teaching aids text is restored to show, making it convenient for teachers to practice vocabulary. When a hide-to-restore operation is received on the hidden teaching vocabulary or teaching aids text, the teaching vocabulary or teaching aids text at the corresponding position is restored to show, making it convenient for teachers to display them one by one for vocabulary practice.

[0101] In one embodiment, each flashcard in the vocabulary display interface has a corresponding explanation control; receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on the explanation control corresponding to the first flashcard, displaying the vocabulary explanation content corresponding to the first flashcard, and thus obtaining the vocabulary teaching interactive interface. The first flashcard is any one of at least one flashcard.

[0102] Vocabulary explanation content refers to all the content required to explain the vocabulary taught in the flashcards. This content includes at least one of the following: pronunciation, definition, related words, usage, and composition. Definitions provide explanations of the vocabulary. Related words include similar-looking words, homophones, and antonyms. Usage includes word formation, collocations, and example sentences. Composition includes the number of strokes, radicals, and writing steps. The content may also include parts of speech and writing animations. This application does not limit the specific type of vocabulary explanation content.

[0103] After receiving at least one teaching vocabulary word from the cloud processing device, the local display device can retrieve the vocabulary explanation content for each of the at least one teaching vocabulary word from the vocabulary explanation content database, thus obtaining the vocabulary explanation content for each vocabulary word in the vocabulary display interface. The vocabulary explanation content database stores the vocabulary explanation content for different teaching vocabulary words. The vocabulary explanation content database is divided into a local explanation content database and a cloud explanation content database. The local display device first retrieves the vocabulary explanation content for each of the at least one teaching vocabulary word from the local explanation content database; for teaching vocabulary words not found in the local explanation content database, the local display device retrieves the vocabulary explanation content from the cloud explanation content database. If the teaching vocabulary word is a Chinese character, the explanation content includes, but is not limited to, the text, strokes, radicals, similar-looking characters, pinyin list, homophones corresponding to the pinyin, word combinations corresponding to the pinyin, and sentence examples corresponding to the pinyin. If the teaching vocabulary word is an English word, the explanation content includes, but is not limited to, the phonetic symbols, pronunciation files, definitions, fixed collocations, example sentences, and synonyms of the English word.

[0104] When a trigger operation is received on the explanation control of the first character card, the local display device determines the first sequential index of the first character card in the vocabulary display interface, retrieves the vocabulary explanation content of the teaching vocabulary corresponding to the first sequential index, and displays it as the vocabulary explanation content corresponding to the first character card to display the vocabulary teaching interactive interface. The sequential index is used to indicate the order of the character cards and teaching vocabulary in the vocabulary display interface; different character cards have different sequential indices in the vocabulary display interface.

[0105] For example, refer to Figure 3J When the user clicks the explanation control corresponding to the literacy card s1 in J2, the system receives a trigger operation on the explanation control corresponding to literacy card s1, displays the vocabulary explanation content corresponding to the first literacy card, and obtains the vocabulary teaching interactive interface as follows: Figure 3J As shown in J10.

[0106] It should be noted that the number of explanation controls in the vocabulary display interface can also be one. In other possible designs, users can first select a flashcard in the vocabulary display interface, and then click the explanation control in the vocabulary display interface to enter an interactive vocabulary teaching interface that displays the vocabulary explanation content corresponding to the flashcard. This application does not impose any restrictions on this.

[0107] The vocabulary interactive control includes an explanation control. Each flashcard has a corresponding explanation control. When a trigger operation is received on the explanation control of a flashcard, the corresponding vocabulary explanation content is displayed. The vocabulary explanation content includes pronunciation, definition, related words, vocabulary usage, and vocabulary composition. It automatically obtains vocabulary-related teaching resources, and vocabulary explanation teaching can be carried out by triggering the explanation control. Teachers do not need to search for resources in advance, which is convenient and fast.

[0108] In some possible cases, the vocabulary teaching interactive interface includes a flashcard switching control. After receiving a trigger operation on the explanation control corresponding to the first flashcard and displaying the vocabulary explanation content corresponding to the first flashcard to obtain the vocabulary teaching interactive interface, it also includes: receiving a trigger operation on the flashcard switching control and switching to display the vocabulary explanation content corresponding to the second flashcard in the vocabulary teaching interactive interface. The second flashcard is at least one flashcard in the vocabulary display interface that is adjacent to the first flashcard in sequence.

[0109] When a trigger operation is received on the flashcard switching control, the local display device determines the second sequence index based on the first sequence index, and retrieves the vocabulary explanation content corresponding to the second sequence index as the vocabulary explanation content for the second flashcard. The second sequence index is either the previous or next sequence index of the first sequence index. When the triggered flashcard switching control is used to switch to the next vocabulary word, the second sequence index is the next sequence index of the first sequence index; when the triggered flashcard switching control is used to switch to the previous vocabulary word, the second sequence index is the next sequence index of the first sequence index.

[0110] For example, refer to Figure 3K When the user clicks the flashcard switching control c1 in J10, a trigger operation is received on the flashcard switching control c1, and the vocabulary teaching interactive interface switches to displaying the vocabulary explanation content corresponding to the second flashcard, such as... Figure 3K As shown in J11.

[0111] The vocabulary teaching interactive interface includes a flashcard switching control. When a trigger operation is received on the flashcard switching control, the corresponding vocabulary explanation content of the flashcard is switched and displayed, making it convenient for teachers to directly switch the vocabulary to be taught.

[0112] In some possible scenarios, different types of vocabulary explanation content are displayed in pages on the vocabulary teaching interactive interface. The vocabulary teaching interactive interface includes multiple content menu controls, and different content menu controls are used to trigger the display of different types of vocabulary explanation content. After receiving a trigger operation on the explanation control corresponding to the first character card, displaying the vocabulary explanation content corresponding to the first character card, and obtaining the vocabulary teaching interactive interface, it also includes: receiving a selection operation on the first content menu control, and switching the display of the vocabulary explanation content corresponding to the first character card and the first content menu control in the vocabulary teaching interactive interface. The first content menu control is any content menu control other than the second content menu control among the multiple content menu controls, and the second content menu control is the content menu control that is selected among the multiple content menu controls in the vocabulary teaching interactive interface.

[0113] When a selection operation is received for the first content menu control, the local display device retrieves the vocabulary explanation content of the type corresponding to the first content menu control from the vocabulary explanation content corresponding to the first literacy card, and displays it as the vocabulary explanation content corresponding to the first literacy card and the first content menu control.

[0114] For example, refer to Figure 3L When the user clicks the content menu control c2 in J10, a trigger operation is received on the content menu control c2. Content menu control c2 is the first content menu control. In the vocabulary teaching interactive interface, the vocabulary explanation content corresponding to the first flashcard and the first content menu control is displayed, such as... Figure 3L As shown in J12. See also J12. Figure 3M When the user clicks the content menu control c3 in J12, a trigger operation is received on the content menu control c3. Content menu control c3 is the first content menu control. In the vocabulary teaching interactive interface, the vocabulary explanation content corresponding to the first flashcard and the first content menu control is displayed, such as... Figure 3L As shown in J13.

[0115] Different types of vocabulary explanations are displayed in pages on the vocabulary teaching interactive interface. When a selection operation is received from the content menu control, the vocabulary explanation content is switched to facilitate teachers' explanation of new words.

[0116] The vocabulary teaching interactive interface includes multiple content menu controls. Different content menu controls are used to trigger the display of different types of vocabulary explanation content. In the process of displaying the vocabulary explanation content corresponding to the first character card and obtaining the vocabulary teaching interactive interface, the content menu controls in the vocabulary teaching interactive interface can be displayed according to the following steps A1-A3:

[0117] A1. Retrieve the vocabulary explanation content corresponding to the first character flashcard from the vocabulary explanation content database.

[0118] The principle behind acquiring the vocabulary explanations corresponding to the first flashcard can be found in the previous introduction, and will not be repeated here.

[0119] A2. If the vocabulary explanation content corresponding to the third content menu control exists in the vocabulary explanation content corresponding to the first character card, the third content menu control will be displayed in the vocabulary teaching interactive interface.

[0120] The third content menu control is any type of content menu control.

[0121] For example, the third content menu control is a control that triggers the display of the definitions of the taught vocabulary. If the vocabulary explanation content corresponding to the first character card contains the definition of the taught vocabulary in the first character card, then the third content menu control will be displayed in the vocabulary teaching interactive interface, such as displaying... Figure 3K-3M The "Explanation" button is shown.

[0122] A3. If the vocabulary explanation content corresponding to the third content menu control does not exist in the vocabulary explanation content corresponding to the first literacy card, the third content menu control will not be displayed.

[0123] For example, the third content menu control is a control that triggers the display of the definitions of the taught vocabulary. If the definition of the vocabulary in the first vocabulary card is not found in the vocabulary explanation content, the third content menu control will not be displayed in the vocabulary teaching interactive interface. Figure 3K-3M The "Explanation" button is shown.

[0124] The system determines whether to display the corresponding type of content menu control based on the obtained vocabulary explanations, thus enabling flexible display of the content menu control.

[0125] In one embodiment, at least one vocabulary interactive control in the vocabulary display interface includes an audio playback control; the above-mentioned receiving a trigger operation on the vocabulary interactive control and displaying the vocabulary teaching interactive interface includes: receiving a trigger operation on the audio playback control and displaying a playback settings interface, the playback settings interface being used to set audio playback parameters, the audio playback settings interface including a playback start control; receiving a trigger operation on the playback start control, displaying the audio playback interface, and playing the teaching audio corresponding to at least one teaching vocabulary in the vocabulary display interface according to the audio playback parameters set in the playback settings interface.

[0126] The audio playback parameters include, but are not limited to, audio timbre, audio volume, number of times the taught vocabulary is repeated, and the pause interval between two adjacent taught vocabulary words. Users can set different audio playback parameters in the playback settings interface. The audio playback interface includes the current audio display text adapted to the function of the audio playback control. The current audio display text is either the current flashcard or the current teaching aid text corresponding to the currently played taught vocabulary word. In some specific designs, when the audio playback control is used to implement dictation, the current audio display text is the current teaching aid text corresponding to the currently taught vocabulary word; when the audio playback control is used to implement guided reading, the current audio display text is the current flashcard corresponding to the currently taught vocabulary word. This application does not impose any restrictions on this.

[0127] After receiving at least one teaching vocabulary word from the cloud processing device, the local display device can retrieve the audio file of each teaching vocabulary word from the local pronunciation file database or the cloud pronunciation file database, thus obtaining at least one audio file. Following the audio playback parameters, it sequentially plays each audio file from the at least one audio file, thereby playing the teaching audio corresponding to at least one teaching vocabulary word in the vocabulary display interface. By sequentially playing the audio files of each teaching vocabulary word according to the audio playback parameters, dictation or guided reading practice can be achieved.

[0128] For example, refer to Figure 3N When the user clicks the dictation button in J2, the audio playback control is triggered, and the playback settings interface is displayed as shown. Figure 3N As shown in J14; when the user clicks the "Start Dictation" button in J14, a trigger operation is received on the playback start control, and the audio playback interface is displayed as shown. Figure 3N As shown in J15.

[0129] The vocabulary interactive control includes an audio playback control. When a trigger operation is received on the audio playback control, a playback settings interface is displayed. The playback settings interface contains a playback start control. Then, when a trigger operation is received on the playback start control, the audio playback interface is displayed, and the teaching audio corresponding to the teaching vocabulary is played according to the audio playback parameters set in the playback settings interface. This helps teachers to directly conduct dictation or reading practice. The playback settings interface is displayed first to set the audio playback parameters, which allows teachers to set more reasonable audio playback parameters according to the actual scenario.

[0130] The method of this application has been described above; the apparatus of this application will be described below.

[0131] See Figure 4 , Figure 4This is a schematic diagram of the structure of an image-based vocabulary teaching interactive device provided in an embodiment of this application, such as... Figure 4 As shown, the image-based vocabulary teaching interactive device 30 includes:

[0132] Image acquisition module 301 is used to acquire the target image to be identified;

[0133] Display module 302 is used to display a vocabulary content block and a vocabulary teaching control when the target image contains teaching vocabulary. The vocabulary content block includes the content area where the teaching vocabulary in the target image is located.

[0134] The display module 302 is also used to receive a trigger operation on the vocabulary teaching control and display a vocabulary display interface. The vocabulary display interface includes at least one character card and at least one vocabulary interaction control. Each character card includes a teaching word. The at least one character card is a character card corresponding to at least one teaching word. The at least one teaching word is obtained by extracting the teaching words from the vocabulary content block. The vocabulary interaction control is used to trigger the execution of a vocabulary interaction task.

[0135] The display module 302 is also used to receive a trigger operation on the vocabulary interaction control and display a vocabulary teaching interaction interface. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction task corresponding to the vocabulary interaction control.

[0136] It should be noted that the aforementioned image-based vocabulary teaching interactive device 30 can execute the image-based vocabulary teaching interactive method provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects of the method. Technical details not described in detail in the embodiments can be found in the image-based vocabulary teaching interactive method provided in the embodiments of this application.

[0137] See Figure 5 , Figure 5 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application. The interactive device 40 includes a processor 401, a memory 402, and a touch-sensitive display screen 403. The memory 402 and the touch-sensitive display screen 403 are connected to the processor 401, for example, via a bus.

[0138] Processor 401 is configured to support the interactive device 40 in performing the corresponding functions in the methods described in the above method embodiments. Processor 401 may be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof. The aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The aforementioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0139] The touch-sensitive display screen 403 is used to display the interface and receive user operations.

[0140] Memory 402 is used to store program code, etc. Memory 402 may include volatile memory (VM), such as random access memory (RAM); memory 402 may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); memory 402 may also include combinations of the above types of memory.

[0141] The memory 402 is used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the image-based vocabulary teaching interaction method in the embodiments of this application. The processor executes various functional applications and data processing of the image-based vocabulary teaching interaction method by running the non-volatile software programs, instructions, and modules stored in the memory, thereby realizing the functions of the image-based vocabulary teaching interaction method provided in the above method embodiments.

[0142] The memory 402 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function. The data storage area may store data created based on the use of the picture-based vocabulary teaching interactive device. In some embodiments, the memory may include memory remotely located relative to the processor, which can be connected to the picture-based vocabulary teaching interactive device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0143] The one or more modules are stored in the memory. When executed by the one or more processors, they perform the image-based vocabulary teaching interaction method in any of the above method embodiments. For example, they perform the method steps described in the above method embodiments to realize the functions of the modules described in the above device embodiments.

[0144] This application also provides a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the method described in the foregoing embodiments.

[0145] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0146] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A picture-based interactive vocabulary teaching method, characterized in that, include: Obtain the target image to be identified; If the target image contains teaching vocabulary, a vocabulary content block and vocabulary teaching controls are displayed, wherein the vocabulary content block includes the content area where the teaching vocabulary in the target image is located; The system receives a trigger operation on the vocabulary teaching control and displays a vocabulary display interface. The vocabulary display interface includes at least one character card and at least one vocabulary interaction control. Each character card includes a teaching vocabulary. The at least one character card is a character card corresponding to at least one teaching vocabulary. The at least one teaching vocabulary is obtained by extracting teaching vocabulary from the vocabulary content block. The vocabulary interaction control is used to trigger the execution of a vocabulary interaction task. The system receives a trigger operation on the vocabulary interaction control and displays a vocabulary teaching interaction interface. The vocabulary teaching interaction interface includes teaching interaction resources corresponding to the teaching vocabulary. The teaching interaction resources are obtained by executing the vocabulary interaction tasks corresponding to the vocabulary interaction control.

2. The method according to claim 1, characterized in that, The at least one vocabulary interaction control includes classroom activity controls; The step of receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: The system receives a trigger operation on the classroom activity control, displays classroom activity resources, and obtains the vocabulary teaching interactive interface, wherein the classroom activity resources are obtained by resource matching of the at least one teaching vocabulary.

3. The method according to claim 1, characterized in that, Each flashcard also includes supplementary teaching text corresponding to the taught vocabulary, which is used to assist in learning the taught vocabulary; the at least one vocabulary interactive control includes a hidden control; The step of receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: Upon receiving a trigger operation on the first hidden control, the teaching vocabulary in the literacy card is hidden, resulting in the vocabulary teaching interactive interface. The first hidden control is a hidden control used to hide the teaching vocabulary; or... The system receives a trigger operation on the second hidden control, hides the teaching aid text in the literacy card, and obtains the vocabulary teaching interactive interface. The second hidden control is a hidden control used to hide the teaching aid text.

4. The method according to claim 3, characterized in that, After receiving the trigger operation on the first hidden control, hiding the teaching vocabulary in the literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: Upon receiving a cancellation operation on the first hidden control, the teaching vocabulary in the literacy card is restored and displayed, thus obtaining the vocabulary display interface; or, After receiving the trigger operation on the second hidden control, hiding the teaching aid text in the literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: Upon receiving a cancellation operation on the second hidden control, the teaching aid text in the literacy card is restored to display, thus obtaining the vocabulary teaching interactive interface.

5. The method according to claim 3, characterized in that, After receiving the trigger operation on the first hidden control, hiding the teaching vocabulary in the literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: Receive the hidden / restore operation for the teaching vocabulary at the first position, and restore the display of the teaching vocabulary at the first position, where the first position is the original position where the teaching vocabulary is located; or, After receiving the trigger operation on the second hidden control, hiding the teaching aid text in the literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: The function receives a hidden / restore operation on the teaching aid text at the second position and restores the display of the teaching aid text at the second position, which is the original position where the teaching aid text was located.

6. The method according to claim 1, characterized in that, The at least one vocabulary interactive control includes an explanation control, and each flashcard has a corresponding explanation control; The step of receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: The system receives a trigger operation on the explanation control corresponding to the first character card, displays the vocabulary explanation content corresponding to the first character card, and obtains the vocabulary teaching interactive interface; the first character card is any one of the at least one character card, and the vocabulary explanation content includes at least one of the following: the pronunciation of the teaching vocabulary, the definition of the teaching vocabulary, the related vocabulary of the teaching vocabulary, the usage of the teaching vocabulary, and the vocabulary composition of the teaching vocabulary.

7. The method according to claim 6, characterized in that, The vocabulary teaching interactive interface includes a flashcard switching control; After receiving the trigger operation of the explanation control corresponding to the first literacy card, displaying the vocabulary explanation content corresponding to the first literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: The system receives a trigger operation on the flashcard switching control and switches the display of vocabulary explanation content corresponding to the second flashcard in the vocabulary teaching interactive interface. The second flashcard is the flashcard that is adjacent to the first flashcard in the order of the at least one flashcard.

8. The method according to claim 6, characterized in that, Different types of vocabulary explanations are displayed in a paginated manner on the vocabulary teaching interactive interface; the vocabulary teaching interactive interface includes multiple content menu controls, and different content menu controls are used to trigger the display of different types of vocabulary explanations. After receiving the trigger operation of the explanation control corresponding to the first literacy card, displaying the vocabulary explanation content corresponding to the first literacy card, and obtaining the vocabulary teaching interactive interface, the method further includes: The system receives a selection operation on the first content menu control and switches the display of the vocabulary explanation content corresponding to the first character card and the first content menu control in the vocabulary teaching interactive interface. The first content menu control is any content menu control other than the second content menu control among the plurality of content menu controls, and the second content menu control is the content menu control that is selected among the plurality of content menu controls.

9. The method according to claim 8, characterized in that, The process of displaying the vocabulary explanation content corresponding to the first character card to obtain the vocabulary teaching interactive interface includes: The vocabulary explanation content corresponding to the first literacy card is obtained from the vocabulary explanation content database. The vocabulary explanation content database is used to store the vocabulary explanation content of different teaching vocabulary. If there is vocabulary explanation content corresponding to the third content menu control in the vocabulary explanation content corresponding to the first literacy card, the third content menu control is displayed in the vocabulary teaching interactive interface. The third content menu control is any type of content menu control. If the vocabulary explanation content corresponding to the third content menu control is not present in the vocabulary explanation content corresponding to the first literacy card, the third content menu control will not be displayed.

10. The method according to claim 1, characterized in that, The flashcards also include supplementary teaching texts corresponding to the taught vocabulary, which are used to assist in learning the taught vocabulary; the at least one vocabulary interaction control includes an audio playback control. The step of receiving a trigger operation on the vocabulary interaction control and displaying the vocabulary teaching interaction interface includes: The system receives a trigger operation on the audio playback control and displays a playback settings interface. The playback settings interface is used to set audio playback parameters and includes a playback start control. The system receives a trigger operation on the playback start control, displays an audio playback interface, and plays the teaching audio corresponding to the at least one teaching vocabulary according to the audio playback parameters set in the playback settings interface. The audio playback interface includes current audio display text adapted to the function of the audio playback control. The current audio display text is the current flashcard corresponding to the currently played teaching vocabulary or the current teaching auxiliary text corresponding to the current teaching vocabulary.

11. The method according to claim 10, characterized in that, Playing the teaching audio corresponding to the at least one teaching vocabulary word according to the audio playback parameters set in the playback settings interface includes: Obtain the audio file for each of the at least one teaching vocabulary words to obtain at least one audio file; According to the audio playback parameters, each audio file in the at least one audio file is played sequentially.

12. The method according to any one of claims 1-11, characterized in that, The vocabulary content display block and vocabulary teaching controls include: Display the vocabulary content block; Receive a selection operation for the vocabulary content block; The vocabulary teaching control is displayed.

13. An interactive device, characterized in that, The device includes a memory, a touch-sensitive display, and a processor, wherein the memory and the touch-sensitive display are connected to the processor, the touch-sensitive display is used to display an interface and receive user operations, and the processor is used to execute one or more computer programs stored in the memory, wherein when the processor executes the one or more computer programs, it causes the interactive device to perform the method as described in any one of claims 1-12.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-12.

Images